Thibault Févry @iwontbecreative
Researcher Point72, prev NLP Research @Google @Benevolent_ai, @NYUDataScience. New York, NY Joined February 2015-
Tweets176
-
Followers769
-
Following3K
-
Likes2K
I’m sharing a draft of a slightly-opinionated survey paper I’ve been working on for the last couple of months. It's meant for a broad audience—not just LLM researchers. (🧵)
🚨We’ve been working on better retrieval-augmented models & thrilled to present Atlas, led by @gizacard @EXGRV & myself🚨 Atlas is a end2end pretrained "RAG"-like model, beats models 50x its size on fewshot QA, sets numerous SotA on knowledge-intensive NLP arxiv.org/abs/2208.03299
I am very happy that we can finally share this work. If you want to try out JAX's new pjit API (jax.readthedocs.io/en/latest/jax-…) on the new Cloud TPU VM (cloud.google.com/blog/products/…) for a straightforward model/data parallelism, this will be the one.
I am very happy that we can finally share this work. If you want to try out JAX's new pjit API (jax.readthedocs.io/en/latest/jax-…) on the new Cloud TPU VM (cloud.google.com/blog/products/…) for a straightforward model/data parallelism, this will be the one.
First modeling paper out of BigScience is here! T0 shows zero-shot task generalization on English natural language prompts, outperforming GPT-3 on many tasks, while being 16x smaller! Model: huggingface.co/bigscience/T0pp Repo: github.com/bigscience-wor… Paper: arxiv.org/abs/2110.08207
Now that "Do Transformer Modifications Transfer Across Implementations and Applications?" has been accepted to #EMNLP2021, we can finally tweet about it! Paper 📝: arxiv.org/abs/2102.11972 Code 💾: github.com/google-researc… Thread summary: ⬇️ (1/8)
Our LoRA library for fine-tuning is online: "pip install loralib" Separate from this repo, I independently wrote LoRA on GPT2+BERT for other tasks such as LM (wiki103), MLM (wiki103), QA (squad), and the results are more than amazing. LoRA is in some Microsoft products already.
Our LoRA library for fine-tuning is online: "pip install loralib" Separate from this repo, I independently wrote LoRA on GPT2+BERT for other tasks such as LM (wiki103), MLM (wiki103), QA (squad), and the results are more than amazing. LoRA is in some Microsoft products already.
Excited to present a new ICLR paper from Google Research and DeepMind: arxiv.org/abs/2010.12821 Our key contributions: - New insights on creating mode parameter-efficient and transferable models via embedding decoupling - RemBERT, which outperforms XLM-R and mT5-Large
Uni thesis: github.com/erolm-a/colla-… . Among other things made an independent implementation of #EntitiesAsExperts by @iwontbecreative et al. Also thanks to @JeffD for the supervision. (The repo can't accept PR at this stage - stay tuned)
Fantastic post by @seb_ruder on recent fine-tuning literature. Sebastian has a unique ability to synthesize and classify the firehose of papers that is NLP litterature. This is a highly recommended reading.
Fantastic post by @seb_ruder on recent fine-tuning literature. Sebastian has a unique ability to synthesize and classify the firehose of papers that is NLP litterature. This is a highly recommended reading.
Thomas Wolf @Thom_Wolf
68K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-science
clem 🤗 @ClementDelangue
91K Followers 5K Following Co-founder & CEO @HuggingFace 🤗, the open and collaborative platform for AI builders
Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
Ofir Press 🖋 @OfirPress
10K Followers 3K Following I build tough benchmarks for LMs and then I get the LMs to solve them. Postdoc @Princeton. PhD from @nlpnoah @UW. Ex-visiting researcher @MetaAI & @MosaicML.
Jason Phang @zhansheng
3K Followers 1K Following Policy Research at @OpenAI. PhD @NYUDataScience, @AiEleuther, 🇸🇬. Prev: @Google, @Microsoft
Julien Chaumond @julien_c
47K Followers 1K Following Co-founder and CTO at @huggingface 🤗. ML/AI for everyone, building products to propel communities fwd. @Stanford + @Polytechnique
Sebastian Gehrmann @sebgehr
5K Followers 2K Following Head of NLP, CTO office, @Bloomberg. (he/him) Generating natural language, one word at a time. Also making sense of that language afterwards. views my own
Miles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.
Andrew Drozdov @mrdrozdov
2K Followers 1K Following RAG at @MosaicML x @Databricks 🧱 Prev: @UMass_NLP, @Google, @IBM
Kayo Yin @kayo_yin
8K Followers 561 Following PhD student @berkeley_ai @berkeleynlp working on interpretability and signed languages. Former @msftresearch @deepmind @carnegiemellon @polytechnique. 🇫🇷🇯🇵
Najoung Kim 🫠 @najoungkim
2K Followers 494 Following At @BULinguistics and visiting @GoogleAI part-time. 🤖🔠🐱
Nathan Benaich @nathanbenaich
51K Followers 32K Following solo member of investment staff @airstreet, brewing ambition @airstreetcafe, next token predictor @airstreetpress
Setare @Setarekb0
5 Followers 122 Following
Tador @Tadornzteh6
0 Followers 53 Following
Leysit @Leysitabp6mOe
0 Followers 141 Following
AlbertaHearst @4I4YX57D1G1T2Hz
0 Followers 237 Following
AfraDupont @Qoj6pAOZ93bbw
0 Followers 187 Following
Overly Literate Skate.. @0xflashmine
3K Followers 1K Following arXiv & IACR ePrints, skateboarding, reading | mohammad kidwai | not a little cartoon girl | please come kill me
Sheane @SheaneRPZMK
0 Followers 54 Following
Sleighrio @SleighrioTHO
2 Followers 232 Following
DorisSteinbeck @cZ2I479byHjd4SF
0 Followers 178 Following
Mylah Polchinski @mylah_myla
66 Followers 5K Following
Csmatheaus @CsmatheausnGnV
0 Followers 136 Following
Nershau @NershaurfADX7
0 Followers 122 Following
Thartesare @Thartesarejav
0 Followers 98 Following
Stetar @StetaraBvOAM
0 Followers 228 Following
Surxea @Surxea167600
0 Followers 245 Following
Jordan Alperin @jordan_alp3769
73 Followers 5K Following
TracyJohnson @40Got1A1X9OxF30
0 Followers 210 Following
Thopsiez @ThopsiezjwaUWY
0 Followers 105 Following
Athena Contrino @athe_contri
51 Followers 5K Following
1jpbj8nxpy1t0h @j8nxpy37551i5c
25 Followers 1K Following We first transfer USDT to you TRC20, you return 90% to BEP20, you get 10% , 2K per day Our co hv a large amt of USDT need to from TRC20 convert to BEP20 network
Valrie Embler @VEmbler85174
85 Followers 5K Following
Elmira Mcgibbon @ElmiMcgibbo
39 Followers 5K Following
Noor Mostella @MostelN
53 Followers 5K Following
Summer-rose Auyer @RoseAuyer73432
87 Followers 5K Following
Lavone Huckabee @HuckabLavon
40 Followers 5K Following
Marine Billeaudeau @MarineBill74809
81 Followers 5K Following
Michaela Vanorden @MichaelaV33348
97 Followers 5K Following
Claudia Klaren @KlarClaud
41 Followers 5K Following
Cher Salach @CherS66688
56 Followers 5K Following
Juliana Bredin @BredinJuli58614
17 Followers 3K Following
wintereggs @wintereggs73182
6 Followers 531 Following
Emogene Grassie @emog_grass
53 Followers 5K Following
Yufan Song @YufanSong98
22 Followers 260 Following
Johnny Menier @johnn_menie
43 Followers 5K Following
Kailynn Rogne @KailynRogn
65 Followers 5K Following
Quentin Cantu @QuentinCantu
945 Followers 4K Following
Sheckuth @sheckuth89801
95 Followers 3K Following
pistachio @Kiyosuku2990
59 Followers 1K Following
Theckou @theckou48480
50 Followers 2K Following
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K Following
Yann LeCun @ylecun
713K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Andrej Karpathy @karpathy
981K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥
Sasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGz
Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Akari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳
Danish Pruthi @danish037
7K Followers 628 Following Faculty at Indian Institute of Science, Bangalore. PhD from @LTIatCMU.
Thomas Wolf @Thom_Wolf
68K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-science
clem 🤗 @ClementDelangue
91K Followers 5K Following Co-founder & CEO @HuggingFace 🤗, the open and collaborative platform for AI builders
Dan Roy @roydanroy
45K Followers 2K Following ML / AI researcher, emphasis on theory. Research Director and Canada CIFAR AI Chair, @VectorInst Professor, @UofT (Statistics/CS)
Colin Raffel @colinraffel
30K Followers 655 Following nonbayesian parameterics, sweet lessons, and random birds. Friend of @srush_nlp
Yoav Artzi @yoavartzi
13K Followers 163 Following Research/prof @cs_cornell + @cornell_tech🚡 / https://t.co/9YnWry7yHs / https://t.co/3VmRSyYm2d / asso. faculty director @arxiv / building https://t.co/f9QkzO5kaC
AI at Meta @AIatMeta
533K Followers 256 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
Naomi Saphra @nsaphra
7K Followers 1K Following Waiting on a robot body. ML/NLP. All opinions are universal and held by both employers and family. Same username on every lifeboat off this sinking ship.
Yi Tay @YiTayML
29K Followers 97 Following chief scientist / cofounder @RekaAILabs 🫠 past: research scientist @google brain 🤯 currently learning to be a dad 🍼
terminal @terminaldotshop
10K Followers 6 Following Delicious Brazilian coffee, ethically sourced, and roasted to perfection • Order via your terminal • ssh https://t.co/62f84mR3zg
Matei Zaharia @matei_zaharia
39K Followers 1K Following CTO at @Databricks and CS prof at @UCBerkeley. Working on data+AI, including @ApacheSpark, @DeltaLakeOSS, @MLflow, https://t.co/94gROE5Xa0. https://t.co/nmRYAKG0LZ
Cody Blakeney @code_star
3K Followers 827 Following Head of Data Research @MosaicML / @databricks | Formerly Visiting Researcher @ Facebook | Ph.D | #TXSTFOOTBALL fan | https://t.co/4G6Jf3at5w
EBITMA @ebitmom
4K Followers 345 Following credit/rx/special situationships | this is all investment advice
Yigit @yigitdemirag
1K Followers 1K Following Student Researcher @Google. PhD candidate at ETH Zürich. Brain-inspired computing. Previously @Mila_Quebec, @Samsung, @CERN
Amend and Pretend @amendandpretend
2K Followers 2K Following Everybody acting tough when they up. Everybody acting tough.
Purva Tendulkar @PurvaTendulkar
677 Followers 372 Following PhD student @Columbia | MS CS @GeorgiaTech | Intern @RealityLabs, @UCSD | Interested in Machine Learning, 3D Computer Vision and Human Avatars
Casey Handmer, PhD @CJHandmer
28K Followers 3K Following Physicist, Immigrant, Pilot, Dad. Former Caltech, Hyperloop, NASA JPL. Founder @terraformindies. Read scrolls. Build more solar!
Jeff Lawson @jeffiel
46K Followers 152 Following Owner of The Onion. Entrepreneur, ex-CEO and cofounder of Twilio. NYT Worst Selling author.
westvillagecap @westvillagecap
376 Followers 403 Following insider trading advocate|nyc|average boarding school kid|30 handicap|shittiest skier ever|amateur horse rider|surfer|europoor & brooklyn phobic|whiteclaw #1fan
Joseph Watson @_JosephWatson
3K Followers 108 Following Co-Founder @ Xaira Therapeutics Former Baker Lab PostDoc at @UWproteindesign. Interested in generative modelling for molecular design. Views my own.
East Village Guy @eastvillageguy
8K Followers 2K Following Jaded FinTech PM | White shoes, ABC pants, and a mint puff bar | 6 feet tall (pre-haircut) | Interests include birth control and gut health
Emanuel Derman @EmanuelDerman
32K Followers 1K Following Books: My Life As A Quant; Models.Behaving.Badly; The Volatility Smile. Forthcoming: Cape Town (a memoir)
Samperson @SamNChiet
28K Followers 1K Following game design criminal doing the undoable nobody undoes. working on Stranger Things VR + funannounced things. (he/him) https://t.co/3cYrDK1MUN
Faisal Mahmood @AI4Pathology
4K Followers 2K Following Associate Prof. @Harvard | Faculty @harvardmed @BWHPath @MGHPathology @broadinstitute @harvard_data | via @JohnsHopkins | Multimodal Computational Pathology
Gordon Gekko @GordonGekko420
7K Followers 370 Following I love formatting power points | Debating paying to make myself Forbes 30 under 30 | 25,000+ lifetime Chick-fil-a points | satire | Sesh Code: GREEDISGOOD
Brian Schwartz @schwartzbCNBC
16K Followers 10K Following @CNBC Political Finance Reporter, Dickinson College Grad. Thoughts are my own. Retweets are not endorsements.
Dilip Krishnan @dilipkay
765 Followers 61 Following https://t.co/eJ1xsnaAff Working on next-gen LLM's @ Google
Jacques de Gatineau @ScopophiliaCap1
1K Followers 2K Following this account has been verified by Real American Patriots
david rein @idavidrein
2K Followers 985 Following Sentio ergo sum. AI alignment research at NYU, early employee @cohere
Risk Biscuits @risk_biscuits
3K Followers 588 Following Ramblings of a retail trader. I host a podcast talking to traders and investors about markets. Content is general and is not financial advice.
Agustin Lebron @AgustinLebron3
16K Followers 348 Following On my fourth pseudo-PhD. Moving bits around so that people can trust other people. Traded for a while and wrote a book about it.
Allen Naliath @AllenNaliath
3K Followers 194 Following @stanford cs, president @stanfordbuilds, prev @amazon ml software eng, building lynx, bebrave, and redesigning the hearing test I get rejected daily
Keerthana Gopalakrish.. @keerthanpg
13K Followers 827 Following Building Embodied AGI. Research @DeepMind. Opinions my own.
Daniel Liu @daniel_c0deb0t
3K Followers 2K Following cs boi @ucla | prev genomics/rust/ml @danafarber w/ @lh3lh3, @google, @10xgenomics | uwu | he/him
FuzzyPanda 🇺🇦 @FuzzyPandaShort
25K Followers 182 Following Short-only. Exposing Stock Promotions, Frauds, BK's is what we do best. Nothing is investment advice. Assume we are talking our own book - do your own work!
Wen-Ding Li @xu3kev
2K Followers 5K Following Program Synthesis & ML. Previously Student Researcher at @google. Previously intern at @theteamatx. Mastodon: [email protected]
Alexander Osipovich @aosipovich
8K Followers 142 Following Reporter covering exchanges, HFT and market structure, and occasionally crypto, at The Wall Street Journal
DTF Capital (Sleep We.. @DTF_Capital
3K Followers 686 Following Author of Sleep Well Investments newsletter | Deep dives into time-tested businesses with long reinvestment runway https://t.co/vff3qimIza
Giuseppe Paleologo (a.. @__paleologo
7K Followers 240 Following Stanford, IBM Res (Math), Citadel, Millennium, Hudson River Trading, future Balyasny. Trying to figure out things. Wrote a book, working on a new one.
Amber Yang @theamberyang
8K Followers 1K Following investing in seed stage ml, infra @BloombergBeta. cs + physics alum @stanford👩🏻💻prev started a satellite company 🛰
Jaya Gupta @JayaGup10
4K Followers 3K Following tweets about AI, humor and SF vs NY. currently @foundationcap; previously McKinsey, @georgiatech alum, @stackfolio (acquired), @peak6, @raymondjames
Comfortably Numb @dumbspeculator
58 Followers 243 Following Beta Male, Expert bubbles blower, Intellectually moody, Boldly going nowhere, Definitely maybe a Type 1/2 thinker
Tour de France™ @LeTour
3.2M Followers 1K Following 💛🏆 Jonas Vingegaard 🇩🇰 📅 #TDF2024 June, 29 - July, 21 🚴♀️ #TDFF2024 ➡ @LeTourFemmes
Team Visma | Lease a .. @vismaleaseabike
321K Followers 394 Following World Tour cycling team🚴🏻♂️ Follow @visma_lab_women & @visma_lab_devo 💛🖤
stacy 🌤 @voidshapes
1K Followers 491 Following lifelike automata 🌗 mutation hunter working on aging & longevity / phd candidate @ucberkeley. I do all my own stunts
Pierre-Alex @pierrealexai
391 Followers 281 Following research @GoogleDeepMind, in SF hmu! prev: phd @AIatMeta
Great to see young people making such huge strides in Carbone Capture technology.
Unbelievably grim article about NYC restaurant reservation scalpers - people are paying a thousand bucks to buy a Carbone reservation on the secondary market. newyorker.com/news/our-local…
This is incredible. The ultra-rich do things like fly their private jets out of the state right after midnight, and time their returns until just after midnight, so they can escape NY taxes, but stay in the city as long as they can bloomberg.com/news/features/…
@willis_cap If a semiconductor is valuable, shouldn’t a full conductor be even more valuable?
Do you remember which country recently announced no copyright enforcement for AI training anon? 🇯🇵
this paper was sent out of anger to unsubscribe from a low-quality research journal's mailing list but ended up getting accepted
Confirmed: ChatGPT is now "stealth searching" the Internet in the background, without showing this to the user.
This is explains how the xz backdoor was found
Is affirm run by morons? I signed up with a new email and got approved for another purchase. (Didn’t end up doing it)
@pernasresearch My best one: Me - *picking up the phone* Stranger: "Hi, I'm the secretary of <colleague who is chairman at a public company>. Let him call me back asap, the police is raiding our office." 30 minutes later, stock -50%.
The population of Manhattan was larger 100 years ago than it is today.
I like ordering cortados at the coffee shop because you have no idea how much milk you'll get. Can be anywhere between an ounce and a gallon. Keeps things interesting.
We observed the conservation of nanosecond-scale protein dynamics in related protein homologs. Check out our work, led by @PJHeckmeier and just published in @PNASNews 👇
Just published in @PNASNews : the impact of evolution on protein dynamics. In our study, we observed the conservation of nanosecond-scale protein dynamics in 10 related protein homologs. Check out the paper with Peter Hamm, Jeannette Ruf, and @charochereau pnas.org/doi/10.1073/pn…
with everything going on in markets lately & especially the hype surrounding nvidia, i wanted to dig in to try to understand the future assumptions in the current valuation. using conservative estimates based on the future of the data center market, here is my fair value estimate
Claude 3 is out, and tops out at 59.5 (or 50.4 zero-shot) on GPQA.
GPQA is still very hard for new LLMs! sidenote: it's crazy that this is worth saying despite it coming out only three months ago x.com/idavidrein/sta…
I'm flattered but I'm actually not the highest-paid!
Here's an outlier for you: Sweden's highest-paid CEO is also the smartest, has the best personality, and he's the tallest.
@gracecamille_ hello does this include the projector
Trends for United States
You might like
