Ves Stoyanov @vesko_st
Head of AI at @magicaltome. Ex-Language Researcher at @FacebookAI. Large LMs and multilingual NLP. @JHUCLSP and @Cornell alumn. https://t.co/WTSCasqDI6 Menlo Park, CA Joined May 2009-
Tweets134
-
Followers2K
-
Following550
-
Likes770
Is OpenAI string matching and filtering its outputs? Are the world's most powerful Natural Language Processing models are still gated by good old-fashioned string matching to filter copyrighted content from its output? #OpenAI linkedin.com/posts/ves-sto_…
I love perplexity.ai -- the best search engine out there! Big time rooting for @denisyarats and @perplexity_ai. Give it a try if you haven't yet.
I love perplexity.ai -- the best search engine out there! Big time rooting for @denisyarats and @perplexity_ai. Give it a try if you haven't yet.
I recently joined @mbzuai as an Adjunct Professor in the NLP department. I am enjoying working with the amazing people there. The department is hiring -- would love to have more amazing colleagues, please apply!
I recently joined @mbzuai as an Adjunct Professor in the NLP department. I am enjoying working with the amazing people there. The department is hiring -- would love to have more amazing colleagues, please apply!
It's been an exciting 2023! Looking forward to an even more productive 2024.
It's been an exciting 2023! Looking forward to an even more productive 2024.
It is great to see @magicaltome on LinkedIn's Top 50 startup list! I am really excited at the opportunity to build a great product that helps people be more creative and expressive! linkedin.com/pulse/linkedin…
Playing with our most advanced AI feature @magicaltome: page generation. It uses few-shot learning to produce different ways to express my idea, the hierarchy of the content, and the design layout. I continue to be in awe of how easily my ideas can come to life on a page!
What a milestone for @magicaltome! 10 million creators!!! At Meta 10 million didn't seem like a huge number, but I have come to appreciate the dedication to customers and building something useful to get this far.
What a milestone for @magicaltome! 10 million creators!!! At Meta 10 million didn't seem like a huge number, but I have come to appreciate the dedication to customers and building something useful to get this far.
Thanks to all the former colleagues and close collaborators that made Llama 2 a reality. The startup community really appreciates the model being available for free even for commercial use. Very excited to try it at @magicaltome!
Thanks to all the former colleagues and close collaborators that made Llama 2 a reality. The startup community really appreciates the model being available for free even for commercial use. Very excited to try it at @magicaltome!
Unfortunately, I can't be in Toronto for ACL this year. But our work on bgGLUE will be there. Please go meet @mhardalov and the rest of our co-author and hear about this interesting new resource for NLP in Bulgarian!
Unfortunately, I can't be in Toronto for ACL this year. But our work on bgGLUE will be there. Please go meet @mhardalov and the rest of our co-author and hear about this interesting new resource for NLP in Bulgarian!
I’m super excited to join Tome to help build product-grade AI to power storytelling. tome.app/tome/why-i-joi…
I’m super excited to join Tome to help build product-grade AI to power storytelling. tome.app/tome/why-i-joi…
We’re thrilled to welcome ⋆⁺₊⋆ Ves Stoyanov ⋆⁺₊⋆ to Tome as our head of AI. @vesko_st spent nearly a decade as an AI leader at Meta, where he used LLMs to make online experiences safer. Ves took our questions on why he joined, his favorite podcasts, and more 🎙:
Apparently, GPT-4 turned @GaryMarcus from a "skeptic" into an alarmist. From "not impressed by large language models’ shallow, unreliable, confabulating intelligence" to "AI systems with human-competitive intelligence" in just a few months.
Apparently, GPT-4 turned @GaryMarcus from a "skeptic" into an alarmist. From "not impressed by large language models’ shallow, unreliable, confabulating intelligence" to "AI systems with human-competitive intelligence" in just a few months.
Really disappointed in @OpenAI's complete lack of transparency around the GPT-4 release. OpenAI seems to be getting more secretive with each release despite hugely benefiting from other labs openness.
Exciting work shows that LLMs can do even better, given access to the execution results of a program in addition to the NL input and the program itself. Work by @AnsongNi during his Meta internship mentored by @VictoriaLinML. Happy to have played a small role supporting him.
Exciting work shows that LLMs can do even better, given access to the execution results of a program in addition to the NL input and the program itself. Work by @AnsongNi during his Meta internship mentored by @VictoriaLinML. Happy to have played a small role supporting him.
Incorporating more tools into large pretrained models and allowing them to be a decision engine will open many more possibilities for AI. Very cool work by @timo_schick, @JaneDwivedi, @robdessi, @robertarail, @MariaLomeli_, @LukeZettlemoyer, @nicola_cancedda, @ThomasScialom!
Incorporating more tools into large pretrained models and allowing them to be a decision engine will open many more possibilities for AI. Very cool work by @timo_schick, @JaneDwivedi, @robdessi, @robertarail, @MariaLomeli_, @LukeZettlemoyer, @nicola_cancedda, @ThomasScialom!
We worked on understanding instruction fine-tuning and how it generalizes to new problems. Check out the OPT-IML paper and the associated models trained on top of the OPT 30B and 175B parameter models.
We worked on understanding instruction fine-tuning and how it generalizes to new problems. Check out the OPT-IML paper and the associated models trained on top of the OPT 30B and 175B parameter models.
My outstanding intern, Mengzhou, worked very hard on studying the learning trajectories of large LMs. A few very interesting findings from the work.
My outstanding intern, Mengzhou, worked very hard on studying the learning trajectories of large LMs. A few very interesting findings from the work.
We should prompt LMs by selecting 🚨diverse🚨 in-context examples to solve our target task, because diverse examples may have complementary explanations‼️ 📄Check out our new preprint arxiv.org/pdf/2211.13892… where we look into how explanations work in-context.
Tomorrow, I will be presenting our paper ToKen as an Oral Presentation at @emnlpmeeting #EMNLP2022 | 10:15 AM in Hall B (Unsupervised and Weakly Supervised Methods) This work was part of my residency at @metaai Joint work w/ @faisalladhak, @MonaDiab77 and👇🧵 1/7
Proud of our team for making it possible to run very large (and accurate) models on every post by amortizing inference over different classifiers. The original paper that showed that text classifiers can share the same RoBERTa trunk with different heads: arxiv.org/pdf/2004.14287…
Proud of our team for making it possible to run very large (and accurate) models on every post by amortizing inference over different classifiers. The original paper that showed that text classifiers can share the same RoBERTa trunk with different heads: arxiv.org/pdf/2004.14287…
Yann LeCun @ylecun
711K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.AI at Meta @AIatMeta
531K Followers 255 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.Akari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Ofir Press @OfirPress
10K Followers 3K Following I build tough benchmarks for LMs and then I get the LMs to solve them. Postdoc @Princeton. PhD from @nlpnoah @UW. Ex-visiting researcher @MetaAI & @MosaicML.Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.Mike Lewis @ml_perception
6K Followers 227 Following Llama3 pre-training lead. Partially to blame for things like the Cicero Diplomacy bot, BART, RoBERTa, kNN-LM, top-k sampling & Deal Or No Deal.Graham Neubig @gneubig
31K Followers 586 Following Associate professor at CMU, studying natural language processing and machine learning.William Wang @WilliamWangNLP
14K Followers 717 Following UCSB NLP Lab + ML Center. https://t.co/6TOnqbk6YT https://t.co/KJYhnav3Et Mellichamp Chair Prof. at UCSB CS. PhD @ CMU SCS. Areas: #NLProc, Machine Learning, AI.Jacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJwSebastian Riedel (@ri.. @riedelcastro
15K Followers 470 Following Researcher in NLP/ML @deepmind, @ucl_nlp, @[email protected] on MastodonNathan Schneider @complingy
4K Followers 1K Following Computational Linguist and Professional Nerd at Georgetown University he/him pronouns, ALL the prepositions @[email protected] @complingy.bsky.socialAlexis Conneau @alex_conneau
24K Followers 113 Following Audio AGI Research Lead @OpenAI - GPT-Next - Past: XLM, Unsupervised ASR, Unsupervised MT, Wav2vec 2.0/XLSR, MUSE, Unsupervised cross-lingual transferSebastian Ruder @seb_ruder
80K Followers 1K Following Multilingual LLMs @cohere • Prev: @GoogleDeepMind • Newsletter: https://t.co/7JGh2qpG98Felix Hill @FelixHill84
9K Followers 777 Following Research Scientist, Deepmind I try to think hard about everything I tweet, esp on 90s football and 80s music None of my opinions are really someone else'sRoysa @Roysa639688
0 Followers 84 Followingpengch fan @FanPengch
216 Followers 6K FollowingKyla Kelly @_Kyla_Kelly_
28 Followers 175 Following AI Enthusiast - Opinions and statements are my own.Aaditya ; @Aaditya26082004
524 Followers 7K Following CS'26 • Machine Learning • Open-Source • Web Dev. • Algorithms • Jai Shree Krishna 🦚🪈tangbinh @tangbinh2
38 Followers 119 FollowingEva Louise Marie Gabr.. @e681554349
9 Followers 3K FollowingHadoop @Hadoop02277010
563 Followers 4K FollowingEngineer @Enginee21030126
27 Followers 208 FollowingFeigaobox @feigaobox
145 Followers 1K FollowingDaria Soboleva @dmsobol
84 Followers 210 Following AI & ML leader at @CerebrasSystems. Previously at @Google, @Yandex, and @Cisco.Zach0 @Zach0__
293 Followers 4K Following statsparrot. bayescraft. torch. audio transformers. uplift. causal inference. conformal prediction. xgboost.Nenchev @Ivan_Nenchev
50 Followers 345 Following Digital Clinician Scientist working on linguistic markers of schizophreniaAniket Pallav @aniketpallav
1K Followers 3K Following 'Tech for good' believer, PgM In free time:aviation enthusiast, start-ups, personal finance, climate change, foodie work @Google | ex-@deloitte | MBA, EnggData Science Research.. @ArionDas
360 Followers 2K Following Deep Learning || Research Work on ML, DL || Large Language Models || GANs || RAG || Competitive Programming || Generative AI || Optimization Algorithms || IIITRBrian Zhan @brianzhan1
1K Followers 5K Following Early stage investor @CRV. Prev PM of @Facebook Presto, which spun into @trinodb / @starburstdata.Omar El Bachyr @omarelbachyr
23 Followers 376 Following PhD Student @SnT_uni_lu, NLP for Finance, Generative NLP, Explainable AI Moroccan 🇲🇦 Luxembourger 🇱🇺JESSICA CANETH @Jessica_caneth
48 Followers 720 Following Football cruise Manchester united full fans and koobie mannio fanLaughingLorelei @LaughingLo1751
20 Followers 2K FollowingWilliam Sun @williamsun2020
126 Followers 1K FollowingRyan Finley @rnfinley
122 Followers 2K FollowingMohammad Raihan Uddin @RaihanAkash0
251 Followers 4K Following Researcher- ML, AI, Federated Learning.MMCapital @joinpantom
89 Followers 988 Followingl u i s @clague17
702 Followers 1K Following growth eng @magicaltome i like coffee and riding bikes with friends | @contrary | @RiceUniversityDon't Let Your… | A.. @cheers2wisdom
888 Followers 5K Following Forever critical of promises not kept - brands or relationships. Fascinated by Product Management since 2012. Sold clothes before that. Here to criticise all.Fred Grier @fredmgrier
2K Followers 3K Following Business + San Diego | Reporting on fast-growing companies & VC firms | Formerly technology reporter @sdbusiness | Alum @ucsandiego and MBA @uofsandiego 🌴Rishi Swami @rishi_swami
170 Followers 2K Following Data, AI/ML | Learning iteration # 1.1e4| Helping orgs extract value from dataMB @mbitem
209 Followers 1K FollowingTameez Sunderji @tsunderji
614 Followers 5K Following Nothing in life is to be feared, it is only to be understood.Pallav Nadhani @pallavn
9K Followers 3K Following Accidental entrepreneur. Built & scaled multiple bootstrapped ventures in BI & DevTools space | 2x exits @FusionCharts / Muze | Investor in 100+ startups.Benjamin Schieken @JSCHIEK
646 Followers 5K Following @gofincast is a free tool that makes sure borrowers get the best deal. We check your Loan Estimate, find savings, and protect your privacy 💸🤑#RavensFlock ✡️James Perkins @jamesrperkins
514 Followers 3K Following Product Dir of Point-of-Sale Solutions @ Chase, tech junkie, family man, & practical environmentalist. Founder Tek Perks, Co-Founder CityRyde. All views my own.Andrew Wiggin @Its_Andrew_W
137 Followers 491 FollowingNakul @nakulsan
526 Followers 2K Following @BigSurAI. Previously: @mmhmmapp, @MetaForWork, @parseit, @googleChetan Verma @chtnverma
377 Followers 1K Following guy who forwards reddit jokes. also ml engineer. @iitmadras @ucsd alumjl @jlroqueni
152 Followers 503 FollowingStuart Green @stuartbgreen
98 Followers 836 FollowingYann LeCun @ylecun
711K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingAI at Meta @AIatMeta
531K Followers 255 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistAkari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳Yoav Artzi @yoavartzi
13K Followers 163 Following Research/prof @cs_cornell + @cornell_tech🚡 / https://t.co/9YnWry7yHs / https://t.co/3VmRSyYm2d / asso. faculty director @arxiv / building https://t.co/f9QkzO5kaCSasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzDelip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Tim Dettmers @Tim_Dettmers
29K Followers 820 Following PhD Student at @UW. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.Ofir Press @OfirPress
10K Followers 3K Following I build tough benchmarks for LMs and then I get the LMs to solve them. Postdoc @Princeton. PhD from @nlpnoah @UW. Ex-visiting researcher @MetaAI & @MosaicML.Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.Mike Lewis @ml_perception
6K Followers 227 Following Llama3 pre-training lead. Partially to blame for things like the Cicero Diplomacy bot, BART, RoBERTa, kNN-LM, top-k sampling & Deal Or No Deal.Christopher Manning @chrmanning
126K Followers 115 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋Soumith Chintala @soumithchintala
186K Followers 877 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Richard Socher @RichardSocher
101K Followers 970 Following CEO @youSearchEngine Investing at @aixventuresHQ Before: Stanford Adj Prof in AI/NLP, Chief Scientist at Salesforce, MetaMindGraham Neubig @gneubig
31K Followers 586 Following Associate professor at CMU, studying natural language processing and machine learning.William Wang @WilliamWangNLP
14K Followers 717 Following UCSB NLP Lab + ML Center. https://t.co/6TOnqbk6YT https://t.co/KJYhnav3Et Mellichamp Chair Prof. at UCSB CS. PhD @ CMU SCS. Areas: #NLProc, Machine Learning, AI.l u i s @clague17
702 Followers 1K Following growth eng @magicaltome i like coffee and riding bikes with friends | @contrary | @RiceUniversityChetan Verma @chtnverma
377 Followers 1K Following guy who forwards reddit jokes. also ml engineer. @iitmadras @ucsd alumOliver Libaw @oliverlibaw
657 Followers 840 Following Currently @FuriosaAI Formerly @MetaAI blog editor, @Yahoo, Veoh (don't ask), Mexico City Times (RIP), @ABC News Once @Cambridge_Uni, @PomonaCollegePerplexity @perplexity_ai
132K Followers 29 Following Our mission is to serve the world’s curiosity. https://t.co/BBZ1kG0TVGHeng Ji @hengjinlp
4K Followers 236 FollowingSunipa Dev @sunipa17
2K Followers 568 Following Responsible, and Inclusive #NLProc. Senior Research Scientist RAI-HCT @GoogleAI. Previously @CIFellows @uclanlp and @UtahSoC. Chair @WiNLPWorkshop she/herJonathan Clark @JonClarkSeattle
3K Followers 2K Following Research Scientist @ Google: Multilingual NLP, Machine Learning, C++. Previously MT@Microsoft and CMU. Opinions are my own.Punit Singh Koura @punitkoura
43 Followers 251 FollowingArchana Sankar @archsankar
410 Followers 253 Following Building @magicaltome. Previously @google @netflix @adobeJesse Chase @ChasingUX
2K Followers 624 Following Design @magicaltome. Previously @airbnb, @slab, @digitalocean.medha @MedhaGupta_
128 Followers 269 Following eng @magicaltome ✨prev @meta | @RiceCompSci alumna | she/herLaurens van der Maate.. @lvdmaaten
653 Followers 1K Following Distinguished Research Scientist at Meta AI. t-SNE. DenseNet. Web-scale weakly supervised vision. CrypTen. Currently herding Llamas.Leo Boytsov @srchvrs
7K Followers 2K Following Sr. Research Scientist @AWS Labs (ph-D @LTIatCMU) working on unnatural language processing, speaking πtorch & C++. Opinions sampled from MY OWN 100T param LM.Momchil Hardalov @mhardalov
140 Followers 347 Following Scientist @AWS Bedrock Labs working on Guardrails for LLMs | Ex: Sofia University, @checkstep, @dextofficial, @adcash. Opinions my own.Priya Goyal @priy2201
1K Followers 499 Following Founding member @datologyai, ex-Google Deepmind, ex-Facebook AI Research (FAIR).Rebecca Qian @rebeccatqian
564 Followers 346 Following Co-founder & CTO @PatronusAI, previously NLP research @MetaAIYann Masoch @yannmasoch
400 Followers 112 Following UX Designer | Engineer | Business | Photographer & Videographer | Love to cook and share time Building GenAI tool for creative and marketing people @DistropyAIJade Lai @jadelai__
2K Followers 1K Following Partner @ Coatue | formerly enterprise investment partner @a16z, investor @Playground_VC | proud 🇨🇦Devin Sandoz @devinsandoz
21 Followers 20 Following Head of Marketing for @magicaltome. Back on Twitter after a break. Into tech, basketball, comedy, books, slacker rock. Don't think too hard.Mamoru B Komachi @mamoruk
12K Followers 6K Following Professor (Graduate School of Social Data Science) at Hitotsubashi University. 鍵アカウントで相互フォローを承認いただけない方、投稿数が0件の方はブロックすることがありますので、ご了承ください。Yury Zemlyanskiy @_theopompus
102 Followers 363 Following Research Scientist at Augment https://t.co/n3MP9qqkzK. Ex-Google Research, graduated from @ShaLabUSC.Nikhila Ravi @nikhilaravi
5K Followers 2K Following Research Engineer @AIatMeta (FAIR), @Cambridge_Uni, @kennedyscholars @harvard, @MCCOfficial cricketer 🇮🇳 🇬🇧 🇺🇸Abhinav Arora @abhinavarora28
21 Followers 227 FollowingMary Williamson @mary_williamson
39 Followers 98 FollowingMatthew Smith @MattHalseySmith
126 Followers 212 FollowingMarc Andreessen 🇺�.. @pmarca
1.4M Followers 24K Following Techno-optimist. E/acc. Technology brother. Move Fast and Make Things. p(Doom) = 0; p(“1984”) = not 0.Seth Rosenberg @SethGRosenberg
12K Followers 1K Following Invest in seed & A fintech, AI Applications & consumer software at Greylock @greylockVC @magicaltome @roblox @wisetackinc @espressosys @0x @payjoyzaki @meetZaki
754 Followers 867 FollowingAlexander (Sasha) Vla.. @grandcheburator
104 Followers 252 Following Co-founder and CEO at Stealth, Former Head of Engineering @magicaltome.Jack Reed🐧 @mejackreed
934 Followers 2K Following Software Engineer @magicaltome. Formerly @StanfordLibsVlad @vladquant
4K Followers 1 Following Started with C64. End not yet in sight. CEO & founder of @KagiHQ. Humanizing the web. Prefer lists to following.Khalid El-Arini @kelarini
375 Followers 1K Following working on AI fairness at Meta. Egyptian American. DMV native and DC sports sufferer. dad. tweets my own. #YNWAMatthew Leavitt @leavittron
2K Followers 778 Following Chief Science Officer, Co-Founder @datologyai. Former: Head of Data Research @MosaicML; FAIR. 🧠 and 🤖 intelligence // views are from nowhereKathleen Chaykowski @Kchaykowski
9K Followers 2K Following Comms & Marketing @WindBorneWx. Formerly @robinhoodapp @WSJ @Stanford. Compulsive list maker, word nerdMichael Mignano @mignano
15K Followers 1K Following vc & partner @lightspeedvp. former ceo & co-founder anchor (acq. by @spotify, now @forpodcasters).Tome @magicaltome
26K Followers 760 Following The leading AI-native research and presentation platform for sales and marketing teams.Jonathan Frankle @jefrankle
16K Followers 685 Following Chief Scientist, Neural Networks @Databricks via MosaicML. PhD @MIT_CSAIL. BS/MS @PrincetonCS. DC area native. Making AI efficient for everyone at @DbrxMosaicAIPing (Iris) Yu @ping_iris_yu
33 Followers 69 Following Research Scientist @MetaAI (FAIR); Previously @amazon @TencentGlobal ; Opinions are my own.Vitaliy Chiley @vitaliychiley
2K Followers 607 Following Head of NLP Pretraining @Databricks / @MosaicML | Former @CerebrasSystems | What do we want? FLOPS! When do we want it? TOKENS!Can LLMs acquire meaning/semantics from just text? Some think it is a priori not possibile, I personally think it's a super interesting philosophical question which needs further investigation! Thoughts? arxiv.org/abs/2404.12145
📜 New preprint! Equipped with our multisense consistency method, we dive deep into an exploration of the semantic understanding of #LLMs. @eliabruni & @_dieuwke_ @metaai #NLProc [1/7]🧵 arxiv.org/abs/2404.12145
Excited to share a preview of Llama3, including the release of an 8B and 70B (82 MMLU, should be the best open weights model!), and preliminary results for a 405B model (still training, but already competitive with GPT4). Lots more still to come... ai.meta.com/blog/meta-llam…
We're honored to be selected as one of the #ForbesAI50 for the second year in a row. Let's keep building.
Introducing Forbes’ sixth annual #ForbesAI50 list trib.al/rSXcyJ6
Update: As promised, one order of magnitude more compute testing AdamW vs. Sophia. This time applied to two different transformer architectures. Sophia is clearly the winner again. Will run one more ablation with another order of magnitude more compute to see if trend holds.
No replies here. Decided to try out on our own benchmarks, consisting of an auto-regressive, multi-modal pre-training at scale. Pretty complex setting. Yellow: Tuned (LR) AdamW Purple: Tuned (LR) Sophia Average Loss:
I posted on @LinkedIn about using @magicaltome to create presentations. Then @devinsandoz, their Head of Product Marketing reached out for more feedback. Social listening at its best.
@GreylockVC’s most requested feature.
New in Tome: upload logos and images into your diagrams. Market maps in a snap.
Web images to make any point, now searchable in Tome
The best slide decks I've been shown recently are all consistently tome.app. It reminds me of starting to see Notion links everywhere a few years ago. AI-native software is the best software.
One of the best pieces of career advice I received came indirectly from @myleott, via @stephenroller, which was to always "optimize for knowledge." I've found that this holds through every layer of abstraction, from company/team choice down to the specifics of daily experiments
My dog was nervous at first but she ended up loving the canoe. Our first time experiencing a sunny Mendocino!
Loving the new @magicaltome hat. @keithpeiris and @hliriani have the best style
I am honored to receive the Apple Scholars in AIML fellowship! Very grateful to my advisor, mentors and collaborators along the way :) Excited to keep exploring the Pareto-frontier of capabilities and efficiency of foundation models!
Congrats to @xiamengzhou on receiving an Apple Scholars in AIML fellowship! 🎉🍏 The fellowship recognizes graduate students doing innovative and cutting-edge research in machine learning. Xia is part of @princeton_nlp, advised by @danqi_chen. bit.ly/3wZz78q
I have the best students in the world. Thank you all so so much.
Welcome back Mikel! We are thrilled to have one of the top researchers on Language Models in Europe among us. He has already made a difference in a very short time, and helped set up a thriving research environment.
Excited to be officially back at the University of the Basque Country! I will be working as an Honorary Researcher at @IxaGroup and @Hitz_zentroa at 20% dedication, which I will combine with my current role at @RekaAILabs. Happy to be back home!
Congrats Dr. Ormazabal! Excited to continue working together at @RekaAILabs!
Some personal news, I successfully defended my PhD thesis yesterday. I'd like to thank my amazing supervisors @artetxem and @eagirre , as well as all my colleagues at @Hitz_zentroa. I joined @RekaAILabs full time earlier this year, excited to work with this strong team!
The sunlight at the Green Bazaar was beautiful today.
I used @magicaltome for a board meeting and it was wildly illuminating to know how much time each person spent on each part of the pre-read when considering their feedback. It would be crazy to fly blind on any meeting of consequence going forward.
Rainbow Teaming adapts successful methods from Reinforcement Learning to automatically create adversarial prompts that are both effective and diverse. Finetuning on this dataset in turn greatly increases the model robustness to adversarial attacks. Check the paper out!
Introducing 🌈 Rainbow Teaming, a new method for generating diverse adversarial prompts for LLMs via LLMs It's a versatile tool 🛠️ for diagnosing model vulnerabilities across domains and creating data to enhance robustness & safety 🦺 Co-lead w/ @sharathraparthy & @_andreilupu
Another day, another subway stop in Almaty. This time we’re admiring Zhibek Zholy Station.
Made for when inspiration strikes. Start a presentation anytime in our mobile web app, then pick your work back up on desktop.