Branch-Solve-Merge will be presented at #NAACL2024 😀
There's growing interest in using LLM as evaluator. BSM improves its correctness+consistency via task decomposition -- generating granular eval criteria & merging them.
@omerlevy_@real_asli@mohitban47@jaseweston@xl_nlp
Branch-Solve-Merge will be presented at #NAACL2024 😀
There's growing interest in using LLM as evaluator. BSM improves its correctness+consistency via task decomposition -- generating granular eval criteria & merging them.
@omerlevy_@real_asli@mohitban47@jaseweston@xl_nlp
🚨 Introducing ToolVerifier, our new method for generalization to new tools.
🚀 ToolVerifier outperforms GPT-4 on some tasks despite being based on Llama-2 70b.
🤖 Key ideas:
- fine-tune on synthetically generated data for tool use with reasoning traces
- self-verification…
🚨 Introducing ToolVerifier, our new method for generalization to new tools.
🚀 ToolVerifier outperforms GPT-4 on some tasks despite being based on Llama-2 70b.
🤖 Key ideas:
- fine-tune on synthetically generated data for tool use with reasoning traces
- self-verification…
Our team in FAIR labs (at Meta) is hiring researchers (RE, RS & PostDoc)! DM if interested.
We work on the topics of Reasoning, Alignment and Memory/architectures (RAM).
Recent work:
Self-Rewarding LMs: arxiv.org/abs/2401.10020
Pairwise Cringe Loss: arxiv.org/abs/2312.16682…
61K Followers 2K Followinga combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
186K Followers 877 FollowingCofounded and lead @PyTorch at Meta.
Also dabble in robotics at NYU.
AI is delicious when it is accessible and open-source.
35K Followers 3K FollowingAI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
9K Followers 777 FollowingResearch Scientist, Deepmind
I try to think hard about everything I tweet, esp on 90s football and 80s music
None of my opinions are really someone else's
36K Followers 774 FollowingFR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.
6K Followers 227 FollowingLlama3 pre-training lead. Partially to blame for things like the Cicero Diplomacy bot, BART, RoBERTa, kNN-LM, top-k sampling & Deal Or No Deal.
10K Followers 3K FollowingI build tough benchmarks for LMs and then I get the LMs to solve them. Postdoc @Princeton. PhD from @nlpnoah @UW. Ex-visiting researcher @MetaAI & @MosaicML.
343 Followers 827 FollowingI ❤️ engineering biology to improve health & environment +
businesses that realize the impact of science. 🤘@UTDiscoveries
🦑@tandem_repeat 🌱@Valley_DAO
38 Followers 402 FollowingFirst year Graduate student in Aerospace Studies, UofT, major in robotics and machine learning . Always passionate to explore and learn.
1 Followers 150 FollowingResearcher in Trustworthy NLP, Alignment, and AI Governance at @nyuniversity. Sharing insights on AI Safety. #NLP #AISafety #AIGovernance
14K Followers 153 FollowingWe are empowering AI innovation through decentralization. Join Gentium to create, collaborate, and earn with AI agents. #DecentralizeAI #GentiumAI
135 Followers 237 FollowingSr. Research Eng @SiemensHealth - MI (R&D) • JB Sr. Scholar 2016 • Came for the news, stayed for the memes 🤷♂️ Sharing my journey
61K Followers 2K Followinga combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
186K Followers 877 FollowingCofounded and lead @PyTorch at Meta.
Also dabble in robotics at NYU.
AI is delicious when it is accessible and open-source.
35K Followers 3K FollowingAI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
261K Followers 26 FollowingWe're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant Claude at https://t.co/aRbQ97uk4d.
9K Followers 777 FollowingResearch Scientist, Deepmind
I try to think hard about everything I tweet, esp on 90s football and 80s music
None of my opinions are really someone else's
36K Followers 774 FollowingFR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.
1K Followers 2K FollowingML / GenAI (+Jailbreaks) research for Responsible AI & Productivity, @Microsoft AI, @WiMLDS| Ph.D. @CarnegieMellon, @UMich | making AI trustworthy | She/Her
123K Followers 19 FollowingMakers of Devin, the first AI software engineer. We are an applied AI lab focused on reasoning, and code is just the beginning. Join us: https://t.co/tpfZwEwGiq
39K Followers 609 FollowingCofounder @openai, lead post-training for ChatGPT and the API. Interested in reinforcement learning, alignment, birds, jazz music
710 Followers 268 FollowingI study learning for reasoning and perception, in brains and machines.
A sr. director of AI research at NVIDIA and a CS Prof. at Bar-Ilan University. @NvidiaAI
19K Followers 76 FollowingA non-profit research lab focused on interpretability, alignment, and ethics of artificial intelligence.
Creators of GPT-J, GPT-NeoX, and VQGAN-CLIP
6K Followers 2K FollowingResearch @allen_ai. I evaluate (multi-modal) LLMs, build agents, and study the science of LLMs. Previously: @GoogleAI & @MetaAI FAIR @nlp_usc
2K Followers 362 FollowingPhD @ NYU. ESMFold / PyTorch. Climbs all day. Definitely not s̶k̶y̶n̶e̶t̶GPT5. Unsupervised learner but sometimes still gets a few rewards.
27K Followers 297 FollowingProfessor of linguistics and professor of computer science at Stanford and author of the James Beard award finalist "The Language of Food"
4K Followers 485 FollowingI like AI & music. Working on making LLMs easier & safer to use. Final year PhD student at Stanford advised by Chelsea Finn & Chris Manning.
3K Followers 672 FollowingResearch Scientist @allen_ai / @ai2_mosaic, PhD in NLP/Dialogue 🤖 UofA. Ex Visiting researcher @Mila_Quebec Ex Research intern at @GoogleDeepMind @MSFTResearch
2K Followers 282 FollowingDirector of Research Science, North American Labs, Meta AI. Affiliate Professor @UWashington Former Partner Research Manager Microsoft, AWM President 2015-2017