NLPurr @NLPurr
SciComm of Academic NLP Papers | Research Scientist | Explainability, Prompting, Benchmarking, Metrics, Red-Teaming & Eval of LLMs nlpurr.github.io Joined July 2022-
Tweets932
-
Followers1K
-
Following759
-
Likes7K
OK, this is probably going to raise more questions than it answers, but I just want to put this out here so that no one ever says "we can just get around the data limitations of LLMs with self-play" ever again.
Researchers often have to ask for recommendation letters for visa/job applications, etc. I wrote a script that allows you to find who cites your papers frequently to create a list of potential letter writers: github.com/neubig/researc… Hope it's helpful, improvements are welcome!
The next 10x in deep learning efficiency gains are going to come from intelligent intervention on training data. But tools for automated data curation at scale didn’t exist—until now. I’m so excited to announce that I’ve co-founded @datologyai, with @arimorcos and @hurrycane
Or even just a working cat bot.
@DrJimFan @RichardSSutton Animals and humans get very smart very quickly with vastly smaller amounts of training data. My money is on new architectures that would learn as efficiently as animals and humans. Using more data (synthetic or not) is a temporary stopgap made necessary by the limitations of our…
I attended a Google-hosted workshop today. Workshops like these are a great chance to spread their work. I enjoyed the talks immensely. However, for whatever reason, this was the gender breakdown. I'm posting because I think it's important that people know these statistics.
Don't confuse the approximate retrieval abilities of LLMs for actual reasoning abilities.
Don't confuse the approximate retrieval abilities of LLMs for actual reasoning abilities.
These takes are going to reverse polarize me into being a Google defender. Do people just forget that Bard exists and was shipped to the public in like March?
These takes are going to reverse polarize me into being a Google defender. Do people just forget that Bard exists and was shipped to the public in like March?
Scientific work which cannot be replicated is failed scientific work. Work using closed methods that don't even allow the possibility of replication should be treated as marketing rather than science. Scientists who publish said work should have their reputations suffer.
Scientific work which cannot be replicated is failed scientific work. Work using closed methods that don't even allow the possibility of replication should be treated as marketing rather than science. Scientists who publish said work should have their reputations suffer.
careful about overfitting to lists like this. there are many ways to do good research -- my fav papers were born out of getting "stuck in rabbit holes" that no-one else went down...
careful about overfitting to lists like this. there are many ways to do good research -- my fav papers were born out of getting "stuck in rabbit holes" that no-one else went down...
researchers should start making "collaborate with me" docs the same way people make "date me" docs (and no, neither a resume nor a CV counts)
This account... Embodies how much I can run from unanswered emails 😅
This account... Embodies how much I can run from unanswered emails 😅
Easier rephrasing that still leads to incorrect output by GPT4:
If you keep your DMs open to everyone (as message requests), please note that twitter has changed the default option to requests from verified users only+people you follow. Make sure to shift it to the last option (if you did not keep it at the first option previously).
Super excited that our work on how context affects language model acceptability judgements has received an #ACL2023NLP outstanding paper award🤩! (w/@koustuvsinha @j_gauthier @amuuueller @kanishkamisra @kerenfuentes313 @roger_p_levy) check it out here: aclanthology.org/2023.acl-long.…
Super excited that our work on how context affects language model acceptability judgements has received an #ACL2023NLP outstanding paper award🤩! (w/@koustuvsinha @j_gauthier @amuuueller @kanishkamisra @kerenfuentes313 @roger_p_levy) check it out here: aclanthology.org/2023.acl-long.…
@DrJimFan @YiTayML We had already found evidence of this before (x.com/koustuvsinha/s…) - good that folks are converging on the same conclusions! @a_kazemnejad @adinamwilliams
@DrJimFan @YiTayML We had already found evidence of this before (x.com/koustuvsinha/s…) - good that folks are converging on the same conclusions! @a_kazemnejad @adinamwilliams
In-context learning (ICL) is a fascinating property of transformers. We seek to de-mystify ICL as a combination of 1️⃣ learning template circuits 2️⃣ context-sensitive retrieval of those templates and 3️⃣ rebinding appropriate slots in the templates. 🧵 1/N arxiv.org/abs/2307.01201
I'll be at #ACL2023NLP in Toronto next week! Would love to meet/catch up with people- please reach out. I'm giving an invited talk "Two Views of LM Interpretability" at the NLRSE workshop Thursday at 4:40pm. Come hear my thoughts on prompting & mechanistic interpretability.
I'll be at #ACL2023NLP in Toronto next week! Would love to meet/catch up with people- please reach out. I'm giving an invited talk "Two Views of LM Interpretability" at the NLRSE workshop Thursday at 4:40pm. Come hear my thoughts on prompting & mechanistic interpretability.
Ah man, exactly the paper that I was writing at the moment. But at least, I know I ran my experiments right 😂 Great work 😄
Large generative models have made it possible to solve many problems in a few-shot or even zero-shot manner; however we still don't have a systematic and robust way of doing so! The goal of R0-FoMo is to discuss how to move the needle on that end! See you at #Neurips2023
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingJim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.MMitchell @mmitchell_ai
80K Followers 1K Following Interdisciplinary researcher focused on shaping AI towards long-term positive goals. ML & Ethics. Same content in the Sky, Threads, & the Prehistoric ElephantSara Hooker @sarahookr
39K Followers 7K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.Shaily @shaily99
5K Followers 2K Following PhD @LTIatCMU Prev: @GoogleAI @MSFTResearch. Working on ethics and evaluation in #NLProc. Usually ranting, often about research & DEI. 📚 @readsndrantsSameer Singh @sameer_
7K Followers 2K Following Cofounder @SpiffyAI and Assoc Prof at @UCIrvine, working on reliable LLMs, explanations for AI+ML, adversaries for NLP, and debugging/evaluation.Qingxiu Dong @qx_dong
841 Followers 592 Following PhD student @PKU1898. Research Intern @MSFTResearch Asia.Zachary Lipton @zacharylipton
59K Followers 2K Following Professor: CMU/@acmi_lab, CTO / CSO: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷Kelly Marchisio (St. .. @cheeesio
1K Followers 558 Following Multilingual NLP @cohere. Formerly: PhD @jhuclsp Alexa Fellow @amazon dev @Google MPhil @cambridgenlp EdM @hgse 🔑🔑¬🧀 (@kelvenmar20)Michael Saxon @m2saxon
2K Followers 1K Following CS PhD cand @ucsbNLP 🌊🌴 @NSF GRFP 🧐analyzing semantics in generative lang/img AI models🤖 Big tech ex-intern. BS/MS @ASU 🌵🏜 🔜 @AMD opensrc GenAI RS internDanish Pruthi @danish037
7K Followers 628 Following Faculty at Indian Institute of Science, Bangalore. PhD from @LTIatCMU.Kaiser Sun @KaiserWhoLearns
732 Followers 407 Following Ph.D. student at @jhuclsp , human LM that hallucinates. Formerly @MetaAI, @uwnlp and @AWS they/them🏳️🌈Mark Dredze @mdredze
4K Followers 786 Following John C Malone Professor at @JohnsHopkins @JHUCompSci @jhuclsp @jhumceh; Part time @techatbloomberg (tweets my own) Mastodon @[email protected]Tamara Boyarski @boyars_tama
82 Followers 5K FollowingSumaiya Islam @islam_sumuu
5 Followers 17 Following Social Media #Manager And Advertiser || Digital #Marketer || Freelancer 💻 || Content Writer || Data Entry || Works at Fiverr and Upwork 📈✨ #seo #advertisingMarkus Rauhalahti, Ph.. @MRauhalahti
848 Followers 5K Following Independent researcher: molecular design/nanotech, human-AI collab, informetrics, DIY-scihw. Prev compchem/biophys/info phd&postdoc @helsinkiunitingezhang @tingezhang
0 Followers 422 FollowingHarper-rose Kutsch @RoseKutsch53788
77 Followers 5K FollowingCharles Moore @charles_moore9
252 Followers 3K Following Bahagialah kamu , dengan pilihan ♍Ǚ dan kebahagiaanmu itu adalah suatuu kesedihan buat aq sααt ϊηϊ .Tenille McDermott @tenille_mc
643 Followers 3K Following Bookseller. PhD student in Creative Writing. AI, LLMs and time perception. Editorial team @Sudo_Journal. She/her.e.bstan @ebstan
6 Followers 1K Followingkun zhu @kunzhu118672
78 Followers 897 FollowingJade Paling @JadePali
13 Followers 3K FollowingVictoria Butland @ButlaVictori
73 Followers 5K Followingrealgoodkid @realgoodkid0
362 Followers 5K FollowingYee Vanyo @VanyoYee75145
80 Followers 5K FollowingNan HUO @NanHUO9637
209 Followers 420 Following CS PhD Student @HKUniversity. Previously M.S. @JohnsHopkins.Serena Dibley @SerDibl
33 Followers 5K FollowingAxel Hellström @AxhellAI
26 Followers 56 Followingsaraelo @_saraelo
33 Followers 644 Following Freelance Software Engineer | Immersed in AI, VR, AR, and wearable Tech | JavaScript, Python | Web3, Creative Coding, 3D, & WebGL.Logan @a_no_op
145 Followers 2K Following Product with Google Cloud Platform. Building AI for technical customer support and developer tools.JohnSnowLabs @JohnSnowLabs
41K Followers 30K Following Helping healthcare and life science organizations put AI to work faster with state-of-the-art LLM & NLP.Tilda Cooney @TilCoone
21 Followers 3K FollowingSamuel Path @smlpth
10K Followers 1K Following Senior Developer @ShopifyEng 🛒 by day ☀️ / Working in payments 💶 / Current stack: Rails + React / Playing with LLMs and Python by night 🌙 / Father of 4Ahmed Moubtahij @TheAyenem
179 Followers 1K Following ing., NLP scientist @CRIM_ca ''Focus is a matter of deciding what things you're not going to do'' - John Carmack. Opinions my own.Connor Tobin @connortobin
48 Followers 305 Following founder of ebuynow: maker of #moto360, #motowatch & #kodaksmarthome, obsessed with data driven ventures.Casso Rari @CassoRari
127 Followers 518 FollowingNoah @_Noahhweb3_
322 Followers 3K Following Web3 Marketer & Advisor • My tweets are NFA • DM for inquries i • Partner @rollbitcom • Marketing @GROOMIESNFTSantiago Víquez @santiviquez
1K Followers 987 Following ML 🥑 @ NannyML. Building ageML. Creator of https://t.co/VdulSUUsQyKosmos Jobs and Recru.. @Kosmoscorpinc1
1K Followers 4K Following A Recruiting/Talent firm. View and apply on thousands of jobs from Sales, Engineering, Accounting. Healthcare, Mfg, etc on our website at https://t.co/HRsZnUPdeeBaron Bolton @BoltonBaro42349
142 Followers 3K Followingmorph(em)ing @nlprookie
17 Followers 116 FollowingDevr Inc. @DevrOfficial
248 Followers 5K Following Devr is a new Internet protocol for the governance of decentralized privacy networks (DPN), powering a new era for data sharing economiesMartha @andrews80martha
198 Followers 3K FollowingFrank P Seidl @SpaceConscious
40K Followers 43K Following Alchemist Series, A Walk to the Moon, Artist Frank Seidl https://t.co/JCAYEksEjJ MCAD Alumnus 72 https://t.co/g9qjzVRgOD - Model Flo Li, San Diego - https://t.co/oC2TJ77H7IPeter Ince @satoriweb
409 Followers 3K Following Software Engineer and Researcher; at the intersection of smart contracts and MLJocelyn Sunseri @jocelyn_sunseri
48 Followers 401 Following Machine Learning @DEShawResearch, opinions my own.☁️ @rototavukcu
73 Followers 536 Following personal microblog of a researcher & man of simple pleasures.pshark @2shark2shark
0 Followers 2K FollowingAisha Khatun @a2khatun
141 Followers 287 Following Graduate student, CS @ University of Waterloo. NLP researcher @ Wikimedia Foundation. Figuring out ways to make LLMs consistent and usable for story generation.Thismeash @thismeash70435
35 Followers 895 FollowingChris Velis @cvelis1
138 Followers 2K FollowingAI Deeply @AiDeeply
402 Followers 5K Following AI is reshaping the world. Who are the people and companies driving the change? Visit our website to search more than 5,000 profiles.Yann LeCun @ylecun
712K Followers 719 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.François Chollet @fchollet
470K Followers 769 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingSebastian Raschka @rasbt
267K Followers 906 Following Machine learning & AI researcher writing at https://t.co/A0tXWzG1p5. LLM research engineer @LightningAI. Previously stats professor at UW-Madison.Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Graham Neubig @gneubig
31K Followers 588 Following Associate professor at CMU, studying natural language processing and machine learning.Ana Marasović @anmarasovic
4K Followers 604 Following Asst prof @UUtah · Ex @allen_ai @uwnlp postdoc @HD_NLP PhD · she/her 🇭🇷Sasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzJim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.Jay Alammar @JayAlammar
35K Followers 1K Following Machine learning and language models R&D. Builder. Writer. Visualizing AI, ML, and LLMs one concept at a time. @Cohere. https://t.co/TquuQXlLOJLucas Beyer (bl16) @giffmana
56K Followers 446 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]MMitchell @mmitchell_ai
80K Followers 1K Following Interdisciplinary researcher focused on shaping AI towards long-term positive goals. ML & Ethics. Same content in the Sky, Threads, & the Prehistoric ElephantSara Hooker @sarahookr
39K Followers 7K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.merve @mervenoyann
56K Followers 4K Following open-sourceress at @huggingface 🧙🏻♀️ proud mediterrenean 🍋 I do TL;DR on ML papersLeo Boytsov @srchvrs
7K Followers 2K Following Sr. Research Scientist @AWS Labs (ph-D @LTIatCMU) working on unnatural language processing, speaking πtorch & C++. Opinions sampled from MY OWN 100T param LM.Tom Goldstein @tomgoldsteincs
23K Followers 2K Following Professor at UMD. AI security & privacy, algorithmic bias, foundations of ML. Follow me for commentary on state-of-the-art AI.Kayo Yin @kayo_yin
8K Followers 560 Following PhD student @berkeley_ai @berkeleynlp working on interpretability and signed languages. Former @msftresearch @deepmind @carnegiemellon @polytechnique. 🇫🇷🇯🇵Mark Tenenholtz @marktenenholtz
114K Followers 544 Following Head of AI @PredeloHQ. XGBoost peddler, transformer purveyor.Gautam Kamath @thegautamkamath
44K Followers 507 Following Assistant Prof of CS @UWaterloo, Faculty @VectorInst, Canada @CIFAR_News AI Chair. Co-EiC @TmlrOrg. I lead @TheSalonML. Privacy, robustness, machine learning.Sarah Wiegreffe @sarahwiegreffe
4K Followers 984 Following At @allen_ai @ai2_aristo @uwnlp. Research in language model transparency & interpretability. PhD from @mlatgt @icatgt @gtcomputing. Views my own.Hanie Sedghi @HanieSedghi
7K Followers 1K Following Staff Research Scientist at Google DeepMind. Interested in the science of deep learning. Current focus: Pushing boundaries of LLMs capabilitiesJoel Tetreault @Tetreault_NLP
1K Followers 422 Following VP of Research at Dataminr co-Program Chair of ACL2020 https://t.co/Bj7uRRRf09Arman Cohan @armancohan
2K Followers 728 Following Assistant Professor of CS @Yale Research Scientist at AI2 @allen_ai NLP/AI ResearchFangyuan Xu @brunchavecmoi
322 Followers 499 Following 许方园👩🏻💻phd student @ ut austin, interested in nlphyunji amy lee @hyunji_amy_lee
431 Followers 239 Following PhD student @kaist_ai. Previously: @allen_ai. Working on Information Retrieval and Retrieval Augmented LMsJohn Giorgi @johnmgiorgi
302 Followers 299 Following CS Ph.D. student @UofT/@DonnellyCentre/@VectorInst || Intern @allen_ai/@SemanticScholar (2X) || Currently building @abridgehqManling Li @ManlingLi_
3K Followers 419 Following Postdoc @Stanford, Incoming Assistant Professor @Northwestern, PhD @UIUC. Working on Knowledge Foundation Models, especially for Multimodal data (Language + X).Mohit Bansal @mohitban47
9K Followers 651 Following Parker Distinguished Professor, UNC Chapel Hill (@unc). Director https://t.co/5qlPVgnrlN (@uncnlp). Prev: @Berkeley_AI, @TTIC_Connect @IITKanpur #NLP, #CV, #AI, #MLsam laki (e^-λ) @samlakig
3K Followers 4K Following good vibes don't cancel out :S they yearn for love (pfp by @untitled01ipynb, credit @yacineMTB and @alterwyx for great art)Chenhao Tan @ChenhaoTan
4K Followers 902 Following Assistant professor @UChicagoCS @UChicago. Working on human-centered AI, NLP, CSS at @ChicagoHAI, also part of @ChicagoNLP. DM for Postdoc/PhD opportunities.Scaled Foundations @ScaFoAI
287 Followers 9 Following Scaled Foundations is an AI research and deployment company building safe General Robot Intelligence.jasmine collins @jazcollins_
6K Followers 704 Following research scientist @databricks! previously @berkeley_ai phd, @googleai and @metaai. interested in human brains and computer brains 💫Nat McAleese @__nmca__
3K Followers 306 Following Superalignment by models helping humans help models help humans at OpenAI. Previously @DeepMind. Views my own.Seraphina Goldfarb-Ta.. @seraphinagt
832 Followers 349 Following Head of AI Safety @cohere. Phd @EdinburghNLP @InfAtED. If you don't recognise me, that's because I am invisible https://t.co/oRZvFdIDcR𝙷𝚒𝚖𝚊 𝙻.. @hima_lakkaraju
16K Followers 836 Following Professor @Harvard; PI @ai4life_harvard; Co-founder @trustworthy_ml; #AI #ML #Safety; Stanford PhD; MIT @techreview #35InnovatorsUnder35Jason Weston @jaseweston
9K Followers 569 Following Research @MetaAI+NYU. Pretrain+FT: NLP from Scratch (2011). Multilayer attention+position embed+LLM: MemNets (2015). Recent (2023+):Sys 2 Attn, Self-Rewarding..Jordan Ellenberg @JSEllenberg
28K Followers 919 Following Math professor at Wisconsin. Number enthusiast. Author of HOW NOT TO BE WRONG and SHAPE (May 2021)Ani Kembhavi @anikembhavi
2K Followers 297 Following Senior Director @allen_ai + Affiliate Assoc Prof @UW 📷 : Visual Prog, Unified-IO, BiDAF 🤖 : ProcTHOR, Objaverse, SPOC 🌎 : SATLAS All views my own.Ben Recht @beenwrekt
26K Followers 365 Following optimization. machine learning. uc berkeley. I blog at https://t.co/fkJujOPsJb The world won't end.Armen Aghajanyan @ArmenAgha
6K Followers 263 Following Research Scientist @ Meta AI (FAIR) https://t.co/8XF2vtiIVy Opinions are my own.Preetum Nakkiran @PreetumNakkiran
10K Followers 2K Following ML research @Apple. @sh_reya’s fiancé | PhD @Harvard, postdoc @UCSanDiego, EECS @Berkeley_EECS, "AI" @OpenAI, @GoogleAISameer Singh @sameer_
7K Followers 2K Following Cofounder @SpiffyAI and Assoc Prof at @UCIrvine, working on reliable LLMs, explanations for AI+ML, adversaries for NLP, and debugging/evaluation.🔎Julia Evans🔍 @b0rk
209K Followers 641 Following programming and exclamation marks. she/her. zines at https://t.co/Rl14X28NuU. mostly posting on Mastodon at https://t.co/HTBbL2lnZrZijian "Jason" Ding @jasonzding
1K Followers 1K Following PhD candidate @hcil_umd | Human Intent-AI Interaction Research | Incoming Intern @IBMResearch Previously @MSFTResearch @Dataminr @DesignLabUCSD @Cambridge_UniMichael Carbin @mcarbin
3K Followers 371 Following Associate Professor in EECS at @MIT | Founding Advisor at @mosaicml | Programming Systems | Neural Networks | Approximate ComputingConjecture @ConjectureAI
3K Followers 2 Following We are building Cognitive Emulation, an alternative AI paradigm that is controllable, transparent, and safe. Get in touch at [email protected].Bill Yuchen Lin 🤖 @billyuchenlin
6K Followers 2K Following Research @allen_ai. I evaluate (multi-modal) LLMs, build agents, and study the science of LLMs. Previously: @GoogleAI & @MetaAI FAIR @nlp_uscSusan Zhang @suchenzang
20K Followers 504 Following @ Google Deepmind. Past: @MetaAI, @OpenAI, @unitygames, @losalamosnatlab, @Princeton etc. Always hungry for compute.Pablo Samuel Castro @pcastr
10K Followers 813 Following Señor swesearcher @ Google DeepMind. Adjunct prof @ U de Montreal & Mila. Musician. From 🇪🇨 living in 🇨🇦.Air Katakana @airkatakana
6K Followers 907 Following based postdoctoral researcher in AI and language learning enthusiast📍tokyoXeophon @TheXeophon
1K Followers 845 FollowingErnest Davis @ErnestSDavis
297 Followers 6 FollowingRaunak Chowdhuri @raunakdoesdev
3K Followers 738 Following I’m into open science, elegant software architecture, and well-crafted interfaces. Building https://t.co/0GX1wFmPoU 🔮M. Alex O. Vasilescu @AlexTensor
2K Followers 1K Following Developing #causal #tensor framework -TensorFaces, Human Motion Signatures | Alumna @MIT & @UofT, @UCLA : Assoc Dir #ComputerVision & #Graphics | #womenwhocodeMistral AI @MistralAI
91K Followers 0 Following Fast, open-source and secure language models. Join us https://t.co/INALdNGvCPGuillaume Lample @GuillaumeLample
37K Followers 648 Following Cofounder & Chief Scientist https://t.co/hLfvKLkFHd (@MistralAI). Working on LLMs. Ex @MetaAI | PhD @Sorbonne_Univ_ | MSc @CarnegieMellon | X11 @PolytechniqueDimitris Papailiopoul.. @DimitrisPapail
11K Followers 976 Following prof @ wisconsin; thinking about transformers; learning in context; babas of Inez LilyChris Olah @ch402
91K Followers 173 Following Reverse engineering neural networks at @AnthropicAI. DMs open! Previously @distillpub, OpenAI Clarity Team, Google Brain. Personal account.noahdgoodman @noahdgoodman
2K Followers 109 Following Professor of natural and artificial intelligence @Stanford. Research Scientist at @GoogleDeepMind. (@StanfordNLP @StanfordAILab etc)Ofir Press @OfirPress
10K Followers 3K Following I build tough benchmarks for LMs and then I get the LMs to solve them. Postdoc @Princeton. PhD from @nlpnoah @UW. Ex-visiting researcher @MetaAI & @MosaicML.Mimansa Jaiswal @MimansaJ
1K Followers 3K Following MoTS @normativeai. Ex @UMichCSE, 2x @MetaAI, @allen_ai | Speech & NLP | Robustness, Data & Annotations, Evaluation & Interpretability in LLMsReka @RekaAILabs
11K Followers 13 Following An AI research and product company 🫠. We are a team of scientists and engineers building state-of-the-art multimodal language models 😻Mitchell Gordon @mitchellgordon
1K Followers 391 Following Incoming assistant prof @MITEECS (fall 2024), postdoc @uwcse. PhD @StanfordHCI. Former intern @Apple @Google @cmuhcii. HCI, human-centered AI, social computing.Greg Durrett @gregd_nlp
6K Followers 752 Following CS professor at UT Austin. I do NLP most of the time. he/himSven Gowal @sgowal
425 Followers 81 Following Robust ML @DeepMind, previously @GoogleAI. @[email protected]OK, this is probably going to raise more questions than it answers, but I just want to put this out here so that no one ever says "we can just get around the data limitations of LLMs with self-play" ever again.
Expecting @COLM_conf reviews to say: Why didn't you compare your method to LLaMA 3? LLaMA 3 is now out! (Credit to my PhD student)
@mihaela_v Somehow the idea that it’s manufactured doesn’t offer much relief to me. I can muster little time or energy for things like meal planning. I’ve mostly stopped exercising. I often wake up in the night stressing about work. My personal needs always feel less important than the job.
If someone offered you a job that more or less required working or thinking about work every waking moment of your life, what is the minimum level of compensation you would find acceptable?
“What would an AI research & education mission that crossed the whole campus look like?” This is the question posed to me & a working group by @UofMaryland's Provost Rice summer'23. Now we’re announcing the answer: #AIMaryland, the AI Interdisciplinary Institute at Maryland. >
#UMD is proud to announce the launch of the AI Interdisciplinary Institute at Maryland (AIM)! This new institute will be dedicated to developing the next generation of artificial intelligence education, technology and leaders: go.umd.edu/4cMk5DB #AIMaryland
Some cool stuff is coming, stay tuned =)
The superalignment fast grants are now decided! We got a *ton* of really strong applications, so unfortunately we had to say no to many we're very excited about. There is still so much good research waiting to be funded. Congrats to all recipients!
Before I get a "but actually not all research is Big Model" - yeah I know. I do a lot of that too. There are many types of important research that industry is no good for - this is obvious and doesn't need to be explicitly repeated every time
I'm writing this cause I'm a bit salty. We've implemented so many seemingly promising, published & popular papers only for them to utterly flop. At least I like to think that my personal bs Big Model paper classifier is now pretty good given my extensive training data.
This this this. I don't like to call out papers we can't reproduce because I'm not a fan of making life and career harder for PhD students. But I no longer believe anything if we haven't reproduced it ourselves.
I'm writing this cause I'm a bit salty. We've implemented so many seemingly promising, published & popular papers only for them to utterly flop. At least I like to think that my personal bs Big Model paper classifier is now pretty good given my extensive training data.
We look forward to hearing from talented and ambitious candidates who are eager to contribute to cutting-edge research in LLM.
Our team at Google DeepMind has a full-time Research Scientist position available at our Mountain View site. Minimum qualification: PhD in ML/NLP. Please email me with: your CV and Google Scholar link; a brief description of the impactful work you have done; and what you aim…
Researchers often have to ask for recommendation letters for visa/job applications, etc. I wrote a script that allows you to find who cites your papers frequently to create a list of potential letter writers: github.com/neubig/researc… Hope it's helpful, improvements are welcome!
We are not going to run such checks before the paper submission deadline, but please figure things out by then.
@COLM_conf Does this apply to abstract submission as well? In other words, is an abstract submission to COLM (that is under review at ARR) considered a proper submission under the dual submission policy?
There's a fundamental tension here. Most tech folks want the raise the ceiling (sexy, hype creating, splashy stuff) Most healthcare workers want to raise the floor (boring but important stuff) How do I know? I'm a CS researcher who invested years in developing mutually…
The reason why the tech industry has consistently failed to “disrupt” medicine is because they actually have no clue how medicine actually works or have any insight whatsoever.
We're dealing with a case where the base model works fine, but after fine tuning it only generates empty strings. Can you please generate responses on this eval set? Model:
"that would be great, thanks for suggesting! as you can tell from my extensive posting this week I have a grant proposal deadline coming up but let's get a drink next week!"
Graduating from a PhD program next year (2025)? If you're considering doing a post-doc after your PhD, you might want to start reaching out to potential advisors relatively soon - it can take at least a year to secure funding (through fellowships or grants).
Data research and survey papers both suffer from the fact that the ML community has historically not considered them glamorous, much to the detriment of...everyone. @AlbalakAlon et al's thorough survey on data selection is absolutely going on the @datologyai reading list.
{UCSB|AI2|UW|Stanford|MIT|UofT|Vector|Contextual AI} present a survey on🔎Data Selection for LLMs🔍 Training data is a closely guarded secret in industry🤫with this work we narrow the knowledge gap, advocating for open, responsible, collaborative progress arxiv.org/abs/2402.16827
@BlancheMinerva It’s not (only) clickbait, it’s part of the technical report 🫣