LLM Evals Workshop @NeurIPS @LLM_eval
NeurIPS 2025 Workshop. Evaluating the Evolving LLM Lifecycle: Benchmarks, Emergent Abilities, and Scaling sites.google.com/corp/view/llm-… San Diego Joined July 2025-
Tweets19
-
Followers130
-
Following16
-
Likes16
Last 2 days to the deadline! If you're interested in helping with the reviewing process, please consider volunteering using the following form. There will be best reviewer awards! docs.google.com/forms/d/e/1FAI…
Last 2 days to the deadline! If you're interested in helping with the reviewing process, please consider volunteering using the following form. There will be best reviewer awards! docs.google.com/forms/d/e/1FAI…
Volunteer to be a reviewer: docs.google.com/forms/d/1JPQB2…
@abeirami Indeed! In our NeurIPS workshop @LLM_eval, we’ll tackle the most pressing evaluation challenges. Join us to discuss how we should design the next generation of evaluations with experts in the field! More details: sites.google.com/view/llm-eval-…
We are still in an Evaluation crisis!
needed this so badly
needed this so badly
I’m very excited to be co-organizing this @NeurIPSConf workshop on LLM evaluations! Evaluating LLMs is a complex and evolving challenge. With this workshop, we hope to bring together diverse perspectives to make real progress. See the details below:
I’m very excited to be co-organizing this @NeurIPSConf workshop on LLM evaluations! Evaluating LLMs is a complex and evolving challenge. With this workshop, we hope to bring together diverse perspectives to make real progress. See the details below:
Do not miss this one!
Very excited to announce that I’ll be co-organizing a @NeurIPSConf workshop on LLM evals! Identifying shortcomings in model capabilities in a robust, scientific way is a critical part of model development. Looking forward to discussing ideas and hearing from some eval experts!
Very excited to announce that I’ll be co-organizing a @NeurIPSConf workshop on LLM evals! Identifying shortcomings in model capabilities in a robust, scientific way is a critical part of model development. Looking forward to discussing ideas and hearing from some eval experts!
Evaluating LLMs is one of the most critical and nuanced challenges in AI today. I am super excited to be co-organizing this workshop @NeurIPSConf to discuss the most pressing evaluation challenges. Details 👇
Evaluating LLMs is one of the most critical and nuanced challenges in AI today. I am super excited to be co-organizing this workshop @NeurIPSConf to discuss the most pressing evaluation challenges. Details 👇
Elena K. @ElenaK20367375
0 Followers 16 Following
Gabriele Dominici @g_dominici
12 Followers 84 Following PhD Student at @USI (Lugano, Switzerland) in AI Safety | Graduate at the @University of Cambridge | Ex @MIT Research Intern
umang keshri @keshriumang
25 Followers 651 Following ML Engineer | Cooking | Exploring infinity in this world of absolute perfection.
Andrea Moleri @moleriandrea
43 Followers 738 Following Machine Learning at @Honda Research Institute EU, MSc Student at @UNIMIB
Ratna Kandala @ratna_kandala
251 Followers 3K Following ICML 2025 Postdoctoral Researcher working in NLP @ University of Kansas Ph.D. in Linguistics @ IIT Hyderabad BS-MS in Systems Biology @ UoH #NLP#AI#Neuroscience
Ken Tsui @kenhktsui
143 Followers 340 Following ML engineer, researcher | VLM, LLM benchmark | Opinions are my own
Elinor🎗️ @elinorpd_
520 Followers 396 Following @MIT // researching fairness, equity, & pluralistic alignment in LLMs previously @medialab, @Mila_Quebec / @mcgillu i like language and frisbees and sunsets
Marilena Zoumpoulidi @MZoumpoulidi
0 Followers 34 Following
Mike Guerzhoy @guerzhoy
171 Followers 513 Following Personal account. Teaching-Stream Asst. Prof, @UofT EngSci and @uoftmie . Ex-: @Princeton, @inria_grenoble, @EpsonCanada, affiliate scientist @UnityHealthTO
Yue Zhang @zyflame104
3 Followers 66 Following
Yash Saxena @yashsaxena2111
4 Followers 23 Following PhD Student @UMBC | Knowledge Infused Learning | Attribution | Information Retrieval | Neurosymbolic AI
Nishant-9703 @nishant_097
27 Followers 285 Following
Harsh Desai @dreamerharsh
1 Followers 4K Following
Vanya BK @VanyaBk
34 Followers 1K Following
Anna Gausen @AnnaGausen
138 Followers 291 Following Research Scientist, Societal Impacts @AISecurityInst | PhD, AI Safety @ImperialCollege
Riccardo Cadei @riccardocadeii
180 Followers 528 Following PhD student in Causal Learning and AI @ISTA | ex @Harvard @EPFL
Michael Saxon @m2saxon
3K Followers 2K Following 🧐 Multilinguality, evals, and more for ((V)L,R)Ms & T2I 🏔️Postdoc @uw @techpolicylab 🌊NSF GRF & CS PhD @ucsbNLP 🌵ECE BS/MS @asu typomaxed pontificator
Yotam Perlitz 👾 @yotamperlitz
89 Followers 159 Following Research Scientist at @ibmresearch, Practicing #NLProc, #RL. Opinions are my own.
Amartya Hatua @amartya_hatua
42 Followers 565 Following Senior Data Scientist at Fidelity Investments
Gyuwan Kim @gyuwankim93
872 Followers 1K Following Ph.D. Candidate @ucsbcs and @ucsbNLP. Previously, @AIatMeta, @AWSAI, @Apple MLR, @MSFTResearch, @NAVER_AI_Lab, and @SeoulNatlUni.
005 @jiayi005
0 Followers 124 Following
Yzriga @Yzriga179
43 Followers 317 Following
Christian Internò @ChrisInterno
60 Followers 722 Following Researcher at @unibielefeld (@HammerLabML) and @Honda Research Institute EU, Visiting Researcher at @CSHL at the Department of Computational Neuroscience.
Anil Murthy @Anil_MurthyB
56 Followers 1K Following AI, LLMs, RL || PhD-ing in CS @SCAI_ASU || @ASU & @TAMU Aggie Alumnus || Likes to wrestle with existential questions from time to time || Sporadically here;
tao @tao33343772
5 Followers 85 Following
Duygu Ataman @_dataman_
1K Followers 445 Following Scientist/engineer working on computational models for language understanding and reasoning. Assistant professor @MetuCogSci.
Yulman Perez @Yulman_Perez
352 Followers 1K Following PhD Candidate in Energy Resources Engineering @stanford. Opinions = Mine.
Veljko Kovac @KovacVeljko
189 Followers 493 Following Tech Founder || @join_ef @AmlabUva @Cambridge_Uni
Özgür Güler @ozgurgulerx
543 Followers 2K Following Algorithmic Resistance — Human Dignity by Design #Ataturk #komorebi
trey 博士 🇭🇰 ... @Comparativist
8K Followers 7K Following currently writing/thinking about human and machine intelligence, domestication, and infrastructure on Substack while I rebuild my startup.
tony c @tonyc66993
1 Followers 562 Following
Sjoerd van Steenkiste @vansteenkiste_s
2K Followers 687 Following Researching AI models that can make sense of the world / Gemini @GoogleAI
Cozmin Ududec @CUdudec
370 Followers 2K Following @AISecurityInst Testing and Science of Evals. Ex quantum foundationalist.
Sungmin Cha @_sungmin_cha
395 Followers 271 Following Faculty Fellow @nyuniversity | PhD @SeoulNatlUni
Sai Suresh @saisuresh1999
41 Followers 209 Following Master Student @SIC_Saar in Data Science & AI Rashtrapati Scout Awardee (President Scout Awardee). Chess Player FIDE 1309(But could play like 1500+ :D).
Wes @WesleyPasfield
123 Followers 681 Following
Ash @arshiailaty
509 Followers 3K Following PhD @UCIrvine & @SDSU | EX-SWE-intern@Tesla گورستانِ ماه است شب!
Kaushik Doddamani @Kaushik_N_D
4 Followers 138 Following Masters in Data Science and AI @ IIT Madras
safir @safirgwe
36 Followers 704 Following
Sibayan Mitra @sibayan_mitra
30 Followers 73 Following Finding way through life. Believers in long term success. Interested in neurotech, machine learning, philosophy and Entrepreneurship. BITS PILANI🇮🇳
wlg @wlg64737265
3 Followers 182 Following
ibrahim ethem @satilik_karga
431 Followers 630 Following ''Bu adam bilim yapmak değil oyun oynamak istiyor'' Cognitive Science PhD Student - METU / Cognitive Science MSc - METU / Computer Engineering - Koç University
Isabela Albuquerque @isabela_alb
229 Followers 235 Following Research Scientist @DeepMind. She/her. 🇧🇷
Jason Wei @_jasonwei
98K Followers 639 Following ai researcher @meta superintelligence labs, past: openai, google 🧠
Minjoon Seo @seo_minjoon
2K Followers 578 Following Co-Founder & CEO at Config Intelligence, Associate Professor at KAIST
Xuechen Li @lxuechen
16K Followers 944 Following Previously @xai. Interested in the engineering and science for scaling. Opinions are my own. @Stanford PhD.
Nathan Lambert @natolambert
57K Followers 857 Following Figuring out AI @allen_ai, open models, RLHF, fine-tuning, etc Contact via email. Writes @interconnectsai Wrote The RLHF Book Mountain runner
Esin Durmus @esindurmusnlp
4K Followers 440 Following Researcher @anthropicai. Previously Postdoc @stanfordnlp and PhD @cornellcis. Working on large language models.
Sanmi Koyejo @sanmikoyejo
3K Followers 104 Following I lead @stai_research at Stanford. Co-founder @VirtueAI_co
NeurIPS Conference @NeurIPSConf
140K Followers 39 Following San Diego Dec 2-7, 25 and Mexico City Nov 30-Dec 5, 25. Tweets to this account are not monitored. Please send feedback to [email protected].
Diyi Yang @Diyi_Yang
18K Followers 2K Following Assistant Professor @Stanford CS @StanfordNLP @StanfordAILab LLMs for Humans
Marius Hobbhahn @MariusHobbhahn
5K Followers 1K Following CEO at Apollo Research @apolloaievals prev. ML PhD with Philipp Hennig & AI forecasting @EpochAIResearch
Nithya Attaluri @attaluri_nithya
652 Followers 827 Following research engineer @googledeepmind // @miteecs @mitcsail bs & meng ‘23 // views my own
rishi @RishiBommasani
6K Followers 2K Following Societal/economic impacts of AI; AI policy & governance @StanfordHAI Stanford CS PhD w/ @percyliang @jurafsky Cornell CS undergrad w/ @clairecardie
Yangjun Ruan @YangjunR
1K Followers 720 Following Creating @thinkymachines | Prev @UofT @stanfordAILab @VectorInst
Berivan Isik @BerivanISIK
11K Followers 1K Following Research scientist @GoogleAI. Gemini data & eval | prev: PhD @Stanford @StanfordAILabTrends for United States
You might like
