Yotam Perlitz 👾 @yotamperlitz
Research Scientist at @ibmresearch, Practicing #NLProc, #RL. Opinions are my own. perlitz.github.io Joined January 2015-
Tweets95
-
Followers89
-
Following159
-
Likes50
What a GEM!
Yotam Perlitz 👾 retweeted
A big thank you to the Unitxt team, collaborators, and our community for an incredible 2024! Together, we pushed boundaries in AI evaluation and set new standards for the field. Read our End-of-Year Summary here: unitxt.ai/en/latest/blog… #unitxt #llmevaluation
Yotam Perlitz 👾 retweeted
Another cool benchmarking paper published yesterday. In "JuStRank: Benchmarking LLM Judges for System Ranking", researchers from @IBMResearch introduced JuStRank, the first large-scale benchmark for evaluating LLM judges for ranking target systems: arxiv.org/abs/2412.09569
Yotam Perlitz 👾 retweeted
Prompting LMs is not enough to quantify their linguistic competence! Meet the Holmes🔎 benchmark at #EMNLP2024 #TACL or 👉🧵 💠Meta-study of current literature 💠Coverage of LMs and phenomena 💠Analysis of LM size, architecture, and instruction tuning holmes-benchmark.github.io
Yotam Perlitz 👾 retweeted
RAG Developer Attention! 🔔 Docling is a new library from @IBM that efficiently parses PDF, DOCX, and PPTX and exports them to Markdown and JSON. It supports advanced PDF understanding and seamless integration with @llama_index and @LangChainAI. TL;DR: 🗂️ Parses numerous…
Yotam Perlitz 👾 retweeted
Can lowercase really make or break an AI’s answer? 🤔 And what happens when an LLM ‘sees’ old TV-style white noise? 📺 We put these quirks to the test using Unitxt, showcasing the powerful, flexible testing it enables. Read on: unitxt.ai/en/latest/blog… #AI #MachineLearning #LLM
Yotam Perlitz 👾 retweeted
Scaling laws predict🦣large models by training🦟small ones, cool right? Fortunately, they are not that complicated or costly at least they don't have to be We have collected 400+ models fitted 1000+ scaling laws and created 1 guide for cheap & more reliable scaling law fitting:
Yotam Perlitz 👾 retweeted
It's been a great collaboration journey with my wonderful co-authors: @AndreasWaldis, @yotamperlitz @LChoshen, and @IGurevych. Please check it out and let us know if you'd like to see any additional functions or analyses added to the benchmark.
Get your benchmark game on: huggingface.co/spaces/ibm/ben…
Get your benchmark game on: huggingface.co/spaces/ibm/ben… https://t.co/5Y7QUz0Ype
Yotam Perlitz 👾 retweeted
1/ Into Image Captioning? Don’t miss this! Struggling to keep up with the influx of new metrics but still see the same 5 (BLEU, METEOR, ROUGE, CIDEr, SPICE) leading? Read our recent Captioning evaluation survey! arxiv.org/abs/2408.04909 w\ @GabiStanovsky @AbendOmri @leafrermann >
Me trying to choose the right LLM benchmark without BenchBench: x.com/yotamperlitz/s…
Me trying to choose the right LLM benchmark without BenchBench: x.com/yotamperlitz/s… https://t.co/DQEttklUGQ
Shoutout to @streamlit, our framework of choice! Shoutout to @huggingface for hosting our space 🤗
Shoutout to @streamlit, our framework of choice! Shoutout to @huggingface for hosting our space 🤗
Hanna Hajishirzi @HannaHajishirzi
9K Followers 445 Following Sr. Director of AI at @allen_ai, Prof at @uw_cse, lead OLMo, Tulu
Lj Flores @ljyflores38
70 Followers 159 Following Fiddling with language models @Mila_Quebec @McGill_NLP | Prev @yalenlp, @adobe (intern) | Proudly Filipino 🇵🇭
Omer Rolfson @OmerRolfso69318
18 Followers 2K Following
EV_BatteryBets🇺�... @Ofexe798688
46 Followers 2K Following 15-30% Monthly | 2 High-Conviction Stocks.Short-Term Gains: 15-20% in Days/Weeks.DM "JOIN" for WhatsApp Alerts. Live Trade Signals • Market Analysis
umlaut @barbara_rhubarb
14 Followers 598 Following
Daniel Nisnevich @DanielNisnevich
7 Followers 187 Following BSc CS @ HUJI 👨🏻💻| Interested in NLP, Deep Learning, & Model Evaluation 📝
Cassandra Hayes @HayesCassa26415
101 Followers 5K Following
Noy Sternlicht @NoySternlicht
129 Followers 482 Following PhD candidate at @nlphuji | Using NLP to help scientists 📚
Jass @ForecastVIX
137 Followers 68 Following # Random Manifols,#Forecast Reality, #Volatility #Stochastic processes #BTM.2.0 #SystematicTrading, ...sneak peek at Financial Markets...Not investment advice.
chris macrae @obamauni
338 Followers 6K Following https://t.co/se2mw8HAaT https://t.co/kxby7VjXdc https://t.co/PmxBDBw9pU 73rd year Economist & Von neumann https://t.co/RIggkciimp hod 390 ED3dao
Shahar Levy @ShaharLevy19
20 Followers 52 Following Computer Science (NLP) MSc Student @CseHuji Computer Vision Software Engineer @Corephotonics
Sebastian Gehrmann @sebgehr
6K Followers 2K Following Head of Responsible AI, CTO office, @Bloomberg. (he/him) Formerly LLMs @ Google Brain / Harvard. views my own
AI Horizons @theaihorizons
595 Followers 4K Following AI tips, tools & insights in plain English. Led by NASA & Big Tech AI experts. Trusted by 10K+ pros & early adopters
Nadav Timor @NadavTimor
1K Followers 8K Following AI inference, speculative decoding, open source. Built novel decoding algorithms – default in Hugging Face Transformers (150+ ⭐). Making AI faster + cheaper
Itay Nakash @itay__nakash
182 Followers 479 Following Research Scientists @ IBM | AI Safety | Agents, LLMs & NLP
Alex Choi @alex_choi_cs
34 Followers 182 Following student @GeorgeMasonU. NLP research with GMNLP. always curious.
Sepehr Kamahi @SepeKtacular
149 Followers 1K Following MSc-ing at University of Tehran. Interested in the Physics of Language Models.
Ofir Lindenbaum @Ofirlin
1K Followers 2K Following Assistant professor at Bar Ilan University. Primary research is Machine learning, computational biology, and signal processing.
Thijs Bergkamp @ThijsBergkamp
80 Followers 7K Following
Ah @Alonhal
5 Followers 158 Following
Michael Saxon @m2saxon
3K Followers 2K Following 🧐 Multilinguality, evals, and more for ((V)L,R)Ms & T2I 🏔️Postdoc @uw @techpolicylab 🌊NSF GRF & CS PhD @ucsbNLP 🌵ECE BS/MS @asu typomaxed pontificator
Moran Mizrahi @moranmiz
325 Followers 275 Following PhD student at @Csehuji (@HyadataLab). Interested in Natural Language Processing, Data Science, Human-Computer Interaction and Computational Creativity.
Qinyuan Ye @qinyuan_ye
2K Followers 2K Following ☁️ Research Scientist @SFResearch | 🐾 Teaching machines to be versatile and curious. | Prev @nlp_usc
Chau Minh Pham @chautmpham
474 Followers 457 Following PhD student @umdcs | Long-form Narrative Generation & Analysis | Intern @AdobeResearch @MSFTResearch
Dung Doan @dungdx34
334 Followers 7K Following
Dana Arad 🎗️ @dana_arad4
355 Followers 583 Following Working on interpretability of LLMs and VLMs. CS PhD candidate at @TechnionLive @technion_cs_nlp
Jonathan Herzig @jonherzig
387 Followers 400 Following
Leonid Karlinsky @leokarlin
250 Followers 161 Following Principal Research Scientist (STSM) @ MIT-IBM Lab @ IBM Research
Shachar Mirkin @shacharmirkin
940 Followers 952 Following Language and Natural Language Processing, mostly. PhD. Freelance AI/ML/DS/NLP consulting (applied & research)
Itay Itzhak @Itay_itzhak_
335 Followers 254 Following NLProc, deep learning, and machine learning. Ph.D. student @TechnionLive and @HebrewU
Arie Cattan @ArieCattan
491 Followers 567 Following CS Phd student at @biunlp and intern at @Google, previously @IBMResearch @allen_ai
Flor Plaza PhD @florplaza22
1K Followers 1K Following Assistant Professor at @LIACS | NLP for Social Good | #Emotions #HateSpeech #Fairness #Ethics | 🏆Awards: @scie_inform @FundacionBBVA @sepln | ☀️🥾🏔
Rostand @rkennezangue
45 Followers 532 Following Build infra for training, finetuning and serving multimodal deep learning, VLM, LLM, IR, SEARCH at web scale.
Benedikt Stroebl @benediktstroebl
918 Followers 1K Following YC S25, ex-Princeton PhD, Oxford, Google, TUM.
Harish Tayyar Madabus... @harish
2K Followers 2K Following Lecturer (~Assistant Professor) in Artificial Intelligence. Work on Deep Learning for #NLProc and Deep Contextual Meaning Representations
cathal horan @cathalhoran
720 Followers 2K Following Machine Learning Engineer @Intercom, previously @awscloud. Marathon running, existentialist techie.
Eva Louise Marie Gabr... @e681554349
11 Followers 7K Following
LLM Evals Workshop @N... @LLM_eval
131 Followers 16 Following NeurIPS 2025 Workshop. Evaluating the Evolving LLM Lifecycle: Benchmarks, Emergent Abilities, and Scaling
Christopher Potts @ChrisGPotts
14K Followers 649 Following Stanford Professor of Linguistics and, by courtesy, of Computer Science. Member of technical staff @stanfordnlp and @StanfordAILab. Co-founder @ Bigspin AI.
Interconnects @interconnectsai
7K Followers 1 Following What you need to know about AI research trends, from @natolambert Wednesday mornings weekly, sometimes extra posts.
Susan Zhang @suchenzang
34K Followers 689 Following @ Google Deepmind. Past: @MetaAI, @OpenAI, @unitygames, @losalamosnatlab, @Princeton etc. Always hungry for intelligence.
Epoch AI @EpochAIResearch
27K Followers 0 Following Investigating the trajectory of AI for the benefit of society.
Soumith Chintala @soumithchintala
252K Followers 1K Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
John Schulman @johnschulman2
65K Followers 1K Following Recently started @thinkymachines. Interested in reinforcement learning, alignment, birds, jazz music
Hanna Hajishirzi @HannaHajishirzi
9K Followers 445 Following Sr. Director of AI at @allen_ai, Prof at @uw_cse, lead OLMo, Tulu
Jack Morris @jxmnop
46K Followers 994 Following research @cornell // language models, information theory, science of AI
Yuval Abraham יוב�... @yuval_abraham
80K Followers 735 Following עיתונאי בשיחה מקומית, לרוב בגדה Journalist, 972 Magazine
Frank Noe @FrankNoeBerlin
12K Followers 548 Following Scientist, #MachineLearning and #AI for the Sciences (esp. Physics/Chemistry). Scuba Diver and Traveler.
Nan Jiang @nanjiang_cs
10K Followers 73 Following machine learning researcher, with focus on reinforcement learning. assoc prof @ uiuc cs. Course on RL theory (w/ videos): https://t.co/vqVKwY4RJE
Mengdi Wang @MengdiWang10
4K Followers 1K Following Professor @Princeton in AIML. Co-Director of #Princeton AI^2. Program Chair @ICLR2023. Formerly @MIT @GoogleDeepmind @Tsinghua. my Erdos number: 3
Aviral Kumar @aviral_kumar2
5K Followers 355 Following Assistant Professor of CS & ML at @CarnegieMellon. Part-time Research Scientist Google. PhD from UC Berkeley.
Chelsea Finn @chelseabfinn
83K Followers 399 Following Asst Prof of CS & EE @Stanford Co-founder of Physical Intelligence @physical_int PhD from @Berkeley_EECS, EECS BS from @MIT
Roger Grosse @RogerGrosse
11K Followers 795 Following
Sanmi Koyejo @sanmikoyejo
3K Followers 104 Following I lead @stai_research at Stanford. Co-founder @VirtueAI_co
David Duvenaud @DavidDuvenaud
31K Followers 4K Following Machine learning prof @UofT. Former team lead at Anthropic. Working on generative models, inference, & latent structure.
Stefano Ermon @StefanoErmon
20K Followers 374 Following AI Prof @Stanford | CEO & Cofounder @InceptionAILabs | Co-inventor of DDIM, FlashAttention, DPO, GAIL, and score-based/diffusion models
Dan Roy @roydanroy
57K Followers 2K Following ML / AI researcher. Research Director and Canada CIFAR AI Chair, @VectorInst. Professor, @UofT (Statistics/CS).
Patrick Shafto @patrickshafto
3K Followers 904 Following PM @DARPA; Prof of Math and CS @Rutgers-Newark; co-founder @ https://t.co/e6dJA2bLus; Math @the_IAS 2021-2023. https://t.co/2plDQE0s6K https://t.co/XuiVK8VmO3
Prof. Anima Anandkuma... @AnimaAnandkumar
34K Followers 2K Following "Godmother" of AI+Science, Bren Professor @caltech, Time100, Fmr Sr Director of #AI research @nvidia Fmr Principal Scientist @awscloud
Wenhu Chen @WenhuChen
23K Followers 674 Following AI researcher. Interested in Reasoning, Multimodal. I direct TIGER-Lab. Author of PoT, MMMU, MMLU-Pro, MAmmoTH, LongRAG, MAP-Neo, YuE, VL-Rethinker
Jeff Clune @jeffclune
29K Followers 431 Following Professor, CS, U. British Columbia. CIFAR AI Chair, Vector Institute. Sr. Advisor, DeepMind | ML, AI, deep RL, deep learning, AI-Generating Algorithms (AI-GAs)
Noam Brown @polynoamial
92K Followers 858 Following Researching reasoning @OpenAI | Co-created Libratus/Pluribus superhuman poker AIs, CICERO Diplomacy AI, and OpenAI o3 / o1 / 🍓 reasoning models
roeeaharoni @roeeaharoni
2K Followers 788 Following Research Scientist @GoogleAI Tel-Aviv | Phd @BIUNLP Lab
Luca Soldaini 🎀 @soldni
11K Followers 1K Following I like tokens! I lead the OLMo data team at @allen_ai w/ @kylelostat. Open source is fun 🤖☕️🍕🏳️🌈 Opinions are sampled from my own stochastic parrot
Steven Rattner @SteveRattner
121K Followers 357 Following Former head of Obama Auto Task Force. Wall Street financier. Contributing Writer to NY Times Op-Ed. Morning Joe Economic Analyst. 🌐
Luke Zettlemoyer @LukeZettlemoyer
10K Followers 2K Following
Rotem Dror @DrorRotem
323 Followers 252 Following Asst. Prof. of Natural Language Processing @UofHaifa
trailcam @Trail_Cams
187K Followers 157 Following
Sebastian Gehrmann @sebgehr
6K Followers 2K Following Head of Responsible AI, CTO office, @Bloomberg. (he/him) Formerly LLMs @ Google Brain / Harvard. views my own
Microsoft Research @MSFTResearch
560K Followers 2K Following We advance science and technology to benefit humanity.
Tatsunori Hashimoto @tatsu_hashimoto
9K Followers 198 Following Assistant Prof at Stanford CS, member of @stanfordnlp and statsml groups; Formerly at Microsoft / postdoc at Stanford CS / Stats.
Hugging Face @huggingface
567K Followers 210 Following The AI community building the future. https://t.co/VkRPD0Vclr
Lior Alexander @LiorOnAI
106K Followers 2K Following Covering the latest in AI development • ML Eng since 2017 • Building @AlphaSignalAI into the #1 source of news for AI devs → At 250k readers.
Sam Paech @sam_paech
3K Followers 201 Following Evals @LiquidAI_ Maintainer of EQ-Bench https://t.co/Jy56OlHrP5 https://t.co/oRApPQwvWS
Michael Moor @Michael_D_Moor
4K Followers 779 Following MD. PhD. Assistant Professor @ETH Zurich. Previously @Stanford CS.
Moran Mizrahi @moranmiz
325 Followers 275 Following PhD student at @Csehuji (@HyadataLab). Interested in Natural Language Processing, Data Science, Human-Computer Interaction and Computational Creativity.
Everyday Astronaut @Erdayastronaut
2.0M Followers 621 Following Professional rocket orientation specialist, explainer of flamey stuff and rocket chaser. Bringing space down to Earth for everyday people 🚀
Trends for United States
36,3 B posts
17,5 B posts
25,3 B posts
35,1 B posts
21,5 B posts
32,2 B posts
40,5 B posts
1.096 posts
330 B posts
9.741 posts
1.980 posts
17,1 B posts
6.514 posts
2.328 posts
9.029 posts
3.093 posts
6.497 posts
61 B posts
You might like
Ariel Gera
@ArielGera2
50 Followers
Gili Lior
@GiliLior
193 Followers
Asaf Yehudai
@AsafYehudai
570 Followers
Esther Shizgal
@EstherShizgal
92 Followers
Shachar Don-Yehiya
@Shachar_Don
286 Followers
Uri Berger
@uriberger88
157 Followers
Elad Granot
@eladgranot
66 Followers
Ori Ernst
@oriern1
88 Followers
HUJI NLP
@nlphuji
371 Followers
Arie Cattan
@ArieCattan
491 Followers
Elron Bandel
@ElronBandel
318 Followers
Yoel Shoshan
@YoelShoshan
68 Followers
Ben Bogin
@ben_bogin
766 Followers
Avihu Dekel
@AvihuDkl
286 Followers
Aviv Slobodkin
@lovodkin93
394 Followers