Yotam Perlitz 👾 @yotamperlitz
Research Scientist at @ibmresearch, Practicing #NLProc, #RL. Opinions are my own. perlitz.github.io Joined January 2015-
Tweets95
-
Followers89
-
Following158
-
Likes50
What a GEM!
Yotam Perlitz 👾 retweeted
A big thank you to the Unitxt team, collaborators, and our community for an incredible 2024! Together, we pushed boundaries in AI evaluation and set new standards for the field. Read our End-of-Year Summary here: unitxt.ai/en/latest/blog… #unitxt #llmevaluation
Yotam Perlitz 👾 retweeted
Another cool benchmarking paper published yesterday. In "JuStRank: Benchmarking LLM Judges for System Ranking", researchers from @IBMResearch introduced JuStRank, the first large-scale benchmark for evaluating LLM judges for ranking target systems: arxiv.org/abs/2412.09569
Yotam Perlitz 👾 retweeted
Prompting LMs is not enough to quantify their linguistic competence! Meet the Holmes🔎 benchmark at #EMNLP2024 #TACL or 👉🧵 💠Meta-study of current literature 💠Coverage of LMs and phenomena 💠Analysis of LM size, architecture, and instruction tuning holmes-benchmark.github.io
Yotam Perlitz 👾 retweeted
RAG Developer Attention! 🔔 Docling is a new library from @IBM that efficiently parses PDF, DOCX, and PPTX and exports them to Markdown and JSON. It supports advanced PDF understanding and seamless integration with @llama_index and @LangChainAI. TL;DR: 🗂️ Parses numerous…
Yotam Perlitz 👾 retweeted
Can lowercase really make or break an AI’s answer? 🤔 And what happens when an LLM ‘sees’ old TV-style white noise? 📺 We put these quirks to the test using Unitxt, showcasing the powerful, flexible testing it enables. Read on: unitxt.ai/en/latest/blog… #AI #MachineLearning #LLM
Yotam Perlitz 👾 retweeted
Scaling laws predict🦣large models by training🦟small ones, cool right? Fortunately, they are not that complicated or costly at least they don't have to be We have collected 400+ models fitted 1000+ scaling laws and created 1 guide for cheap & more reliable scaling law fitting:
Yotam Perlitz 👾 retweeted
It's been a great collaboration journey with my wonderful co-authors: @AndreasWaldis, @yotamperlitz @LChoshen, and @IGurevych. Please check it out and let us know if you'd like to see any additional functions or analyses added to the benchmark.
Get your benchmark game on: huggingface.co/spaces/ibm/ben…
Get your benchmark game on: huggingface.co/spaces/ibm/ben… https://t.co/5Y7QUz0Ype
Yotam Perlitz 👾 retweeted
1/ Into Image Captioning? Don’t miss this! Struggling to keep up with the influx of new metrics but still see the same 5 (BLEU, METEOR, ROUGE, CIDEr, SPICE) leading? Read our recent Captioning evaluation survey! arxiv.org/abs/2408.04909 w\ @GabiStanovsky @AbendOmri @leafrermann >
Me trying to choose the right LLM benchmark without BenchBench: x.com/yotamperlitz/s…
Me trying to choose the right LLM benchmark without BenchBench: x.com/yotamperlitz/s… https://t.co/DQEttklUGQ
Shoutout to @streamlit, our framework of choice! Shoutout to @huggingface for hosting our space 🤗
Shoutout to @streamlit, our framework of choice! Shoutout to @huggingface for hosting our space 🤗
Cuijat @Cuijat582310
25 Followers 2K Following
Hanna Hajishirzi @HannaHajishirzi
9K Followers 443 Following Sr. Director of AI at @allen_ai, Prof at @uw_cse, lead OLMo, Tulu
Lj Flores @ljyflores38
71 Followers 156 Following Fiddling with language models @Mila_Quebec @McGill_NLP | Prev @yalenlp, @adobe (intern) | Proudly Filipino 🇵🇭
Omer Rolfson @OmerRolfso69318
23 Followers 2K Following
EV_BatteryBets🇺�... @Ofexe798688
43 Followers 2K Following 15-30% Monthly | 2 High-Conviction Stocks.Short-Term Gains: 15-20% in Days/Weeks.DM "JOIN" for WhatsApp Alerts. Live Trade Signals • Market Analysis
umlaut @barbara_rhubarb
13 Followers 596 Following
Daniel Nisnevich @DanielNisnevich
8 Followers 187 Following BSc CS @ HUJI 👨🏻💻| Interested in NLP, Deep Learning, & Model Evaluation 📝
Cassandra Hayes @HayesCassa26415
86 Followers 4K Following
Noy Sternlicht @NoySternlicht
125 Followers 476 Following PhD candidate at @nlphuji | Using NLP to help scientists 📚
Jass @ForecastVIX
140 Followers 67 Following # Random Manifols,#Forecast Reality, #Volatility #Stochastic processes #BTM.2.0 #SystematicTrading, ...sneak peek at Financial Markets...Not investment advice.
chris macrae @obamauni
340 Followers 6K Following https://t.co/se2mw8HAaT https://t.co/kxby7VjXdc https://t.co/PmxBDBw9pU 73rd year Economist & Von neumann https://t.co/RIggkciimp hod 390 ED3dao
Shahar Levy @ShaharLevy19
20 Followers 52 Following Computer Science (NLP) MSc Student @CseHuji Computer Vision Software Engineer @Corephotonics
Sebastian Gehrmann @sebgehr
6K Followers 2K Following Head of Responsible AI, CTO office, @Bloomberg. (he/him) Formerly LLMs @ Google Brain / Harvard. views my own
AI Horizons @theaihorizons
589 Followers 4K Following AI tips, tools & insights in plain English. Led by NASA & Big Tech AI experts. Trusted by 10K+ pros & early adopters
Nadav Timor @NadavTimor
857 Followers 7K Following AI inference, speculative decoding, open source. Built novel decoding algorithms – default in Hugging Face Transformers (149k+ ⭐). Making AI faster + cheaper
Itay Nakash @itay__nakash
181 Followers 476 Following Research Scientists @ IBM | AI Safety | Agents, LLMs & NLP
Alex Choi @alex_choi_cs
34 Followers 182 Following student @GeorgeMasonU. NLP research with GMNLP. always curious.
Sepehr Kamahi @SepeKtacular
147 Followers 2K Following MSc-ing at University of Tehran. Interested in the Physics of Language Models.
Ofir Lindenbaum @Ofirlin
1K Followers 2K Following Assistant professor at Bar Ilan University. Primary research is Machine learning, computational biology, and signal processing.
Thijs Bergkamp @ThijsBergkamp
81 Followers 7K Following
Ah @Alonhal
5 Followers 151 Following
Michael Saxon @m2saxon
3K Followers 2K Following 🧐 Multilinguality, evals, and more for ((V)L,R)Ms & T2I 🔜🏔️Postdoc @uw @techpolicylab 🌊NSF GRF & CS PhD @ucsbNLP 🌵ECE BS/MS @asu typomaxed pontificator
Moran Mizrahi @moranmiz
323 Followers 275 Following PhD student at @Csehuji (@HyadataLab). Interested in Natural Language Processing, Data Science, Human-Computer Interaction and Computational Creativity.
Qinyuan Ye @qinyuan_ye
2K Followers 2K Following ☁️ Research Scientist @SFResearch | 🐾 Teaching machines to be versatile and curious. | Prev @nlp_usc
Chau Minh Pham @chautmpham
469 Followers 457 Following PhD student @umdcs | Long-form Narrative Generation & Analysis | Intern @AdobeResearch @MSFTResearch
Dung Doan @dungdx34
333 Followers 8K Following
Dana Arad 🎗️ @dana_arad4
341 Followers 575 Following Working on interpretability of LLMs and VLMs. CS PhD candidate at @TechnionLive @technion_cs_nlp
Jonathan Herzig @jonherzig
387 Followers 399 Following
Leonid Karlinsky @leokarlin
249 Followers 159 Following Principal Research Scientist (STSM) @ MIT-IBM Lab @ IBM Research
Shachar Mirkin @shacharmirkin
938 Followers 952 Following Language and Natural Language Processing, mostly. PhD. Freelance AI/ML/DS/NLP consulting (applied & research)
Itay Itzhak @Itay_itzhak_
334 Followers 252 Following NLProc, deep learning, and machine learning. Ph.D. student @TechnionLive and @HebrewU
Arie Cattan @ArieCattan
483 Followers 566 Following CS Phd student at @biunlp and intern at @Google, previously @IBMResearch @allen_ai
Flor Plaza PhD @florplaza22
1K Followers 1K Following Assistant Professor at @LIACS | NLP for Social Good | #Emotions #HateSpeech #Fairness #Ethics | 🏆Awards: @scie_inform @FundacionBBVA @sepln | ☀️🥾🏔
Rostand @rkennezangue
42 Followers 532 Following Build infra for training, finetuning and serving multimodal deep learning, VLM, LLM, IR, SEARCH at web scale.
Benedikt Stroebl @benediktstroebl
886 Followers 1K Following co-founder and cto at Rid (YC S25), ex-Princeton, Oxford, Google, TUM. @sellwithatext
Harish Tayyar Madabus... @harish
2K Followers 2K Following Lecturer (~Assistant Professor) in Artificial Intelligence. Work on Deep Learning for #NLProc and Deep Contextual Meaning Representations
cathal horan @cathalhoran
721 Followers 2K Following Machine Learning Engineer @Intercom, previously @awscloud. Marathon running, existentialist techie.
Eva Louise Marie Gabr... @e681554349
11 Followers 7K Following
LLM Evals Workshop @N... @LLM_eval
110 Followers 16 Following NeurIPS 2025 Workshop. Evaluating the Evolving LLM Lifecycle: Benchmarks, Emergent Abilities, and Scaling
Christopher Potts @ChrisGPotts
14K Followers 643 Following Stanford Professor of Linguistics and, by courtesy, of Computer Science. Member of technical staff @stanfordnlp and @StanfordAILab. Co-founder @ Bigspin AI.
Interconnects @interconnectsai
7K Followers 1 Following What you need to know about AI research trends, from @natolambert Wednesday mornings weekly, sometimes extra posts.
Susan Zhang @suchenzang
33K Followers 650 Following @ Google Deepmind. Past: @MetaAI, @OpenAI, @unitygames, @losalamosnatlab, @Princeton etc. Always hungry for intelligence.
Epoch AI @EpochAIResearch
27K Followers 7 Following Investigating the trajectory of AI for the benefit of society.
Soumith Chintala @soumithchintala
250K Followers 1K Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
John Schulman @johnschulman2
65K Followers 1K Following Recently started @thinkymachines. Interested in reinforcement learning, alignment, birds, jazz music
Hanna Hajishirzi @HannaHajishirzi
9K Followers 443 Following Sr. Director of AI at @allen_ai, Prof at @uw_cse, lead OLMo, Tulu
Jack Morris @jxmnop
45K Followers 980 Following research @cornell @meta // language models, information theory, science of AI
Yuval Abraham יוב�... @yuval_abraham
78K Followers 735 Following עיתונאי בשיחה מקומית, לרוב בגדה Journalist, 972 Magazine
Frank Noe @FrankNoeBerlin
12K Followers 547 Following Scientist, #MachineLearning and #AI for the Sciences (esp. Physics/Chemistry). Scuba Diver and Traveler.
Nan Jiang @nanjiang_cs
10K Followers 73 Following machine learning researcher, with focus on reinforcement learning. assoc prof @ uiuc cs. Course on RL theory (w/ videos): https://t.co/vqVKwY4RJE
Mengdi Wang @MengdiWang10
4K Followers 1K Following Professor @Princeton in AIML. Co-Director of #Princeton AI^2. Program Chair @ICLR2023. Formerly @MIT @GoogleDeepmind @Tsinghua. my Erdos number: 3
Aviral Kumar @aviral_kumar2
5K Followers 355 Following Assistant Professor of CS & ML at @CarnegieMellon. Part-time Research Scientist Google. PhD from UC Berkeley.
Chelsea Finn @chelseabfinn
82K Followers 399 Following Asst Prof of CS & EE @Stanford Co-founder of Physical Intelligence @physical_int PhD from @Berkeley_EECS, EECS BS from @MIT
Roger Grosse @RogerGrosse
11K Followers 798 Following
Sanmi Koyejo @sanmikoyejo
3K Followers 104 Following I lead @stai_research at Stanford. Co-founder @VirtueAI_co
David Duvenaud @DavidDuvenaud
31K Followers 4K Following Machine learning prof @UofT. Former team lead at Anthropic. Working on generative models, inference, & latent structure.
Stefano Ermon @StefanoErmon
20K Followers 373 Following AI Prof @Stanford | CEO & Cofounder @InceptionAILabs | Co-inventor of DDIM, FlashAttention, DPO, GAIL, and score-based/diffusion models
Dan Roy @roydanroy
57K Followers 2K Following ML / AI researcher. Research Director and Canada CIFAR AI Chair, @VectorInst. Professor, @UofT (Statistics/CS).
Patrick Shafto @patrickshafto
3K Followers 881 Following PM @DARPA; Prof of Math and CS @Rutgers-Newark; co-founder @ https://t.co/e6dJA2bLus; Math @the_IAS 2021-2023. https://t.co/2plDQE0s6K https://t.co/XuiVK8VmO3
Prof. Anima Anandkuma... @AnimaAnandkumar
34K Followers 2K Following Bren Professor @caltech, Time100, Fmr Sr Director of #AI research @nvidia Fmr Principal Scientist @awscloud
Wenhu Chen @WenhuChen
22K Followers 666 Following AI researcher. Interested in Reasoning, Multimodal. I direct TIGER-Lab. Author of PoT, MMMU, MMLU-Pro, MAmmoTH, LongRAG, MAP-Neo, YuE, VL-Rethinker
Jeff Clune @jeffclune
29K Followers 431 Following Professor, CS, U. British Columbia. CIFAR AI Chair, Vector Institute. Sr. Advisor, DeepMind | ML, AI, deep RL, deep learning, AI-Generating Algorithms (AI-GAs)
rohan anil @_arohan_
25K Followers 2K Following
Noam Brown @polynoamial
91K Followers 852 Following Researching reasoning @OpenAI | Co-created Libratus/Pluribus superhuman poker AIs, CICERO Diplomacy AI, and OpenAI o3 / o1 / 🍓 reasoning models
roeeaharoni @roeeaharoni
2K Followers 782 Following Research Scientist @GoogleAI Tel-Aviv | Phd @BIUNLP Lab
Luca Soldaini 🎀 @soldni
11K Followers 1K Following I like tokens! I lead the OLMo data team at @allen_ai w/ @kylelostat. Open source is fun 🤖☕️🍕🏳️🌈 Opinions are sampled from my own stochastic parrot
Steven Rattner @SteveRattner
121K Followers 357 Following Former head of Obama Auto Task Force. Wall Street financier. Contributing Writer to NY Times Op-Ed. Morning Joe Economic Analyst. 🌐
Luke Zettlemoyer @LukeZettlemoyer
10K Followers 2K Following
Rotem Dror @DrorRotem
325 Followers 252 Following Asst. Prof. of Natural Language Processing @UofHaifa
trailcam @Trail_Cams
185K Followers 155 Following
Sebastian Gehrmann @sebgehr
6K Followers 2K Following Head of Responsible AI, CTO office, @Bloomberg. (he/him) Formerly LLMs @ Google Brain / Harvard. views my own
Microsoft Research @MSFTResearch
561K Followers 2K Following We advance science and technology to benefit humanity.
Tatsunori Hashimoto @tatsu_hashimoto
8K Followers 198 Following Assistant Prof at Stanford CS, member of @stanfordnlp and statsml groups; Formerly at Microsoft / postdoc at Stanford CS / Stats.
Hugging Face @huggingface
560K Followers 210 Following The AI community building the future. https://t.co/VkRPD0Vclr
Lior⚡ @LiorOnAI
106K Followers 2K Following Covering the latest in AI development • ML Eng since 2017 • Building @AlphaSignalAI into the #1 source of news for AI devs → At 250k readers.
Michael Moor @Michael_D_Moor
4K Followers 776 Following MD. PhD. Assistant Professor @ETH Zurich. Previously @Stanford CS.
Moran Mizrahi @moranmiz
323 Followers 275 Following PhD student at @Csehuji (@HyadataLab). Interested in Natural Language Processing, Data Science, Human-Computer Interaction and Computational Creativity.
Everyday Astronaut @Erdayastronaut
2.0M Followers 619 Following Professional rocket orientation specialist, explainer of flamey stuff and rocket chaser. Bringing space down to Earth for everyday people 🚀
Mandar ✨ @mandarsharma
1K Followers 771 Following Powered by anxiety™. Gemini @Google. PhD @VirginiaTech. IOE Pulchowk alum. I was doing NLP before BERT.Trends for United States
126 B posts
33,9 B posts
27,3 B posts
17,6 B posts
13 B posts
76,6 B posts
4.674 posts
4.319 posts
9.488 posts
1.533 posts
2.678 posts
62,8 B posts
4.778 posts
2.716 posts
2.098 posts
1.710 posts
2.463 posts
You might like
Gili Lior
@GiliLior
190 Followers
matan orbach
@MatanOrbach
22 Followers
Asaf Yehudai @IJCAI �...
@AsafYehudai
559 Followers
Esther Shizgal
@EstherShizgal
91 Followers
Uri Berger
@uriberger88
153 Followers
Roy Bar Haim
@RoyBarHaim
43 Followers
Elad Granot
@eladgranot
65 Followers
Ori Ernst
@oriern1
86 Followers
HUJI NLP
@nlphuji
367 Followers
Arie Cattan
@ArieCattan
483 Followers
Elron Bandel
@ElronBandel
316 Followers
Or Tal
@Or__Tal
154 Followers
Yoel Shoshan
@YoelShoshan
67 Followers
Ben Bogin
@ben_bogin
758 Followers
Avihu Dekel
@AvihuDkl
287 Followers