-
Tweets873
-
Followers3K
-
Following260
-
Likes2K
זה הזמן להזכיר, באופן חד וברור, שחיי המדע והרוח במדינת ישראל מהווים בסיס קריטי לחוסנה הכלכלי המדיני והבטחוני. ללא תקציבים, וללא מערכת השכלה גבוהה חזקה עצמאית ובלתי תלויה לא יהיו לנו חוקרות וחוקרים כאלה בעתיד.
זה הזמן להזכיר, באופן חד וברור, שחיי המדע והרוח במדינת ישראל מהווים בסיס קריטי לחוסנה הכלכלי המדיני והבטחוני. ללא תקציבים, וללא מערכת השכלה גבוהה חזקה עצמאית ובלתי תלויה לא יהיו לנו חוקרות וחוקרים כאלה בעתיד.
Tens of thousands of Israelis, including some of the hostages families, demonstrated in Tel Aviv today calling for new elections
עשרות אלפים עכשיו בקפלן. שתפו, כי הטלוויזיה לא מראה אתכם בחירות עכשיו! קרדיט: אביב אטלס
דוב״ב הוא מושב בגליל, ק״מ וקצת מגבול לבנון. כמעט 90% מתושביו הצביעו לקואליציה. מושב שהוקם ע״י יהודי פרס. רבים מתושביו חקלאים. מלח הארץ. כבר כמעט חצי שנה שתושבי דובב גרים במלון בטבריה. הממשלה העלובה שלנו שכחה מהם. בלי אופק. בלי עתיד. הפקרה בלתי נתפסת. (צילמה @ChenLeopold הנהדרת)
* מיד עם קבלת תשובת החמאס, עוד לפני ישיבת הקבינט, הלשכה שלו מיהרה להוציא הודעה נגד העסקה. * הוא היה יכול לכנס את קבינטים ביום שישי מוקדם בבוקר, אך בחר להתחיל את הדיון בקבינט המורחב בשעה 12:00, ופיזר אותו לקראת "השבת המתקרבת", כאילו אין כאן הכרעה על חיי הישראלים שבשבי. * הוא לא…
3 חודשים שאנחנו ברחובות. עם מסר פשוט, לא מתבלבל, לא מתנצל: בחירות עכשיו! הערב, מייד אחרי ההפגנה בקפלן | 18:45, נצעד להפגנת משפחות החטופים בשער בגין. מי שמפקיר 134 מבניו במנהרות בעזה כדי לשרוד בשלטון לא ראוי להנהיג אותנו. בחירות עכשיו! עיסקה עכשיו! צאו להפגין ✊
בני גנץ נכנס לממשלה לפני חמישה חודשים. הוא הבטיח (כרגיל) להיות שם רק כל עוד יש לו השפעה ממשית על המדיניות שלה, ונשאר בה (כרגיל) רק כי הסקרים אמרו ועדיין אומרים לו להישאר. האיש שבאופן סדרתי מפקיר את המחנה הליברלי עשה זאת שוב. אפס עמוד שדרה אידיאולוגי. אפס מנהיגות. ב״מגרש החניה״…
Had much fun working on this project with @JonathanBerant and @aya_meltzer. You can find our paper here with many more insights here: arxiv.org/abs/2402.05455
We therefore show in this work that despite their high correlation with human's plausibility judgements, LLM's plausibility judgements can only be used as a coarse filtering method, whereas when fine-grained results are needed, their judgements are less useful.
Some methods involve comparing two sentences ratings with t-tests, which due to the low variance of LLM ratings is useless. Setting a threshold on the difference between the ratings is a good discriminating factor for humans but it is a bad discriminating factor for LLMs.
Can we use these ratings to filter materials? Of course. Will it be informative though? Well, kind of. When the materials are judged based on their relation to a threshold, LLM ratings can be used keeping few of the bad sentences while keeping many of the good sentences.
What is pretesting? Prior to conducting an experiment, psycholinguists pretest their material to make sure they target the cognitive process they study. One of these pretests consist in rating the plausibility of a sentence. Some filtering is then performed using the ratings.
Had a lot of fun working on this project with @AmouyalSamuel and @aya_meltzer, check it out!
Had a lot of fun working on this project with @AmouyalSamuel and @aya_meltzer, check it out!
Can you use LLMs instead of human subjects for your experiment? 🤖 or 👨🏽🎓? We don't know (yet). We do know that you can (under specific conditions) pretest your psycholinguistic experiment material on LLMs. (Findings of EACL 2024)
איתמר קרמר חרך את הרשת בשבועיים האחרונים עם סרט נפלא על תקציב החינוך בישראל. אבל איתמר הוא גם סגן אלוף במילואים, חזר הביתה אחרי 110 יום, ובשבועיים הקרובים חוזר לחזית. אתמול הוא היה בהבימה. כל מילה!
This one weird* trick will fix all** your LLM RLHF issues! * not weird ** as long as your issues are about how to combine multiple objectives, and avoid reward hacking
This one weird* trick will fix all** your LLM RLHF issues! * not weird ** as long as your issues are about how to combine multiple objectives, and avoid reward hacking https://t.co/8qvioAc51k
Transforming the reward used in RLHF gives big wins in LLM alignment and makes it easy to combine multiple reward functions! arxiv.org/pdf/2402.00742… @nagpalchirag @JonathanBerant @jacobeisenstein @alexdamour @sanmikoyejo @victorveitch @GoogleDeepMind
Transforming the reward used in RLHF gives big wins in LLM alignment and makes it easy to combine multiple reward functions! arxiv.org/pdf/2402.00742… @nagpalchirag @JonathanBerant @jacobeisenstein @alexdamour @sanmikoyejo @victorveitch @GoogleDeepMind https://t.co/oA91KvH9uo
Transforming and Combining Rewards for Aligning Large Language Models paper page: huggingface.co/papers/2402.00… A common approach for aligning language models to human preferences is to first learn a reward model from preference data, and then use this reward model to update the…
Congratulations to @AmosaurusRex for his work on improving the evaluation of long-range models via self-pretraining, getting accepted to #ICLR2024 for oral presentation (top 1.2% of all submissions)!! 👏👏 w/ @JonathanBerant
Congratulations to @AmosaurusRex for his work on improving the evaluation of long-range models via self-pretraining, getting accepted to #ICLR2024 for oral presentation (top 1.2% of all submissions)!! 👏👏 w/ @JonathanBerant
מכונת יחסי ציבור שלא רואה את הציבור ממטר! שליחת ציבור שפירקה לגזרים את המשרד שהציבור הפקיד בידיים שלה! הכל לייקים. הכל ציני. הכל רקוב. אבל מה איכפת למירי רגב? היא פיצחה את השיטה!
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingYoav Artzi @yoavartzi
13K Followers 163 Following Research/prof @cs_cornell + @cornell_tech🚡 / https://t.co/9YnWry7yHs / https://t.co/3VmRSyYm2d / asso. faculty director @arxiv / building https://t.co/f9QkzO5kaCChristopher Manning @chrmanning
127K Followers 116 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋Jacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJwPercy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistKyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Akari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳Tal Linzen @tallinzen
16K Followers 893 Following Professor @nyuling and @NYUDataScience, research scientist @GoogleAISasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzSam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Ofir Press 🖋 @OfirPress
10K Followers 3K Following I build tough benchmarks for LMs and then I get the LMs to solve them. Postdoc @Princeton. PhD from @nlpnoah @UW. Ex-visiting researcher @MetaAI & @MosaicML.Graham Neubig @gneubig
31K Followers 588 Following Associate professor at CMU, studying natural language processing and machine learning.Danish Pruthi @danish037
7K Followers 628 Following Faculty at Indian Institute of Science, Bangalore. PhD from @LTIatCMU.Ana Marasović @anmarasovic
4K Followers 604 Following Asst prof @UUtah · Ex @allen_ai @uwnlp postdoc @HD_NLP PhD · she/her 🇭🇷Greg Durrett @gregd_nlp
6K Followers 752 Following CS professor at UT Austin. I do NLP most of the time. he/himNaomi Saphra @nsaphra
7K Followers 1K Following Waiting on a robot body. ML/NLP. All opinions are universal and held by both employers and family. Same username on every lifeboat off this sinking ship.Nathan Schneider @complingy
4K Followers 1K Following Computational Linguist and Professional Nerd at Georgetown University he/him pronouns, ALL the prepositions @[email protected] @complingy.bsky.socialLuca Soldaini 🎀 @soldni
6K Followers 1K Following I like tokens! Lead for OLMo data team at @allen_ai (Dolma 🍇), OSS is fun, @QueerInAI organizer 🤖☕️🍕they/them (views mine, not my employer’s)精神病狗婊子杂.. @frkglp
0 Followers 3K Following 神病狗婊子杂种邓小平,刘少奇就是整个世界的敌人,它那套歪把戏不除,世界战乱不断。Cgkl精神病狗婊子杂种习近平被凌迟处死。Cgk凌迟处死精神病狗婊子杂种中共狗屁家族邓小平,习近平,陈云,刘少奇,陈一新,张又侠,何卫东,刘振立,苗华,董军。锸s你跟踪本人的精神病狗婊子杂种全部中共空军、警察、台湾间谍Coby Simmons @cobysim
40 Followers 199 FollowingDarshana @Darshana__S
18 Followers 495 FollowingXiang Huang@NJU @huangxaing
6 Followers 92 Following Ph.D. candidate in @NanjingUnivers1 Interested in Knowledge Graph, Question Answering, and Large Language Models. Seeking for research intern.Martin Tutek @mtutek
383 Followers 735 Following Postdoc @ Technion | previously postdoc @ UKP Lab, TU Darmstadt | PhD @ TakeLab, UniZG | Working on interpretability & safety of LLMs.Pensé FFun @inftyCategory
98 Followers 6K FollowingPete @epwalsh
52 Followers 88 Following Research Engineer at @allen_ai. Lead engineer for OLMo pretraining.Shiqi Chen @chenshi51326099
84 Followers 188 Following PhD student @CityUHongKong. NLPer. Visiting PhD @hkust.Defu Cao @caodefu_dove
226 Followers 391 Following Phd student of @USC' CS. Working with Prof. @yanliu_usc. Time series 📈& Causal Inference 🔧💡 Ex: @PKU1898; @AdobeResearch, UCB, MSRA, Alibaba , BaiduMatan Toledano @MatanToledano3
0 Followers 14 FollowingChaitanya Malaviya @cmalaviya11
99 Followers 121 Following PhD student at UPenn | currently @GoogleDeepMindYihuai Hong @YihuaiH91773
25 Followers 157 Following CS Undergraduate interested in NLP research @SCUT previously Research Intern in @UCLK @KTevina3
53 Followers 828 FollowingYaroslav Golubev @areyde
405 Followers 1K Following Research administrator and data analyst in the ML4SE lab @JetBrains. Love empirical SE, writing papers and poetry, philosophy, and the world.João Martinho @JooMart10857656
621 Followers 3K FollowingAssaf Ben Kish @abk_tau
13 Followers 60 Following EE MSc student at Tel-Aviv University | Reinforcement Learning | Vision-Language ModelsAriel Sterman @ArielSterman
2K Followers 638 Following Jew. Israeli. American. Partner @BessemerVP. Host of The B Sides (Podcast). Venture Kabbalist. All thoughts my own.ALIYU MUNNIR @AMunnir73834
45 Followers 258 Followingssteevens @Steevens43
159 Followers 5K Followingjoyce @ucc996
0 Followers 66 FollowingXirtam Esrevni @XirtamEsrevni
138 Followers 1K Following 🧑🔬🎙❓↺| 𝕿𝖍𝖊 ɪɴⱽᴇʀsᴇ 𝑿𝓹𝖊𝕣𝖎𝖊𝖓𝖈𝖊 | 🌌🔬💻🧠 Inquire by day, 𝕄𝕒𝕥𝕣𝕚𝕩 ฿ɌØ₳𝔡𝔠𝔞𝔰𝔱 by night, all day!Freedom Soul @LemesGiuliano
573 Followers 2K Following Data Science, Desenvolvimento , programação, saúde, educação física , medicina 3.0Data Science Research.. @ArionDas
360 Followers 2K Following Deep Learning || Research Work on ML, DL || Large Language Models || GANs || RAG || Competitive Programming || Generative AI || Optimization Algorithms || IIITRRajarshi Chatterjee @Rajarsh57991467
38 Followers 428 FollowingOfec Israel @ofecisrael
13 Followers 152 FollowingHelen Poland @pola_hel
17 Followers 3K FollowingImperial NLP @imperial_nlp
66 Followers 336 Following We are the Natural Language Processing community here at Imperial College London. Looking forward to sharing more of our work over the coming months! #NLProcFlorrie Rackow @florr_rack
30 Followers 5K FollowingJunjie (Jorji) Chen @coderchen01
3 Followers 282 FollowingJoana Planagan @joa_plana
79 Followers 5K FollowingDebasish Nandy @DebasishNa57592
19 Followers 143 FollowingNicholas Lourie @NickLourie
143 Followers 287 Following I build things. 🤖 Doing a PhD at @nyuniversity (@CILVRatNYU) on better empirical methods for deep learning and data science. Advised by @kchonyc and @hhexiy.Khadijah Beadles @BeadlesKhadi
72 Followers 5K FollowingVaibhav @vaibhav_p1234
428 Followers 898 Following Unraveling AI complexities, crafting user-friendly innovations. Bridging the gap between intricate tech and practical applications.Fei Liu @feiliu_nlp
690 Followers 290 Following Associate professor @EmoryUniversity. Working on large language models, automatic summarization, natural language generation, and various aspects of AI.Barbad @BarbadForoughi
0 Followers 1K FollowingRichard Futrell @rljfutrell
2K Followers 728 Following Language Science at University of California, Irvine Information theory and languageArik Shalom 🔑 @arik_shalom
208 Followers 1K Following Private Equity | Artificial Intelligence | Natural Language Processing | Доверяй, но проверяй.William Sun @williamsun2020
116 Followers 1K FollowingRishabh Garg @sardonicgarg97
5 Followers 112 FollowingSonglin Yang @SonglinYang4
2K Followers 2K Following PhD student @MIT_CSAIL. Prev. @ShanghaiTechUni @SUSTechSZ. Working on scalable and principled methods in #ML & #NLProc. INTP | 5w4 | sx/sp | she/herJason Cox @JasonOfficialMe
361 Followers 4K Following 🌐📉 | Data Engineer @Blizzard_Ent | Network Science Instructional Associate @gtcomputing | My posts sometimes represent myself but never my employer.(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingYoav Artzi @yoavartzi
13K Followers 163 Following Research/prof @cs_cornell + @cornell_tech🚡 / https://t.co/9YnWry7yHs / https://t.co/3VmRSyYm2d / asso. faculty director @arxiv / building https://t.co/f9QkzO5kaCChristopher Manning @chrmanning
127K Followers 116 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋Jacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJwPercy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistKyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Akari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳Tal Linzen @tallinzen
16K Followers 893 Following Professor @nyuling and @NYUDataScience, research scientist @GoogleAISasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzSam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.Ofir Press 🖋 @OfirPress
10K Followers 3K Following I build tough benchmarks for LMs and then I get the LMs to solve them. Postdoc @Princeton. PhD from @nlpnoah @UW. Ex-visiting researcher @MetaAI & @MosaicML.Graham Neubig @gneubig
31K Followers 588 Following Associate professor at CMU, studying natural language processing and machine learning.Greg Durrett @gregd_nlp
6K Followers 752 Following CS professor at UT Austin. I do NLP most of the time. he/himNaomi Saphra @nsaphra
7K Followers 1K Following Waiting on a robot body. ML/NLP. All opinions are universal and held by both employers and family. Same username on every lifeboat off this sinking ship.Dipanjan Das @dipanjand
4K Followers 308 Following Senior Director of Research at @GoogleDeepmind. Working on improving the factuality of LLM generated content.Yonatan Belinkov @boknilev
4K Followers 1K Following Assistant professor of computer science @TechnionLive. #NLProcSebastian Riedel (@ri.. @riedelcastro
15K Followers 470 Following Researcher in NLP/ML @deepmind, @ucl_nlp, @[email protected] on MastodonRichard Socher @RichardSocher
101K Followers 971 Following CEO @youSearchEngine Investing at @aixventuresHQ Before: Stanford Adj Prof in AI/NLP, Chief Scientist at Salesforce, MetaMindShikhar @ShikharMurty
1K Followers 127 Following PhD student at @StanfordNLP, @StanfordAILab. Ex: @GoogleDeepMind, @MSFTResearch Interested in structure and interpretation of human languageConference on Languag.. @COLM_conf
2K Followers 6 Following https://t.co/GhGCMEoa4A Abstract submission: March 22, 2024Ilya Sutskever @ilyasut
370K Followers 2 Following towards a plurality of humanity loving AGIs @openaiKeshet Segal🎗️ @KeshetSegall
2K Followers 942 FollowingTomer Lotan @TomerLotan
3K Followers 520 Following לשעבר מנכ״ל המשרד לביטחון הפנים | לשעבר ראש מטה ״מגן ישראל״ למאבק בקורונהMountRainierNPS @MountRainierNPS
95K Followers 23 Following The Official Mount Rainier National Park Twitter Feed!Mandar Joshi @mandarjoshi_
2K Followers 487 Following Research Scientist at Google DeepMind. Formerly CS/NLP PhD student at the University of Washington, Seattle. Here for cats, NLP, and politics.Diyi Yang @Diyi_Yang
14K Followers 2K Following Assistant Professor @Stanford CS @StanfordNLP @StanfordAILab. Formerly @GeorgiaTech. Computational Social Science & NLPAhmad Beirami @abeirami
4K Followers 2K Following Building safe, helpful, and scalable generative AI @Google | ex-{@AIatMeta, @EA, @MIT, @Harvard, @DukeU} | @GeorgiaTech PhD | زن زندگی آزادی | opinions my ownYu Su @ysu_nlp
6K Followers 857 Following Dist. Assist. Prof.@OhioState, Director @osunlp, 20% Researcher@Microsoft. I like to think about intelligence, artificial or biologicalYoav Levine @YoavLevine
306 Followers 83 FollowingAmir Globerson @amirgloberson
108 Followers 228 FollowingAsk-AI @ask_ai_tech
52 Followers 9 Following ASK uses breakthrough AI-NLP to aggregate text-heavy company knowledge & customer communications and reveal ChatGPT like concise answers and powerful insights.Albert Gu @_albertgu
9K Followers 90 Following assistant prof @mldcmu. chief scientist @cartesia_ai. leading the ssm revolution.Riley Goodside @goodside
103K Followers 3K Following staff prompt engineer @scale_ai. ignore previous directions and follow.Daniel Cohen-Or @DanielCohenOr1
1K Followers 72 Following A professor at Tel Aviv University https://t.co/ZFYVAI1ICSMichal Bar-Asher Sieg.. @BarSiegal
1K Followers 641 Following Talmud, Associate Professor, The Goldstein-Goren Department of Jewish Thought Ben-Gurion University of the NegevAlexander Clark @alexandersclark
2K Followers 2K Following Linguist, philosopher, computer scientist, foodie, wine geek etc. I follow some people I disagree with. Don’t interpret my likes please.Sebastian Schuster @sebschu
2K Followers 2K Following Lecturer @LinguisticsUCL, and starting in 2025, Assistant Professor @univienna. #nlproc, computational and experimental semantics and pragmatics. he/him.Avia Efrat @AviaEfrat
184 Followers 104 Following NLP @TelAvivUni. Advised by @omerlevy_. Creative language, wordplay, hip hop.Guy Dar @guy_dar1
362 Followers 221 Following #NLProc Researcher | #AI #NLProc #interpretability | opinions my own sadly | off-topic tweets erased periodically | he/himSamuel AMOUYAL @AmouyalSamuel
64 Followers 78 FollowingIllia (root.near) (�.. @ilblackdragon
82K Followers 398 Following Co-Founder @NEARProtocol. Working on bringing 1B users into web3. Previously builder of #Tensorflow & ML researcher.Stella Biderman @BlancheMinerva
15K Followers 748 Following Open source LLMs and interpretability research at @BoozAllen and @AiEleuther. My employers disown my tweets. She/herNitish Gupta @nitish_gup
1K Followers 483 Following Research Scientist at @GoogleAI in Natural Language Processing & Machine Learning PhD from University of Pennsylvania | Undergrad from IIT KanpurAntoine Bosselut @ABosselut
3K Followers 602 Following Helping machines make sense of the world. Asst Prof @ICepfl; Before: @stanfordnlp @allen_ai @uwnlp @MSFTResearch #NLProc #AIBigScience Large Mode.. @BigScienceLLM
9K Followers 1 Following Follow the training of "BLOOM 🌸", the @BigScienceW multilingual 176B parameter open-science open-access language model, a research tool for the AI community.Shivanshu Gupta @shivanshug11
165 Followers 93 Following PhD Candidate at UC Irvine | Previously @asapp @amazon @linkedin @msftresearch @iitdelhi | #NLP & #ML ResearchOhad Rubin @OhadRubin
717 Followers 3K Following P.hD student. Researching Natural Language Processing at Tel Aviv University. Let's have more paperclips? 📎⏩Ori Ram @ori__ram
764 Followers 386 Following Research Scientist @GoogleAI, working on #NLProc. Previously: PhD from @TelAvivUni, Research Scientist @AI21LabsDaniel Fried @dan_fried
3K Followers 797 Following Assistant prof. @LTIatCMU @SCSatCMU, working on NLP: language interfaces, applied pragmatics, language-to-code, grounding. 🐘: @[email protected]Dan Roth @DanRothNLP
2K Followers 54 Following VP/Distinguished Scientist, AWS AI Labs and the Eduardo D. Glandt Distinguished Professor, CIS, University of PennsylvaniaBhuwan Dhingra @bhuwandhingra
928 Followers 290 Following Natural Language Processing / Machine Learning research. Assistant Professor @dukecompsci, @duke_nlp; Research Scientist @googleai🇺🇦 Alex Polozov @Skiminok
4K Followers 698 Following Sr. Staff Research Scientist @Google • ex- @Theteamatx, @MSFTResearch, @uwcse • program synthesis, deep learning, AI4Code • he/him • @[email protected]Momentis Surgical™ @MomentisSurg
84 Followers 0 Following Transforming robot-assisted surgery with maneuverable, flexible & innovative technology for less-invasive, benign gynecologic procedures. Policy: https://t.co/RwjhvSztUbEMNLP 2024 @emnlpmeeting
12K Followers 41 Following EMNLP 2024 - The 2024 Conference on Empirical Methods in Natural Language Processing, November 12 –16, 2024 Hashtag: #EMNLP2024Princeton NLP Group @princeton_nlp
4K Followers 56 Following Princeton NLP Group led by @prfsanjeevarora @danqi_chen @karthik_r_ntsvetshop @tsvetshop
800 Followers 131 Following Group account for Prof. Yulia Tsvetkov's lab at @uwnlp. We work on low-resource, multilingual, social-oriented NLP. Details on our website:"הוֹי הָאֹמְרִים לָרַע טוֹב וְלַטּוֹב רָע שָׂמִים חֹשֶׁךְ לְאוֹר וְאוֹר לְחֹשֶׁךְ שָׂמִים מַר לְמָתוֹק וּמָתוֹק לְמָר" (ישעיהו ה, כ)
Want to train an aligned LM in a new language 🌏 but don’t have preference data for training the reward model (RM)? 💡 Just use a RM for another language: it often works well, sometimes even BETTER than if you had a RM in your target language! 🤯 arxiv.org/abs/2404.12318
Check out Zhaofeng's work from his internship with us! TL;DR A reward model trained on language S preference data could be used to align a language T LLM. This sometimes works even better than using a reward model trained on language T preference data.
Want to train an aligned LM in a new language 🌏 but don’t have preference data for training the reward model (RM)? 💡 Just use a RM for another language: it often works well, sometimes even BETTER than if you had a RM in your target language! 🤯 arxiv.org/abs/2404.12318
Google presents Reuse Your Rewards Reward Model Transfer for Zero-Shot Cross-Lingual Alignment Aligning language models (LMs) based on human-annotated preference data is a crucial step in obtaining practical and performant LM-based systems. However, multilingual human
Is this not just saying that performance on LLM benchmarks improves with perplexity (you fit the data better)? Generative models are already trained to essentially compress their training set.
Compression Represents Intelligence Linearly LLMs' intelligence – reflected by average benchmark scores – almost linearly correlates with their ability to compress external text corpora repo: github.com/hkust-nlp/llm-… abs: arxiv.org/abs/2404.09937
New from @GoogleDeepMind: When can you trust your LLM? We show that LLMs consistently overestimate their own accuracy on some topics (eg nutrition) while underestimating it on others (eg math). Our Few-shot Recalibrator fixes LLM over/under-confidence: arxiv.org/abs/2403.18286 🧵
Check out our new work on few-shot recalibration of LMs with our amazing intern @XiangLisaLi2!
New from @GoogleDeepMind: When can you trust your LLM? We show that LLMs consistently overestimate their own accuracy on some topics (eg nutrition) while underestimating it on others (eg math). Our Few-shot Recalibrator fixes LLM over/under-confidence: arxiv.org/abs/2403.18286 🧵
זה הזמן להזכיר, באופן חד וברור, שחיי המדע והרוח במדינת ישראל מהווים בסיס קריטי לחוסנה הכלכלי המדיני והבטחוני. ללא תקציבים, וללא מערכת השכלה גבוהה חזקה עצמאית ובלתי תלויה לא יהיו לנו חוקרות וחוקרים כאלה בעתיד.
Wow! What amazing news! Israeli mathematician, Avi Wigderson, was awarded the 2023 Turing Prize for insights into randomness. Wigderson was born in my hometown of Haifa and completed his undergraduate studies at the city's Technion – Israel Institute of Technology. MAZAL Tov…
Avi Wigderson wins the Turing Award 🏆 Others speak of Avi's math and CS genius, but here's a glimpse of his character ❤️ @TheOfficialACM #ACMTuringAward
@GalitDistel גלית, אני מבינה את המצב הנפשי המורכב שאת שרויה בו ומקווה שביום מן הימים תמצאי מזור למכאוביך. זה לא גורע במאום מגאוותי הרבה על כך שיש לי חלק, גם אם מינורי, בכך שאת כבר לא שרה במדינת ישראל. לאנשים כאן מגיע יותר.
הערב. בקפלן, במרכז חורב, בכיכר ראלי, בנתניה, בבית שמש, בכרמיאל, בהרצליה, בנס ציונה, ברחובות, בבאר שבע ובעוד עשרות מוקדים בכל הארץ. ממשלת הגיהנום מלא מלא חוגגת חצי שנה לכשלון. אין שום דרך אחרת לתיקון: ב-ח-י-ר-ו-ת ע-כ-ש-י-ו‼️
אכזריות (בירוקרטית או אחרת) איננה קשיחות ועמידות. ההפך; היא מעידה על חולשה עמוקה, על פחד. כל ילד בעזה חף מפשע. אתם מחפשים טיעון טקטי, ולא רק אנושי? ישראל לא יכולה לנצח דבר באמצעות הפעלת כוח לבדה.
תמונה שלא תראו בתקשורת הישראלית: הנוי, בת העשר, מסתובבת לבדה בעזה, גוועת ברעב לאחר שאביה וסבתה נהרגו, דודה שלה נפצעה ואחיה בן ה 17 עזב את הבית כדי לחפש אוכל ולא שב. אמא שלה בישראל, סיפור מורכב עליו כתבתי בהארץ. להכניס אותה לארץ להתאחד עם אמה זאת הדרך היחידה כנראה להציל אותה.…
השיחה עם @ItzhakFried בסיעור מוחות היתה מאתגרת במיוחד: איך אפשר להכניס כל כך הרבה שנות מחקר פורה ופורץ דרך בחצי שעה? מסתבר שאפשר, ואפילו להספיק לקראת הסוף לדבר על רוע אנושי, ומנין הוא מגיע. @relevant_il. לפרק המלא: live.relevant.co.il/#/asset?id=5dd…
Peer Reviews in 2019: u no sota ,paper no new! Peer Reviews Today: Thou art not the paragon of innovation; thy parchment beareth no novelty.
Excited to share new work on surfacing health equity-related biases in LLMs. We design rubrics covering 6 dimensions of bias, release EquityMedQA, a collection of 7 adversarial datasets, and conduct a large-scale human evaluation study with Med-PaLM 2. arxiv.org/abs/2403.12025
Excited to present our work “μPLAN: Summarizing using a Content Plan as Cross-Lingual Bridge” at #EACL2024 at the Poster Session 3 at 14:00. Come say hi! 👋 Check out the paper here: aclanthology.org/2024.eacl-long… and the data here: github.com/google-deepmin… #NLProc
Now that everyone is writing LLM programs, the idea of doing approximate bayesian inference by sampling along linguistic pipelines (rather than k-best, etc.) is more relevant again aclanthology.org/W06-1673/
Join us this Friday at the #UncertaiNLP workshop First keynote will be given by Chrysoula Zerva (IST, Lisbon) on "Uncertainty in NLP: Quantification, interpretation and evaluation" Location: Bastion 2 room of the Corinthia Program: uncertainlp.github.io/program