Anej Svete @AnejSvete
PhD fellow at @ETH_en @ETH_AI_Center, supervised by @ryandcotterell and @val_boeva. Working on understanding language models through formal language theory. Joined May 2022-
Tweets26
-
Followers125
-
Following85
-
Likes278
🤖 Ever wondered what RNN-based language models are truly capable of? Check out our #EMNLP2023 paper which places formal bounds on their capabilities! With @AnejSvete, @leoduw, and @RyanCotterell (1/7) arxiv.org/abs/2310.12942
ACL org announcement: 📢 The list of accepted tutorials at EACL, ACL, NAACL and EMNLP in 2024 is out 🎉 #NLProc Please help spread the word. Retweeting w/ references, especially with instructors information etc is very much appreciated - thanks! 😊
What is the best way to use language models for ranking tasks, such as "rank the following countries by size: 🇺🇸,🇨🇳,🇨🇦,🇷🇺"? We study pairwise, pointwise and listwise prompting as well as unsupervised Contrast-Consistent Ranking (CCR): preprint arxiv.org/pdf/2309.06991… ⬇️ thread
Are you a big fan of structure? Have you ever wanted to apply the latest and greatest large language model out-of-the-box to parsing? Are you a secret connoisseur of linear-time dynamic programs? If you answered yes, our outstanding #ACL2023NLP paper may be just right for you!
Come to our ACL tutorial tomorrow at 14h on generating text from language models! Material will be online here: rycolab.io/classes/acl-20… w/ @tpimentelms @afra_amini @johnhewtt @Malagutti_Luca @ryandcotterell
Representing Rycolab at #eacl2023 with @butoialexandra @OpedalAndreas @karstanczak @ClementePasti and Kevin Du!
Our feline attendees have had a strong presence at #eacl2023 so far! Here's @butoialexandra and others with one of our conference cats.
Ever wondered how you would prove that a language model based on a recurrent neural network is Turing complete? @AnejSvete and I programmed a version of the proof by Siegelmann and Sontag (1995) [binds.cs.umass.edu/papers/1995_Si…] in legible Python. Check it out: github.com/rycolab/rnn-tu…
Our tutorial on Formal Language Theory and Neural Networks [rycolab.io/classes/esslli…] was accepted to @ESSLLI_official. Stop by beautiful Ljubljana this summer to learn how to view language models through a more formal lens. A superset of the course notes: drive.google.com/file/d/1IYgjs0…
A conference is coming up, and you need new slides? What if you had a digital assistant to convert your paper into a (draft) slide set? A research team at ETH Zurich has been working on a tool to convert articles to slides. To fine-tune the prototype, we need your help! (1/2)
And that's it! Package in little jars, share with friends, give as gifts. Everyone has had candy, but how many people have had homemade candy? These are a true ray of sunshine in the depths of winter 🍋
Our MSc course in formal language theory is happening again in Spring 2023! Check out the syllabus rycolab.io/classes/aflt-s…. Content includes: (closed) semirings, the algebraic path problem, WFSA algorithms, WCFGs, Newton’s algorithm, the left-corner transformation
Super excited about teaching ETH’s first course on Large Language Models! Check the syllabus out here rycolab.io/classes/llm-s2…. Jointly taught with my colleagues @mrinmayasachan, Ce Zhang and @florian_tramer.
Long queues to get a chance to speak with @AnejSvete and @ravfogel! 🐍 Check out their work on Acyclic WFSA with Failure Arcs and Kernelized Concept Erasure @emnlpmeeting! @ryandcotterell @adveisner @xtimv @BenjaminDayan @CSatETH cs.jhu.edu/~jason/papers/… arxiv.org/abs/2201.12191
Pretrained LMs are powerful! How to leverage their power for structured prediction? We are thrilled to share our paper “Autoregressive Structured Prediction with Language Models”, which achieves SOTA on NER, relation extraction, coreference resolution! #emnlp2022
Super excited to share a ton of research papers accepted to #EMNLP2022 that were done in collaboration with @JohnsHopkins researchers! Congratulations to the authors on this achievement!! 🥳🥳🥳 Details to follow soon.
Algorithms for Weighted Pushdown Automata, at #EMNLP2022 with @butoialexandra @BrianDuSell @xtimv @ryandcotterell arxiv.org/abs/2210.06884
I am being pressured by a Zoomer to create a BeReal account. Should I do it?
To what extent do neural networks learn compositional behaviour? Together with @nsaphra, Jon Rawski, @ryandcotterell and @adinamwilliams we take a lesson from formal language theory to answer this question. arxiv.org/abs/2208.08195
There is a lot of interest in attending our course remotely by non-ETH students! After some thought, I've decided anyone is more than welcome to join remotely (through Zoom).
There is a lot of interest in attending our course remotely by non-ETH students! After some thought, I've decided anyone is more than welcome to join remotely (through Zoom).
Viviana @Viviana75842443
2 Followers 161 Following
Aso Mahmudi @AsoMahmudi
259 Followers 105 Following
Nikola Selic @nikola_selic
182 Followers 1K Following ex SDE intern @ AWS | MSc @TU_Muenchen | I try to make cool stuff, noisy input gang. Opinions expressed entirely my own.
Martin Funkquist @MartinFunkquist
91 Followers 509 Following PhD student @ Linköping University, working on AI with integrating natural language with acting and planning
Anh Đặng @Anhng20460612
14 Followers 278 Following ReMa Linguistics and Communication Sciences, Centre for Language Studies, Radboud University
Tannon Kew @tannonk
130 Followers 239 Following phd student at @cl_uzh, working on controlled conditional text generation, text simplification and leveraging LLMs
WANG Shunjie @ShunjieW
6 Followers 111 Following Formal languages and automata theory for NLP, computational and mathematical linguistics
mak @slougui57
375 Followers 1K Following
Jaap Jumelet @JumeletJ
493 Followers 315 Following PhD candidate at UvA with @wzuidema NLP ∩ Interpretability ∩ Linguistics PhD in 5 words: Finding structure in language models
TasksWithCode @TasksWithCode
488 Followers 3K Following We spotlight ML researchers & practitioners. High (S) fact: ~50% code contributors to ML paper implementations are practitioners collaborating with researchers
Clément Jambon @clementjbn
372 Followers 2K Following Visiting student at SNU 🛬 MSc student at ETH Zürich 📚 Previously at Nvidia, Inria and École polytechnique 🔙 I hike and cycle during my free time 🏞️
Pratyay Banerjee (ন.. @Neilzblaze007
243 Followers 4K Following I live in the shadows, but I watch everything.
Tobi Scheithauer @TobiScheithauer
4 Followers 131 Following CS MSc student @ETH Focus on machine intelligence for genomics and more
Laure Ciernik @lciernik
17 Followers 83 Following PhD student at ML Group @TUBerlin @bifoldberlin | MSc thesis at Boeva Lab, @ETH_en
Volodymyr Kyrylov @darkproger
2K Followers 2K Following AI student at USI/ETH. Donate https://t.co/GDSkWG2tak
Ilker Guler @ilker__guler
196 Followers 2K Following Former NATO Officer | Defense Planner | Maritime & Space Security Analyst | Sailing & Yachting Racer | Salesforce Admin & Developer | AWS & DevOps Engineer
Miloš Stanojević @milosstanojevic
637 Followers 602 Following Research scientist @DeepMind • Natural language processing • Parsing • Formal Languages • https://t.co/NBa754qVmY
Alizée Pace @AlizeePace
344 Followers 439 Following PhD student in ML @ETH_AI_Center @MPI_IS (RL, causality, healthcare) | prev: RLHF for Gemini @GoogleAI, @Cambridge_Uni
Zakaria Benahmed @zakariabhd_ia
38 Followers 426 Following Master's on Advanced Intelligent Systems. PYTHONIST.
Vivek Gupta @keviv9
2K Followers 5K Following PostDoc @cogcomp UPenn | Ph.D. CS @UUtah | @iitkanpur. @Bloomberg & @MSFTResearch Fellow | ex-@MetaAI, @IBM, @Verisk, @samsungresearch, @Synopsys #nlp #ml
ZurichAI @zurichnlp
372 Followers 140 Following We host meetups in Zurich to bring together researchers, engineers and enthusiasts in NLP, CV and beyond!
Lukas Wolf @lukaswolf_
226 Followers 383 Following cofounder @sonia_health (YC W24). researcher in ml, nlp, cogsci @eth_en @mitbrainandcog
Ethan Gotlieb Wilcox @weGotlieb
921 Followers 415 Following Postdoc at ETH Zurich. Formerly PhD student at Harvard Linguistics, affiliated with MIT Brain & Cog Sci. Language, Computers, Cognition.
Robin Chan @robinsmchan
26 Followers 44 Following cs phd student @ETH nlp, hci, vis previously @IBMResearch
Nico Daheim @ndaheim_
200 Followers 391 Following @ELLISforEurope PhD student in NLP and ML at @UKPLab @TUDarmstadt and @ETH_en. Previously MSc. in Data Science @RWTH.
Gabriele Sarti @gsarti_
2K Followers 2K Following PhD Student @GroNLP 🐮, core dev of @InseqLib (https://t.co/tTjrg26ygQ). Interpretability ∩ HCI ∩ #NLProc. Prev: @AmazonScience, @Aindo_AI, @ItaliaNLP_Lab.
Mona Diab @MonaDiab77
1K Followers 689 Following Director of LTI, CMU. ACL Fellow. I am passionate about language, mind, responsible technologies, technology/society, history, politics, nutrition!
Kat Vylomova (कत�.. @ivrik
1K Followers 1K Following Lecturer @cis_unimelb SIGTYP @sig_typ SIGMORPHON Cyberpunk;neuro*;math for kids;fractals;C++;awk/sed/xargs/egrep; G-D-Em-C G-D-C-G Dr 🐱 Mum Views are my own
Zhijing Jin @ZhijingJin
3K Followers 1K Following Final-year PhD @MPI_IS & @ETH_en w/ @bschoelkopf. Research on (1) @CausalNLP and (2) NLP4SocialGood @NLP4SG. Mentor and mentee @ACLMentorship.
Wangchunshu Zhou @wangchunshu
2K Followers 2K Following Cofounder & CTO of AIWaves Inc. #LLMs. Former CS PhD student at ETH Zurich. Former research scientist at Bytedance AI Lab, Intern at MSRA, and PYI at AI2.
Guneet Singh Kohli @guneetsk99
460 Followers 3K Following AI Engineer @ GreyOrange, Building Indian LLMs with Odia GenAI Independent Researcher working on variety of random problems.
Filip with an ‘F’ @Lemoncloak
398 Followers 1K Following #NLProc postdoc @AdaptCentre @TUDublinCompSci | nerd, gamer, runner, language-lover, time-waster, pun enthusiast, singer @arduvocal | he/him 🏳️🌈
Leonie Weissweiler @LAWeissweiler
789 Followers 314 Following Visiting Researcher with @adelegoldberg1 at @Princeton | prev. @cislmu @LTIatCMU @CambridgeLTL
jerry @gerasimoss
1K Followers 1K Following he/him, assist. prof. @MaastrichtU data miner+machine learner,☕ addict,📺 🎬 binge-watcher, #avgeek ✈️, G&T🍸, proud geek- views my own
Nithish Kannen @NithishKannen
450 Followers 2K Following Languages @GoogleAI | Ex- @AmazonScience London, @IBMResearch | @CNERG @IITKgp | #NLPProc
Jasmijn Bastings @jasmijnbastings
4K Followers 2K Following Sr Research Scientist @GoogleDeepMind. Interested in gender, feminism, fairness, bias & ethics in #NLProc/#AI. Views my own. She/they.
Florian Barkmann @flobarkmann
49 Followers 117 Following PhD student at Boeva Lab, @ETH_en | Mostly working on ML applied to cancer research | Previously @DKFZ, DKRZ, @uni_tue, @HKUniversity
Leo Du @leoduw
168 Followers 202 Following Positive semi-nondeterministic PhD student @jhuclsp currently visiting #rycolab ETH | previously @uwcse | math junkie | profile pic reads "the 8th Busy Beaver"
Joseph Imperial @josephimperial_
1K Followers 5K Following UKRI CDT PhD @ARTAIBath @bathnlp @UniofBath 🇬🇧. Language generation, evals, and alignment. Research Faculty @NationalUPhil 🇵🇭. He/him.
Miloš Stanojević @milosstanojevic
637 Followers 602 Following Research scientist @DeepMind • Natural language processing • Parsing • Formal Languages • https://t.co/NBa754qVmY
Alizée Pace @AlizeePace
344 Followers 439 Following PhD student in ML @ETH_AI_Center @MPI_IS (RL, causality, healthcare) | prev: RLHF for Gemini @GoogleAI, @Cambridge_Uni
Lukas Wolf @lukaswolf_
226 Followers 383 Following cofounder @sonia_health (YC W24). researcher in ml, nlp, cogsci @eth_en @mitbrainandcog
Slavko Žitnik @szitnik
178 Followers 141 Following NLP & AI expert, Assist. Prof. at Uni Lj, Chairman of SDI, Chairman of SDJT
Clemente Pasti @ClementePasti
57 Followers 139 Following
Robin Chan @robinsmchan
26 Followers 44 Following cs phd student @ETH nlp, hci, vis previously @IBMResearch
Filip with an ‘F’ @Lemoncloak
398 Followers 1K Following #NLProc postdoc @AdaptCentre @TUDublinCompSci | nerd, gamer, runner, language-lover, time-waster, pun enthusiast, singer @arduvocal | he/him 🏳️🌈
eaclmeeting @eaclmeeting
4K Followers 24 Following The European Chapter of the Association for Computational Linguistics An annual Top-tier *ACL conference. #EACL2024 #NLProc 17-22 March 2024
Jia-Bin Huang @jbhuang0604
51K Followers 285 Following Associate Professor @umdcs; Part-time Research Scientist @Meta. I like pixels.
Yann LeCun @ylecun
712K Followers 719 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Leo Du @leoduw
168 Followers 202 Following Positive semi-nondeterministic PhD student @jhuclsp currently visiting #rycolab ETH | previously @uwcse | math junkie | profile pic reads "the 8th Busy Beaver"
Elliott Ash @ellliottt
5K Followers 3K Following Prof @ETH Zurich: Law, Economics, and Data Science; @cepr_org affiliate (PE). Previously @warwickecon, @PrincetonSPIA, @columbia_econ, @ColumbiaLaw, @UTAustin.
Will Merrill @lambdaviking
2K Followers 569 Following Ph.D. student @ NYU🗽 Theoretical aspects of NLP and LMs /nætʃɹəl/🇮🇸 + formal🤵 languages + TCS🧮
David Chiang @davidweichiang
2K Followers 554 Following Associate Professor of Computer Science and Engineering at University of Notre Dame. Natural language processing, formal grammars, machine learning
Afra Amini @afra_amini
231 Followers 243 Following Ph.D. student at ETH AI Center, ex-intern @GoogleDeepMind
Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
Chris Dyer @redpony
11K Followers 1K Following i live in Angel, London. I am a researcher at DeepMind. I play the cello. 𒌓𒈪𒊭𒄠𒋗 𒆪𒌦𒄭𒁺 𒌓 𒌨𒊑𒅇𒈬𒅆𒋢𒌨𒅇𒈨𒇷𒅍
Emanuele Palumbo @palu_ema
77 Followers 90 Following PhD Fellow at @ETH_AI_Center | Multimodal Learning | Variational Methods | Generative Models | AI for Health
galvanize (gail weiss.. @gail_w
1K Followers 328 Following Trying to get off of here, dms checked rarely. Better to send an email postdoc at EPFL, understanding neural networks. https://t.co/lnaKoR7vmc .
Ethan Gotlieb Wilcox @weGotlieb
921 Followers 415 Following Postdoc at ETH Zurich. Formerly PhD student at Harvard Linguistics, affiliated with MIT Brain & Cog Sci. Language, Computers, Cognition.
SIGREP @sigrep_acl
1K Followers 32 Following @ACL_NLP Special Interest Group on Representation Learning. We organise #Repl4NLP.
Tal Linzen @tallinzen
16K Followers 893 Following Professor @nyuling and @NYUDataScience, research scientist @GoogleAI
Sašo Dolenc @SasoDolenc
5K Followers 504 Following
Baptiste Freydt @bfreydt
113 Followers 248 Following Master DS @ETH, co-host @niptechpodcast, pâtissier amateur 🥐🇫🇷
Fernando Adauto @fer_adauto
86 Followers 165 Following Machine Learning Engineer Studied at ETH Zurich
Rami Aly @Ramiyaly
157 Followers 243 Following PhD Candidate at @CambridgeNLP, researching NLP for Fact Checking with @vlachos_nlp.
Linlu Qiu @linluqiu
435 Followers 505 Following PhD student @MIT_CSAIL | formerly AI resident @Google
Csordás Róbert @robert_csordas
542 Followers 356 Following Postdoc at Stanford working on systematic generalization and algorithmic reasoning. Ex IDSIA PhD, Ex @DeepMind intern.
Tiancheng Hu @tiancheng_hu
735 Followers 2K Following PhD student @CambridgeLTL @Cambridge_Uni. Previously @MSP_UTD @UT_Dallas @ETH_en @EPFL_en. Interested in NLP and CSS
Freda Shi @fredahshi
2K Followers 674 Following Starting July 2024: Asst. Prof. @UWCheritonCS @VectorInst, #nlproc #compling Now: PhD Student @TTIC_Connect Ex-@PKU1898, @MetaAI, @GoogleDeepMind Feeder of 3 🐈
Tanja Samardzic @tsamardzict
203 Followers 128 Following language•science•programming•philosophy• basics
Kat Vylomova (कत�.. @ivrik
1K Followers 1K Following Lecturer @cis_unimelb SIGTYP @sig_typ SIGMORPHON Cyberpunk;neuro*;math for kids;fractals;C++;awk/sed/xargs/egrep; G-D-Em-C G-D-C-G Dr 🐱 Mum Views are my own
Karolina Stanczak @karstanczak
515 Followers 446 Following NLP & ML PhD candidate @uni_copenhagen @CopeNLU
Kumar Shridhar @JupyterAI
585 Followers 1K Following PhD in ML/NLP @eth_en | I do #NLProc and #AI | Past: @MSFTResearch @AIatMeta @AmazonScience @rptu_kl_ld | He/him. Views are my own.
Tuhin Chakrabarty @TuhinChakr
2K Followers 620 Following Newly minted Ph.D. from @ColumbiaCompSci studying creativity. Ex affiliations: @GoogleDeepmind @SFResearch @allen_ai
Luca Malagutti @Malagutti_Luca
53 Followers 321 Following Provided 'as is' without warranties of any kind || CS MSc @ETH_en
Tiwa Eisape @tiwa_eisape
1K Followers 1K Following PhD student at @MIT working on NLP and cognitive science - @NSF grfp fellow. Previously with @GoogleAI and @Meta FAIR
Jennifer White @JenniferCWhite
370 Followers 163 Following PhD Student at the University of Cambridge working on NLP
AI Conference DL Coun.. @DlCountdown
16K Followers 11 Following Bot. I daily tweet progress towards machine learning and computer vision conference deadlines. Maintained by @chriswolfvision.
Riccardo De Santi @desariky
390 Followers 606 Following PhD student @ETH_AI_Center. Prev. @UniofOxford, @imperialcollege. Into Sequential Decision Making foundations and applications in Scientific Discovery.
Antonio Lopardo @AntonioLprd
64 Followers 436 Following
Benno Krojer @benno_krojer
2K Followers 2K Following PhDing in AI (Vision+Language) @Mila_Quebec and @mcgillu. Vanier Scholar. I try to see my research as an infinite game: I play so I get to continue playing
Butoi Alexandra @butoialexandra
134 Followers 209 Following PhD student at ETH Zürich focusing on NLP🤖 Ever wondered what RNN-based language models are truly capable of? Check out our #EMNLP2023 paper which places formal bounds on their capabilities! With @AnejSvete, @leoduw, and @RyanCotterell (1/7) arxiv.org/abs/2310.12942
ACL 2024 (4/4) @aclmeeting - Presentation Matters: How to Communicate Science in the NLP Venues and in the Wild? Sarvnaz Karimi, Cecile Paris and Gholamreza Haffari. - Computational Expressivity of Neural Language Models. Alexandra Butoi, Ryan Cotterell and Anej Svete.
ACL org announcement: 📢 The list of accepted tutorials at EACL, ACL, NAACL and EMNLP in 2024 is out 🎉 #NLProc Please help spread the word. Retweeting w/ references, especially with instructors information etc is very much appreciated - thanks! 😊
New paper w/ @davidweichiang! We present "Stack Attention," giving transformers a latent model of syntax that requires no syntactic supervision, with improvements on formal and natural language modeling. Paper: arxiv.org/abs/2310.01749 Code: github.com/bdusell/stack-… Short 🧵⬇️
In case anyone was wondering:
When he realized red is the good part of the watermelon.. 😅
How to say "I left my poster in the bus" without saying "I left my poster in the bus." @AnejSvete and @butoialexandra
What is the best way to use language models for ranking tasks, such as "rank the following countries by size: 🇺🇸,🇨🇳,🇨🇦,🇷🇺"? We study pairwise, pointwise and listwise prompting as well as unsupervised Contrast-Consistent Ranking (CCR): preprint arxiv.org/pdf/2309.06991… ⬇️ thread
Timeless tweet:
When you say, "This is a reinforcement learning problem," you should say it with the same excitement as "This is NP-hard."
titans of industry. intellectual giants
"as an AI language model" is a watermark which works better than some proper LM watermarking methods.
Go to Google Scholar and look up ‘As an AI language model” -“ChatGPT”’
Today we are open-sourcing SynJax which is a JAX library for efficient probabilistic modeling of structured objects (sequences, segmentations, alignments, trees...). It can compute everything you would expect from a probability distribution: argmax, samples, marginals, entropy...
T-minus 5 days until the 34th #ESSLLI: Santa's Little Workshop. Gifts for participants and lecturers are packed and waiting for you. 🎁
lol Gašper is making rounds in India Today
This Berkeley professor walked into an Oppenheimer set unknowingly. Read post #Oppenheimer indiatoday.in/trending-news/…
AI Johnny Cash sings "Barbie Girl"
This is my favourite twitter bug and I want it to stay
Kevin's video is blowing up my DMs -- worth a watch!
Can backprop compute the *entropy* of a computation graph? You betcha! And, our Fulbright fellow Kevin Du won an outstanding paper award at #ACL2023NLP telling you how! He generalizes backprop to semirings to compute all sorts of quirky quantities Video: youtu.be/SUTMeVdCuXs
Omg, this video is incredible—highly recommended (★★★★★)
Can backprop compute the *entropy* of a computation graph? You betcha! And, our Fulbright fellow Kevin Du won an outstanding paper award at #ACL2023NLP telling you how! He generalizes backprop to semirings to compute all sorts of quirky quantities Video: youtu.be/SUTMeVdCuXs
Trends for United States
You might like
