Gerasimos Lampouras @glampouras_NLP
Call me Makis :) Team Leader of the London NLP Team at Huawei Noah's Ark Lab. Geek extra-ordinaire. My views are my own but they can be yours too! London, England Joined February 2021-
Tweets57
-
Followers133
-
Following226
-
Likes59
Some career news :) And btw, I have always wanted to do this kind of update post, hehe.
If you are in Malta 🇲🇹 (hi!👋), come join me today at the Generation session (Marie Louise 2 - Radisson Blu Hotel) 14:00 - 15:30 local time, where I will present our work "Text-to-Code Generation with Modality-relative Pre-training"! 🎉
If you are in Malta 🇲🇹 (hi!👋), come join me today at the Generation session (Marie Louise 2 - Radisson Blu Hotel) 14:00 - 15:30 local time, where I will present our work "Text-to-Code Generation with Modality-relative Pre-training"! 🎉
Quite excited about this work!! Make sure to poke @fenchri about it on @eaclmeeting if you are interested (or me, I should be around too). :)
Quite excited about this work!! Make sure to poke @fenchri about it on @eaclmeeting if you are interested (or me, I should be around too). :)
ARR commitments for our Workshop on Simulation of Conversational Intelligence in Chat (SCI-CHAT 2024) @eaclmeeting are due on Jan 17th with the shared task deadline on the 20th! ARR link: openreview.net/group?id=eacl.… Workshop website: sites.google.com/view/dialogue-… #EACL2024 #NLProc
ARR commitments for our Workshop on Simulation of Conversational Intelligence in Chat (SCI-CHAT 2024) @eaclmeeting are due on Jan 17th with the shared task deadline on the 20th! ARR link: openreview.net/group?id=eacl.… Workshop website: sites.google.com/view/dialogue-… #EACL2024 #NLProc
Very happy to be co-organizing this workshop and shared task with the fine folks at @tcd and @AdaptCentre! Please help us spread the word of our research track and shared task: Paper deadline: Dec 18th ARR commitment deadline: Jan 17th Shard task deadline: Jan 20th
Very happy to be co-organizing this workshop and shared task with the fine folks at @tcd and @AdaptCentre! Please help us spread the word of our research track and shared task: Paper deadline: Dec 18th ARR commitment deadline: Jan 17th Shard task deadline: Jan 20th
No Unit Tests for your weakly typed programming languages? Check out our new Code Synthesis paper using RL over a reward derived from existing and converted Unit Tests.
No Unit Tests for your weakly typed programming languages? Check out our new Code Synthesis paper using RL over a reward derived from existing and converted Unit Tests.
Check out the Regular Expression Inference Challenge, organised by yours truly with Mojtaba Valizadeh, @iiacobacNLP , and Martin Berger: arxiv.org/abs/2308.07899 codalab.lisn.upsaclay.fr/competitions/1… #machinelearning #inference #challenge #AI #ML #llm #llms #huawei
Our wonderful NLP team at Huawei Noah’s Ark Lab is looking for Research Engineers and Research interns. We are looking for people to work on LLMs for general code and reasoning-related tasks. Please apply here huaweiuk.teamtailor.com/jobs/2858908-r…
Preliminary call (in Greek) for post-docs at "Archimedes", RC "Athena", including NLP. athenarc.gr/el/archimedes_…
I'm still impressed by Abu Dhabi. Thanks #EMNLP2022 If you are attending the conference and you are looking for interesting opportunities at #HuaweiNoahsArk we can have a chat
Join us tomorrow (in-person!) with @chenxi_jw and @iiacobacNLP at the Multilingual Representation Learning (MRL) workshop #EMNLP2022: Poster Session 11.00-12.30 (GMT+4)!
Join us tomorrow (in-person!) with @chenxi_jw and @iiacobacNLP at the Multilingual Representation Learning (MRL) workshop #EMNLP2022: Poster Session 11.00-12.30 (GMT+4)!
Looking forward to @emnlpmeeting next week! I'll be presenting this work with @vlachos_nlp and @tomstafford. We annotate (cc @lexicoloco) disagreements on @Wikipedia Talk pages according to the dispute tactics used by speakers, which enables fun analyses and experiments.
AKBC 2022 #akbc2022 is only two weeks from now! We have a great lineup of invited speakers: akbc.ws/2022/speakers/ A list of wonderful papers: akbc.ws/2022/papers/ Four exciting workshops: akbc.ws/2022/workshops/ More details in the following threads:
AKBC starts today! The morning session will be in Cinema 1 in Level -2!
Our EntityCS paper w/ @chenxi_jw + @iiacobacNLP, during her internship at Huawei Noah's Ark, is accepted in Findings of #EMNLP2022! :tada: 📄 arxiv.org/abs/2210.12540 We augment multilingual LMs with entity knowledge by creating an Entity-centric Code-switching corpus! 🧵⬇️
Shirley Kay @AlanKeynes92542
23 Followers 161 Following Enthusiast for yoga, music, reading, travel, investment, fashion and designTalia Tseriotou @taltser
37 Followers 109 Following PhD Student in Natural Language Processing at @QMUL | @GoogleDeepMind ScholarXi Wang @wangxieric
801 Followers 943 Following Lecturer of NLP @sheffielduni, previous Research Fellow @UCL, PhD @TerrierTeam Glasgow Uni. Research interests in Personalised Conversational AI, NLP and IR.Qizheng Gu @Bibliophobia__
27 Followers 460 FollowingChristine de Kock @christinedekock
258 Followers 254 Following Researcher & lecturer in NLP at @unimelbMarshal Sinaga @ArijonaMarshal
127 Followers 4K Following Doctoral researcher at Aalto University / FCAI𝐁𝐞𝐥𝐥𝐞 .. @ElaineMcDowall3
960 Followers 2K FollowingImperial NLP @imperial_nlp
66 Followers 336 Following We are the Natural Language Processing community here at Imperial College London. Looking forward to sharing more of our work over the coming months! #NLProcJulius Cheng @julius_gulius
46 Followers 46 Following PhD at @cambridgenlp, former staff ML eng @otter_ai, MSCS @Stanford, linguistics & cogsci @UCBerkeleyRyan-Rhys Griffiths @Ryan__Rhys
5K Followers 4K Following Postdoc Researcher @Meta | PhD @Cambridge_Uni | ML4Science | Bayesian Optimisation | ex-@Mila_Quebec | ex-@Huawei | ex-@SecondmindLabs | Chess FIDE MasterSteven McDonagh @steve_mcdonagh
150 Followers 647 Following Senior Lecturer @ University of Edinburgh; CV/ML; views my own.Nafise Sadat Moosavi @NafiseSadat
348 Followers 293 Following Lecturer (~Assistant Prof.) in NLP @SheffieldNLP @shefcompsci, Muslim Iranian womanMark Stevenson @drmarkstevenson
862 Followers 315 Following Senior Lecturer at @shefcompsci Member of @SheffieldNLP Natural Language Processing, Text Analytics, Data Science, Artificial IntelligenceAntonis Anastasopoulo.. @anas_ant
3K Followers 2K Following Assist. Prof at George Mason CS #nlproc MT, ASR, and documentation of endangered languages.George Michalopoulos @gmichalo
15 Followers 42 Following I am a Senior Applied Scientist at MicrosoftMichal Lukasik @miclukasik
134 Followers 196 Following Research Scientist at Google Research, New York.stormpooper @stormpooper_67
188 Followers 3K FollowingOndrej Dusek @tuetschek
564 Followers 858 Following Teaching computers to talk at Charles University. (Computational) linguistics, politics, climate, public transit. He/him. https://t.co/zFcgerpMcASunflowerAura @aura_sunfl321
23 Followers 2K FollowingGiorgos Vernikos @gvernikos
225 Followers 309 Following Final year PhD student at @EPFL and @heigvd working on Machine Translation and LLMs | Ex. @Google & @AmazonSciencekkyoucanfly @kkyoucanfly
65 Followers 536 FollowingXuekai Zhu @zhu_xuekai
157 Followers 917 Following Ph. D. Candidate at Shanghai Jiao Tong University @sjtu1896 | ACL 2023 Area Chair Award |Language models | Data-centric scalingSerah @memas93786711
1 Followers 165 Following I like talking about business, I like to make friendship , reading, swimming, traveling, cooking, shoppingRobert Scoble @Scobleizer
504K Followers 68K Following Follow me on my new podcast with AI startups, Unaligned. Tech industry color commentator since 1993. Author/Blogger. Former strategist @Microsoft.Constantinos Karouzos @ckarouzos
401 Followers 1K Following 🇬🇷🇪🇺🇬🇧🇮🇹 PhD student @ The University of Sheffield UKRI CDT Speech and Language Tech. | x ML Eng. @behaviorsignals | 2020 Alumni ECE NTUAChristina Williams @KateCarter9122
186 Followers 4K Following Tasha specializes in adult products (silicone dolls) and provides you with the best quality service, please visit the Telegram channel for details.Matina Thomaidou @matinathom
2K Followers 2K Following Happy Mama 🌿 VP, Head of Data Science at Dataseat (@VerveGroupHQ) 💻 ex-@Meta | PhD in ML | Against the oddsBilly Vythikowski @vythikowski
30 Followers 318 FollowingMehdi Rezagholizadeh @mrgzadeh
350 Followers 545 Following Principal Research Scientist, Huawei Noah's Ark Lab; PhD from Centre for Intelligent Machines (CIM), McGill UniversityAdam Sanchez-Ayte @asanchez75
670 Followers 3K Following R & D engineer. My interests mainly cover the area of Knowledge Representation, Computer Science, and Philosophy.Pinzhen "Patrick" Che.. @pinzhen_chen
75 Followers 224 Following Working on LLMs and MT @EdinburghNLP @InfAtEdJames O' Neill @JamesONeil21
197 Followers 745 Following Machine Learning Research Engineer - @dynamo_ai Ex @Huawei, @Amazon (Amazon JP), @insight_centre, @USC_ISI (Intern)Vignesh K C @Vignesh20264513
331 Followers 4K Following Interested in startups,finance, economy| | #Modi_ka_parivar.Marco Roberti @MarcoRoberti
186 Followers 355 Following 🖥 NLP Research Engineer @TechAtBloomberg, London. 👨🎓 AI PhD @DiUnito. {Opinions are my own ᐸGOᐳ} #NLP #NLProc #DeepLearning #AIChenxi @chenxi_jw
282 Followers 149 Following Postdoc @CambridgeNLP. Ex-Research Intern @GoogleDeepMind @Amazon Alexa AI @Huawei Noah's Ark LabGCSanity @gcsanity
11 Followers 240 FollowingAGICenter @AGI_leaderboard
6 Followers 65 Following https://t.co/XsQ39qxljo Email: info@https://t.co/XsQ39qxljoChryssa Zerva @chryssaZrv
378 Followers 325 Following Assistant Professor @informatica_IST, @ist_tecnico. Interested in understanding uncertainty in data, models, life. NLP, ML and climbing fan.Michael Schlichtkrull @michael_sejr
563 Followers 739 Following Lecturer, Queen Mary University of London. Affiliated Lecturer, University of Cambridge. He/him. I think a lot about evidence and #NLProc.Cesare Campagnano @caesar_one_
198 Followers 413 Following PhD Student @ Sapienza University of Rome | ex-AmazonTommaso @pasini_t
530 Followers 819 Following Computer alchemist at Bloomberg Interested in semantics and multilinguality. Opinions are my own.kordoni_nlp @KordoniN
1K Followers 1K Following NLP Group, Humboldt University Berlin — Opinions my ownAlexandros Papangelis @alex_papangelis
242 Followers 228 Following Amazon Alexa AI. Plato Research Dialogue System: https://t.co/RS7igTBJH9Talia Tseriotou @taltser
37 Followers 109 Following PhD Student in Natural Language Processing at @QMUL | @GoogleDeepMind ScholarMachel Reid @machelreid
2K Followers 1K Following Research Scientist @GoogleDeepMind Working on LLMs on the Gemini Team; did gemini 1.5 proDesmond Elliott @delliott
3K Followers 440 Following Assistant Professor at the University of Copenhagen working on multimodal machine learning.Allen Institute for A.. @allen_ai
54K Followers 361 Following AI for the Common Good. › Join us: https://t.co/DqTs1G4bGO › Get our newsletter: https://t.co/tvb1VpySfLXi Wang @wangxieric
801 Followers 943 Following Lecturer of NLP @sheffielduni, previous Research Fellow @UCL, PhD @TerrierTeam Glasgow Uni. Research interests in Personalised Conversational AI, NLP and IR.Oriol Vinyals @OriolVinyalsML
167K Followers 82 Following VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead. Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.Arpit Mittal @IamArpitMittal
159 Followers 56 Following Working on the next generation of AI enabled devices at Amazon.Jonathan Clark @JonClarkSeattle
3K Followers 2K Following Research Scientist @ Google: Multilingual NLP, Machine Learning, C++. Previously MT@Microsoft and CMU. Opinions are my own.Zheng Yuan @zhengyuan_nlp
240 Followers 298 Following Assistant Professor in NLP @KingsCollegeLon | Visiting Researcher @cambridgenlp @Cambridge_CL @Cambridge_Uni | Researcher #NLProc, #MachineLearningPranava Madhyastha @foobarin
140 Followers 1K Following NLP and Multimodal Machine Learning. Asst. Professor @CityUniLondonWilker Aziz @wilkeraziz
1K Followers 343 Following #BlackLivesMatter Assistant professor at UvA developing machine learning and natural language processing. He/him.ARIA @ARIA_research
10K Followers 36 Following Advanced Research + Invention Agency. Empowering scientists to reach for the edge of the possible.Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.Sasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzKyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Yoav Artzi @yoavartzi
13K Followers 163 Following Research/prof @cs_cornell + @cornell_tech🚡 / https://t.co/9YnWry7yHs / https://t.co/3VmRSyYm2d / asso. faculty director @arxiv / building https://t.co/f9QkzO5kaCJohannes Welbl @Johannes_Welbl
602 Followers 246 Following University College London - @UCLMR & @UCLCS. ML, NLP, Machine ComprehensionEdoardo Ponti @PontiEdoardo
2K Followers 389 Following Assistant Professor in #NLP at @EdinburghUni and affiliated lecturer @Cambridge_Uni | Modular deep learningMaria Liakata @xrysoflhs
1K Followers 514 Following Professor in Natural Language Processing, Queen Mary University of London, Turing AI fellow.Christine de Kock @christinedekock
258 Followers 254 Following Researcher & lecturer in NLP at @unimelbSiva Reddy @sivareddyg
5K Followers 966 Following Assistant Professor @Mila_Quebec @McGillU @ServiceNowRSRCH; Postdoc @StanfordNLP; PhD @EdinburghNLP; Natural Language Processor #NLProcACL Anthology @aclanthology
6K Followers 13 Following Host of scientistic papers for @aclmeeting and other venues in the field of Natural Language Processing Not closely monitored, so responses may be delayed.siggen_acl @siggen_acl
294 Followers 6 Following SIGGEN is the ACL (Association for Computational Linguistics) special interest group for Natural Language Generation. https://t.co/QVffdt379kEmiel van Miltenburg @evanmiltenburg
2K Followers 643 Following Assistant professor in computational linguistics at Tilburg University - working on NLG/#nlproc/ethics. https://t.co/K9j9nEclR8Imperial NLP @imperial_nlp
66 Followers 336 Following We are the Natural Language Processing community here at Imperial College London. Looking forward to sharing more of our work over the coming months! #NLProcStanford NLP Group @stanfordnlp
145K Followers 179 Following Computational Linguists—Natural Language—Machine Learning @chrmanning @jurafsky @percyliang @ChrisGPotts @tatsu_hashimoto @MonicaSLam @Diyi_Yang @StanfordAILabfast.ai @fastdotai
128K Followers 17 Following Deep learning R&D: https://t.co/cGBcDU8wJ9; Education: https://t.co/bNXBttRAuR; Software: https://t.co/0z7Ws3SHDt; Book: https://t.co/lVEDyioBtg; @math_rachel @jeremyphowardEleutherAI @AiEleuther
19K Followers 76 Following A non-profit research lab focused on interpretability, alignment, and ethics of artificial intelligence. Creators of GPT-J, GPT-NeoX, and VQGAN-CLIPNeurIPS Conference @NeurIPSConf
112K Followers 35 Following New Orleans, Dec 10-16, 23. https://t.co/ga8aOw615g Tweets to this account are not monitored. Please send feedback to [email protected].Anthropic @AnthropicAI
262K Followers 26 Following We're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant Claude at https://t.co/aRbQ97uk4d.Guillaume Lample @GuillaumeLample
37K Followers 648 Following Cofounder & Chief Scientist https://t.co/hLfvKLkFHd (@MistralAI). Working on LLMs. Ex @MetaAI | PhD @Sorbonne_Univ_ | MSc @CarnegieMellon | X11 @PolytechniqueFrançois Chollet @fchollet
470K Followers 769 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.Mistral AI @MistralAI
91K Followers 0 Following Fast, open-source and secure language models. Join us https://t.co/INALdNGvCPIvan Vulić @licwu
2K Followers 334 Following PRA@Cambridge; Interested in (way) too many things for his well-being, but mostly (and rarely) (re)tweets about NLP, ML, IR, language(s); (likes parentheses)casszhao @casszzx
284 Followers 869 Following Lecturer (Assistant Professor) in #NLProc @SheffieldNLP @shefcompsci opinions are my own (which are shaped by media and random things unfortunately)alexandra birch @alexandrabirch1
928 Followers 345 Following Senior research fellow at Edinburgh interested in translation, IE and dialogueEdinburghNLP @EdinburghNLP
11K Followers 139 Following The Natural Language Processing Group at the University of EdinburghRyan-Rhys Griffiths @Ryan__Rhys
5K Followers 4K Following Postdoc Researcher @Meta | PhD @Cambridge_Uni | ML4Science | Bayesian Optimisation | ex-@Mila_Quebec | ex-@Huawei | ex-@SecondmindLabs | Chess FIDE MasterSteven McDonagh @steve_mcdonagh
150 Followers 647 Following Senior Lecturer @ University of Edinburgh; CV/ML; views my own.Matthieu Zimmer @matthieu_zimmer
4 Followers 2 FollowingSara Hooker @sarahookr
39K Followers 7K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.Abacus.AI @abacusai
49K Followers 6 Following Use Gen AI to build Applied AI agents and systems. AI builds Applied AI while DS teams supervise and evaluate the results. Working towards open-source AGIJulien Chaumond @julien_c
47K Followers 1K Following Co-founder and CTO at @huggingface 🤗. ML/AI for everyone, building products to propel communities fwd. @Stanford + @PolytechniqueInterested in fact-checking? Just announced: Next @FEVERworkshop at EMNLP shared task: fever.ai/task.html aiming to evaluate systems verifying real-world claims with evidence from the Web, based on the AVERITEC dataset: arxiv.org/abs/2305.13117 With the amazing team:
@nikaletras giving his inaugural professorial lecture “Language Modelling for the sake of Language Modelling” @SheffieldNLP
If you are in Malta 🇲🇹 (hi!👋), come join me today at the Generation session (Marie Louise 2 - Radisson Blu Hotel) 14:00 - 15:30 local time, where I will present our work "Text-to-Code Generation with Modality-relative Pre-training"! 🎉
Happy to share our work on "Text2Code Generation with Modality-relative Pre-training" w/ @gcsanity & @glampouras_NLP, accepted at #EACL2024! 🎉 We propose to treat code and natural language as different modalities. 📜arxiv.org/abs/2402.05783 💻coming soon (pending int. review)
I successfully defended my thesis! Many thanks to @IAugenstein @nikaletras for being such kind examiners! Heartfelt gratitude to my supervisors @tweyde @foobarin, internship mentors @fenchri @claravania @AlhamFikri @jasmijnbastings @fantinehuot & all who helped me on the journey!
By analysing embeddings of code-related words, we find (as expected) that in the "code" space similar operations come close together but in the "NL" space they are further apart, depending on their semantics (e.g. open-close).
We experiment with 2 LMs, 2 model scales and 4 training objectives, testing on HumanEval & MBPP. Our findings suggest that embedding separation, as a 2nd training stage, can improve code generation mostly on p@10 and p@100, indicating that it helps increase model expressiveness.
To granually measure performance, we propose a new variation of the classic functional correctness, pass@k metric: incremental pass@k. This includes code completion eval, models are prompted with partial code solutions, incrementing each successive prompt one code line at a time.
This is realised via 2 stategies: partial separation (only separating embeddings based on programming language keywords) and full separation (separate all embeddings).
We posit a simple idea: Code keywords have strictly defined semantics, hence they need to be treated as a different *modality* from natural language. We start from a pre-trained CodeLM and associate distinct embeddings for each token depending on its modality, focusing on Python.
Happy to share our work on "Text2Code Generation with Modality-relative Pre-training" w/ @gcsanity & @glampouras_NLP, accepted at #EACL2024! 🎉 We propose to treat code and natural language as different modalities. 📜arxiv.org/abs/2402.05783 💻coming soon (pending int. review)
Happy Friday! Η καμμενιά του Πληροφορικάριου: Ακούς "O Tannenbaum" κ το μυαλό σου πάει στον Tanenbaum απο τα βιβλία με τα Λειτουργικά Συστήματα και τα Δίκτυα. (τι μόνο εγώ το καψα? 🤣)
Celebrating with some of the @cambridgenlp members past, current and future attending EMNLP!
Julius did amazing work! Very happy about this award, thank you!
EMNLP 2023 Best Short Paper Faster Minimum Bayes Risk Decoding with Confidence-based Pruning (Julius Cheng, Andreas Vlachos) aclanthology.org/2023.emnlp-mai… #EMNLP2023 #NLProc
This paper was a blast to write and a blast to present! @ZeerakTalat @verena_rieser @gavin_does_nlp @t_dinkar #EMNLP2023
Thanks to everyone who visited our poster today! #EMNLP2023 Feel free to reach out to chat about related topics anytime. Find the latest paper version here: arxiv.org/pdf/2305.13507…
Pleased to share that I will be co-organising the SCI-CHAT workshop with the theme "Simulation of Conversational Intelligence in Chat" at EACL 2024. More details at: bit.ly/scichat-eacl #EACL #AI #ML #NLP
Proud to announce our paper on "Automatic Unit Test Data Generation and Actor-Critic Reinforcement Learning for Code Synthesis" has been accepted to Findings of #EMNLP2023 . This is joint work with Matthieu Zimmer, @glampouras_NLP , Derrick Goh Xin Deik, and @iiacobacNLP .