Mohammad Aliannejadi @maliannejadi
Assistant Professor at UvA @UvA_IvI. Information Retrieval, Conversation Search, Crowdsourcing. aliannejadi.com Amsterdam, The Netherlands Joined July 2011-
Tweets3K
-
Followers2K
-
Following2K
-
Likes9K
The school is now live on ELLIS official website as well: ellis.eu/events/ellis-s… #SIGIR2024 #ECIR2024 #CIKM2024 #WSDM2025
The school is now live on ELLIS official website as well: ellis.eu/events/ellis-s… #SIGIR2024 #ECIR2024 #CIKM2024 #WSDM2025
1/4 Our reproducibility paper “Measuring Item Fairness in Next Basket Recommendation: A Reproducibility Study” w/ @MingL_7 @mzhariann @MansouryMasoud @maliannejadi @mdr was presented at #ECIR2024 Paper: link.springer.com/chapter/10.100…
🚀 Exciting news! The deadline for submitting papers on LLMs for IR evaluation has been extended to May 2nd, 2024. Don't miss this opportunity to showcase your research and advancements in #AI, #IR, and #NLP. Submit your work now!📝🔍 #DeadlineExtension #LLM #IR #SIGIR2024
🚀 Exciting news! The deadline for submitting papers on LLMs for IR evaluation has been extended to May 2nd, 2024. Don't miss this opportunity to showcase your research and advancements in #AI, #IR, and #NLP. Submit your work now!📝🔍 #DeadlineExtension #LLM #IR #SIGIR2024
Deadline extended to May 2nd, 2024. Published work, original work, and ongoing work on topics related to evaluation and LLMs in IR can be submitted to the workshop. The submission length is flexible; check out the website for more details: llm4eval.github.io/cfp/ #SIGIR2024
Deadline extended to May 2nd, 2024. Published work, original work, and ongoing work on topics related to evaluation and LLMs in IR can be submitted to the workshop. The submission length is flexible; check out the website for more details: llm4eval.github.io/cfp/ #SIGIR2024
Another piece of news today: I'll be the presenter of the module "Neural Recommender Systems" at #ESSIR2024. Looking forward to seeing everyone in Amsterdam!
Another piece of news today: I'll be the presenter of the module "Neural Recommender Systems" at #ESSIR2024. Looking forward to seeing everyone in Amsterdam!
Great opportunity to learn from the best!
Great program, and it's happening in Amsterdam this summer! Check it out:
Only a few days left for the #LLM4Eval! If you have any research relevant to LLM for evaluation in the application of IR and NLP, do not miss the deadline for the LLM4Eval workshop at SIGIR2024. 🗓Deadline: April 25th, 2024 🌐CFP: llm4eval.github.io #IR #NLP #SIGIR2024
Amsterdam in summer is my favorite Amsterdam. Come learn from the best, enjoy the city with some new friends, and overall have a great time 😊
Amsterdam in summer is my favorite Amsterdam. Come learn from the best, enjoy the city with some new friends, and overall have a great time 😊
Listening to @arian_ask giving a talk at SEA about our recent works on document generation for information retrieval.
In our recent paper, we propose to generate relevance labels using LLaMA for QPP. You only need to judge 10 documents per query to outperform all QPP SOTA methods for some recall-oriented metrics, such as nDCG. #SIGIR2024 #ECIR2024 #CIKM2024 #WSDM2025 #NLProc #EMNLP2024
In our recent paper, we propose to generate relevance labels using LLaMA for QPP. You only need to judge 10 documents per query to outperform all QPP SOTA methods for some recall-oriented metrics, such as nDCG. #SIGIR2024 #ECIR2024 #CIKM2024 #WSDM2025 #NLProc #EMNLP2024 https://t.co/MYCu0bW9Bl
📢 Are you working on investigating and utilising the LLMs' capabilities for evaluation? The call for papers is now open for the workshop on LLM4Eval, co-located with #SIGIR2024. 💡 See CFP: llm4eval.github.io/cfp/ 🗓 Submission deadline: April 25, 2024 @SIGIRConf @ACMSIGIR
📢 Are you working on investigating and utilising the LLMs' capabilities for evaluation? The call for papers is now open for the workshop on LLM4Eval, co-located with #SIGIR2024. 💡 See CFP: llm4eval.github.io/cfp/ 🗓 Submission deadline: April 25, 2024 @SIGIRConf @ACMSIGIR
Here is the links to our slides for the Query Performance Prediction tutorial @ecir2024 in Glasgow docs.google.com/presentation/d… #ECIR2024
Here is the links to our slides for the Query Performance Prediction tutorial @ecir2024 in Glasgow docs.google.com/presentation/d… #ECIR2024
I forgot to tweet this out! 😅 "Analysing Utterances in LLM-based User Simulation for Conversational Search" with @maliannejadi and Fabio Crestani accepted to TIST! 🥳 Full paper here: dl.acm.org/doi/10.1145/36…
🚀 Can we rely on LLMs’ internal knowledge to answer complex questions? 🚀 In our recent work with @maliannejadi, we propose a method for generating multiple queries to cover different aspects of the user’s information needs. The paper is available: arxiv.org/abs/2403.19302
Pleasant surprise to walk into the #qpp tutorial after the #ir4good session to see that one of my papers is being explained by @NegarEmpr. Thanks to the organisers for a very good tutorial on a very important topic @ChuanMg @maliannejadi @ebrahim_bagheri @ecir2024
Shubham Chatterjee | .. @ShubhamC526
1K Followers 2K Following Research Associate | University of Edinburgh , Scotland | Neural IR | Representation Learning | Conversational IR | Tweets are my own opinionFernando Diaz @841io
5K Followers 1K Following Associate Professor, CMU. Researcher, Google. Evaluation and design of information retrieval and recommendation systems, including their societal impacts.Leo Boytsov @srchvrs
7K Followers 2K Following Sr. Research Scientist @AWS Labs (ph-D @LTIatCMU) working on unnatural language processing, speaking πtorch & C++. Opinions sampled from MY OWN 100T param LM.Debasis Ganguly @debforit
651 Followers 375 Following Lecturer/Asst. Professor at the School of Computing, University of Glasgow (@UofGlasgow/@GlasgowCS/@IDAglasgow/@ir_glasgow)Sean MacAvaney @macavaney
1K Followers 476 Following he/him · Lecturer (Assistant Professor) at @GlasgowCS @TerrierTeam · working at the intersection of IR&NLP · PhD from @Georgetown IRLab Website: https://t.co/TvZBNq61EySole Pera @DrCh0le
1K Followers 644 Following Associate Professor @wisdelft @tudelft, Misses Rosario, 🧉 Enthusiast, #RecSys #InformationRetrieval #IR4U2 #KidRecArian Askari @arian_ask
463 Followers 779 Following Final year PhD Candidate @UniLeiden | VR @Irlab_amsterdam | Interested in IR, NLP, Large Language ModelsGuido Zuccon @guidozuc
1K Followers 701 Following Professor at The University of Queensland, leader of @IELabGroup (https://t.co/yLTRjRQAWA), Information Retrieval researcherThe IRLab at the Univ.. @irlab_amsterdam
2K Followers 185 Following The IRLab at U. of Amsterdam, w/ Mohammad Aliannejadi @maliannejadi, Evangelos Kanoulas @ekanou, Maarten Marx, Maarten de Rijke @mdr, Andrew Yates @andrewyatesHossein A. (Saeed) Ra.. @srahmanidashti
756 Followers 2K Following PhD Student at WI (@ucl_wi_group) | @FAICDT1 | @UCLMark Sanderson @IR_oldie
4K Followers 247 Following I'm a search engine researcher. I tweet about information retrieval (IR) and uni work. I'm at RMIT University, these are my personal opinions.Maartje ter Hoeve @maartjeterhoeve
2K Followers 380 Following Machine Learning Researcher @Apple MLR • PhD from @UvA_Amsterdam • MSc AI, BA Linguistics • Interned @Apple MLR; @MetaAI; @MSFTResearch; @BlendleResearchDamiano Spina @damiano10
1K Followers 1K Following PhD in Comp Sci., Senior Lecturer, @RMITComputing, @AdmsCentre, @arc_gov_au DECRA. CM Camaleão, Capoeira @ACDP_Australia. Percussionist at @Wombatuque.Webis Group @webis_de
707 Followers 402 Following Research group working the fields of Information Retrieval, Natural Language Processing, Data Mining, Machine Learning, and Artificial Intelligence.Elmeerakh @iillmeeraa
0 Followers 20 Following Ph.D. In knowledge and Information science, Shiraz University, Researcher in Information Retrieval, User Behavior and User ExperienceTesarknioth @tesarkniot47078
0 Followers 85 FollowingLiang Ding @liangdingNLP
471 Followers 1K Following NLP/ML Researcher (working on developing LLM and exploring its way to AGI) & Ex-@JD_Corporate @TencentGlobal @Sydney_Uni. Opinions are my own.Peffayr @peffayr994
0 Followers 93 FollowingGiovanni Trappolini @GioTrappolini
121 Followers 247 Following Research Fellow in AI @Sapienza_EngineeringFarzin Maghoul @FMaghoul
9 Followers 145 FollowingBaohaoLiao @baohao_liao
145 Followers 262 Following PhD for NLP @UvA_Amsterdam. Previously study @RWTH @sjtu1896ACM CIKM 2024 @cikm2024
45 Followers 84 Following 33rd ACM International Conference on Information and Knowledge ManagementAli Rasekh @AliRase43860963
1 Followers 11 FollowingPhillip Lippe @phillip_lippe
2K Followers 426 Following PhD student at @UvA_Amsterdam (@quvalab), @GoogleDevExpert JAX/Flax | Prev.: Intern @GoogleDeepMind, @MSFTResearchRaj Arasu @arasraj
86 Followers 496 FollowingShivam Pandey @ShivamPR21
173 Followers 4K Following Past: Research Engineer Intern @_FiveAI | SR. Student Research Associate @ IITK - SERB | ADAS Intern @BoschGlobal | BTech - MTech GeoInformatics, @IITKanpurShiguang Wu @shiguang_wu
49 Followers 213 Following MSc student in the IRLAB at Shandong University. Working on Information Retrieval.Jonah Turner @drexalt
324 Followers 931 Following grinding ml, current master's student 🇫🇷 e/acc - gpu kernels - computer visionEva Louise Marie Gabr.. @e681554349
9 Followers 3K Followingrohit babbar @rohitbabbar_rb
150 Followers 1K Following ML/AI academic @ University of Bath, UK & Aalto University, Finland. Views are personalPratyay Banerjee (ন.. @Neilzblaze007
240 Followers 4K Following I live in the shadows, but I watch everything.Rigoberto Barber @BarberRigo91531
8 Followers 673 FollowingMehdi Elahi @mehdielaahi
385 Followers 652 Following Associate Professor in 🇳🇴 Social Science Faculty @UiB WP-Leader @SFIMediaFutures Co-founder of https://t.co/KE0FEhhXHg Group Former member of @Polimi @UniBzYumeng Wang @YumengWang13
47 Followers 210 FollowingMilad Momeni @milad1372
26 Followers 130 Following Ph.D. Student in Human-Computer Interaction @UofRegina C₈H₁₀N₄O₂Yuanna Liu @YuannaLiu6
9 Followers 27 Following미카일 @mikxtwt
12 Followers 142 Following Ph-Ding | Hate reviewers 1 and 4 | Caffeine addict | Outer space 🌌 freaks me out | 🐈 rule | La ilaha illa anta subhanaka inni kuntu minaz-zaliminReNeuIR Workshop @ SI.. @ReNeuIRWorkshop
134 Followers 54 Following The 3rd Workshop on Reaching Efficiency in Neural Information Retrieval (ReNeuIR) to be held jointly with ACM SIGIR 2024Himanshu Beniwal @HimanshuBeniwaI
261 Followers 896 Following #NLP #ML #AI PhD Student at @lingoiitgn, @iitgn. Alum: @cup_bathinda & @h_garhwalBenjamin @disraeliXII
378 Followers 4K Following Defender of the principles of Western culture. Preferred pronouns: My Lord and Master. Gladstonian liberal. Not to be mistaken for regressive lefties.mohamad sobhi @8422421147
0 Followers 13 FollowingS Khan @khan_saiful_
86 Followers 2K Followingかや @Kaya815_
114 Followers 346 FollowingYaroslav Golubev @areyde
405 Followers 1K Following Research administrator and data analyst in the ML4SE lab @JetBrains. Love empirical SE, writing papers and poetry, philosophy, and the world.vishal @sirsystems2
36 Followers 2K FollowingIstituto di Scienza e.. @IstiCnr_It
214 Followers 196 Following CNR-ISTI Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" è il maggiore istituto @CNRsocial_ per l'informatica (🇬🇧 @IstiCnr)Zhi-Quan Feng @ZhiQuanFeng1046
4 Followers 43 Followingcosimorulli @cosimorulli1
36 Followers 132 Following Researcher at the High Performance Computing Lab, ISTI, CNR.kidist Amde Mekonnen @kidist_amde
84 Followers 243 Following Ph.D. student at @irlab_amsterdam, University of Amsterdam |IR | Multimodal learning | XAIAdam Roegiest @AdamRoegiest
26 Followers 27 Following I sometimes do stuff as the VP, Research & Technology @ Zuva. Coffee/Lego/Cooking enthusiast.Jasmin Kareem @JasKareem
29 Followers 103 Following PhD candidate in explainable recommendations at @irlab_amsterdam and @jadatascienceShrestha Mohanty @shremoha
47 Followers 187 Following Grad Student Researcher @MIT, prev: Applied Scientist @Microsoft, MS @UCberkeley. Interested in AI, ML and NLPMichal Lukasik @miclukasik
130 Followers 194 Following Research Scientist at Google Research, New York.Reza Barzegar Nozari @BarzegarNozari
12 Followers 104 Following Skilled in Data Science, Machine learning, and scripting languages (Python and MATLAB). Interested in Recommender System.Shubham Chatterjee | .. @ShubhamC526
1K Followers 2K Following Research Associate | University of Edinburgh , Scotland | Neural IR | Representation Learning | Conversational IR | Tweets are my own opinionFernando Diaz @841io
5K Followers 1K Following Associate Professor, CMU. Researcher, Google. Evaluation and design of information retrieval and recommendation systems, including their societal impacts.Nicola Ferro @frrncl
1K Followers 209 Following Information Retrieval, Digital Libraries, Evaluation - Full Professor in Computer Science at @UniPadova, leading @iiia_unipd #RussiaUkraineConflict #againstwarYann LeCun @ylecun
711K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.Leo Boytsov @srchvrs
7K Followers 2K Following Sr. Research Scientist @AWS Labs (ph-D @LTIatCMU) working on unnatural language processing, speaking πtorch & C++. Opinions sampled from MY OWN 100T param LM.Debasis Ganguly @debforit
651 Followers 375 Following Lecturer/Asst. Professor at the School of Computing, University of Glasgow (@UofGlasgow/@GlasgowCS/@IDAglasgow/@ir_glasgow)Sean MacAvaney @macavaney
1K Followers 476 Following he/him · Lecturer (Assistant Professor) at @GlasgowCS @TerrierTeam · working at the intersection of IR&NLP · PhD from @Georgetown IRLab Website: https://t.co/TvZBNq61EySole Pera @DrCh0le
1K Followers 644 Following Associate Professor @wisdelft @tudelft, Misses Rosario, 🧉 Enthusiast, #RecSys #InformationRetrieval #IR4U2 #KidRecGlasgow IR Group @ir_glasgow
1K Followers 128 Following Glasgow Information Retrieval Group @GlasgowCSArian Askari @arian_ask
463 Followers 779 Following Final year PhD Candidate @UniLeiden | VR @Irlab_amsterdam | Interested in IR, NLP, Large Language ModelsGuido Zuccon @guidozuc
1K Followers 701 Following Professor at The University of Queensland, leader of @IELabGroup (https://t.co/yLTRjRQAWA), Information Retrieval researcher(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingFrançois Chollet @fchollet
469K Followers 770 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.Andrej Karpathy @karpathy
979K Followers 904 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥The IRLab at the Univ.. @irlab_amsterdam
2K Followers 185 Following The IRLab at U. of Amsterdam, w/ Mohammad Aliannejadi @maliannejadi, Evangelos Kanoulas @ekanou, Maarten Marx, Maarten de Rijke @mdr, Andrew Yates @andrewyatesLiang Ding @liangdingNLP
471 Followers 1K Following NLP/ML Researcher (working on developing LLM and exploring its way to AGI) & Ex-@JD_Corporate @TencentGlobal @Sydney_Uni. Opinions are my own.Chris Samarinas @CSamarinas
253 Followers 976 Following CS PhD at CIIR @manningcics, founder of @NagetInc. Researcher in NLP & Information Retrieval, trying to organize the world's content better than my sock drawer.Giovanni Trappolini @GioTrappolini
121 Followers 247 Following Research Fellow in AI @Sapienza_EngineeringACM CIKM 2024 @cikm2024
45 Followers 84 Following 33rd ACM International Conference on Information and Knowledge ManagementBaohaoLiao @baohao_liao
145 Followers 262 Following PhD for NLP @UvA_Amsterdam. Previously study @RWTH @sjtu1896Phillip Lippe @phillip_lippe
2K Followers 426 Following PhD student at @UvA_Amsterdam (@quvalab), @GoogleDevExpert JAX/Flax | Prev.: Intern @GoogleDeepMind, @MSFTResearchYibin Lei🐶 @LeiYibin
15 Followers 409 FollowingJasmin Kareem @JasKareem
29 Followers 103 Following PhD candidate in explainable recommendations at @irlab_amsterdam and @jadatasciencemrz.salehi @MrzSalehi
149 Followers 87 Following PhD Candidate @UvA_Amsterdam @QUvALab @ELLISforEuropeTroll Football @TrollFootball
4.0M Followers 574 Following 🚨 Don't follow us if you can't take a troll on your fav club/player. Contact: [email protected] #NoVoteToBJP #ModiHataoDeshBachaoShiguang Wu @shiguang_wu
49 Followers 213 Following MSc student in the IRLAB at Shandong University. Working on Information Retrieval.dinos @din0s_
799 Followers 424 Following IR & NLP Research @ZetaVector. Interested in Neural Information Retrieval, Language Modeling, and Explainable AI. Prev: MSc AI @UvA_AmsterdamYumeng Wang @YumengWang13
47 Followers 210 FollowingReka @RekaAILabs
11K Followers 13 Following An AI research and product company 🫠. We are a team of scientists and engineers building state-of-the-art multimodal language models 😻LLM4IREval Workshop @llm4eval
15 Followers 23 Following First Workshop on Large Language Models for Evaluation in IR (LLM4IREval@SIGIR2024)Milad Momeni @milad1372
26 Followers 130 Following Ph.D. Student in Human-Computer Interaction @UofRegina C₈H₁₀N₄O₂Yuanna Liu @YuannaLiu6
9 Followers 27 FollowingAtefe Hassani @HassaniAtefe
19 Followers 51 Following Interested in Medical Imaging and Signal ProcessingProf. Paola Grosso @PaolaGrossoWork
370 Followers 153 Following Computer scientist at @UvA_Amsterdam. Scientific director @UvA_IvI. Member of the MNS research group (@MnsUva). h.ReNeuIR Workshop @ SI.. @ReNeuIRWorkshop
134 Followers 54 Following The 3rd Workshop on Reaching Efficiency in Neural Information Retrieval (ReNeuIR) to be held jointly with ACM SIGIR 2024cosimorulli @cosimorulli1
36 Followers 132 Following Researcher at the High Performance Computing Lab, ISTI, CNR.kidist Amde Mekonnen @kidist_amde
84 Followers 243 Following Ph.D. student at @irlab_amsterdam, University of Amsterdam |IR | Multimodal learning | XAIAdam Roegiest @AdamRoegiest
26 Followers 27 Following I sometimes do stuff as the VP, Research & Technology @ Zuva. Coffee/Lego/Cooking enthusiast.Michal Lukasik @miclukasik
130 Followers 194 Following Research Scientist at Google Research, New York.Shrestha Mohanty @shremoha
47 Followers 187 Following Grad Student Researcher @MIT, prev: Applied Scientist @Microsoft, MS @UCberkeley. Interested in AI, ML and NLPYoga for Academics @yoga4academics
1K Followers 150 Following Deadline-friendly yoga & empowering topics for academics 🪷Secure Learning Lab (.. @uiuc_aisecure
938 Followers 289 Following We are a computer science research group led by Bo Li at UIUC, focusing on responsible and trustworthy machine learning.Stanford Trustworthy .. @stai_research
134 Followers 47 Following A research group in @StanfordAILab researching AI Capabilities, Trust and Safety, Equity and Reliability Website: https://t.co/CgOHvNHL4xEhud Reiter @EhudReiter
2K Followers 88 Following I am a computer scientist who works on natural language generation and evaluation, often in healthcare contexts. I teach at Aberdeen University.Yougang Lyu @yougang_lyu
26 Followers 200 FollowingPhilip Vollet @philipvollet
29K Followers 5K Following Head of Developer Growth @weaviate_io & Open source lover tweeting about machine learning and data science projects.Erbacher Pierre @Pi_Erbacher
31 Followers 67 FollowingRuizhe Li @liruizhe94
664 Followers 2K Following Lecturer (Assistant Professor) @ABDNCompSci | Ex Postdoc research fellow @ucl_wi_group | PhD CS @SheffieldNLPYuntian Deng @yuntiandeng
3K Followers 3K Following #NLProc Postdoc @ai2_mosaic | Assistant Professor @UWaterloo '24 | Faculty Affiliate @VectorInst '24 | PhD @HarvardPhilip Tannor @PhilipTannor
5K Followers 5K Following CEO at Deepchecks | Moderator at https://t.co/eIctpd8n3A | Forbes 30 Under 30 | Open Source Validation of AI & LLMs https://t.co/e8ivMRLuEpOpen Search Foundatio.. @openwebsearch
241 Followers 235 Following (OSF) is a non-profit initiative working on concepts for a cooperative, open and distributed Internet search. Imprint: https://t.co/Tf2FKmLIvHSajad Ebrahimi @sadjadeb
71 Followers 71 Following MASc student at University of Guelph | NLP Enthusiast, Interested in Information RetrievalAlain Starke 🦙 @alainstarke
993 Followers 787 Following Top-3 wimpers op je feestje | Assistant Professor Persuasive Communication @UVA_ASCOR | Assoc. Prof. II Recommender Systems @InfoMedia_uib @SFIMediaFuturesNaghmeh Jamali @NaghmeAi
21 Followers 281 Following Natural Language Processing, Computer Vision, Trustworthy NLP Models.Fereshte Khani @fereshte_khani
5K Followers 859 Following @OpenAI, ex-@Microsoft, CS Ph.D. @stanfordAILab, working on reliability, and alignment in machine learning.Nathan Lambert @natolambert
25K Followers 689 Following Figuring out AI @allen_ai, "rl boi" DM me papers. Writes @interconnectsai, talks @retortai Has phd and some credentialsAleksandr V. Petrov @asash
550 Followers 235 Following PhD researcher (Recommender Systems) @TerrierTeam, University of Glasgow. Ex. Senior Software Engineer @Amazon. The opinions are mine.بیزینس لانچ کردم برا تولد پادشاه و به به🥰 خیلی تجربه باحالی بود ❤️
1/4 Our reproducibility paper “Measuring Item Fairness in Next Basket Recommendation: A Reproducibility Study” w/ @MingL_7 @mzhariann @MansouryMasoud @maliannejadi @mdr was presented at #ECIR2024 Paper: link.springer.com/chapter/10.100…
Although I couldn’t make it myself tonight, it’s really cool to see our Responsible Media Lab highlighted at @RecSysNL by @McWillemsen!
#RecSysNL is back. @McWillemsen is opening the session introducing @jadatascience . P.S. the location is just amazing. Thanks @DPGMediaAI for sponsoring the RecSysNL.
If you are a grant agency looking for grant reviewers for grants paying out millions, you should use a little of that money to compensate your reviewers.
🚀 Exciting news! The deadline for submitting papers on LLMs for IR evaluation has been extended to May 2nd, 2024. Don't miss this opportunity to showcase your research and advancements in #AI, #IR, and #NLP. Submit your work now!📝🔍 #DeadlineExtension #LLM #IR #SIGIR2024
Only a few days left for the #LLM4Eval! If you have any research relevant to LLM for evaluation in the application of IR and NLP, do not miss the deadline for the LLM4Eval workshop at SIGIR2024. 🗓Deadline: April 25th, 2024 🌐CFP: llm4eval.github.io #IR #NLP #SIGIR2024
And we celebrated the 500th promotion chaired by prof. Peter van Emde Boas. What a milestone! . Thanks from @UvA_IvI! I’m sure many here on Twitter/x had him as chair during their defense.
Special day at the Agnietenkapel yesterday. With a double whammy. Dr. Misha Mesarcik defended very well his dissertation (@MnsUva @UvA_IvI @daily_image)
📢 SynTOD: An Effective Approach to Synthetic Data Generation for Task-Oriented Dialogue Systems 🤖💬 arxiv.org/abs/2404.14772 It enables TODS to handle:🎯Intent Classification & Slot Filling, 🔍 Search & Filtering,📝 Summarization & RAG... without relying on real data👇
🔥A new milestone for Generative Retrieval on large-scale IR datasets! We propose a new GR framework-PAG, outperforming many SOTA dense retrieval models on MS MARCO 8.8M while only requiring x7.7 less index memory. Preprint: arxiv.org/pdf/2404.14600… Code: github.com/HansiZeng/PAG
TL;DR: Generate diverse synthetic data for your domain-specific task-oriented dialogue system using LLMs by doing random walk over the state transition graph. This will lead to a substantial performance boost.
📢 SynTOD: An Effective Approach to Synthetic Data Generation for Task-Oriented Dialogue Systems 🤖💬 arxiv.org/abs/2404.14772 It enables TODS to handle:🎯Intent Classification & Slot Filling, 🔍 Search & Filtering,📝 Summarization & RAG... without relying on real data👇
Our #SIGIR2024 paper about evaluating retrieval models in RAG pipelines is now on Arxiv! We also release a Python package too! "Evaluating Retrieval Quality in Retrieval-Augmented Generation" @HamedZamani github.com/alirezasalemi7… arxiv.org/abs/2404.13781 Thread 🧵👇 1/7
@armancohan's talk on LLMs for multi-document contexts is now available on YouTube: youtube.com/watch?v=vR_lt2…
Today's (April 19) CIIR Talk at 1:30 PM EDT: Piecing the Puzzle: Language Models for Multi-Document Contexts by @armancohan from @YaleCompsci It will be livestreamed. Learn more here: ciir.cs.umass.edu/node/742
We're extending the submission deadline for the Gen-IR workshop [coda.io/@sigir/gen-ir-…] to May 2. We did that last year, let's make it a tradition 😀
Wondering how to evaluate the retrieval quality in RAG pipelines? check this out! TL;DR: evaluating based on the passages that contain groundtruth answers or KILT's provenance labels has low correlations with end-to-end RAG performance. Try "pip install erag" instead! #SIGIR2024
Our #SIGIR2024 paper about evaluating retrieval models in RAG pipelines is now on Arxiv! We also release a Python package too! "Evaluating Retrieval Quality in Retrieval-Augmented Generation" @HamedZamani github.com/alirezasalemi7… arxiv.org/abs/2404.13781 Thread 🧵👇 1/7
He’s working overtime to help fill the Etihad
Last week I gave my lecture on Parameter-Efficient Finetuning (PEFT) at the @UvA_IvI MSc in AI - Foundation Models course! Find the slides here: dropbox.com/scl/fi/gngd55q… and the rest of our course with @cgmsnoek: uvafomo.github.io
Last Friday, we had a visit by @leifos, who presented the paper "Information Seeking Challenges of Socially Responsible Consumers" dl.acm.org/doi/10.1145/36… in our group meeting.
Today, Andrew Yates @andrewyates from the University of Amsterdam will give an in-person seminar at ISTI-CNR (@IstiCnr) entitled "An encoder-centric view of neural retrieval". Thanks @andrewyates!