Generation Evaluation & Metrics Workshop @gem_workshop

Official Handle of the 💎 Generation Evaluation & Metrics (GEM) workshop (ACL 2021, EMNLP 2022, EMNLP 2023) gem-benchmark.com Joined July 2023

Tweets

33
Followers

85
Following

2
Likes

14

Yufang Hou @yufanghou

2 years ago

📢Please help us to spread the word: the GEM human evaluation team is launching a new multilingual shared task on data-to-text generation and summarization. More information at gem-benchmark.com/shared_task. We are looking forward to receiving your submissions! #NLProc #NLP

1 17 31 3K 4

Vered Shwartz @VeredShwartz

2 years ago

Finally, @ShuhaibMehri will present his work on instruction tuning for automatic evaluation of generative tasks (arxiv.org/abs/2310.20072) at the GEM workshop on Wed, Dec 6 at 11am SGT. He is applying to grad schools, talk to him if you're recruiting :) 7/7

0 5 12 2K 0

Download Image

Tiancheng Hu @tiancheng_hu

2 years ago

On my way to @emnlpmeeting soon! Join me at @gem_workshop in Leo 2, 2:30pm on Dec 6 for a presentation about this paper. Thrilled to also contribute as a panelist in @WiNLPWorkshop on "Tackling Misinformation in Generative AI", 11:00am-12:00 in Leo 1 on Dec 6. See you there!

Tiancheng Hu @tiancheng_hu

2 years ago

2 35 134 29K 61

0 2 21 2K 1

Janet Liu @janetlauyeung

2 years ago

1⃣ Stop by my poster presentation at the @gem_workshop on Dec 6 at 11:00am-12:30pm if you're interested in evaluating summarization for non-news data and how discourse structures can support applications like summarization across text types aclanthology.org/2023.findings-…

1 2 9 2K 0

BathNLP @BathNLP

2 years ago

We have three papers led that will be presented at #EMNLP2023 and #GEMWorkshop centered around readability assessment and language model evaluation ✍️📢 Work done by @josephimperial_ and @harish See you in Singapore! 🌃🇸🇬

0 2 13 5K 2

Download Image

Generation Evaluation & Metrics Workshop @gem_workshop

2 years ago

Excited🤩for the 3rd GEM Workshop EMNLP 2023! Here's the schedule for Dec 6! (in Singapore🇸🇬time) 9-10:30 Opening Remarks + 6 12min talks 10:30-11🧋Coffee Break 11-12:30🪧Poster Sess 1 12:30-14🍕Break 14-15:30 7 12min talks 15:30-16🧋Covfefe Break :P 16-17:30🪧Poster Sess 2 👇🏻

1 5 11 3K 0

Meriem @mellem_boo

2 years ago

Excited to present our recent work at the GEM 💎Workshop, EMNLP 2023: “Elo Uncovered: Robustness and Best Practices in Language Model Evaluation” w/ @eddotman, @beyzaermis, @sarahookr, @mziizm 📃: arxiv.org/abs/2311.17295

1 6 30 3K 9

Download Image

Learn Prompting @learnprompting

2 years ago

At #EMNLP right now? Check out the GEM💎workshop. A lot of good prompt-based stuff 👇🧵 gem-benchmark.com/workshop

3 3 4 753 0

Kaustubh Dholé @KaustubhDhole

2 years ago

📢'LLMs as SocioTechnical Systems' accepted@TheBigPicture Workshop #EMNLP2023 aclanthology.org/2023.bigpictur… Through previous studies, the paper discusses 5 common ML traps that LLMs fall into proposing ways to address points of LLM failure by gauging from a socio-technical lens.

0 2 3 290 1

Sebastian Gehrmann @sebgehr

2 years ago

GEM logistics update: The venue has internet issues and we cannot get a stable zoom connection. If you are scheduled to give a talk in the early session and have the ability to go this afternoon instead let us know and we will reshuffle things. We are continuing to try to join.

1 2 5 2K 0

Yixin Wan @yixin_wan_

2 years ago

Might be slightly last minute, but I’m thrilled to announce that I will also be giving a talk on our paper in the @gem_workshop this afternoon! 🤩 The session will start at 2pm, in room Leo 2, but it will also be co-hosted through zoom. Drop by and say hi! 😁

Yixin Wan @yixin_wan_

2 years ago

2 7 82 25K 10

Download Image

0 2 30 20K 0

Yuling Gu @gu_yuling

2 years ago

Check out our poster "Robust Tooling and New Resources for Large Language Model Evaluation via Catwalk" at the @gem_workshop (11am - 12.30pm, Dec 6). Visit my collaborators from @allen_ai there too!

1 1 9 386 0

Nishant Subramani @nsubramani23

2 years ago

Heading to #EMNLP2023 today! Would love to catch up with old friends and meet new folks excited about interpretability, generation, and understanding LM internals 🔧 📜 - My collaborators at @allen_ai are presenting our poster on LM eval at the @gem_workshop at 11am today!

1 2 23 2K 1

Khyathi Chandu @khyathi_chandu

2 years ago

Today and Now!!! Checkout the fantastic talks and posters lined up at #GEM at #EMNLP2023. If you are interested in generation and evaluating it, come join us in room *Leo* for the exciting schedule today 🤩🤩 #NLProc

Generation Evaluation & Metrics Workshop @gem_workshop

2 years ago

1 5 11 3K 0

0 1 13 1K 0

Sebastian Gehrmann @sebgehr

2 years ago

GEM workshop logistics: we are in LEO 2. Up two escalators and a bit of a walk. We have a rocket chat channel #gem-workshop we will monitor for questions. See you soon!

0 1 6 881 0

Kaustubh Dholé @KaustubhDhole

2 years ago

Checkout the schedule for the GEM workshop below and the awesome posters lined up! 👇 December 6 -> 9 am Singapore time!

Generation Evaluation & Metrics Workshop @gem_workshop

2 years ago

Checkout the schedule for the GEM workshop below and the awesome posters lined up! 👇 December 6 -> 9 am Singapore time!

1 5 11 3K 0

0 2 5 428 0

Jekaterina Novikova @j-novikova-nlp.bsky.social @J_Novikova_NLP

2 years ago

Looking forward to the GEM workshop at EMNLP ( @gem_workshop) where 45 papers on evaluation, generation and metrics were accepted this year! As AC I only saw 6 of them so far, and all the accepted ones presented interesting approaches and valuable contributions - don't miss!