🔍Hallucination or informativeness? 🤔Our latest research unveils a multi-dimensional benchmark and an LLM-based metric for measuring faithfulness and coverage in LVLMs. Explore our new method for a more reliable understanding of model outputs! 📣arxiv.org/pdf/2404.13874…
Our team in FAIR (at Meta) is hiring researchers (RS & PostDoc) to work on the broad topics of text and multimodal LLMs.
Location: NY, Seattle or Menlo Park for RS, and Seattle for PostDocs.
PostDoc: metacareers.com/jobs/968496244…
Research Scientist, AI (PhD): metacareers.com/jobs/752169417…
How to enjoy the best of both worlds of efficient training (less communication and computation) and inference (constant KV-cache)?
We introduce a new efficient architecture for long-context modeling – Megalodon that supports unlimited context length. In a controlled head-to-head…
📢 We propose a new benchmark called PhonologyBench for testing how well LLMs perform on three tasks that require sound knowledge : phonemic transcription, counting syllables, and listing possible rhymes.
w/ Harshita Khandelwal, @VioletNPeng 1/3
I had a great time visiting UCLA and USC during the spring break to give talks on "Amazing Multilingual Capabilities and Concerning Cultural Biases in Large Language Models".
Thanks to @_jessethomason_@VioletNPeng@kaiwei_chang@robinomial for hosting!
Remember AMR?🤭 Turns out, with its clear, structured representation of the semantic information in text, we can targetedly generate challenging negative examples with disguising hallucination to train automatic evaluators to spot them! #NAACL24
Remember AMR?🤭 Turns out, with its clear, structured representation of the semantic information in text, we can targetedly generate challenging negative examples with disguising hallucination to train automatic evaluators to spot them! #NAACL24
Proud of this work where we show event detection can generalize from one epidemic to another by identifying epidemic-related event types (e.g. symptoms) even if the actual mentions (e.g. of symptoms) are distinctive. So training on COVID, we can generalize to Monkeypox! #NAACL24
Proud of this work where we show event detection can generalize from one epidemic to another by identifying epidemic-related event types (e.g. symptoms) even if the actual mentions (e.g. of symptoms) are distinctive. So training on COVID, we can generalize to Monkeypox! #NAACL24
💡Can LLMs like GPT-4 reason creatively? Excited to share our latest research on AI and creativity! 🚀 Introducing MacGyver: a new playground for everyday innovation and physical reasoning --we collect problems to trigger unconventional usage of objects and innovative solutions.
📢 I'm recruiting a postdoc at UMD
🗓️ Starting in 2024
🖥️🙋 Topics related to human-AI interaction
🔜 Apply by May 31, but earlier if possible!
🤑 $75-$80k+benefits, unencumbered (ie not "big project") funding
Link to full post and form for applications in thread.
>
A Design Space for Intelligent and Interactive Writing Assistants #CHI2024 👩🏻✏️🤖
What writing assistants do you use? What else are out there and how do they differ? What do we need to consider when designing new writing assistants?
🔗 arxiv.org/abs/2403.14117 (1/6)
I joined OpenAI a few months ago, and I find it extremely rewarding to try to help with safety/privacy/fairness/etc in AI systems used by many people. If you are interested in these important problems, please apply at openai.com/careers/search…
EMNLP 2024 invites the submission of long and short papers featuring substantial, original, and unpublished research on empirical methods for Natural Language Processing. More info at: 2024.emnlp.org/calls/main_con…#EMNLP2024
New multimodal leaderboard on the hub 🚀
Many situations require models to parse images containing text: maps, web pages, real world pictures, memes, ... 🖼️
& the ConTextual team introduced a brand new dataset to evaluate how good models are on this!
huggingface.co/blog/leaderboa…
🚨Summer AI Research Internships🚨
The @TechAtBloomberg office of the CTO is looking for summer AI research interns! ML, NLP, Vision, LLMs
Spread the word.
Interested candidates should apply here:
forms.gle/niB9ZU6eEi6iEz…
✨New Paper Alert✨
Adding safety prompts can safeguard LLMs against harmful inputs, but do you know how they intrinsically work?
Check our latest paper: We study the working mechanisms of safety prompts from the perspective of model representations
📄arxiv.org/abs/2401.18018
🚀Excited to introduce ConTextual, a study on the capabilities of the LLMs (GPT-4V, Gemini, LLaVA) to perform joint reasoning over the text and visual content in the images.
GPT-4V is behind humans on this task by 30.8%!
📜 arxiv.org/abs/2401.13311
🌐 con-textual.github.io
ACL announcement:
"The ACL Executive Committee has voted to significantly change ACL's approach to protecting anonymous peer review. The change is effective immediately. (1/4) #NLPRoc
60K Followers 2K Followinga combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
6K Followers 2K FollowingResearch @allen_ai. I evaluate (multi-modal) LLMs, build agents, and study the science of LLMs. Previously: @GoogleAI & @MetaAI FAIR @nlp_usc
35K Followers 3K FollowingAI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
6K Followers 1K FollowingI like tokens! Lead for OLMo data team at @allen_ai (makin Dolma 🍇), open source science fan, @QueerInAI organizer 🤖☕️🍕they/them
11K Followers 519 FollowingAI researcher @UWaterloo @GoogleAI @VectorInst. Interested in natural language processing, diffusion models. I direct TIGER-Lab at UWaterloo.
7K Followers 1K FollowingMultimodal and Embodied AI Researcher / Professor @UCSC. Director of https://t.co/Y4swOBag21. AI for Humanity in the long run. he/him
4K Followers 786 FollowingJohn C Malone Professor at @JohnsHopkins @JHUCompSci @jhuclsp @jhumceh; Part time @techatbloomberg (tweets my own) Mastodon @[email protected]
7K Followers 1K FollowingWaiting on a robot body. ML/NLP. All opinions are universal and held by both employers and family. Same username on every lifeboat off this sinking ship.
239 Followers 751 FollowingSenior Research Fellow in University of Oxford @OxfordTVG
Faculty Researcher @Google
#ResponsibleAI #AISafety #GenAI
Homepage: https://t.co/YOSVO3jb6h
237 Followers 2K FollowingScientist Researcher @ Tübingen University and Professorial Research Fellow @ Fudan University, and interested in LLMs, NLP, and computational cognition .
648 Followers 5K FollowingTwitter Nerd... Interested in Deep Learning (self-supervised learning & LLMs), Astrophysics (exoplanets), and Cosmology (CMB).... I like to build things
217 Followers 2K FollowingEntrepreneurship and Strategy Ph.D. Candidate @LancasterManage/ Interested in Innovation, Strategy, and Artificial Intelligence | AI Strategy and Organisation
25 Followers 291 FollowingThe official account of the International Workshop on Sustainable Transition with AI collocated with IJCAI 2024 | #IJCAI_STAI2024 #IJCAI2024
60K Followers 2K Followinga combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
35K Followers 3K FollowingAI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
7K Followers 1K FollowingMultimodal and Embodied AI Researcher / Professor @UCSC. Director of https://t.co/Y4swOBag21. AI for Humanity in the long run. he/him
4K Followers 786 FollowingJohn C Malone Professor at @JohnsHopkins @JHUCompSci @jhuclsp @jhumceh; Part time @techatbloomberg (tweets my own) Mastodon @[email protected]
7K Followers 1K FollowingWaiting on a robot body. ML/NLP. All opinions are universal and held by both employers and family. Same username on every lifeboat off this sinking ship.
23K Followers 211 FollowingI finished school at 16 & bachelor at 18. I share my journey to help people become lifelong learners. Building @GeniusGTX, @cajunkoi, https://t.co/RjMFcaaDZi.
1K Followers 910 FollowingInterdisciplinary researcher interested in modality, discourse, and dialogue.
Assistant Professor of CS @Khoury College, Northeastern University
2K Followers 377 FollowingIncoming Assistant Professor @umdcs and Research Scientist @RealityLabs. Previously PostDoc @StanfordAILab and Ph.D. @UTCompSci. I teach machines 👀👂🖐️.
4K Followers 2K FollowingAssistant Professor @UWCSE developing computational methods that leverage large-scale behavioral data to improve human well-being. Recruiting PhD students :-)
2K Followers 164 FollowingBuilding embedding/vectorization models, customized for your domain and company, for better retrieval quality
https://t.co/MEAhTpBQqd
2K Followers 673 FollowingNLP Prof @MBZUAI, & @UH, Director @RiTUAL_Lab. Friend, mother, partner, loves sunny days and live music. EiC @reviewAcl and ARR board. Views are my own.
229K Followers 3K Following@NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
3K Followers 423 FollowingPostdoc @Stanford, Incoming Assistant Professor @Northwestern, PhD @UIUC. Working on Knowledge Foundation Models, especially for Multimodal data (Language + X).
702 Followers 135 FollowingMIT Postdoc, incoming NYU Faculty Fellow and UCLA Assistant Professor. In her free time, interested in generation and ethics of AI.
2K Followers 597 FollowingComputer science prof at Carnegie Mellon @SCSatCMU. Researcher in algorithms and machine learning. Study privacy, fairness, and algorithmic economics. he/him
5K Followers 2K FollowingHead of NLP, CTO office, @Bloomberg. (he/him)
Generating natural language, one word at a time. Also making sense of that language afterwards. views my own
3K Followers 452 FollowingPostdoc at @MSFTResearch | Assistant Professor at @UChicagoCS (2024) | PhD at @Stanford | Language models, AI-assisted writing, Human-AI interaction ✍️
2K Followers 320 FollowingStaff Research Scientist @Apple AI/ML. Ex-Principal Researcher @Microsoft Azure AI. Working on building large-scale vision and multimodal foundation models.
4K Followers 2K FollowingAssistant professor of @umdcs @umiacs @ml_umd at UMD. Researcher in #AI/#ML, #Trustworthy AI/ML, #EthicalAI, AI #Democratization, AI for ALL.