UCSB NLP Group @ucsbNLP
The NLP Group @ University of California, Santa Barbara. Profs. @WilliamWangNLP, Xifeng Yan, Simon Todd, @CodeTerminator, @lileics; acct run by @m2saxon nlp.cs.ucsb.edu Santa Barbara, CA Joined July 2021-
Tweets176
-
Followers1K
-
Following729
-
Likes390
Just had an amazing visit to the legendary @aliceoh at KAIST! Blown away by the brilliant students and world-class faculty. It truly is the MIT of Korea! 🌟🎓 #KAIST
had a lot of fun presenting Neuroformer at Caltech this week, thanks for the engaging discussion! 😁
had a lot of fun presenting Neuroformer at Caltech this week, thanks for the engaging discussion! 😁
🚨We've been assessing T2I metrics wrong...until now‼️ Our new meta-metric for T2I faithfulness metrics, T2IScoreScore (TS2), checks if a metric correctly orders and separates many images against single prompts! The results may surprise you... t2iscorescore.github.io 1/5
Huge congratulations to @AlbalakAlon for defending his PhD thesis “Understanding and Improving Models Through a Data-Centric Lens”. It’s refreshing to witness Alon’s growth, innovation, and leadership in the last few years. Alon is my 8th PhD graduate and I wish him all the best!
🤩 I'm honored that insights from our data selection survey are being shared across the globe 🌍 Fantastic slides @Thom_Wolf !
🤩 I'm honored that insights from our data selection survey are being shared across the globe 🌍 Fantastic slides @Thom_Wolf !
Awesome new work with @sharonlevy21 and colleagues. I learned a lot about how to think about bias in LLMs from this study.
Awesome new work with @sharonlevy21 and colleagues. I learned a lot about how to think about bias in LLMs from this study.
@niloofar_mire visits us and SoCal #nlproc peeps and shares her work on privacy considerations for large language models.
I'll be @uclanlp tmw & @ucsbNLP the next day to talk about how the "emergent" capabilities of LLMs create emergent inference-time privacy risks, and how membership inference attacks can be inconclusive in current setups! Hit me up if you wanna chat! tinyurl.com/mia-cnfide
🚀Fire linguists in the LLM era? No! Excited to share LingoLLM, a novel method for processing endangered languages with linguistic resources. LingoLLM improves the translation of many endangered languages from 0 to 10.5 BLEU! It helps other tasks as well! arxiv.org/abs/2402.18025
{UCSB|AI2|UW|Stanford|MIT|UofT|Vector|Contextual AI} present a survey on🔎Data Selection for LLMs🔍 Training data is a closely guarded secret in industry🤫with this work we narrow the knowledge gap, advocating for open, responsible, collaborative progress arxiv.org/abs/2402.16827
[New paper!] Can LLMs truly evaluate their own output? Can self-refine/self-reward improve LLMs? Our study reveals that LLMs exhibit biases towards their output. This self-bias gets amplified during self-refine/self-reward, leading to a negative impact on performance. @ucsbNLP
Thank you for joining us yesterday @yanaiela! We are very excited by the "What's In My Big Data" direction! wimbd.apps.allenai.org
Happy to share our new preprint on understanding how reasoning emerges from language model pre-training: arxiv.org/abs/2402.03268 We hypothesize that language models can aggregate reasoning paths seen in pre-training data to draw new conclusions at inference time.
Congrats to our very own Matthew Ho (@matt_seb_ho) for winning a Computing Research Association Outstanding Undergraduate Research Honorable Mention! cra.org/crn/2024/01/ou…
💻 LMs leveraging generative pretraining learn many diverse skills. 🧠 But what can GPTs trained on brain data learn to do? Introducing Neuroformer. A generative model pretrained on massively multimodal, multitask neuronal data! (ICLR 2024) 🧵
One thing that stood out to me at #NeurIPS2023 was there were a lot more application papers than before. This was not the case with my last neurips (2018). I'd like to encourage this wave by highlighting one such paper. LayoutGPT: Compositional Visual Planning and Generation…
Congratulations to our undergraduate student @matt_seb_ho for being selected for Honorable Mention of the 2024 Computing Research Association's (CRA) Outstanding Undergraduate Researcher Award (URA). 🥳 Matthew is the lead author of WikiWhy.
UCSB at #NeurIPS2023. 🥳🥳🥳
William Wang @WilliamWangNLP
14K Followers 718 Following UCSB NLP Lab + ML Center. https://t.co/6TOnqbk6YT https://t.co/KJYhnav3Et Mellichamp Chair Prof. at UCSB CS. PhD @ CMU SCS. Areas: #NLProc, Machine Learning, AI.
Bill Yuchen Lin 🤖 @billyuchenlin
6K Followers 2K Following Research @allen_ai. I evaluate (multi-modal) LLMs, build agents, and study the science of LLMs. Previously: @GoogleAI & @MetaAI FAIR @nlp_usc
Xin Eric Wang @xwang_lk
7K Followers 1K Following Multimodal and Embodied AI Researcher / Professor @UCSC. Director of https://t.co/Y4swOBag21. AI for Humanity in the long run. he/him
Yu Su @ysu_nlp
6K Followers 857 Following Dist. Assist. Prof.@OhioState, Director @osunlp, 20% Researcher@Microsoft. I like to think about intelligence, artificial or biological
Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
Michael Saxon @m2saxon
2K Followers 1K Following CS PhD cand @ucsbNLP 🌊🌴 @NSF GRFP 🧐analyzing semantics in generative lang/img AI models🤖 Big tech ex-intern. BS/MS @ASU 🌵🏜 🔜 @AMD opensrc GenAI RS intern
Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Sean (Xiang) Ren @xiangrenNLP
6K Followers 561 Following Building @SaharaLabsAI | @USCViterbi Early Career Chair, Professor @nlp_usc | @MIT TR 35 , @ForbesUnder30 | Prev: @allen_ai, @Snapchat, @Stanford, @UofIllinois
Sebastian Gehrmann @sebgehr
5K Followers 2K Following Head of NLP, CTO office, @Bloomberg. (he/him) Generating natural language, one word at a time. Also making sense of that language afterwards. views my own
Tao Yu @taoyds
3K Followers 815 Following @XLangNLP lab, asst. prof. @HKUniversity. prev. postdoc @uwnlp; phd @Yale; intern @MSFTResearch, @SFResearch. he/him 🌈
Pan Lu @lupantech
4K Followers 1K Following PhD @CS_UCLA @uclanlp | Amazon/Bloomberg/Qualcomm/UCLA Fellows | Ex @Tsinghua_Uni @MSFTResearch @allen_ai @Adobe | #NLPoc, LLMs, Reasoning, AI4Math, AI4Science
Liangming Pan (on job.. @PanLiangming
1K Followers 717 Following Postdoc at @ucsantabarbara @ucsbNLP | Ph.D. from @NUSingapore @wing_nus | Researcher in #NLProc | Interests: Reasoning, QA, Generation, Fact Checking
Peng Qi @qi2peng2
3K Followers 336 Following #NLProc researcher @ AWS AI (@AmazonScience). Part-time machine learner & linguistics enthusiast. Previously: PhD @stanfordnlp, JD AI. He/him. Opinions my own.
🌴Muhao Chen🌴 @muhao_chen
2K Followers 552 Following 🐹Assistant Professor of Computer Science @UCDavis🐹 | 💙PhD @UCLAComSci 2019💛 | 🌴加州boy🌴 | 🎸@GALNERYUSOFFIC2#1🎧! |♛Collecting⌚♛
Qinyuan Ye @qinyuan_ye
2K Followers 1K Following 👩💻 Ph.D. student @nlp_usc @CSatUSC @USC_ISI | 🐾 Teaching machines to be more versatile and curious.
Alex Fabbri @alexfabbri4
373 Followers 334 Following Researcher @SFResearch; PhD '21 @Yale; BA '17 @Columbia; Opinions are my own.
Alon Albalak @AlbalakAlon
888 Followers 465 Following CS PhD candidate at @ucsbNLP. Research: Data-centric AI, Efficiency in ML, NLP.
Wenhao Yu @wyu_nd
2K Followers 622 Following Senior Research Scientist at @TencentGlobal AI Lab in Seattle | Bloomberg PhD Fellow | Ex. @MSFTResearch @allen_ai @NotreDame @Bloomberg
Shaily @shaily99
5K Followers 2K Following PhD @LTIatCMU Prev: @GoogleAI @MSFTResearch. Working on ethics and evaluation in #NLProc. Usually ranting, often about research & DEI. 📚 @readsndrants
Qingxiu Dong @qx_dong
841 Followers 592 Following PhD student @PKU1898. Research Intern @MSFTResearch Asia.
精神病狗婊子杂.. @frkglp
0 Followers 3K Following 神病狗婊子杂种邓小平，刘少奇就是整个世界的敌人，它那套歪把戏不除，世界战乱不断。Cgkl精神病狗婊子杂种习近平被凌迟处死。Cgk凌迟处死精神病狗婊子杂种中共狗屁家族邓小平，习近平，陈云，刘少奇，陈一新，张又侠，何卫东，刘振立，苗华，董军。锸s你跟踪本人的精神病狗婊子杂种全部中共空军、警察、台湾间谍
ssteevens @Steevens43
159 Followers 5K Following
Brian Bosho @Brian_Bosho
49 Followers 192 Following
Zhiyong Wang @Zhiyong16403503
409 Followers 2K Following Visiting Ph.D. student at Cornell University. Ph.D. candidate at CUHK. Working on bandits and reinforcement learning theory.
lipi @lipiisme
88 Followers 1K Following Co-founder of https://t.co/SJDbmaSt4P Amateur developers, #AI enthusiasts
Yin-Hong Cao @caoyinhong
142 Followers 1K Following Postdoc in Jiayang Li Lab, Institute of Genetics and Developmental Biology, CAS. Focus on the Multi-omics of dandelions & rice🌱🌾Recruiting Top-Tier Talents👇
V Sriram @VSriram23
140 Followers 4K Following
Charleigh Hecox @charlei_he
31 Followers 2K Following 🔗Charleigh | 25 | Biggest crypto casino presale👇💥
AI & Partners @AI_and_Partners
1K Followers 7K Following The European Union AI Act coming into force in 2024 aims to address problems associated with the use, development and/or deployment of AI systems.
Pensé FFun @inftyCategory
100 Followers 6K Following
Mohammed Amine BEN CH.. @AmineLehocine
35 Followers 1K Following
perfect_ar @perfectar1
2 Followers 164 Following AI researcher| Large Language Model | LLM Alignment
Jindong Gu @Jindong73504766
293 Followers 891 Following Senior Research Fellow in University of Oxford @OxfordTVG Faculty Researcher @Google #ResponsibleAI #AISafety #GenAI Homepage: https://t.co/YOSVO3jb6h
Mehak Dhaliwal @mehakdh1
36 Followers 121 Following CS PhD student @ UCSB Interested in AI for Healthcare, NLP, Fairness, and Robustness
Robonomous @realpolity101
2K Followers 2K Following controls,robotics & UAVs//Algos,CV//usual sh!tposter XD //
Ytkkk @Monotonik_
15 Followers 815 Following
Mohamed Ahmed @m_0_a
322 Followers 880 Following Researcher at Microsoft Africa - working on task alignment and evaluation of LLMs | Ex- @benevolent_ai | Ex- NEC Labs Europe | Ex-@UCL | @so_innovate
Yixin Wang @yixinwang_
689 Followers 4K Following
Danial Namazifard @IamDanialNamazi
70 Followers 470 Following MSc Student in AI, NLP Researcher @ UT #NLProc #MachineLearning
Zhengliang Shi @Zhengliang_Shi
2 Followers 105 Following
Noble @NabeelAlpha1
29 Followers 114 Following
Harsh Kohli @hkohli14
33 Followers 220 Following PhD student at The Ohio State University Previously - Amazon, Microsoft, GeorgiaTech, BITS Pilani Research interests: Language Models and all things NLP
Yasmin @YasminC_Ling
13 Followers 381 Following Language acquisition, computational modelling, the neurobiology of language. Aberdeen/London
Atharva Joshi @atharvajoshi011
16 Followers 1K Following ECE Grad student @Northeastern with a focus on Machine Learning. Prev. ML/DS Internships - @Abiomed, @Morningstar & @TNeGA_Official. Undergrad @BITSPilaniGoa
Diallo Ciré @adamahawadiallo
131 Followers 1K Following Machine learning & NLP for low-ressource language Human-centered technologies
Liu Xiaochen @lxc0422
118 Followers 1K Following #ArtificialIntelligence #MachineLearning #ComputerVision #3Dreconstruction #3Dmeasurement #ImageProcessing #Robotics #Programming #Packaging
joyce @ucc996
0 Followers 66 Following
Mati_N_itaM @palindrome_boy
0 Followers 30 Following
Gautam Machiraju 🌺 @gmachiraju
641 Followers 4K Following PhD-ing @StanfordAILab w/ @ParagMallick @HazyResearch🌲 AI-driven data copilots for scientific discovery♟️🧬🔬🛰🔭 Powered by prog house, people, 3rd places 🪩✨
sempra @sempra44283
37 Followers 424 Following
cyk @ychai1224
5 Followers 393 Following
Denghui Zhang @denghui_zhang
291 Followers 399 Following Assistant Professor at Stevens Institute of Technology.
William Wang @WilliamWangNLP
14K Followers 718 Following UCSB NLP Lab + ML Center. https://t.co/6TOnqbk6YT https://t.co/KJYhnav3Et Mellichamp Chair Prof. at UCSB CS. PhD @ CMU SCS. Areas: #NLProc, Machine Learning, AI.
Bill Yuchen Lin 🤖 @billyuchenlin
6K Followers 2K Following Research @allen_ai. I evaluate (multi-modal) LLMs, build agents, and study the science of LLMs. Previously: @GoogleAI & @MetaAI FAIR @nlp_usc
Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | Pianist
Yoav Artzi @yoavartzi
13K Followers 163 Following Research/prof @cs_cornell + @cornell_tech🚡 / https://t.co/9YnWry7yHs / https://t.co/3VmRSyYm2d / asso. faculty director @arxiv / building https://t.co/f9QkzO5kaC
Xin Eric Wang @xwang_lk
7K Followers 1K Following Multimodal and Embodied AI Researcher / Professor @UCSC. Director of https://t.co/Y4swOBag21. AI for Humanity in the long run. he/him
Yann LeCun @ylecun
711K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Yu Su @ysu_nlp
6K Followers 857 Following Dist. Assist. Prof.@OhioState, Director @osunlp, 20% Researcher@Microsoft. I like to think about intelligence, artificial or biological
Wenhu Chen @WenhuChen
11K Followers 520 Following AI researcher @UWaterloo @GoogleAI @VectorInst. Interested in natural language processing, diffusion models. I direct TIGER-Lab at UWaterloo.
Graham Neubig @gneubig
31K Followers 588 Following Associate professor at CMU, studying natural language processing and machine learning.
Andrej Karpathy @karpathy
979K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K Following
Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
Ana Marasović @anmarasovic
4K Followers 604 Following Asst prof @UUtah · Ex @allen_ai @uwnlp postdoc @HD_NLP PhD · she/her 🇭🇷
Michael Saxon @m2saxon
2K Followers 1K Following CS PhD cand @ucsbNLP 🌊🌴 @NSF GRFP 🧐analyzing semantics in generative lang/img AI models🤖 Big tech ex-intern. BS/MS @ASU 🌵🏜 🔜 @AMD opensrc GenAI RS intern
Akari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳
Jacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJw
Jia-Bin Huang @jbhuang0604
51K Followers 285 Following Associate Professor @umdcs; Part-time Research Scientist @Meta. I like pixels.
Wenting Zhao @wzhao_nlp
811 Followers 353 Following PhD student @cornell_tech Food for life, NLP for soul!
Ming Yin @MingYin_0312
916 Followers 842 Following @Princeton Postdoc. PhDs @UCSBCS @UCSBPSTAT. Ex @awscloud AI. undergrad @USTC. Area Chair @NeurIPS23
Fuheng Zhao @FuhengZ
339 Followers 701 Following Ph.D. candidate @dsl_ucsb, interested in Big Data, Distributed Systems, Databases, and Privacy. Prev intern @FoundationDB @SnowflakeDB @GraySystemsLab
Xianjun Yang @Qnolan4
348 Followers 987 Following Phd @ucsbcs, Bachelor @tsinghua_uni, AI Safety, nlp, GenAI. Open to collaboration. Incoming Interns @Amazon and @AIatMeta (Looking for full-time jobs)
Weixi Feng @weixi_feng
396 Followers 292 Following CS Ph.D. candidate @UCSB @UCSBNLP. Ex-research intern @Adobe, @Amazon. #Multimodality #ComputerVision #NLProc.
SoCal NLP Symposium @socalnlp
207 Followers 72 Following ☀️🏝️Annual symposium with students and faculty to promote NLP research in the (Southern) California region 👩💻 #SoCalNLP2023 🔜 @ucla, posts by @BrihiJ
Raphael Schumann @RaphiRaph_
367 Followers 1K Following Natural Language Processing PhD Student @ Heidelberg University.
Yu-Xiang Wang @yuxiangw_cs
2K Followers 280 Following Faculty @ucsbcs, director of ML lab. Previously @ScSatCMU and @awscloud. Researcher in #machinelearning, #reinforcementlearning, #differentialprivacy
Kexun Zhang @kexun_zhang
679 Followers 553 Following PhD student at @LTIatCMU. Previously at @ucsbNLP, @ZJU_china. language lover.
Alfonso Amayuelas @AlfonAmayuelas
492 Followers 530 Following CS PhD Student at @ucsbNLP @ucsantabarbara 😎🌊🏄🏻♂️
Matt Ho @matt_seb_ho
70 Followers 154 Following Undergraduate Researcher @ucsbNLP Interested in LLM reasoning and instruction following.
Danny Rose @DannyRose30
38 Followers 51 Following Undergraduate researcher in @ucsbNLP. Passionate about AI real-world applications for the benefit of humanity.
Yao Qin @YaoQin_UCSB
3K Followers 272 Following Assistant Professor @UCSB; Research Scientist @googleresearch; PhD @UCSD
Chong Liu @ChongLiuCS
509 Followers 355 Following DSI Postdoc @UChicago, Incoming CS Faculty @UAlbany @SUNY, Pilot. Previously @UCSBCS @Amazon. Machine Learning, Optimization, AI for Drug Discovery.
Aditya Sharma @realadityas
61 Followers 251 Following Computer Science (@ucsbcs), NLP Researcher (@ucsbnlp)
Deepak Nathani @deepaknathani11
409 Followers 804 Following PhD Student @UCSBNLP | Mentor @CAREMentorship | Previously: Intern @AWS AI, Pre-Doctoral Researcher @GoogleAI India, Undergrad @IITHyderabad
clulab @LabCLU
80 Followers 11 Following Computational Language Understanding Lab at University of Arizona
Mozhdeh Gheini @MGheini
398 Followers 563 Following @USC Graduate Student | @USC_ISI NLP Researcher | 3x Intern @Apple | Self-proclaimed Michelin 3-star Foodie | she/her
Shaily @shaily99
5K Followers 2K Following PhD @LTIatCMU Prev: @GoogleAI @MSFTResearch. Working on ethics and evaluation in #NLProc. Usually ranting, often about research & DEI. 📚 @readsndrants
Anubrata Das @d_anubrata
579 Followers 2K Following Ph.D. Candidate @UTiSchool I think about Human-Centered NLP | #NLP + #HCI
Niloofar (Fatemeh) Mi.. @niloofar_mire
4K Followers 1K Following Postdoc @uwcse-@uwnlp, Ph.D. from @ucsd_cse /Privacy, ML, NLP, @winlpworkshop chair, @MSFTResearch - Semantic Machines
Hritik Bansal @hbXNov
607 Followers 2K Following CS PhD @UCLA | Bachelors @IITDelhi | Incoming Student Researcher @GoogleDeepMind | Multimodal ML | LLM | Cricket 🏏
Alex Mei @alexmeigz
242 Followers 199 Following Computer Science Masters Graduate @ucsbNLP @ucsbcs. Responsible Machine Learning and Natural Language Generation Research. https://t.co/GLtOr7hj2f.
Antonis Antoniades @anton_iades
391 Followers 766 Following CS PhD student @ucsbNLP teaching machines to think like humans and humans to think like machines. Prev. @UCSBPhysics Guitar/Bouzouki. Cyprus/CA 🧠🤖🎸🌊
Zhiyu Zoey Chen @ZhiyuChen4
1K Followers 303 Following NLP researcher. Postdoc @S3DatCMU. Incoming Assistant Professor @UT_Dallas. PhD @UCSBCS. #NLProc.
Wenda Xu @WendaXu2
678 Followers 319 Following PHD candidate at UCSB’s NLP lab coadvised by William Wang and Lei Li
BU NLP Lab @llamagrp
114 Followers 285 Following Language Learning Machine #NLProc Research Lab at Boston University
Mike Lewis @ml_perception
6K Followers 227 Following Llama3 pre-training lead. Partially to blame for things like the Cicero Diplomacy bot, BART, RoBERTa, kNN-LM, top-k sampling & Deal Or No Deal.
TensorFlow @TensorFlow
378K Followers 117 Following TensorFlow is a fast, flexible, and scalable open-source machine learning library for research and production.
Miles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.
BerkeleyNLP @BerkeleyNLP
5K Followers 33 Following We work on natural language processing, machine learning, linguistics, and deep learning.
Ves Stoyanov @vesko_st
2K Followers 550 Following Head of AI at @magicaltome. Ex-Language Researcher at @FacebookAI. Large LMs and multilingual NLP. @JHUCLSP and @Cornell alumn. https://t.co/WTSCasqDI6
Shashank Srivastava @shsriva
480 Followers 5 Following Assistant Prof. at UNC Chapel Hill. I do research on language and AI. Previously @MSFTResearch, @mldcmu
Yung-Sung Chuang @YungSungChuang
651 Followers 513 Following PhD student @MIT_CSAIL since fall’21; Previous undergrad #NLProc & #SpeechProc researcher @NTU_SPML in #Taiwan.
Ian Goodfellow @goodfellow_ian
299K Followers 1K Following Research Scientist at DeepMind. Opinions my own. Inventor of GANs. Lead author of https://t.co/M6vl8pEifa
AC @aarzchan
1K Followers 1K Following
Oriol Vinyals @OriolVinyalsML
167K Followers 82 Following VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead. Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.
Microsoft Research @MSFTResearch
553K Followers 2K Following We advance science and technology to benefit humanity. https://t.co/kz0nARXbwT Register for Microsoft Research Forum on June 4 ⬇️ Get our newsletter
MilaQuebec @Mila_Quebec
31K Followers 561 Following The world's largest academic research center in deep learning — Le plus grand centre de recherche universitaire en apprentissage profond.
EdinburghNLP @EdinburghNLP
11K Followers 139 Following The Natural Language Processing Group at the University of Edinburgh
Zekun Li @ZekunLi0323
760 Followers 586 Following CS Ph.D. student @UCSB, ex-intern at #MSFTResearch, Meta #RealityLabs, interested in #NLProc, #LLM, and #AI4Health
Paul Liang @pliang279
5K Followers 910 Following PhD student @mldcmu @SCSatCMU. Foundations of multimodal learning & applications in social AI, NLP, and healthcare with @lpmorency and @rsalakhu.
Shang-Wen Li @ShangwenLi1
1K Followers 1K Following Manager, Research & Eng at FAIR; Researcher in #AI, #NLProc & #speech processing; Past: PhD @MIT_CSAIL, ML scientist at AWS, Alexa & Siri; Views my own
Pieter Abbeel @pabbeel
78K Followers 435 Following Diffusion Models; Large World Model; UniSim; TRPO; SAC; Ring Attention; MAML; HER; Domain Randomization; Decision Transformer; LLM as Zero-Shot Planners; RFM-1
Yunmo Chen @YunmoChen
311 Followers 296 Following Ph.D. candidate in Computer Science #NLProc at @jhuclsp | Once @Apple | Twice @MSFTResearch | Twice @AmazonI’m honored to receive the 2023 Pierre-Simon Laplace Award from the IEEE Signal Processing Society today in Seoul, Korea! 🌟 Deeply grateful to my students, collaborators, colleagues, and mentors. Your support make this a shared honor. #IEEE #SignalProcessing #ICASSP2024
had a lot of fun presenting Neuroformer at Caltech this week, thanks for the engaging discussion! 😁
Been enjoying running the @NeuroTechers Neuro+ML Journal Club with @BTolooshams! We recently had a blast discussing with @mehdiazabou and @anton_iades about large models for neuroscience 🧠 Looking forward to more this quarter!
6/5 Important caveats: - Metrics may be both better-correlated to human preference but worse at ranking - Better VLMs will make VLM/VQA-based metrics more powerful (but even more expensive 🤯) - We haven't investigated GPT4V as a backend yet, will add to leaderboard soon🏆
My Ph.D. advisor is visiting South Korea.
Check out our demo website with interactive leaderboard: t2iscorescore.github.io arXiv link: arxiv.org/abs/2404.04251 Dataset on 🤗: huggingface.co/datasets/saxon… Thanks to coauthors @khosh87 @FatimaJahara1 @yujielu_10 @realadityas @WilliamWangNLP and @fatimafellowshp for support!
Surprisingly, we find that the most sophisticated, VLM/VQA-based metrics such as TIFA, DSG, and LLMScore all struggle to beat simple embedding metrics like CLIPScore on the most difficult Real subset for both metrics. Our rigorous evaluation can be used to guide future work! 4/5
To do this, we adapt Spearman correlation and the Kolmogorov-Smirnov statistic to this graph setting, assessing metric scores against these statistics within each walk for each semantic error graph (SEG). SEGs are made from both real & synthetic images, real & fake errors. 3/5
This project, co-led with my @fatimafellowshp mentees @FatimaJahara1 and @khosh87 rigorously tested a variety of text-to-image faithfulness metrics using our new benchmark and metrics. We tested how well each metric separates and orders images within a "semantic error graph" 2/5
🚨We've been assessing T2I metrics wrong...until now‼️ Our new meta-metric for T2I faithfulness metrics, T2IScoreScore (TS2), checks if a metric correctly orders and separates many images against single prompts! The results may surprise you... t2iscorescore.github.io 1/5
Lise Getoor was also on the committee but obviously I forgot to take the picture before she left. 🫠
Huge congratulations to @AlbalakAlon for defending his PhD thesis “Understanding and Improving Models Through a Data-Centric Lens”. It’s refreshing to witness Alon’s growth, innovation, and leadership in the last few years. Alon is my 8th PhD graduate and I wish him all the best!
Thank you to co-authors @FPSLuozi, @sharonlevy21 and advisors @prof_yz, Chitta Baral, and @WilliamWangNLP Especially @prof_yz and his @ApgAsu for inviting me to give a talk that got this project rolling. Let's keep pushing the envelope in multilinguality & multimodality!
- How blind spots in image-image feature extractors sometimes cause "double negatives" where structural similarities between the two translations are also in the visual domain - Translating model tests is a new and important MT domain ¡Nos vemos en 🇲🇽! arxiv.org/abs/2403.11092
If you're interested in multilinguality or multimodal assessment, please check out the discussion! It covers: - Concept subjectivity as a problem in model knowledge assessment - Challenges of translatability and selecting a "best" translation - Error type vs error severity 7/8
As someone invested in rigorously measuring multimodal model capabilities, I think a paper such as this that takes readers through the process of breaking and improving a benchmark is very valuable. I love that we managed to fit a lengthy discussion section in a short paper! 6/8
This shows that correlations between image- and text-domain improvements under error correction are themselves good proxies for model language capacity These findings allow us to intelligently improve the quality of CoCo-CroLa as a benchmark of model multilinguality! 5/
We then compare text-domain similarity improvement ∆SEM to the image-domain improvement of the generated images ∆Xc, and we find that 𝐟𝐨𝐫 𝐥𝐚𝐧𝐠𝐮𝐚𝐠𝐞𝐬 𝐚 𝐦𝐨𝐝𝐞𝐥 "𝐮𝐧𝐝𝐞𝐫𝐬𝐭𝐚𝐧𝐝𝐬," correction impact on images is 𝐩𝐫𝐞𝐝𝐢𝐜𝐭𝐚𝐛𝐥𝐞 𝐟𝐫𝐨𝐦 𝐭𝐞𝐱𝐭 4/
Trends for United States
You might like
