OpenCompass @OpenCompassX
OpenCompass focus on the evaluation and analysis of large language models and vision language models. github: https://t.co/zF7ycuTXxs opencompass.org.cn/home China Joined April 2024-
Tweets73
-
Followers261
-
Following47
-
Likes58
🔥China’s Open-source VLMs boom—Intern-S1, MiniCPM-V-4, GLM-4.5V, Step3, OVIS 🧐Join the AI Insight Talk with @huggingface, @OpenCompassX, @ModelScope2022 and @ZhihuFrontier 🚀Tech deep-dives & breakthroughs 🚀Roundtable debates ⏰Aug 21, 5 AM PDT 📺Live: youtube.com/live/kh0WSMoVZ…
🚀 Introducing #CompassVerifier: A unified and robust answer verifier for #LLMs evaluation and #RLVR! ✨LLM progress is bottlenecked by weak evaluation, looking for an alternative to rule-based verifiers? CompassVerifier can handle multiple domains including math, science, and…
🥳#CodeCriticBench assesses LLMs' critiquing ability in code generation and QA tasks. Covering 10 criteria, it features a 4.3k-samples dataset with three difficulty levels and balanced distribution. 😉CodeCriticBench is now part of the #CompassHub! 😚Feel free to download and…
🥳#StructFlowBench is a structurally annotated multi-turn benchmark that leverages a structure-driven generation paradigm to enhance the simulation of complex dialogue scenarios. 🥳StructFlowBench is now part of the #CompassHub! 😉Feel free to download and explore it—available…
😉#VBench is a comprehensive benchmark evaluates video generation quality. It comprises 16 dimensions in video generation, and also provides a dataset of human preference annotations. 🥳VBench is now part of the #CompassHub! Feel free to download and explore it—available for…
🥰VLM²-Bench is the first comprehensive benchmark that evaluates vision-language models' (#VLMs) ability to visually link matching cues across multi-image sequences and videos. The benchmark consists of 9 subtasks with over 3,000 test cases. 🥳VLM²-Bench is now part of the…
We've uploaded the AIME 2025 exam, complete with questions and solutions, here: huggingface.co/datasets/openc…. Feel free to test your powerful LLM on this dataset.
🌟 Exciting News! CompassArena now back with some major updates: - **Judge Copilot**: An LLM-as-a-Judge tool for model comparisons. 🤖 - **Enhanced Statistical Model**: Improved Bradley-Terry accuracy by addressing confounding variables. 📊 - **20+ New LLMs**: A global mix of…
大语言模型具备稳定推理能力吗？ 「来自上海 AI 实验室 @OpenCompassX 的研究，通过创新的评估方法揭示了一个关键问题：尽管大语言模型在单次测试中可能表现出色（如 OpenAI 最新模型单次准确率达 66.5%），但在需要持续稳定输出的场景中，几乎所有模型的表现都会大幅下降（降幅普遍超过…
Welcome to submit your LMM into our new leaderboard.
Welcome to submit your LMM into our new leaderboard.
OpenCompass has established a leaderboard to evaluate complex reasoning capability of LMMs, consisting of four advanced multi-modal math reasoning benchmarks. Currently, Gemini-2.0-Flash took the 1st place. DM me to suggest more benchmarks and models to this LB.
🚀 Shocking : O1-mini scores just 15.6% on AIME under strict, real-world metrics. 🚨 📈 Introducing G-Pass@k: A metric that reveals LLMs' performance consistency across trials. 🌐 LiveMathBench: Challenging LLMs with contemporary math problems, minimizing data leaks. 🔍 Our…
MMBench has been selected as one of the most influential papers at ECCV 2024, ranking second.🎉🎉🎉 paperdigest.org/2024/09/most-i…
🚀 Excited to announce the release of CompassJudger-1, a powerful Judge LLM for diverse tasks! We've released 4 model sizes. 📷Submit your LLM's performance using CompassJudger to our leaderboard now! 📷Models: ompassJudger: github.com/open-compass/C… 📷Leaderboard:…
ProSA : framework to evaluate and understand Prompt Sensitivity of LLMs by SACHIN KUMAR link.medium.com/BTUVPXsAQNb
Congratulations to @Alibaba_Qwen on the release of so many new models! 🚀🚀🚀 OpenCompass now supports Qwen-2.5. Stay tuned for more evaluation results, coming soon!📊📊📊 github.com/open-compass/o…
飞花弹指间 @ivyinautumn
0 Followers 2 Following
William_TianYi @TianYi1453264
0 Followers 210 Following
Carlos Le @kechung73
228 Followers 6K Following
Facor @Facor051
52 Followers 1K Following
Chris M @chrismsyarra
348 Followers 4K Following Exec. Doctorate (c DBA), MBA (Ent&Innov), MAppFin, GradCert Data Science, BSc Digital/IT.
dodoman @JasperDoman
9 Followers 471 Following
Donnie @vibedonnie
346 Followers 1K Following I post updates about the best LLMs! Here's my list; 🇨🇳 Qwen, DeepSeek, GLM, Kimi, StepFun, MiniMax, Hunyuan. 🇺🇸🇪🇺• GPT, Claude, Gemini, Grok, Mistral
Rachel Zhang @RachelZ58322946
0 Followers 56 Following
browser @shjsndbndkk
7 Followers 373 Following
a31c8j @a31c8j
3 Followers 186 Following
Elle @elleleemy
48 Followers 512 Following
Iamjudah @Iamjudah25
0 Followers 4 Following I am an upcoming Gospel Artist. GOD first......Followed by MUSIC
hhw @haoweiwu2021
21 Followers 926 Following
slobodan rofa @RofaSlobodan
146 Followers 5K Following
Gabriel Lespérance @GabLesperance
763 Followers 2K Following CTO https://t.co/yZi5HUTcCG & betaworks Alumni, CS @ McGill, prev CTO @ https://t.co/NcHWDGwhQH, 4x Deloitte Fast 50
singaraju saiteja @SaitejaSingaraj
121 Followers 4K Following AI Developer Intern at https://t.co/pZ4jTWvjIT
Zhihan Xia @zhihan_xia1009
1 Followers 11 Following
Unchun Yang @unchunyang
131 Followers 3K Following
chunfu wu @chunfu47874
9 Followers 785 Following
FengBy @Feng_By1
7 Followers 414 Following
Junnan Liu @jnanliu
3 Followers 29 Following 🇨🇳 | Northwestern Polytechnical Univ. 👉 Beihang Univ. 👉 PJLab | Conduct research on #NLP, #LLM, Reasoning (Math, QA, Knowledge, ...), Agentic Modeling
Koji Tsuda @kojitsuda
1K Followers 396 Following Data science at @UTokyo_News_en and @RIKEN_AIP_EN https://t.co/4xnP9TIaCZ
天南无名散修 @yuehua_xs
4 Followers 199 Following
Elon Private Chat @elonmusk_00026
59 Followers 3K Following
Manohar Reddy Poreddy @ManoharReddyPo
169 Followers 356 Following Software Engineer | Architect | Engineering Manager | World Top 100 Algorithms
بن فضل @Bennfadel
1K Followers 744 Following اتباع السنة فيه الخير والبركة والسعادة في الدنيا والآخرة
Peiqin Lin @lpq29743
299 Followers 838 Following @ELLISforEurope Ph.D. Student in Natural Language Processing at @CisLmu, supervised by @HinrichSchuetze and @andre_t_martins. On the job market.
Vishnu Prasad @vishnu_prasad_n
27 Followers 551 Following
Aurélien-Morgan @AurelienMorgan_
106 Followers 2K Following Building `pip install retrain-pipelines`, ML-Eng-centric OS DAG engine, WebConsole & transformers/diffusers retrain framework. Wandering around. Mind if I do.
Xin (Rodenza) Xu @XinXuNLPer
194 Followers 497 Following CSE Ph.D. @McAuleyLabUCSD, CS M.E. @ZJU_China Trustworthy NLP, Music AI
Raphael Berdugo @RaphaelBer26361
0 Followers 11 Following
Marto Dumra @mrtdmr2446
83 Followers 303 Following
Burdette Reichert @BurdetteRe58230
10 Followers 927 Following
Victor Strosin @VStrosin37214
27 Followers 3K Following
RAGE-KG 2025 @rage_kg
91 Followers 2K Following RAGE-KG (RAG Enabled by Knowledge Graphs) is an established academic workshop targeting synergies between #KGs, #RAG and #LLMs, coming to #ISWC 2025 🇯🇵.
xiangyu meng @claude_steven_m
0 Followers 207 Following
King Range @RangeKingHZ
15 Followers 223 Following
ACL 2025 @aclmeeting
22K Followers 52 Following Association for Computational Linguistics | ACL 2025 conference | The 63rd Annual Meeting of the ACL Hashtags: #NLProc #ACL2025NLP
Anthropic @AnthropicAI
645K Followers 35 Following We're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant @claudeai on https://t.co/FhDI3KQh0n.
Yi-01.AI @01AI_Yi
9K Followers 73 Following A global company building generative AI LLM and applications
Victor Sanh @SanhEstPasMoi
9K Followers 3K Following AI builder | Something new | Prev. founding crew @huggingface 🤗 | AI x NYC
Omar Sanseviero @osanseviero
51K Followers 3K Following Developer Experience Lead at @GoogleDeepMind Building Gemini API, Gemma, AI Studio and more AI products. My views ex-Chief Llama Officer @huggingface 🇵🇪🇲🇽
AK @_akhaliq
428K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5YmrQ
AI Conference DL Coun... @DlCountdown
19K Followers 11 Following Bot. I daily tweet progress towards machine learning and computer vision conference deadlines. Maintained by @chriswolfvision.
YuanLiuuuuuu @a33668874586
74 Followers 627 Following Researcher at WeChat AI, focusing at large multimodal model and large language model. https://t.co/eyVqwA3CzZ
Z.ai @Zai_org
17K Followers 153 Following The AI lab behind GLM models, dedicated to inspiring the development of AGI to benefit humanity. https://t.co/b6zGxJvzzS
zhoufengzhe07 @zhoufengzhe07
5 Followers 43 Following
OpenAI @OpenAI
4.4M Followers 3 Following OpenAI’s mission is to ensure that artificial general intelligence benefits all of humanity. We’re hiring: https://t.co/dJGr6Lg202
BAAI @BAAIBeijing
3K Followers 227 Following Beijing Academy of Artificial Intelligence. AI Science and Technology Innovation for Global Sustainable Development.
Chelsea Finn @chelseabfinn
83K Followers 399 Following Asst Prof of CS & EE @Stanford Co-founder of Physical Intelligence @physical_int PhD from @Berkeley_EECS, EECS BS from @MIT
Bo Dai @doubledaibo
2K Followers 510 Following Institute of Data Science, The University of Hong Kong. Founder of FeelingAI. Looking for Interns/RAs/PhDs/Postdocs/Full-time researchers and engineers.
Haodong Duan @KennyUTC
218 Followers 244 Following Researcher @ Shanghai AI Lab, working on multi-modal learning B.S. @PKU1898 / Ph.D. @CUHKofficial Built #VLMEvalKit for MLLM evaluation
DeepSeek @deepseek_ai
971K Followers 0 Following Unravel the mystery of AGI with curiosity. Answer the essential question with long-termism.
tldraw @tldraw
69K Followers 13 Following infinite canvas | https://t.co/oXL4NAc6P8 | https://t.co/dO6WPp6YOI | https://t.co/beo7WsKiVe | /tiː ɛl drɔː/
Jiayuan Zhang @tisoga
97K Followers 1K Following Building @devv_ai — the AI product builder with native integrations (LLM, Auth, DB & more). Helping anyone go from idea → app. Ex-@tiktok_us
MMLab@NTU @MMLabNTU
1K Followers 18 Following Multimedia Laboratory @NTUsg, affiliated with S-Lab. Large Multimodal Models, Computer Vision, Image Processing, Computer Graphics, Deep Learning
Jeff Dean @JeffDean
367K Followers 6K Following Chief Scientist, Google DeepMind & Google Research. Gemini Lead. Opinions stated here are my own, not those of Google. TensorFlow, MapReduce, Bigtable, ...
Christopher Manning @chrmanning
152K Followers 229 Following Founder, @stanfordnlp and cs224n. Assoc. Director, @StanfordHAI. Prof. CS & Linguistics, @Stanford. GP @aixventureshq. Australian🇦🇺. Do #NLProc & #AI. 👋
Google DeepMind @GoogleDeepMind
1.2M Followers 279 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
Stanford AI Lab @StanfordAILab
213K Followers 332 Following The Stanford Artificial Intelligence Laboratory (SAIL), a leading #AI lab since 1963. ⛵️🤖 Emmy-winning video: https://t.co/lV9smZTC1m
Yann LeCun @ylecun
955K Followers 765 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
AI at Meta @AIatMeta
716K Followers 288 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
Andrej Karpathy @karpathy
1.4M Followers 1K Following Building @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
Ian Goodfellow @goodfellow_ian
347K Followers 1K Following DeepMind Research Scientist. Opinions my own. Inventor of GANs. Lead author of https://t.co/M6vl8pEQ4I Founding chairman of @pubhealthaction
Andrew Ng @AndrewYNg
1.3M Followers 1K Following Co-Founder of Coursera; Stanford CS adjunct faculty. Former head of Baidu AI Group/Google Brain. #ai #machinelearning, #deeplearning #MOOCs
Berkeley AI Research @berkeley_ai
228K Followers 378 Following We're graduate students, postdocs, faculty and scientists at the cutting edge of artificial intelligence research.
Lilian Weng @lilianweng
166K Followers 166 Following Co-founder of Thinking Machines Lab @thinkymachines; Ex-VP, AI Safety & robotics, applied research @OpenAI; Author of Lil'Log
Jindong Wang @jd92wang
5K Followers 535 Following Assistant Professor @williamandmary, Ex Senior Researcher @MSFTResearch. Generative AI, machine learning, large language models, AI for social sciences.
lmarena.ai @arena
95K Followers 207 Following LMArena: Open Platform for Community-driven AI Benchmarking. Graduated from UC Berkeley / @lmsysorg. We’re hiring: https://t.co/1OkfLq2n0I
Tiezhen WANG @Xianbao_QIAN
7K Followers 2K Following Engineer at HuggingFace, ex-Googler on TFLite / micro. Ideas are my own.
Songyang Zhang @zsytony
43 Followers 135 Following Scientist@Shanghai AI Lab. OpenCompass/InternLM/OpenMMLab
OpenMMLab @OpenMMLab
6K Followers 132 Following From MMDetection to AI Exploration. Empowering AI research and development with OpenMMLab. Discord：https://t.co/BWaz5KtF5e
Hugging Face @huggingface
567K Followers 210 Following The AI community building the future. https://t.co/VkRPD0Vclr
Trends for United States
You might like
