Gabriel Ilharco @gabriel_ilharco
Building cool things @xAI. Prev. PhD at UW, Google AI gabrielilharco.com Palo Alto, CA Joined September 2015-
Tweets449
-
Followers4K
-
Following1K
-
Likes1K
Grok is going multimodal! It’s incredible to see how fast a small, focused team can move. Kudos to the amazing team @xai that made this possible x.ai/blog/grok-1.5v
sharing some highlights from our recent paper: language models scale reliably with over-training and on downstream tasks! arxiv: arxiv.org/abs/2403.08540 104 models, 11M to 7B parameters, varying numbers of tokens, 3 datasets, eval’d on 46 tasks: github.com/mlfoundations/… 1/11
New Resource: Foundation Model Development Cheatsheet for best practices We compiled 250+ resources & tools for: 🔭 sourcing data 🔍 documenting & audits 🌴 environmental impact ☢️ risks & harms eval 🌍 release & monitoring With experts from @AiEleuther, @allen_ai,…
Introducing time vectors! Time vectors are a simple way adapt LMs to new time periods; our results suggest that time is encoded in the weights of finetuned models. Led by my incredible undergrad mentee, Kai Nylund! Paper: arxiv.org/abs/2312.13401 Code: github.com/KaiNylund/lm-w… /1
Another week, another bump in OSS CLIP model performance, 84.4% top-1 ZS Imagenet, solid retrieval. This time via 'Data Filtering Networks' dataset. OpenCLIP and @huggingface transformers compatible weights on the hub huggingface.co/apple?search_m…
Another week, another bump in OSS CLIP model performance, 84.4% top-1 ZS Imagenet, solid retrieval. This time via 'Data Filtering Networks' dataset. OpenCLIP and @huggingface transformers compatible weights on the hub huggingface.co/apple?search_m…
Awesome plot showing the progress in CLIP-like model training! As both a user and a researcher, there are a couple of caveats I personally feel worth pointing out.
Awesome plot showing the progress in CLIP-like model training! As both a user and a researcher, there are a couple of caveats I personally feel worth pointing out.
Our best model, G/14 with 83.0% zero-shot ImageNet top-1 accuracy, is released at both OpenCLIP (github.com/mlfoundations/…) and CLIPA (github.com/UCSC-VLAA/CLIPA)
Our best model, G/14 with 83.0% zero-shot ImageNet top-1 accuracy, is released at both OpenCLIP (github.com/mlfoundations/…) and CLIPA (github.com/UCSC-VLAA/CLIPA) https://t.co/zilKhrIrGq
🚀Big updates to OpenCLIP! We now support over 100 pretrained models, and many other goodies. Check it out! github.com/mlfoundations/…
🚀Big updates to OpenCLIP! We now support over 100 pretrained models, and many other goodies. Check it out! github.com/mlfoundations/…
At @AdeptAILabs we are open-sourcing a new Multi-Modal model with a dramatically simplified architecture and training procedure (more below)
If you are at @ICCVConference and want to use the power of language to improve your zero-shot image classification accuracy, let’s talk! I’ll be at poster 156 in the south foyer at 2:30 today
If you are at @ICCVConference and want to use the power of language to improve your zero-shot image classification accuracy, let’s talk! I’ll be at poster 156 in the south foyer at 2:30 today
If you're interested in the next generation of vision datasets, don't miss our workshop today at #ICCV2023! datacomp.ai/workshop.html
AK @_akhaliq
310K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80Gx
Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
Tim Dettmers @Tim_Dettmers
29K Followers 819 Following PhD Student at @UW. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.
Akari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳
Lucas Beyer (bl16) @giffmana
56K Followers 444 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]
Rosanne Liu @savvyRL
33K Followers 966 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDR
Jacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJw
Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0p
Sara Hooker @sarahookr
39K Followers 7K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.
Ross Wightman @wightmanr
18K Followers 1K Following Computer Vision @ 🤗. Ex head of Software, Firmware Engineering at a Canadian 🦄. Currently building ML, AI systems or investing in startups that do it better.
Ofir Press @OfirPress
10K Followers 3K Following I build tough benchmarks for LMs and then I get the LMs to solve them. Postdoc @Princeton. PhD from @nlpnoah @UW. Ex-visiting researcher @MetaAI & @MosaicML.
Ana Marasović @anmarasovic
4K Followers 604 Following Asst prof @UUtah · Ex @allen_ai @uwnlp postdoc @HD_NLP PhD · she/her 🇭🇷
Jay Hack @mathemagic1an
37K Followers 3K Following Founder/CEO @codegen. Tweets about AI, computing, and their impacts on society. Previously did startups, @palantir, @stanford. Not a pseudonym.
Irina Rish @irinarish
9K Followers 994 Following prof UdeM/Mila; Canada Excellence Research Chair; AAI Lab head https://t.co/UzlrC7ZrGF; INCITE project PI https://t.co/0rV7szd7rH; CSO https://t.co/XDhj6MEtUj
Prithviraj (Raj) Amma.. @rajammanabrolu
5K Followers 520 Following Interactive & grounded AI, RL, NLP. Assistant Prof @UCSanDiego. Research Scientist @DbrxMosaicAI. Prev: @allen_ai, @GeorgiaTech
Weijia Shi @WeijiaShi2
5K Followers 967 Following PhD student @uwcse @uwnlp | Visiting Researcher @MetaAI | Undergrad @CS_UCLA | https://t.co/eLBQmgkvym
Colin Raffel @colinraffel
30K Followers 654 Following nonbayesian parameterics, sweet lessons, and random birds. Friend of @srush_nlp
Andrew Thompson @AndrewT65390500
241 Followers 205 Following Christian Conservative 🍊#1a + #2a = God-given non-negotiable rights to reject totalitarianism and tyranny.
Abdulrahman Tabaza @embed_dim
3 Followers 768 Following enjoyer of various vector spaces, encoders and modalities
MAB氏 @MAB1791652
1 Followers 36 Following
Viviana @Viviana75842443
2 Followers 161 Following
Weloop @Weloop_official
9 Followers 71 Following Download “Weloop” to be a part of your friends circle
nik t. hatziefstathio.. @nikthehat
40K Followers 4K Following ⌗ Innovator-in-Chief ⇢ ❍ne World ✍︎ Investigative Journalist & Director of Open Records Strategy ⇢ AtNight Media ⌇ The New Way ® | One World 🌍
Ben A. Goldberg ™ �.. @BenAnaven
955 Followers 1K Following YESHUA Ha'Mashiach (LORD Jesus Christ) is The Creator and The King of the Universe! - For Elon Musk: I have monetization idea for X. Game changer! -
Sahil Antil @oxshitantil1
36 Followers 642 Following
INGABO @lingaboh
49 Followers 87 Following
Dana Mahmood @deordered
8 Followers 649 Following Fine-tuning AI models oftentimes & practicing philosopher at other times.
L G 🇺🇸 @LGSouzaB
216 Followers 2K Following Lawyer, tech investor, software engineering, space enthusiast and geopolitics aficionado. Invigorated by an exhilarating dance with RISK. Crypto since 2012.
Thanh-Thiên @theblsky
12 Followers 62 Following
Mars (parody) @marknadal
6K Followers 364 Following runway model, cybersecurity CEO, dad, Supreme Court paralegal, escort, CIA consultant, TV director, landlord, poet, HERETIC. engineered products used by 1% 🌎.
Nikita @nikitavoloboev
4K Followers 6K Following Make @LearnAnything_ Learn in public: https://t.co/GbFvuErkYn macOS course: https://t.co/JdbJWru6zG https://t.co/94R8ER7K2h https://t.co/ROkqhyhpEK
AMSARAJ N @amsaraj_n
437 Followers 2K Following
วิไลเมื.. @0nqj62l1s82rp5
72 Followers 1K Following ติดตามฉันแล้วฉันจะอัปเดตสิ่งที่คุณชอบและสนใจ หน้าแรกจะอัปเดตข้อมูลการติดต่อของฉันเป็นครั้งคราว
coffee & AI @realcoffeeAI
42 Followers 597 Following
Zhaoyang Wang @wangwan83764204
301 Followers 4K Following CS PhD student at UoB in the United Kingdom. Research interests: Automated Machine Learning, Online Learning, and Reinforcement Learning 🏳️🌈
Claire Korea @theclairekorea
79 Followers 123 Following making friends @Character_AI | prev Data Engine @Tesla_AI | opinions are my own
Spiderman 🇮🇳 @returnspiderman
1K Followers 6K Following Seek the truth | Everybody talks, very few listen | Watch out here comes the Spider-Man 😁 https://t.co/qwmEhH45SY
Will Mac @ca_dryclean
2 Followers 122 Following
Cryptocracyyy @cryptocracyyy
88 Followers 306 Following
Kodom John @kodomm__
9 Followers 70 Following
Timothy Fowler @teslafsd69
139 Followers 578 Following
Carlos E Salinas @scarlosenrique
417 Followers 3K Following Programacion, Electrónica industrial, Robótica, Música, Educación, EBR
Carson Werner @carsonjwerner
190 Followers 410 Following Through AI, I will help establish a Universal Basic Income for all
Aneeq🗯️ @AneeqROfficial
5K Followers 4K Following Gamer| |Influencer| |content creator| |human rights activist
Ivelina Petrova @ivelinapetrovaX
34 Followers 785 Following Industrial Management and development Master Degree and Architect in Architecture [email protected] [email protected] [email protected]
Björn Behrendt @goodbthoughts
0 Followers 54 Following
Guneet Singh Kohli @guneetsk99
453 Followers 3K Following AI Engineer @ GreyOrange, Building Indian LLMs with Odia GenAI Independent Researcher working on variety of random problems.
K Ra @KRaHumbleBee
538 Followers 5K Following What is beyond our Galaxy, beyond the universe? My goal is to save teens from drugs and homelessness.💔🥲 🚫 PORN/NUDITY NO DMs. NOT INVESTING/🚫 BITCOIN
bilal2vec @bilaltwovec
2K Followers 780 Following ✨ research engineer • prev @googlebrain @cohere @dbrxmosaicai • se @uwaterloo
AK @_akhaliq
310K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80Gx
Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
AI at Meta @AIatMeta
531K Followers 255 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
Tim Dettmers @Tim_Dettmers
29K Followers 819 Following PhD Student at @UW. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.
Akari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳
Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | Pianist
Lucas Beyer (bl16) @giffmana
56K Followers 444 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]
Rosanne Liu @savvyRL
33K Followers 966 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDR
Jacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJw
Sasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGz
Christopher Manning @chrmanning
126K Followers 115 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋
Soumith Chintala @soumithchintala
186K Followers 877 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Jonathan Frankle @jefrankle
16K Followers 685 Following Chief Scientist, Neural Networks @Databricks via MosaicML. PhD @MIT_CSAIL. BS/MS @PrincetonCS. DC area native. Making AI efficient for everyone at @DbrxMosaicAI
Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
Yoav Artzi @yoavartzi
13K Followers 163 Following Research/prof @cs_cornell + @cornell_tech🚡 / https://t.co/9YnWry7yHs / https://t.co/3VmRSyYm2d / asso. faculty director @arxiv / building https://t.co/f9QkzO5kaC
Yi Tay @YiTayML
29K Followers 97 Following chief scientist / cofounder @RekaAILabs 🫠 past: research scientist @google brain 🤯 currently learning to be a dad 🍼
Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0p
Hieu Pham @hyhieu226
2K Followers 41 Following Making GPUs go brrrr @augmentcode 🤖 Past: Research Scientist at Google Brain 🧠 Opinions are my own.
Mars (parody) @marknadal
6K Followers 364 Following runway model, cybersecurity CEO, dad, Supreme Court paralegal, escort, CIA consultant, TV director, landlord, poet, HERETIC. engineered products used by 1% 🌎.
Aitor Ormazabal @aormazabalo
233 Followers 149 Following Member of Technical Staff @RekaAILabs. Prev. PhD @ixaGroup, Research Intern @Aiatmeta FAIR
Wenhu Chen @WenhuChen
11K Followers 520 Following AI researcher @UWaterloo @GoogleAI @VectorInst. Interested in natural language processing, diffusion models. I direct TIGER-Lab at UWaterloo.
Eric Steinberger @EricSteinb
7K Followers 478 Following Writing code that writes code on a mission to build safe superintelligence | CEO/cofounder @magicailabs
Yongchao Zhou @Yongchao_Zhou_
526 Followers 301 Following Build Intelligence @xai | ML PhD @UofT @VectorInst | Prev. @GoogleAI @GoogleDeepMind | Working on LLMs
Trenton Bricken @TrentonBricken
6K Followers 2K Following Trying to figure out what makes minds and machines go "Beep Bop!" @AnthropicAI
Lianmin Zheng @lm_zheng
4K Followers 438 Following CS Ph.D. @ UC Berkeley. Creator of Alpa, Vicuna, and Chatbot Arena. @lmsysorg
Xuechen Li @lxuechen
2K Followers 900 Following Building intelligence @xai. PhD @Stanford. Undergrad @UofT. Worked at @GoogleAI @MSFTResearch @Vectorinst. I go by Chen.
Katia Karpenko @KatiaEarth
800 Followers 545 Following A somewhat-intelligent three-dimensional being at @xAI. Writer: https://t.co/pisunzyEVv. AI Filmmaker. Musician. Upcoming book: https://t.co/rBk0AMk1mF
Dwarkesh Patel @dwarkesh_sp
54K Followers 699 Following Being pretrained Host of Dwarkesh Podcast https://t.co/3SXlu7fy6N https://t.co/rEhnfYywXY https://t.co/hQfIWdM1Un
Saeed Maleki @MalekiSaeed
465 Followers 109 Following
Aditya Paliwal @VastoLorde95
519 Followers 85 Following I only read books that have pictures in them
Haotian Liu @imhaotian
6K Followers 396 Following building intelligence @xAI, creator of #LLaVA, cs @UWMadison, prev @MSFTResearch
Pratik Ramesh @pratiksiyal
60 Followers 486 Following ML PhD student at Georgia Tech | Working on Model Merging and Efficient Deep Learning.
Sholto Douglas @_sholtodouglas
15K Followers 856 Following Scaling Gemini @Deepmind - working towards intelligence too cheap to meter
Karina Nguyen @karinanguyen_
12K Followers 648 Following AI research & eng @AnthropicAI, prev. intern @nytimes, @square, @dropbox
Sandeep @sandeep1337
2K Followers 594 Following Researcher @MistralAI | Previously @NVIDIA | PhD @MILAMontreal | Masters @SCSatCMU | Intern at @MSFTResearch @facebookai @element_ai @DescriptApp
Lenny Bogdonoff @rememberlenny
13K Followers 4K Following Optimist. Working with @natfriedman + @danielgross; to invest in technology startups, support portfolio companies, and incubate new projects.
Evgenii Nikishin @nikishin_evg
1K Followers 845 Following PhD student @Mila_Quebec working on AI agents. Past: a research scientist intern @GoogleDeepMind London #StopWar 🇺🇦
Luca Mattos Möller @lucamoller
160 Followers 222 Following
Aidan Clark @_aidan_clark_
4K Followers 210 Following Research @OpenAI. Ex: @DeepMind, @BerkeleyDAGRS Hae sententiae verbaque mihi soli sunt
Teknium (e/λ) @Teknium1
29K Followers 3K Following Cofounder @NousResearch, prev @StabilityAI Github: https://t.co/LZwHTUFwPq HuggingFace: https://t.co/sN2FFU8PVE Support me on Github Sponsors
OpenAI Developers @OpenAIDevs
71K Followers 0 Following Official @OpenAI account for anyone building on our APIs. Join us in building the future of AI. We ❤️ developers!
Jeff Wu @WuTheFWasThat
258 Followers 245 Following
Manas Joglekar @ManasJoglekar
196 Followers 242 Following
Leo Gao @nabla_theta
5K Followers 337 Following Alignment researcher. cofounder & head of alignment memes @ EleutherAI. currently RE @ OpenAI. Let's make the future awesome.
Jan Hendrik Kirchner @janhkirchner
926 Followers 523 Following phd student in comp neuroscience @ mpi brain research frankfurt, https://t.co/42mTlpAKYJ, ➡️ supergeneralization theorist
Hamish Ivison @hamishivi
476 Followers 596 Following Antipodean Abroad. he/him. I (try to) do NLP research. PhD student @uwcse, prev @Sydney_Uni @allen_ai 🇦🇺🇨🇦🇬🇧
Nelly Papalampidi @pinelopip3
1K Followers 432 Following Research Scientist @DeepMind. PhD @InfAtEd @EdinburghNLP. Ex @MetaAI
Essential AI @essential_ai
2K Followers 5 Following Our mission is to deepen the partnership between humans and computers, unlocking collaborative capabilities that far exceed what could be achieved today.
James Bradbury @jekbradbury
11K Followers 8K Following Compute at @AnthropicAI! Previously JAX, TPUs, and LLMs at Google, MetaMind/@SFResearch, @Stanford Linguistics, @Caixin.
Dan Fu @realDanFu
4K Followers 176 Following CS PhD Candidate at Stanford, systems for machine learning. Sometimes YouTuber/podcaster. Academic Partner, @togethercompute.Tesla FSD v13 will likely be grokking language tokens. What excites me the most about Grok-1.5V is the potential to solve edge cases in self-driving. Using language for "chain of thought" will help the car break down a complex scenario, reason with rules and counterfactuals, and…
come join us where everyone has a shovel!
we're hiring designers, engineers, product, data, infra, and ai tutors - join us! x.ai/careers
Grok can see👀! Excited to share that I joined @xai last month, and it’s such a pleasure to work with a small, focused team and see how fast we can move! This is just the beginning.
You seeing this sh—
@gabriel_ilharco @xai Congrats! Is there a way to try the model myself?
Just a beginning. Multimodal understanding and generation capabilities will be rapidly improving. DM open, come and join us!
Some early results of our first vision model. It'll be integrated into the Grok chat in the medium term. A few other features will ship before that (likely very soon). Props to {@tingchenai, @gabriel_ilharco}. x.ai/blog/grok-1.5v
This new 'explore' tab on twitter is actually pretty good. First change I've found genuinely useful since the new ownership. (I think you only get it if you have Grok.) Lots of errors still, but it's accurate and targeted enough that I'm definitely getting value from it.
Causally running Grok-1 at home
@gabriel_ilharco The future should look like the future...
sharing some highlights from our recent paper: language models scale reliably with over-training and on downstream tasks! arxiv: arxiv.org/abs/2403.08540 104 models, 11M to 7B parameters, varying numbers of tokens, 3 datasets, eval’d on 46 tasks: github.com/mlfoundations/… 1/11
@gabriel_ilharco @xai Congrats Gabriel! Best of luck! ✨
@gabriel_ilharco @xai @gabriel_ilharco we already miss you at uw :) great work; I guess you’ve had a good start, convincing @xai releasing weights
Trends for United States
You might like
