Sherjil Ozair @sherjilozair
prev: autopilot @tesla, deep learning @googledeepmind, phd https://t.co/dxgb6gimCf, cs @iitdelhi sherjil.ozair.ai Joined August 2009-
Tweets2K
-
Followers6K
-
Following3K
-
Likes5K
diagnosis any%
the meta has stagnated, a paradigm shift is cooking
embeddings, not text, is the universal interface llms are not the universal platform neural networks are
👀
chatgpt probably sure at this point that a lot of humans don't have fingers for typing, but still love to write and run code
How did this get published? 🤔
if you love jax, we should probably chat, and you should probably slide into my dms
>saw finetuning v/s prompting discourse >ask them if they are doing full finetunes or LoRA >they dont understand >pull out illustrated diagram explaining difference between finetuning and LoRA >they laugh and say "it's a good finetune sir" >ask for a finetune >its LoRA
the real internet is in discord servers now the old internet, even twitter, feels like a post-apocalyptic town full of auto-generated content as if from a misaligned ai discords are underground towns buzzing with humans, smart, empathic, helpful, ambitious
Stability deserves a lot more credit for being an early torchbearer for open models. They were doing open models before it was cool to do open models. They showed the way for Meta, Mistral, and now Google. Cheering for Stability and hoping to see more amazing things from them!
Stability deserves a lot more credit for being an early torchbearer for open models. They were doing open models before it was cool to do open models. They showed the way for Meta, Mistral, and now Google. Cheering for Stability and hoping to see more amazing things from them!
If you find yourself becoming invested in a Twitter debate, remember that the winning move is almost always to remind yourself that the debate doesn’t matter, the axis on which it rests doesn’t matter, and you should probably disengage and go do something instead.
Beautifully executed. My guess for key ingredients: 1. Modernized high-quality VQ-VAE 2. Precise data curation of only high quality cinematic clips without a lot of dynamism 3. Very large multi-scale diffusion model which is repeatedly applied to upsample in space and time.
Beautifully executed. My guess for key ingredients: 1. Modernized high-quality VQ-VAE 2. Precise data curation of only high quality cinematic clips without a lot of dynamism 3. Very large multi-scale diffusion model which is repeatedly applied to upsample in space and time.
I like people who finish 30 minute meetings in 15 minutes.
1) What
Somewhere in the world, an unknown young person is probably starting a company now that will eventually be as big as today's tech giants.
Google DeepMind @GoogleDeepMind
944K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pJim Fan @DrJimFan
230K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.David Pfau @pfau
22K Followers 1K Following Knowledge manifests itself in radiant dreams that shimmer like the wild sun Views are my own pfau at sigmoid dot social on 🦣 https://t.co/xqtVHHVI17 on 🦋Danijar Hafner @danijarh
14K Followers 869 Following Building AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @DeepMindDelip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingSander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).Miles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.Michael Nielsen @michael_nielsen
96K Followers 6K Following Searching for the numinous 🇦🇺 🇨🇦, home in 🇺🇸 Research @AsteraInstitute https://t.co/maezekzRUbLucas Beyer (bl16) @giffmana
56K Followers 446 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]Shane Gu @shaneguML
28K Followers 1K Following Research Scientist & Manager @GoogleDeepMind Tokyo/MTV. ex: @GoogleAI Brain, @OpenAI. (JP: @shanegJP)yobibyte @y0b1byte
15K Followers 2K Following Kurin ViTaly, senior research scientist @IsomorphicLabs, ML PhD from @UniofOxford on RL, Multitask learning & GraphsJoshua Achiam ⚗️ @jachiam0
14K Followers 949 Following Human. Trying to make safe alchemy machines. Thinking about humanist alchemism (h/alc ⚗️, maybe). Main author of https://t.co/cKuSh210l1Thomas Wolf @Thom_Wolf
68K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-scienceBehnam Neyshabur @bneyshabur
18K Followers 690 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpackingTaco Cohen @TacoCohen
21K Followers 3K Following Deep learner at FAIR. Into codegen, equivariance, generative models. Spent time at Qualcomm, Scyfer (acquired), UvA, Deepmind, OpenAI.Jeff Dean (@🏡) @JeffDean
297K Followers 6K Following Chief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)👩💻 Paige Bai.. @DynamicWebPaige
59K Followers 2K Following ✨Keep it simple, make it scale. AI should be about empowering people, building understanding, & making dreams realities. 👩💻GenAI @GoogleDeepMind ex-@GitHubSiddharth Mahapatra @Sid_Mahapatra12
326 Followers 5K Following Get yourself together, Do whatever it takes, Get sh*t done You'll grow through, what you go through. The question is, are you willing to go through it ~ AnonChaos Song @song_chaos2243
195 Followers 4K FollowingKumail Nanji @KumailNanji
2K Followers 381 Following Your design partner delivering results that convert 🚀 Let’s chat https://t.co/TrLUAOde6l | 👀 Building a 𝕏 visualizer/growth tracker https://t.co/HHDnixOskcayush (e/acc) @ayshptk
6K Followers 791 Following co-founder @inducedai. work with me: [email protected]刘江/LIU Jiang @turingbook
54K Followers 3K Following Exploring AGI. Co-Founder of Turing Company. ex Meituan, BAAI, CSDN. 图灵联合创始人。曾任:智源研究院副院长,CSDN&《程序员》杂志总编,美团技术学院院长。nedned @nletcher
1K Followers 5K Following data (science | analytics | visualisation | engineering), @thoughtworks, #Python, #nlproc, ML, & assorted whimsical miscellaniaPruthvi Raj @pruthvi_eth
2K Followers 759 Following Email Automation For SaaS → https://t.co/UBHo5V1MJuJay Shaw @JayShaw152610
0 Followers 3 FollowingKundan @kumarkundan
27 Followers 163 Followingวิวรรณา @3Vu2TQSIem5X6
48 Followers 1K Following ไม่อยากพลาดช่วงเวลาการออกเดทที่น่าตื่นเต้นที่สุดใช่ไหม ถ้าอย่างนั้นก็รีบตามฉันมา! จะอัปเดตข้อมูลการติดต่อของฉันได้ตลอดเวลาKoolster @Koolster34
146 Followers 2K FollowingKabir Kumar, AI-plans.. @KKumar_ai_plans
262 Followers 327 Following Views are my own. Critique AI Alignment plans at https://t.co/zxHhGCbtFI I'm stupid, impatient and unemployedIshaan Preet Singh @ishaanpreet
4K Followers 801 Following biz, tech, food, history || make mistakes of ambition and not mistakes of slothBen Schulz @schulzb589
1K Followers 5K Following 3D Geospatial Analyst at Maxar Space Operations. Opinions expressed on this site are my own and do not necessarily represent the views of Maxar Technologies.anushk @anushkmittal
5K Followers 1K Following ceo intern @shapes_inc. ai agents w/ social intelligenceevelyn 🩵 @evelynjunn
2K Followers 673 Following building @kawaiifund | previously @stanford | hopeful post-postmodernistAndy Ayrey @AndyAyrey
2K Followers 547 Following trafficker in existential hope • i make websites for space & biotech companies @ https://t.co/MqJ1SS2Xkw • ai adaptation training @ https://t.co/pWNcpCLXdmCeleste @stargrlyceleste
3K Followers 2K Following slinging IoT, mech eng, prev: @tesla @acrylicrobotics @mcgilluAlex Tomala @a__tomala
1K Followers 115 Following Research Engineer @GoogleDeepMind It’s time to ship🫡Mitul Tiwari @mitultiwari
1K Followers 494 Following Director of AI @ServiceNow. Cofounder @PassageAI. Passionate about building products using AI/ML/data science. Worked on People You May Know @LinkedInAakrit Vaish @aakrit
12K Followers 2K Following Founder @haptik @heyinterakt. Investor @peercheque. Building a tech hub in Mumbai @mumbai_tech_.Scratchy @badibouzi
877 Followers 4K Following “Et si vous ne pouvez être les saints de la Connaissance, soyez-en du moins les guerriers.”Jonathan Swanson @swaaanson
21K Followers 341 Following Founder/Chairman @thumbtack & @athenago & https://t.co/TRiL1X4kl6 I always dreamed of having 48 hours in a day: https://t.co/q5Rb2Q02SIdust @dust68133035267
51 Followers 232 Following Searching for a shortcut to ASI. Synthetic data truther.Ionic Commerce @ioniccommerce
1K Followers 2K Following AI Agents+Retail | Magical shopping experiences for the new internet.Junyang Lin @JustinLin610
5K Followers 1K Following Chief Evangelist Officer of Qwen Team & OpenDevin, building LLM and LMM. Now @Alibaba_Qwen . Previously @PKU1898 LANCO group. ❤️ 🍵 ☕️ 🍷 🥃Arif Ahmad @arif_ahmad_py
297 Followers 7K Following All things AI, Computer Science and Circuits! Prev. @GoogleAIAI Papers Podcast @aipaperspodcast
964 Followers 2K Following A digestible daily update on the latest AI Research Papers. Brought to you by @pocketpodappclayton @clayhaight
2K Followers 977 Following canadian dynamist, emergent ventures | prev @ Zipline, Neuralink, Tesla, MaticianRamona Chandran @RamonaChandran
247 Followers 152 Following #DeepLearning #ComputerVision #Tesla #Autopilot #Recruiter #TeslabotAnish @Anish_m
903 Followers 401 Following Co-founder, @ngramdata - building the future of data for Research. empowering you to access insights easily 📈 . Previously at @Airbnb, @Meta, @flexportDr. George MBA PhD FR.. @DrGeorgeMBA
391 Followers 6K Following Founder, CEO and CIO Dynamic Portfolio Manager for disruptive innovation, Corporate Credit Rating, Risk Capital Allocation, AI, ML, Regulation and BankingMandar Joshi @mandarjoshi_
2K Followers 487 Following Research Scientist at Google DeepMind. Formerly CS/NLP PhD student at the University of Washington, Seattle. Here for cats, NLP, and politics.Telt 🍕 @twofifteenam
4K Followers 2K Following something new | former L7 FAANG manager (now L8) | gpu rich | xgboost appreciatoorNate Boyd @n8boyd
695 Followers 2K Following Invest in and help build deep tech & AI startups ~ dad & partner ~ curious & skepticalAndrej Karpathy @karpathy
980K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥AK @_akhaliq
310K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80GxGoogle DeepMind @GoogleDeepMind
944K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pSoumith Chintala @soumithchintala
187K Followers 884 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Jim Fan @DrJimFan
230K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.Danijar Hafner @danijarh
14K Followers 869 Following Building AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @DeepMindSander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).Miles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.Noam Brown @polynoamial
34K Followers 611 Following Researching reasoning @OpenAI | Co-created Libratus/Pluribus, the first superhuman no-limit poker AIs | Co-created CICERO | PhD from @SCSatCMUNatasha Jaques @natashajaques
25K Followers 1K Following Senior Research Scientist at @GoogleAI and Assistant Professor @uwcse. Social Reinforcement Learning in multi-agent and human-AI interactions. PhD from @MIT.Kevin Patrick Murphy @sirbayes
42K Followers 334 Following Research Scientist at Google Brain / Deepmind. Interested in Bayesian Machine Learning.Michael Nielsen @michael_nielsen
96K Followers 6K Following Searching for the numinous 🇦🇺 🇨🇦, home in 🇺🇸 Research @AsteraInstitute https://t.co/maezekzRUbLucas Beyer (bl16) @giffmana
56K Followers 446 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]Sergey Levine @svlevine
80K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical Intelligenceclem 🤗 @ClementDelangue
91K Followers 5K Following Co-founder & CEO @HuggingFace 🤗, the open and collaborative platform for AI buildersanushk @anushkmittal
5K Followers 1K Following ceo intern @shapes_inc. ai agents w/ social intelligenceRussell Kaplan @russelljkaplan
11K Followers 651 Following Past: director of engineering @Scale_AI, startup founder, ML scientist @Tesla Autopilot, researcher @StanfordSVL.Heinrich Kuttler @HeinrichKuttler
2K Followers 699 Following Member of Founding Team @InflectionAI. Ex @FacebookAI, @DeepMind, @Google, @LMU_Muenchen, PhD math-ph. Opinions my own. (Can be yours for a small fee.)Pentagram Design @pentagram
315K Followers 2K Following A multi-disciplinary, independently owned design studio.Tobias van Schneider @vanschneider
116K Followers 277 Following A hopelessly inquisitive man. Remember everything ✣ https://t.co/FLvjjlMCxN Build with pride ✣ https://t.co/9p1tL17ohM Show off your work ✣ https://t.co/ZtaVUw4vAHSmith & Diction @Smith_Diction
4K Followers 33 Following We are a design studio that creates thoughtful identities for imaginative clients.Goodside @Goodside_Studio
2K Followers 23 Following Goodside is a full-service brand studio led by @jstrelioff and @daniellelaroy. We build brands that look good, sound good, and do good.Kumail Nanji @KumailNanji
2K Followers 381 Following Your design partner delivering results that convert 🚀 Let’s chat https://t.co/TrLUAOde6l | 👀 Building a 𝕏 visualizer/growth tracker https://t.co/HHDnixOskcDylan Field @zoink
120K Followers 1K Following ceo @figma. likes on twitter = bookmarking, not endorsementAlexis Gallisá @alexisg
9K Followers 1K Following Husband of the much more talented @lauragallisa. Dir. Design Systems @Frame_io @Adobe. Alum from @giantbomb @gamespot @twitch. @[email protected]Karri Saarinen @karrisaarinen
50K Followers 1K Following ceo of @linear | previously: design at @airbnb, @coinbase. yc alumn (s12)Emery Wells @emerywells
12K Followers 1K Following Founder of a unicorn, @Frame_io (acquired by Adobe). Video Pro. Apple Design Award winner.Ali Moiz @ali_moiz
21K Followers 2K Following building stonks w/@mecolalu; prev exits: @Streamlabs @peanutlabsmedia; writing a children's book. Dad 👪 🇺🇸🇵🇰Rokas Dam @rokasdam
2K Followers 76 Following I help you ship unlimited Next.js apps on AWS with https://t.co/A6mLpfABokTravis Fischer @transitive_bs
19K Followers 733 Following AI founder working on OSS agentic building blocks. Prev: @microsoft, @amazon, saasify. My heart is open source 💕Pruthvi Raj @pruthvi_eth
2K Followers 759 Following Email Automation For SaaS → https://t.co/UBHo5V1MJuDev Shah @0xDevShah
1K Followers 234 Following Building @thenirvanalabs (Nvidia Inception) | MLOps | GenAI | CSE @northeasternKinjal Nandy @itsKinjalNandy
1K Followers 2K Following i wanna talk to chatGPT like i talk to a humanCharlie Marsh @charliermarsh
12K Followers 776 Following Building @astral_sh: Ruff, uv, and other high-performance Python tools. Prev: Staff engineer @SpringDiscovery, @KhanAcademy, BSE @PrincetonCS.jason liu @jxnlco
19K Followers 1K Following sabbatical @southpkcommons, angel investor?? prev @stitchfix @metaPeak Bengaluru @peakbengaluru
122K Followers 63 Following Startup, tech & hipster frenzy from the hottest & fastest growing startup city in the world 💜 Independent voice of Indian Startup Ecosystem! 🍿 @12thMainBotRithwik Jayasimha @thel3l
380 Followers 331 Following hacker, designer, dilettante used to run @claygorilla currently: thinking about interfaces of the futurechewingCode @chewingcode
1K Followers 396 Following software engineer; https://t.co/qWiFmjqMOj; front-end, half back-end, one third designer;Reka @RekaAILabs
11K Followers 13 Following An AI research and product company 🫠. We are a team of scientists and engineers building state-of-the-art multimodal language models 😻Aaron Gokaslan @SkyLi0n
3K Followers 345 Following Creator of the OpenWebText and OpenGPT2. @PyTorch Core Reviewer. PhD Student at @Cornell (interning at @MosaicML) Previously at @FacebookAI and @BrownUniversityyeswondwerr @yeswondwerr
599 Followers 297 FollowingLewis @ctjlewis
27K Followers 15K Following Founder @SpellcraftAI. Prev @Walmart @McDonalds. Almae matres @Wikipedia @YouTube @Coursera.Danny Postma @dannypostmaa
115K Followers 679 Following Founder of https://t.co/reapzFhWNK Building the future of photography.Mercor @mercor_ai
790 Followers 0 Following Mercor is a better way to hire. We’re an AI-powered platform that matches companies with elite talent around the world.Hieu Pham @hyhieu226
2K Followers 26 Following Making GPUs go brrrr @augmentcode 🤖 Past: Research Scientist at Google Brain 🧠 IMO Silver Medalist 🥈 waiting for LLMs to beat me. Tweets are my own opinions.Ishaan Preet Singh @ishaanpreet
4K Followers 801 Following biz, tech, food, history || make mistakes of ambition and not mistakes of slothevelyn 🩵 @evelynjunn
2K Followers 673 Following building @kawaiifund | previously @stanford | hopeful post-postmodernistVaibhav Domkundwar @vaibhavbetter
19K Followers 118 Following Building Better Capital 🦄🦄➡️ $100M AUM founding stage fund ➡️ Backing top-tier Indian founders at Slice, M2P, SuperAGI, Merlin ➡️ 3X Founder ➡️ UC BerkeleyTony Z. Zhao @tonyzzhao
12K Followers 785 Following CS PhD student @Stanford. Aspiring full-stack roboticist. Prev Deepmind, Tesla, GoogleX, Berkeley.Kizaryu @kindkizaryu
88 Followers 100 Following https://t.co/ReUndFQpwW | bootstrapping https://t.co/1fZwlolLgV | may sometimes use this account just for funCeleste @stargrlyceleste
3K Followers 2K Following slinging IoT, mech eng, prev: @tesla @acrylicrobotics @mcgillunext play @nextplayso
522 Followers 2 Following The best way to discover what’s next—curated opportunities, gatherings, and content.Jordan Gonen @jrdngonen
4K Followers 334 FollowingBen Lang @benln
28K Followers 548 Following Angel investing, building @nextplayso, prev early Notion teamAlex Tomala @a__tomala
1K Followers 115 Following Research Engineer @GoogleDeepMind It’s time to ship🫡Michelle Qin @michelleqin_
3K Followers 512 Following CS @pika_labs @Stanford ✌️ I care about people, AI, & design for play 🤸♀️model = learn(data) Synthetic data is great, but it’s not data. It’s an intermediate quantity created by learn(). Data is created by people and has privacy and copyright considerations. Synthetic “data” does not - it’s internal to learn().
One thing I will add: I don't care if you went to IIT. I invest in founders of all backgrounds, and our executive team is a mix - and I could barely tell you who went to school where. We hire for: Curiosity, Excellence and Empathy. Not IIT/Ivy.
Rubrik's IPO today is a rare recent public win for Silicon Valley. But it's just the latest for the 'IIT Mafia,' a small group of Indian immigrant engineers who've since started software standouts like Nutanix, Rubrik and Glean. My story in @Forbes: forbes.com/sites/alexkonr…
SF is like an adrenaline injection. Absolutely no way you don’t want to build something after being here. Vibes are infectious.
San Francisco post-mortum. Tl;dr: Absolute top-tier city if you pretend downtown doesn’t exist. Literally, just never set your set a feet into the inner-city part and you’re going to have an amazing time. ❌ The bad: • Downtown (Tenderloin & SoMa) is a zombie wasteland and…
I keep going back to this thread on how the next AI paradigm is what we should be worried about (autonomous agents), if anything. Here's a Claude summary: 1. As language models become more capable, they get better at exploiting reward models used in reinforcement learning. This…
@teortaxesTex (back from the dead to exchange contact details with folks in my DMs) From my experience doing early RLHF work for Gemini, larger models exploit the reward model more. You need to constantly keep collecting more preferences and retraining reward models to make it not…
no thank you. i won’t do any “deep work” i don’t wanna do. i will do “deep work” on the stuff i loved doing as a kid/teenager.
you can tell when someone’s career is growing linearly because you can see the light in their eyes fade over the years from high school to college it’s all exponentials and it’s your responsibility to keep it that way postgrad
GPU gods, grant me the serenity to hard-code the functions deep nets can not learn, the courage to let them learn the ones they can, and the wisdom to know the difference.
@nealkhosla how do we make it happen?
Many leaders in the AI race prefer to speak solely in platitudes. I would bet on the player that is comfortable and capable of talking about the details. Must listen podcast w Zuck.
I listen to a podcast and then read the transcript if is valuable and worth another round of thinking. Transcript: dwarkeshpatel.com/p/mark-zuckerb…
Build a product that collects real world data for you, and you won’t have to worry about hiding it !
Need more robots
Instead of leaf blowers, I want a quiet little robot that picks leaves up one at a time and puts them in a bag, at night while I'm sleeping.
@nikunj Nikunj! Shhhh. It's supposed to be a secret we're the one firm that doesn't hire associates to make these maps in order to impress LPs and pretend we know what we're talking about to founders
I’m new to VC so maybe someone forgot to tell me.. Why do firms spend so much time on building market maps? Like WHO is actually looking at this (inside or outside the firm) and finding a ton of value. Things are shifting so fast - aren’t these useless in a quarter or two?
@yacineMTB Stay strong, the team sucks anyways.
If you like to take my tweets out of context to make me look bad, here, let me do your job for you:
@yacineMTB Stay strong, the team sucks anyways.
OpenAI caught lightning in a bottle when they realized language transformers could simply be scaled up to unlock long sought after capabilities. but the returns from scaling up that model architecture is starting to plateau. what are the chances they can catch lightning twice?