Darren Tsai @darrenjkt
PhD Candidate @Sydney_Uni, Australian Centre for Field Robotics (ACFR). Autonomous Vehicles, Sensor fusion, 3D Computer Vision. Sydney, Australia Joined February 2021-
Tweets22
-
Followers29
-
Following107
-
Likes95
HuggingGPT is the most interesting paper I read this week. It gets very close to the "Everything App" vision that I described a while ago. ChatGPT acts as a controller over the *AI model space*, picks the right model (app) given the human specification, and assembles them…
Random quick note on Transformer block unification. People are usually a bit surprised that the MLP and Attention blocks that repeat in a Transformer can be re-formated to look very similar, likely unifiable. The MLP block just attends over data-independent {key: value} nodes:
Didn't tweet nanoGPT yet (quietly getting it to good shape) but it's trending on HN so here it is :) : github.com/karpathy/nanoG… Aspires to be simplest, fastest repo for training/finetuning medium-sized GPTs. So far confirmed it reproduced GPT-2 (124M). 2 simple files of ~300 lines
A Large Language Model trained on scientific papers. Type a text and galactica.ai will generate a paper with relevant references, formulas, and everything. Amazing work by @metaai / @paperswithcode
A Large Language Model trained on scientific papers. Type a text and galactica.ai will generate a paper with relevant references, formulas, and everything. Amazing work by @metaai / @paperswithcode
Thanks Lex, I've enjoyed many of the previous episodes so it was a pleasure to come on! (we've known each other from before the podcast (via MIT/autonomy), it's been awesome to watch you grow it so successfully over time 👏)
Thanks Lex, I've enjoyed many of the previous episodes so it was a pleasure to come on! (we've known each other from before the podcast (via MIT/autonomy), it's been awesome to watch you grow it so successfully over time 👏)
DALLE-2 was paywall-released recently by an extremely well-funded company. Just yesterday, a group of independent researchers released their own model (Stable Diffusion) that you can use in a few lines of code for FREE. The speed of the ML research community is insane 🤯
Just found out that diffusion models are the new SOTA for image generation and apparently more stable to train than GANs. Will be giving this a shot!
Just found out that diffusion models are the new SOTA for image generation and apparently more stable to train than GANs. Will be giving this a shot!
A brief history of distances (precambrian machine learning time!). PDF and distance portal: franknielsen.github.io/Divergence/ind…
!!!! Ok I recorded a (new!) 2h25m lecture on "The spelled-out intro to neural networks and backpropagation: building micrograd" youtube.com/watch?v=VMj-3S… . This is the culmination of about 8 years of obsessing about the best way to explain neural nets and backprop.
. @DeepMind released this GOLD a couple days back. If you ever wanted to study Transformers from scratch I think this would be that one resource you wouldn't want to miss: arxiv.org/abs/2207.09238
A common point raised by ML reviewers is that a method is too simple or is made of existing parts. But simplicity is a strength, not a weakness. People are much more likely to adopt simple methods, and simple ones are also typically more interpretable and intuitive. 1/2
Congratulations on the release of the Probabilistic Machine Learning book, an incredibly comprehensive resource for the ML community. (And its free!) It is an honour that the PML book has a section and figures from my Transformers are GNNs blogpost!
Congratulations on the release of the Probabilistic Machine Learning book, an incredibly comprehensive resource for the ML community. (And its free!) It is an honour that the PML book has a section and figures from my Transformers are GNNs blogpost! https://t.co/8Tej840U42
Yesterday was my last day of working at Google. Perhaps this comes as surprise to you twitter folks, as I haven't widely announced that I left academia to try something new. Here's what I learned in 9 months as a Data Analyst who (temporarily) left Astronomy for Big Tech. 1/n
How to come up with research ideas? Excited about starting doing research but have no clue?🤷♂️🤷🏻♀️ Here are some simple methods that I found useful in identifying initial directions. Check out the thread below 👇
Top scoring approaches on any benchmark are often overly complex, overly-specialized models, heavy multi-scale ensembles, fancy training techniques, etc. How do we organize benchmarks / metrics for the "simplest baseline that just works".
I couldn't resist. With contributions from @maxhkw
Favorite review to date: "The results are *impressive and practical*, but are obtained by combining six techniques/insights that are cool but each incremental on their own. Strong Reject!"
Sharing ideas on how to disseminate your research. "I am THRILLED to share that our paper is accepted to ..." Congrats! So what's next? No one is going to browse through the list of thousands of accepted papers. Ain't nobody got time for that. Check out 🧵below for examples.
For many classes of topics/questions Google Search has become super SEO'd, surfacing very low quality often ad-heavy/paginated content. I find myself appending "reddit" to a lot of queries and often getting much better results.
@colinraffel 💯 bow can be a very strong baseline in simpler setups. Eg when I was doing some arxiv-sanity ranking (predict paper a user will add to library given the other N-1 papers in their library already) a simple SVM on tfidf bow crushed BERT features
Vwalter @Vwalter181449
0 Followers 911 Following
Turdues @Turduesua3XFT
43 Followers 5K Following
VernaTobias @0ir4rLfut0tn3
76 Followers 7K Following
Smerseart @Smerseart5HA
75 Followers 7K Following
Viwhough @ViwhoughShmo_
47 Followers 4K Following
FayO'Neil @w7sC4GwiWaM40i8
57 Followers 7K Following
BarbaraBach @7n1p194pYZwT744
30 Followers 4K Following
MaudAddison @dNbOIzupZBN4SL7
71 Followers 7K Following
Kelly @nakatak50740453
60 Followers 7K Following
Shoatho @ShoathotNr
77 Followers 7K Following
NoraNewton @cbtw78o64b3qTE
26 Followers 3K Following
Shanen @Shanen9622
85 Followers 2K Following
InSysOut @InSysOut
21 Followers 436 Following Transforming Visions into Reality – Innovative Solutions, Seamless Integration, and AI Wonders.
ざんぬ @yukky_saito
2K Followers 886 Following 自律移動ロボット/Autowareの開発し始めて12年。自動運転システムのアーキテクト(最近はE2E)。 Sony R&D➝TIER IV #ROS #Autoware https://t.co/gqUs1xGlno 組織を代表するものではなく個人の発言です
Bert De Brabandere @BBrabandere
215 Followers 444 Following CTO and co-founder at @SegmentsAI. Computer Vision and Machine Learning.
Jack Naylor @nackjaylor
235 Followers 1K Following GradIEAust | PhD Candidate researching neural scenes for robotics @SIRISrobotics @sydney_uni Views are my own.
Xuyang Wang @wxyxixixi
11 Followers 39 Following
Snehal Jauhri @SnehalJauhri
599 Followers 713 Following ML for Robotics | Research Intern @allen_ai | PhD candidate, PEARL lab, TU Darmstadt with @GeorgiaChal (🦋@snehaljauhri.bsky.social)
Arun Narenthiran🤖�... @ArunUIUC
551 Followers 2K Following PhD student @IllinoisCS focused on Agricultural Robotics
An Thái Lê @an_thai_le
457 Followers 657 Following Ph.D. Student for #RobotLearning #MachineLearning #Robotics at @ias_tudarmstadt, advised by @Jan_R_Peters. Former intern: @Bosch_AI
David Cáceres Domín... @DavidRobotics
19 Followers 52 Following PhD candidate at Örebro University | Collaborative AI and Robotics
Machines @Machines_MDPI
516 Followers 2K Following Machines (ISSN 2075-1702, IF: 2.1) — #OpenAccess Journal on #machinery and #engineering published monthly online by MDPI.
Kaspar Althoefer @KasparAlthoefer
1K Followers 762 Following ERC Synergy Grant EndoTheranostics https://t.co/xiYjLuGVNI
Januar Kailani Suaeb @januarKai
224 Followers 659 Following And when the night is cloudy, there is still a light that shine on me. Shine on untill tomorrow, let it be.
Harshal Deshpande @thehardesh
284 Followers 1K Following Interested in robotics and climate tech. Robotics @getpeppermint. Previously @bitspilanigoa. Been tweeting about F1 since the past couple of months
Lee K.M @robinlee1994
19 Followers 260 Following
Ankur Parikh @ank_parikh
3K Followers 4K Following Staff Research Scientist at Google DeepMind. Former adjunct assistant prof at @NYU_Courant. PhD at @mldcmu. ML for Bio/Chem (Prev. NLP). All opinions my own.
Leonardo.Ai @LeonardoAi_
58K Followers 1K Following Leonardo Al. The advanced creative toolkit for curious makers. https://t.co/Wn0zqQ5vsR API Access: https://t.co/LfYpTC3Y8j Discord: https://t.co/Fu73yaNwDw
Stanford NLP Group @stanfordnlp
172K Followers 296 Following Computational Linguists—Natural Language—Machine Learning @chrmanning @jurafsky @percyliang @ChrisGPotts @tatsu_hashimoto @MonicaSLam @Diyi_Yang @StanfordAILab
Fei-Fei Li @drfeifei
527K Followers 1K Following Prof (CS @Stanford), Co-Director @StanfordHAI, Cofounder/CEO @theworldlabs, #AI #SpatialIntelligence #GenAI #computervision #robotics #AI-healthcare
Stanford AI Lab @StanfordAILab
213K Followers 332 Following The Stanford Artificial Intelligence Laboratory (SAIL), a leading #AI lab since 1963. ⛵️🤖 Emmy-winning video: https://t.co/lV9smZTC1m
fast.ai @fastdotai
128K Followers 17 Following Deep learning R&D: https://t.co/cGBcDU8wJ9; Education: https://t.co/bNXBttRAuR; Software: https://t.co/0z7Ws3SHDt; Book: https://t.co/lVEDyioBtg; @math_rachel @jeremyphoward
Berkeley AI Research @berkeley_ai
228K Followers 379 Following We're graduate students, postdocs, faculty and scientists at the cutting edge of artificial intelligence research.
Andrew Ng @AndrewYNg
1.3M Followers 1K Following Co-Founder of Coursera; Stanford CS adjunct faculty. Former head of Baidu AI Group/Google Brain. #ai #machinelearning, #deeplearning #MOOCs
Ian Goodfellow @goodfellow_ian
348K Followers 1K Following DeepMind Research Scientist. Opinions my own. Inventor of GANs. Lead author of https://t.co/M6vl8pEQ4I Founding chairman of @pubhealthaction
Kaspar Althoefer @KasparAlthoefer
1K Followers 762 Following ERC Synergy Grant EndoTheranostics https://t.co/xiYjLuGVNI
IROS 2022 @2022Iros
724 Followers 8 Following The 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2022) will be held on October 23–27, 2022 in The Kyoto Int. Conf. Center
IEEE ICRA @ieee_ras_icra
12K Followers 82 Following #ICRA2025 IEEE International Conference on Robotics & Automation 19–23 May, Atlanta, USA
Xiaohua Zhai @XiaohuaZhai
11K Followers 311 Following Researcher at Meta (previously at OpenAI Zürich, Google DeepMind)
Lucas Beyer (bl16) @giffmana
110K Followers 524 Following Researcher (now: Meta. ex: OpenAI, DeepMind, Brain, RWTH Aachen), Gamer, Hacker, Belgian. Anon feedback: https://t.co/xe2XUqkKit ✗DMs → email
Yann LeCun @ylecun
956K Followers 765 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Lee K.M @robinlee1994
19 Followers 260 Following
Stephany Berrio @chinitaberrio
478 Followers 672 Following Intelligent Transportation Systems Research Fellow @Sydney_Uni 🐯Lily's and 🦁Walnut's mom
Andrej Karpathy @karpathy
1.4M Followers 1K Following Building @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
Google DeepMind @GoogleDeepMind
1.2M Followers 279 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
Samaneh Azadi @smnh_azadi
956 Followers 110 Following Research Scientist @GenAI @Meta . Ph.D. graduate from Berkeley AI Research and former intern @GoogleBrain and @AdobeResearch.
Negar Rostamzadeh @negar_rz
10K Followers 821 Following Staff RS @Google Research, Adjunct Professor @McGillu, Associate Industry Member @MIlAMontreal
Sharad Vikram @sharadvikram
2K Followers 590 Following Researcher @ Google Deepmind. I work on JAX + Pallas (https://t.co/lPMsq3yzgL) and Gemini. In the past I worked on Oryx and TFP. I like learning.
Adam Santoro @santoroAI
9K Followers 224 Following Research Scientist in artificial intelligence at DeepMind
Yao Qin @YaoQin_UCSB
4K Followers 317 Following Assistant Professor @UCSB; Research Scientist @Google DeepMind; PhD @UCSD
Harini Kannan @harinidkannan
675 Followers 98 Following Working on something new. Previously generative AI @GoogleBrain and @MIT CS
Aleksandra Faust @AleksandraFaust
3K Followers 537 Following Chief AI Officer @genesistxai. Previously, Research Scientist @GoogleDeepMind, @GoogleAI in #GoogleBrain, @Waymo, @SandiaLabs, @UNM, @UIUC.
Ankur Bapna @ankurbpn
1K Followers 649 Following Conversational Superintelligence @Meta Previously Led Native Audio Generation Gemini 2.5, Native Audio Gemini 1.5 @GoogleDeepmind
Ofir Nachum @ofirnachum
5K Followers 356 Following Research at @OpenAI. Previously at @GoogleAI on the Brain Team. Doing work on #ReinforcementLearning and #MachineLearning
Hugging Face @huggingface
568K Followers 210 Following The AI community building the future. https://t.co/VkRPD0Vclr
Jacob Menick @jacobmenick
6K Followers 326 Following @thinkymachines previously @OpenAI @UCL @DeepMind 🇺🇸/🇬🇧
Chaitanya K. Joshi @chaitjo
9K Followers 974 Following PhD student @Cambridge_CL. Research Intern @AIatMeta and @PrescientDesign. Interested in Deep Learning for biomolecule design.
Peyman Milanfar @docmilanfar
94K Followers 504 Following Distinguished Scientist at Google. Computational Imaging, Machine Learning, and Vision. Tweets = personal opinions. May change or disappear over time.
Martin Maas @martin_maas
490 Followers 305 Following Staff Research Scientist at Google DeepMind. All opinions are my own.
Jasper @latentjasper
8K Followers 394 Following Dad, husband, machine learning researcher. Research Scientist @ Google Brain.
Charles 🎉 Frye @charles_irl
15K Followers 3K Following gpu enjoyer at @modal. he/him. ex @full_stack_dl, @weights_biases (acq. @CoreWeave), phd Berkeley @Redwood_Neuro. try https://t.co/SYWVMCazZ3
Dmytro Mishkin 🇺�... @ducha_aiki
24K Followers 708 Following Marrying classical CV and Deep Learning. I do things, which work, rather than being novel, but not working.
Fabio Petroni @Fabio_Petroni
2K Followers 377 Following Group Leader at @EMBL, focusing on AI-driven Scientific Discovery. Co-Founder @Samaya_AI. Former Researcher @MetaAI (FAIR) @thomsonreuters. PhD @SapienzaRoma.
Hossein Mobahi @TheGradient
6K Followers 762 Following Senior Research Scientist @GoogleDeepMind. I ∈ Optimization ∩ Machine Learning. Fan of @IronMaiden🤘.Here to discuss research 🤓
Alexander Kolesnikov @__kolesnikov__
12K Followers 194 Following
Peter Hase @peterbhase
3K Followers 1K Following Visiting Scientist at Schmidt Sciences. Visiting Researcher at the Stanford NLP Group Previously: Anthropic, AI2, Google, Meta, UNC Chapel Hill
Trapit Bansal @TrapitBansal
32K Followers 250 Following AI Research @Meta | Co-Creator of OpenAI o1 | Previously @OpenAI, @MSFTResearch, @GoogleAI, @facebook, @iiscbangalore, and undergrad @IITKanpur
Ryan Lowe 🥞 @ryan_t_lowe
6K Followers 476 Following full-stack alignment 🥞 @meaningaligned prev: InstructGPT @OpenAI 🦋 @ ryantloweTrends for United States
You might like
