Lilian Weng @lilianweng
Working on AI safety, past on robotics, applied research @OpenAI; Writing ML blogs to help myself & others to learn; Ideas my own. lilianweng.github.io San Francisco, CA Joined December 2009-
Tweets165
-
Followers93K
-
Following147
-
Likes131
We are lucky to have you Mira and we are with you 💙
We are lucky to have you Mira and we are with you 💙
🗣️I've been thinking about data quality & human factor in the process a lot lately, so write a short post on the topic: lilianweng.github.io/posts/2024-02-… More: If you are into the topic, my team is hiring Research Engineer for a new sub-team Human-AI Interaction: openai.com/careers/resear…
Very interesting read. If we apply similar idea to build in a safe mode trigger, it can probably stay robust even after custom fine-tuning.
Very interesting read. If we apply similar idea to build in a safe mode trigger, it can probably stay robust even after custom fine-tuning.
We have various teams working on AI safety at OpenAI. Let us know if you are interested!
We have various teams working on AI safety at OpenAI. Let us know if you are interested!
AI will be an order of magnitude more important for jobs over the next generation than any changes in trade brought @ by trade agreements
Rebirth
About 650 / 770 signed at this moment. As people start waking up, more will come. All the efforts started after 1:30 AM, 500+ within two hours and all of this after 2 crazy days with very little sleep.
🤷♀️
❤️
Feeling a bit intimidating to write about it but work on attacks can lead to good insights for mitigation. Plan to write about mitigation work separately later. Also want to thank all the researchers who shared disclosure reports w/ us so far. 🙏🙏🙏 lilianweng.github.io/posts/2023-10-…
Preparedness team, led by @aleks_madry, will focus on evaluation of and protection for catastrophic risks that might be triggered by AGI-level capability, including cybersecurity, bioweapon threats, persuasion and more. Come join us 💪 - openai.com/careers/search…
Preparedness team, led by @aleks_madry, will focus on evaluation of and protection for catastrophic risks that might be triggered by AGI-level capability, including cybersecurity, bioweapon threats, persuasion and more. Come join us 💪 - openai.com/careers/search…
Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pRosanne Liu @savvyRL
32K Followers 965 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDRJia-Bin Huang @jbhuang0604
51K Followers 285 Following Associate Professor @umdcs; Part-time Research Scientist @Meta. I like pixels.Horace He @cHHillee
23K Followers 445 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemalePercy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistKyunghyun Cho @kchonyc
60K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Petar Veličković @PetarV_93
30K Followers 555 Following Staff Research Scientist @GoogleDeepMind | Affiliated Lecturer @Cambridge_Uni | Associate @clarehall_cam | GDL Scholar @ELLISforEurope. Monoids. 🇷🇸🇲🇪🇧🇦Karol Hausman @hausman_k
22K Followers 140 Following @Physical_int ex: researcher @GoogleAI/@DeepMind, adj. Prof. @Stanford. Into robots, AI, NBA, philosophy, soccer and almond croissants. 🇵🇱🇺🇸François Fleuret @francoisfleuret
30K Followers 477 Following Prof. @Unige_en, Adjunct Prof. @EPFL_en, Research Fellow @idiap_ch, co-founder @nc_shape. AI and machine learning since 1994. I like reality.Sander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).yobibyte @y0b1byte
15K Followers 2K Following Kurin ViTaly, senior research scientist @IsomorphicLabs, ML PhD from @UniofOxford on RL, Multitask learning & GraphsSara Hooker @sarahookr
39K Followers 7K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.Danijar Hafner @danijarh
14K Followers 867 Following Building AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @DeepMindEugene Vinitsky @EugeneVinitsky
13K Followers 2K Following Anti-cynic. Artificial narrow intelligence. Autonomous vehicles, multi-agent learning, and transportation. RS at Apple, Asst. Prof at @nyutandon. He/him.Tim Dettmers @Tim_Dettmers
28K Followers 819 Following PhD Student at @UW. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.rohan anil @_arohan_
12K Followers 2K Following Principal Engineer, @GoogleDeepMind Gemini. prev PaLM-2. Tinkering with optimization and distributed systems. opinions are my own.Jay Alammar @JayAlammar
35K Followers 1K Following Machine learning and language models R&D. Builder. Writer. Visualizing AI, ML, and LLMs one concept at a time. @Cohere. https://t.co/TquuQXlLOJ林彥伯 @rainbow5052
0 Followers 34 FollowingSeunghyuk Oh @SeunghyukOh
0 Followers 29 FollowingConway Zhu @zhu63727
7 Followers 8 FollowingMesubsetofRunionC @mesubsetof
19 Followers 265 Followinggibson7601 @gibson7601
4 Followers 30 FollowingRivharde Dalyonnere @DRivharde
0 Followers 41 FollowingNexServ Technologies,.. @NTI360
188 Followers 1K Following NexServ offers only the industry's best brands and quality-managed National IT services to provide the most reliable products and service offerings since 1999.Angel 💯 @angeldev96
98 Followers 775 Following AI and Machine Learning✨ | Tech enthusiast de día y de noche también. WebDev.Ayooluwa Akintola, MS.. @AyAkintola
30 Followers 236 Following Chemical & Process Systems Engineering | Machine Learning-AI | Data Science & Engineering | Software Engineering | Systems Optimisation | Executive ManagementNicholas Amaya @nickamaya_
32 Followers 150 FollowingJonathan Cruz @cruzjonk
0 Followers 85 FollowingApparatchik MPA, MA, .. @fromhowtowhy
194 Followers 661 FollowingJimeng Shi @jimengshi008
5 Followers 82 Following CS Ph.D. student at Florida International University. Research areas: development and application of machine learning algorithms.umi @umi11110000
0 Followers 32 FollowingDavid Capek @CapekDavid
18 Followers 281 FollowingKCC @Colli2838Karen
569 Followers 1K Following I have kids and I am concerned about humanity. I often wonder why technology is so far behind Also will vote RedLibyan Cossack @LibyanCossack
1K Followers 5K Following Libya/Aerospace/Tech/Politics/Whatever XMR: 42mD3dUuWAH2ZnQDEvUkM3VTMxaUL4DCjK2iR8YW9Bi4WGdSCJGG13RhHKKLJCH7ypgpNbLpL4CpPWyHgRPeTQJRN4QXVzMpriyanshi khatri @priyanshikhatri
7 Followers 83 Followingfer ~ @linuxdasilvajr
653 Followers 881 Following ☕ | 19y | machine learning and low level programmingYuliya @mjulcik
0 Followers 60 FollowingAkam Rahimi @akam_rahimi_
10 Followers 72 Following @Oxford_VGG & @aims_oxford DPhil student at Oxford Universitymkg @mgonekar
26 Followers 1K FollowingWhisperAiML @whisperaiml
1 Followers 88 Followingjc @JerryChir
12 Followers 290 FollowingcrystalWen @JackLiuWen
22 Followers 479 FollowingMing Li @MingL_7
8 Followers 44 Following Ph.D. Student, working on recommender systems and information retrieval.David Y Chang @davidychang
17 Followers 74 Followingreturn10x @return10x
63 Followers 2K FollowingEric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pJürgen Schmidhuber @SchmidhuberAI
106K Followers 0 Following Invented principles of meta-learning (1987), GANs (1990), Transformers (1991), very deep learning (1991), etc. Our AI is used many billions of times every day.Rosanne Liu @savvyRL
32K Followers 965 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDRSergey Levine @svlevine
79K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical IntelligenceAnthropic @AnthropicAI
259K Followers 26 Following We're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant Claude at https://t.co/aRbQ97uk4d.Oriol Vinyals @OriolVinyalsML
166K Followers 82 Following VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead. Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.Ferenc Huszár @fhuszar
40K Followers 1K Following Secular Bayesian. Associate Professor in Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey Alum of @Twitter, Magic Pony and @BaldertonThomas Wolf @Thom_Wolf
67K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-scienceJoshua Achiam ⚗️ @jachiam0
14K Followers 943 Following Human. Trying to make safe alchemy machines. Thinking about humanist alchemism (h/alc ⚗️, maybe). Main author of https://t.co/cKuSh210l1Jan Leike @janleike
44K Followers 322 Following ML Researcher, co-leading Superalignment @OpenAI. Optimizing for a post-AGI future where humanity flourishes.Durk Kingma @dpkingma
35K Followers 346 Following Deep learning, mostly generative models. Prev. Google Brain/DeepMind, founding team @OpenAI. Inventor of the VAE, Adam optimizer, among other things. ML PhD.Chris Olah @ch402
90K Followers 173 Following Reverse engineering neural networks at @AnthropicAI. DMs open! Previously @distillpub, OpenAI Clarity Team, Google Brain. Personal account.Dustin Tran @dustinvtran
40K Followers 649 Following Research Scientist at Google DeepMind. I lead evaluation at Gemini / Bard. AI, Bayesian statistics, deep learning.Jascha Sohl-Dickstein @jaschasd
19K Followers 620 Following Member of the technical staff @ Anthropic. Most (in)famous for inventing diffusion models. AI + physics + neuroscience + dynamics.HeavenlyConditions @HVconditions
43K Followers 78 Following Providing you with the most current information regarding Mtn. operations and traffic updates for Heavenly Mtn. Resort (ACCOUNT DOES NOT REPLY)Kirkwood Conditions @KWconditions
27K Followers 17 Following Providing you with the most current information regarding Mtn. ops, traffic updates, & special events for Kirkwood Mtn. Resort (ACCOUNT DOES NOT REPLY)Alex Cohen 🤠 @anothercohen
188K Followers 1K Following Having fun on the internet. Building something new. Side project: https://t.co/XmAstakS3p. Previously led consumer product @carbonhealthAlexandr Wang @alexandr_wang
141K Followers 698 Following ceo at @scale_ai. rational in the fullness of timeKara Swisher @karaswisher
1.5M Followers 2K Following “Vitriolic” and now “shrill”media lady, though dogs can hear me loud and clearJason Weston @jaseweston
9K Followers 568 Following Research @MetaAI+NYU. Pretrain+FT: NLP from Scratch (2011). Multilayer attention+position embed+LLM: MemNets (2015). Recent (2023+):Sys 2 Attn, Self-Rewarding..Jerry Tworek @MillionInt
7K Followers 281 Following I teach programs how to program @ OpenAI | putting the ball in the damn hoop - @jacobmenickNoam Brown @polynoamial
34K Followers 607 Following Researching reasoning @OpenAI | Co-created Libratus/Pluribus, the first superhuman no-limit poker AIs | Co-created CICERO | PhD from @SCSatCMUThomas Dimson @turtlesoupy
6K Followers 541 Following Technical Staff @OpenAI. Former CEO @illdotinc (acq. OpenAI). Authored “the algorithm” @Instagram. 🇨🇦. Purple monkey dishwasher.Jonathan Lachman @jonlachman
3K Followers 734 Following Head of Special Projects @OpenAI. Former Obama-Biden OMB national security budget director, chief of staff to the Deputy Secretary of DefenseEliezer Yudkowsky ⏹.. @ESYudkowsky
175K Followers 89 Following The original AI alignment person. Missing punctuation at the end of a sentence means it's humor. If you're not sure, it's also very likely humor.Ilya Kostrikov @ikostrikov
8K Followers 615 Following Researcher @OpenAI, previously @Postdoc at UC Berkeley @berkeley_ai, PhD in CS @CILVRatNYUJack Rae @drjwrae
9K Followers 352 Following Principal Scientist @ Google DeepMind Work on Gemini 💎♊ Compression is all you need LLMs (e.g. Gopher, Chinchilla, Gemini) 💼 Past: OpenAI, QuoraAleksander Madry @aleks_madry
31K Followers 165 Following Head of Preparedness at OpenAI and MIT faculty (on leave). Working on making AI more reliable and safe, as well as on AI having a positive impact on society.OpenAI @OpenAI
3.5M Followers 0 Following OpenAI’s mission is to ensure that artificial general intelligence benefits all of humanity. We’re hiring: https://t.co/dJGr6LgzPAArvind Narayanan @random_walker
119K Followers 409 Following Princeton CS prof. Director @PrincetonCITP. I write about the societal impact of AI, tech ethics, & social media platforms. BOOK: AI Snake Oil. Views mine.Barret Zoph @barret_zoph
10K Followers 877 Following @openai Past: Research Scientist at Google Brain.Simon Willison @simonw
70K Followers 5K Following Creator @datasetteproj, co-creator Django. PSF board. @nichemuseums. Hangs out with @natbat + @cleopaws. He/Him. Mastodon: https://t.co/t0MrmnJW0KAK @_akhaliq
307K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80GxTianqi Chen @tqchenml
15K Followers 972 Following AssistProf @mldcmu and @CSDatCMU. Chief Technologist @OctoML. Creator of @XGBoostProject, @ApacheMXNet, @ApacheTVM. Member https://t.co/QYyfjQNp4p, @TheASF.Ted Sanders @sandersted
6K Followers 724 Following Researcher at OpenAI. Be kind to others, and yourself.Ryan Lowe @ryan_t_lowe
5K Followers 356 Following what is the place from which we are creating? ❤️✨🤠❤️Andrew Mayne @AndrewMayne
725K Followers 600K Following Founder https://t.co/TaZkjy3cR7, former OpenAI creative applications, prompt whisperer, Shark Week host and WSJ best selling author.Yuchen Aaron Liu @yliuaaron
186 Followers 197 Following building modern storytelling tool @magicaltome, ex- @pinterest, ex- @airbnb. ucla bruin and tsinghua alum.John Schulman @johnschulman2
39K Followers 608 Following Cofounder @openai, lead post-training for ChatGPT and the API. Interested in reinforcement learning, alignment, birds, jazz musicMark Chen @markchen90
10K Followers 245 Following Head of Frontiers Research at OpenAI. Coach for the USA IOI Team.Lukas Biewald @l2k
25K Followers 4K Following Machine Learning Tools. Founder of @weights_biases. Previously founder of Figure Eight, now @appenglobal.Justin Kan @justinkan
278K Followers 2K Following From the bottom to the top & back again. Co-founded @twitch, now working on making videos, https://t.co/J6efUJZmLI https://t.co/TLYT8YIKok @ryeRichard Socher @RichardSocher
101K Followers 966 Following CEO @youSearchEngine Investing at @aixventuresHQ Before: Stanford Adj Prof in AI/NLP, Chief Scientist at Salesforce, MetaMindHugo Larochelle @hugo_larochelle
113K Followers 625 Following Google DeepMind researcher, machine learning professor, ex-Twitter Cortex, father of 4, wine/music/comedy enthusiastJosh Tobin @josh_tobin_
11K Followers 1K Following ML-powered products @gantry_ml @full_stack_dl. Previously @Berkeley_EECS PhD and @openaiMatthias Plappert @mplappert
3K Followers 244 Following Venture partner at @factorialfunds. AI research & consulting @dfdxlabs. Formerly @GitHub & @OpenAI. DMs are open.Christian Szegedy @ChrSzegedy
32K Followers 2K Following #deeplearning, #ai research scientist. Opinions are mine.i'm very happy to welcome our new board members: fidji simo, sue desmond-hellmann, and nicole seligman, and to continue to work with bret, larry, and adam. i'm thankful to everyone on our team for being resilient (a great openai skill!) and staying focused during a challenging…
so much fun to pore over the details of a working system to find ideas for optimizations no one has noticed
There exists no sentence in any language that conveys how happy I am:
We have reached an agreement in principle for Sam Altman to return to OpenAI as CEO with a new initial board of Bret Taylor (Chair), Larry Summers, and Adam D'Angelo. We are collaborating to figure out the details. Thank you so much for your patience through this.
And now, we all get some sleep😴
We have reached an agreement in principle for Sam Altman to return to OpenAI as CEO with a new initial board of Bret Taylor (Chair), Larry Summers, and Adam D'Angelo. We are collaborating to figure out the details. Thank you so much for your patience through this.
❤️❤️❤️
I deeply regret my participation in the board's actions. I never intended to harm OpenAI. I love everything we've built together and I will do everything I can to reunite the company.
Researchers pittted ChatGPT against genuine doctors, using actual patient questions. ChatGPT was more accurate and more empathetic. By a lot. HT @adamcifu jamanetwork.com/journals/jamai…
Some personal news: I am joining OpenAI (again :)). Like many others both in/out of AI, I am very inspired by the impact of their work and I have personally benefited greatly from it. The future potential is especially exciting; it is a great pleasure to jump back in and build!🪄
Around this time 3 years ago, early 2020, we started testing the OpenAI GPT-3 API with the first external users. It was really hard to get anyone to try it, let alone build on it. So much has changed since then, but still feels like we're in the early days.
Excited for my first public contribution at @OpenAI — Embeddings v2: it unifies text search, text similarity, and code search, outperforms our best v1 models at most tasks, while being priced 99.8% cheaper!
Our new embedding model is significantly more capable at language processing and code tasks, cost effective, and simpler to use. openai.com/blog/new-and-i…
Our new embedding model is significantly more capable at language processing and code tasks, cost effective, and simpler to use. openai.com/blog/new-and-i…
When I joined Tome two years ago, we only had a simple design prototype. Since, we built Tome to become a versatile, powerful storytelling format. I am excited to see what magical stories and ideas people can use Tome to share, and we have so much more to build! Come try Tome!🎉
Today’s the day! 🎉 We’ve officially opened up Tome to everyone. This means that anyone can now use Tome to share their ideas with colleagues and the world. Create your free workspace by heading over to tome.app. We can’t wait to hear what you think.
@lilianweng Fantastic post! I also avoided NTK for a long time due to fear, but the papers (like Neal's 1994 paper) are actually pretty readable. Your post also sets up really well for @TheGregYang 's work on feature learning parameterizations!
What if we designed AI to love each of us like a mother loves her children?
"a raccoon wearing a hoodie working on his laptop late into the night" @OpenAI's DALL-E 2 sees the true me...
I used OpenAI’s newest code model to make simple versions of games like Wordle, VR mazes and Zelda ENTIRELY through natural language. I told it what I wanted and did ZERO editing/coding. Post with demos: andrewmayneblog.wordpress.com/2022/03/17/bui…