-
Tweets381
-
Followers7K
-
Following47
-
Likes499
New work led by @harshays_ on studying how model components affect predictions! Paper link: arxiv.org/abs/2404.11534 Blog: gradientscience.org/modelcomponents
New work led by @harshays_ on studying how model components affect predictions! Paper link: arxiv.org/abs/2404.11534 Blog: gradientscience.org/modelcomponents
We are hosting a meetup around LLMs & RAG on April 30 in SF – lu.ma/pathway-meetup. Talks by @lukaszkaiser (Co-author of Attention is All You Need) & @JChorowski (Co-author with Y Bengio and G Hinton) followed by drinks and bites (🍕 /🍺). See you there!
New findings: We just evaluated Gemini 1.5 Pro on our recent benchmark that tests the impact of context size on reasoning performance - it is much better than 1.0 in long contexts! Though still falls behind GPT4. Also, CoT prompting now improves accuracy (unlike with 1.0). (1/4)
✨Excited to finally drop our new paper: SSMs “look like” RNNs, but we show their statefulness is an illusion🪄🐇 Current SSMs cannot express basic state tracking, but a minimal change fixes this! 👀 w/ @jowenpetty, @Ashish_S_AI arxiv.org/abs/2404.08819
Gravity causes planets to orbit around their stars and bodies on Earth to fall towards the ground; however, goats seem they don't care at all.
The latest evals are in, and we’re open sourcing a GitHub repo to run popular evals on various models, including our latest GPT-4 Turbo model. Evaluating models is challenging—we’ve found this useful and want to share with the broader community. github.com/openai/simple-…
The latest evals are in, and we’re open sourcing a GitHub repo to run popular evals on various models, including our latest GPT-4 Turbo model. Evaluating models is challenging—we’ve found this useful and want to share with the broader community. github.com/openai/simple-…
🔥Exciting news -- GPT-4-Turbo has just reclaimed the No. 1 spot on the Arena leaderboard again! Woah! We collect over 8K user votes from diverse domains and observe its strong coding & reasoning capability over others. Hats off to @OpenAI for this incredible launch! To offer…
turbo reliably solves a math question while opus struggles, “never seen any model being so competent in solving equations”
turbo reliably solves a math question while opus struggles, “never seen any model being so competent in solving equations”
New paper out today in @NatMachIntell, where we show robust neural to speech decoding across 48 patients. nature.com/articles/s4225…
Making a music video with Sora: "this is how the song has always 'looked', it's just that now i get to show you." youtube.com/watch?v=Se93p3…
Ever wonder why we don’t train LLMs over highly compressed text? Turns out it’s hard to make it work. Check out our paper for some progress that we’re hoping others can build on. arxiv.org/abs/2404.03626 With @blester125, @hoonkp, @alemi, Jeffrey Pennington, @ada_rob, @jaschasd
We're introducing new dashboards, metrics, and integrations in the fine-tuning API to give developers more control, and adding new ways to build custom models with OpenAI. openai.com/blog/introduci…
im an alien of exceptional ability
You can now edit DALL·E images in ChatGPT across web, iOS, and Android.
We’re rolling out the ability to start using ChatGPT instantly, without needing to sign-up, so it's even easier to experience the potential of AI. openai.com/blog/start-usi…
Copied here: Zen and the Art of Research Management (with apologies to Sun Tzu), John Naughton, Robert W. Taylor 1. Hire only the very best people, even if they are cussed. Perhaps especially if they are cussed. Your guiding principle should be to employ people who are…
We're sharing our learnings from a small-scale preview of Voice Engine, a model which uses text input and a single 15-second audio sample to generate natural-sounding speech that closely resembles the original speaker. openai.com/blog/navigatin…
Another pro-tip for doing really well on evals: just train on the test set. Literally just do it, you have the examples right there. Ie. here's [redacted] on HumanEval.
Another pro-tip for doing really well on evals: just train on the test set. Literally just do it, you have the examples right there. Ie. here's [redacted] on HumanEval. https://t.co/zM85y9zXhs
It was so great to see almost everyone (we missed you @nikiparmar09!!) from the Transformer paper again. We still haven't all been in the same room at the same time, but we'll make it happen one day. @lukaszkaiser @kyosu @ashVaswani @ilblackdragon @YesThisIsLion
What do you call the disparity between GPU-rich and GPU-poor? Jensen's inequality
Andrew Ng @AndrewYNg
1.0M Followers 909 Following Co-Founder of Coursera; Stanford CS adjunct faculty. Former head of Baidu AI Group/Google Brain. #ai #machinelearning, #deeplearning #MOOCs
Jeremy Howard @jeremyphoward
221K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @Stanford
Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0p
Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
Miles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.
Kyunghyun Cho @kchonyc
60K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
Richard Socher @RichardSocher
101K Followers 969 Following CEO @youSearchEngine Investing at @aixventuresHQ Before: Stanford Adj Prof in AI/NLP, Chief Scientist at Salesforce, MetaMind
Jeff Dean (@🏡) @JeffDean
296K Followers 6K Following Chief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)
Matt Henderson @matthen2
79K Followers 2K Following maths, visualisations, conversational AI. currently @RekaAILabs - previously: @Apple AI/ML, @PolyAI, @GoogleAI, MSc @EdinburghUni, PhD @Cambridge_Eng
rohan anil @_arohan_
12K Followers 2K Following Principal Engineer, @GoogleDeepMind Gemini. prev PaLM-2. Tinkering with optimization and distributed systems. opinions are my own.
Christian Szegedy @ChrSzegedy
32K Followers 2K Following #deeplearning, #ai research scientist. Opinions are mine.
Ethan Caballero is bu.. @ethanCaballero
8K Followers 2K Following ML PhD student @Mila_Quebec ; previously @GoogleDeepMind
Thomas Wolf @Thom_Wolf
68K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-science
Andreas Kirsch 🇮�.. @BlackHC
9K Followers 5K Following Past: 🧑🎓 DPhil @AIMS_oxford @ExeterCollegeOx @UniofOxford (4.5yr) 🧙♂️ RE @DeepMind (1yr) 📺 SWE @Google (3yrs) 🎓 @TU_Muenchen 👤 Fellow @nwspk
Lukasz Olejniczak @LOlejniczak_com
5 Followers 85 Following
PhonkNerdyBit @oncs01
6 Followers 321 Following Unleashing CS Inquiry bombs, chill composure, slinging sarcastic comments. 🤖💻 Stay sharp, stay savvy. #NoFearInquiry
Alexander Morosow @alex5m6
1 Followers 20 Following
Mohamed Alfatih @MohamedAlfx
0 Followers 29 Following
Rafal Sordyl @rafalsordyl
617 Followers 3K Following Economic and Tech Diplomat in Washington, London and Beijing. Cambridge Uni. All opinions mine, most supported by research.
bizika @bizika7
17 Followers 347 Following
Thomas Amberg @tamberg
2K Followers 5K Following Maker/👩💻engineer. Founder @yaler. Organiser @iotzh. Embracing the future. Becoming a teacher. Moving to https://t.co/8mQZUIrSGl
Jun Kim @junkim_100
14 Followers 101 Following
Other Center @othercenter
1K Followers 4K Following Ogólnopolski portal muzyczny i forum muzyczne | http://t.co/Wy24T78Rd0 | Kontakt: e-mail: [email protected]
Jun wan @Junwan296401
0 Followers 10 Following
年孟 @c1gFE6DKJ9gtOeX
48 Followers 410 Following
Abhibha @abhibha2
25 Followers 426 Following MS Information Science grad @SciPitt, Formerly Intern @UCSDJacobs
刘帅Shuai Liu @lishui253557
3 Followers 143 Following independent researcher and strive to directly become a master without going through the master's and doctoral stage.For lives ,For AGI.
MIke @MIke71530700
1 Followers 100 Following
Martin Shkreli (e/acc.. @MartinShkreli
164K Followers 3K Following https://t.co/lzin5ByH0t [email protected] https://t.co/oMIiyJcIzk https://t.co/DuU6MMqcgQ
Krzysztof Sadowski @KrzysztofSadow7
5 Followers 19 Following
🤷♂️ @rodmuy
175 Followers 1K Following
James Leu @skydetainer
127 Followers 3K Following When you can understand and explain the universe,you’re a smart man.
Mike Sexton @MikeESexton
1K Followers 5K Following Cat dad. Cyber/AI @ThirdWayNatSec. NextGen @FP4America. 40 under 40 @MidEastPolicy. Polyglot-ish. He/هو/הוא. mikesexton(@)infosec(.)exchange.
Marek Wydmuch @marekwydmuch
52 Followers 194 Following ML Ph.D. student at Poznan University of Technology, Poland | Board Member at ML in PL | I mostly only read Twitter and rarely post | I stand with 🇺🇦
Mudit Srivastava @muditjps
241 Followers 408 Following Growth @pathway_com | Prev -Founding Team @aiplanethub, led growth & partnerships @CodeChef / @unacademy / @directi | Evangelist of Open Education & AI
Carl Shan @carl_y_shan
0 Followers 38 Following
David I Mckay @DavidMckay416
20 Followers 510 Following Member and board member of the Business Council of Canada, and serve on the advisory board of Catalyst Canada. Montreal, Canada.
Abhishek Tandon @abhi_td
32 Followers 541 Following
Phil Cui @Phil_Cui
59 Followers 386 Following
Дмитрий @ishchenkodg
6 Followers 58 Following
davidluo17 @davidluo_ymu
48 Followers 131 Following A passionate enterprise digitalization transformer, product manager with over 20 years on ERP, BPM, ECommerce, focusing on UX backed by BI/AI+ Efficiency rules
Steven Peniche @stevenpeniche
150 Followers 147 Following Co-Founder & CEO @brujaai┊Formerly @laylodotcom @backblaze
Ori Cohen @oricohen12
17 Followers 321 Following
Ronin.Law @Ronin_InfoArk
63 Followers 268 Following 🚀知识是生命的遗产 👋🏻InfoArk社区的执剑人 📖做了一个AI相关的免费知识库 ☀️没有人会因为分享而贫穷 https://t.co/B7sVqOkYUA
Zhichao Li @w5hirt
101 Followers 1K Following 🧑🏻💻for living. Eng. PhD. Former air/water quality🌏 researcher 👨🔬. Stay humble🏀🎱. Opinions are my own.
TenthLine49 @TenthLine49
5 Followers 2K Following
Vinh Nguyen @vinhnx
850 Followers 5K Following Learning gen AI/LLMs. Cars, iOS, Swift, SwiftUI, Photography. built @ClendarApp. My opinions. "Learn by doing"
onepisya @onepisya
85 Followers 1K Following He/Him/Developer/Designer/Explorer/ ENTJ-A/93🐟双鱼/180cm78kg/💻Code/ 🦀Rust/JavaScript/🐍Python/Lisp/Frontend/ 『 路漫漫其修远兮，吾将上下而求索。』
Lllllpppppp1233 @lllllpppppp1233
2 Followers 29 Following
Junyang Lin @JustinLin610
5K Followers 1K Following Chief Evangelist Officer of Qwen Team & OpenDevin, building LLM and LMM. Now @Alibaba_Qwen . Previously @PKU1898 LANCO group. ❤️ 🍵 ☕️ 🍷 🥃
Petr Hornicky @PetrHornicky
152 Followers 748 Following Shared opinions are my own. References to the disruption leading companies are for education & entertainment purposes. For everything else do your own research.
Will Brenton @wbrenton3
224 Followers 1K Following
Won Bae Suh @wonbaesuh
346 Followers 2K Following SOTA multimodal GENAI/LLM 📰 , 📝 ,🛠️ ,🤖🔬 accelerating humanity’s ascension to safe and responsible Hyperintellgience. GPU Poor. AI proliferation is the Way
Andrej Karpathy @karpathy
977K Followers 904 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥
Yann LeCun @ylecun
709K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Google DeepMind @GoogleDeepMind
942K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K Following
Ilya Sutskever @ilyasut
370K Followers 2 Following towards a plurality of humanity loving AGIs @openai
Jeff Dean (@🏡) @JeffDean
296K Followers 6K Following Chief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)
Steven Levy @StevenLevy
109K Followers 876 Following Editor at Large @WIRED. Your pandemic reading: Facebook: The Inside Story. https://t.co/VWYkJ9denf…
Jerry Tworek @MillionInt
7K Followers 281 Following I teach programs how to program @ OpenAI | putting the ball in the damn hoop - @jacobmenick
OpenAI Developers @OpenAIDevs
70K Followers 0 Following Official @OpenAI account for anyone building on our APIs. Join us in building the future of AI. We ❤️ developers!
Essential AI @essential_ai
2K Followers 5 Following Our mission is to deepen the partnership between humans and computers, unlocking collaborative capabilities that far exceed what could be achieved today.
Aleksander Madry @aleks_madry
31K Followers 165 Following Head of Preparedness at OpenAI and MIT faculty (on leave). Working on making AI more reliable and safe, as well as on AI having a positive impact on society.
Lawrence H. Summers @LHSummers
326K Followers 706 Following Charles W. Eliot University Professor and President Emeritus at Harvard. Secretary of the Treasury for President Clinton and Director of NEC for President Obama
Andrew Mayne @AndrewMayne
725K Followers 600K Following Founder https://t.co/TaZkjy3cR7, former OpenAI creative applications, prompt whisperer, Shark Week host and WSJ best selling author.
Kartik @ayyar
1K Followers 945 Following Generative AI @Roblox. Past: Smart Reply @GoogleAI, cofounder LetterFeed (exit: @Google),@Zynga, @NetApp, @utcompsci. Opinions not my employers.
Tal Broda 🇮🇱 �.. @talbroda
5K Followers 1K Following Head of Research Platform @OpenAI (Prev: @paradigm , @CitSecurities, @D2IQ, @Oracle | @berkeleyhaas & @Columbia_Biz) Swimming upstream.
Clément Canonne @ccanonne_
31K Followers 926 Following Senior Lecturer @Sydney_Uni. Postdocs @IBMResearch, @Stanford; PhD @Columbia. Converts ☕ into puns: sometimes theorems. He/him. @[email protected]
Aakanksha Chowdhery @achowdhery
7K Followers 3K Following LLMs @ Google DeepMind :: PaLM, Gemini // Previously @MSFTResearch, @Stanford, @Princeton // views my own and subject to change
Darth Putin @DarthPutinKGB
603K Followers 209 Following Czar for life of all Russians. Master Strategist. Thought leader. Influencer. Content creator. Author. Wanted in 123 countries. Parody, apparently.
karl the fog @KarlTheFog
357K Followers 263 Following All that is sunny does not glitter, not all those in the fog are lost.
Alex Skidanov (alex.n.. @AlexSkidanov
20K Followers 596 Following Co-founder @NearProtocol, a sharded blockchain with an emphasis on usability.
Jakob Uszkoreit @kyosu
4K Followers 275 Following
Illia (root.near) (�.. @ilblackdragon
81K Followers 400 Following Co-Founder @NEARProtocol. Working on bringing 1B users into web3. Previously builder of #Tensorflow & ML researcher.
galvanize (gail weiss.. @gail_w
1K Followers 329 Following Trying to get off of here, dms checked rarely. Better to send an email postdoc at EPFL, understanding neural networks. https://t.co/lnaKoR7vmc .
Marco Trombetti @marcotrombetti
713 Followers 245 Following Incurable optimist always in love with big ideas. Entrepreneur and investor. @translation @picampusrome
Yuval Noah Harari @harari_yuval
631K Followers 53 Following Historian and bestselling author of 'Sapiens', 'Homo Deus', '21 Lessons for the 21st Century', 'Sapiens: A Graphic History', 'Unstoppable Us', and 'NEXUS'.
OpenAI @OpenAI
3.5M Followers 0 Following OpenAI’s mission is to ensure that artificial general intelligence benefits all of humanity. We’re hiring: https://t.co/dJGr6LgzPA
Matthew Johnson @SingularMattrix
12K Followers 3K Following Researcher at Google Brain. I work on JAX (https://t.co/UGa5tGfinF).
Pieter Abbeel @pabbeel
78K Followers 435 Following Diffusion Models; Large World Model; UniSim; TRPO; SAC; Ring Attention; MAML; HER; Domain Randomization; Decision Transformer; LLM as Zero-Shot Planners; RFM-1
Paul Krugman @paulkrugman
4.5M Followers 129 Following Nobel laureate. Op-Ed columnist, @nytopinion. Author, “The Return of Depression Economics,” “The Great Unraveling,” "Arguing With Zombies," + more.
Google AI @GoogleAI
2.2M Followers 23 Following Google AI is focused on bringing the benefits of AI to everyone. In conducting and applying our research, we advance the state-of-the-art in many domains.
niki parmar @nikiparmar09
10K Followers 774 Following
Ben Goertzel @bengoertzel
66K Followers 2K Following Benevolent #AGI, #transhumanism & eurycosmos. CEO @singularitynet, @true_agi , Chair @opencog @HumanityPlus @iCog_Labs,
Delighted to share our new preprint! with @AlecMarantz, @davidpoeppel and @JeanRemiKing: biorxiv.org/content/10.110… "Hierarchical dynamic coding coordinates speech comprehension in the brain" Summary below 👇 1/8
It's a bad time to be a dictator. The rise of #AI poses threats and opportunities for various people, but one thing's for sure: it can't be intimidated or terrorized. Full conversation with @ianbremmer available on bit.ly/BremmerYNH.
New work led by @harshays_ on studying how model components affect predictions! Paper link: arxiv.org/abs/2404.11534 Blog: gradientscience.org/modelcomponents
How do model components (conv filters, attn heads) collectively transform examples into predictions? Is it possible to somehow dissect how *every* model component contributes to a prediction? w/ @harshays_ @andrewilyas, we introduce a framework for tackling this question!…
We are hosting a meetup around LLMs & RAG on April 30 in SF – lu.ma/pathway-meetup. Talks by @lukaszkaiser (Co-author of Attention is All You Need) & @JChorowski (Co-author with Y Bengio and G Hinton) followed by drinks and bites (🍕 /🍺). See you there!
New findings: We just evaluated Gemini 1.5 Pro on our recent benchmark that tests the impact of context size on reasoning performance - it is much better than 1.0 in long contexts! Though still falls behind GPT4. Also, CoT prompting now improves accuracy (unlike with 1.0). (1/4)
✨Excited to finally drop our new paper: SSMs “look like” RNNs, but we show their statefulness is an illusion🪄🐇 Current SSMs cannot express basic state tracking, but a minimal change fixes this! 👀 w/ @jowenpetty, @Ashish_S_AI arxiv.org/abs/2404.08819
Gravity causes planets to orbit around their stars and bodies on Earth to fall towards the ground; however, goats seem they don't care at all.
The latest evals are in, and we’re open sourcing a GitHub repo to run popular evals on various models, including our latest GPT-4 Turbo model. Evaluating models is challenging—we’ve found this useful and want to share with the broader community. github.com/openai/simple-…
Our new GPT-4 Turbo is now available to paid ChatGPT users. We’ve improved capabilities in writing, math, logical reasoning, and coding. Source: github.com/openai/simple-…
🔥Exciting news -- GPT-4-Turbo has just reclaimed the No. 1 spot on the Arena leaderboard again! Woah! We collect over 8K user votes from diverse domains and observe its strong coding & reasoning capability over others. Hats off to @OpenAI for this incredible launch! To offer…
turbo reliably solves a math question while opus struggles, “never seen any model being so competent in solving equations”
The new GPT-4 Turbo model is the only one that could solve this math question: "Determine the sum of the y-coordinates of the four points of intersection of y = x^4 - 5x^2 - x + 4 and y = x^2 - 3x." Even Opus never gets close to the right answer
New paper out today in @NatMachIntell, where we show robust neural to speech decoding across 48 patients. nature.com/articles/s4225…
Making a music video with Sora: "this is how the song has always 'looked', it's just that now i get to show you." youtube.com/watch?v=Se93p3…
Ever wonder why we don’t train LLMs over highly compressed text? Turns out it’s hard to make it work. Check out our paper for some progress that we’re hoping others can build on. arxiv.org/abs/2404.03626 With @blester125, @hoonkp, @alemi, Jeffrey Pennington, @ada_rob, @jaschasd
We're introducing new dashboards, metrics, and integrations in the fine-tuning API to give developers more control, and adding new ways to build custom models with OpenAI. openai.com/blog/introduci…
You can now edit DALL·E images in ChatGPT across web, iOS, and Android.
We’re rolling out the ability to start using ChatGPT instantly, without needing to sign-up, so it's even easier to experience the potential of AI. openai.com/blog/start-usi…
Copied here: Zen and the Art of Research Management (with apologies to Sun Tzu), John Naughton, Robert W. Taylor 1. Hire only the very best people, even if they are cussed. Perhaps especially if they are cussed. Your guiding principle should be to employ people who are…
We're sharing our learnings from a small-scale preview of Voice Engine, a model which uses text input and a single 15-second audio sample to generate natural-sounding speech that closely resembles the original speaker. openai.com/blog/navigatin…
What do you call the disparity between GPU-rich and GPU-poor? Jensen's inequality
Trends for United States
You might like
