Xuechen Li @lxuechen
Building intelligence @xai. PhD @Stanford. Undergrad @UofT. Worked at @GoogleAI @MSFTResearch @Vectorinst. I go by Chen. lxuechen.com Joined June 2015-
Tweets271
-
Followers2K
-
Following901
-
Likes7K
Causally running Grok-1 at home
Do you want to work for @xai in London? Now you can. We're looking for software engineers. Apply if you want to get stuff done, work with smart people, and get grilled in one of my coding interviews. Backend & data: boards.greenhouse.io/xai/jobs/42769… Full-stack: boards.greenhouse.io/xai/jobs/42769…
Are you hiring top AI talent? Here is a list of Ph.D. students affiliated with @StanfordAILab who are on the industry and academic job markets this year! This list showcases diverse research areas and 41% of these graduates are URMs! Check it out: ai.stanford.edu/blog/sail-grad…
The Conference on Language Modeling 🦙 (colmweb.org) has the mission of "creating a community of researchers with expertise in different disciplines, focused on understanding, improving, and critiquing the development of LM technology." 🧵 Here are 17 papers from 17…
Super thrilled to share our latest work, AlphaGeometry from @GoogleDeepMind , the first AI system ever approaching the IMO gold medalists in solving Olympiad geometry math problems. Published today at Nature, titled “Solving olympiad geometry without human demonstrations”, our…
Yaron @lipmanya and I are hiring a PhD intern for FAIR EMEA! If you're interested in fundamental research on generative modeling and related topics, feel free to reach out: {rtqichen,ylipman}@Meta.com. *The position is in Paris.* Dates are flexible. metacareers.com/jobs/140947795…
Starting the year with a small update, phi-2 is now under MIT license, enjoy everyone! huggingface.co/microsoft/phi-2
I'm teaching a new course on AI Alignment this term at the University of Toronto. The first half will cover idealized models of future AI systems (optimal planners, universal induction, etc.), and the second half will cover practical alignment techniques in the context of LLMs.
i hope in 2024 there'd be more works discussing how capabilities emerge from specific patterns of data, rather than just model scale
There's an important missing perspective in the "GPT-4 is still unmatched" conversation: It's a process (of good engineering at scale), not some secret sauce. To understand, let's go back to 2000s/2010s when the gap between "open" IR and closed Google Search grew very large. 🧵
There's an important missing perspective in the "GPT-4 is still unmatched" conversation: It's a process (of good engineering at scale), not some secret sauce. To understand, let's go back to 2000s/2010s when the gap between "open" IR and closed Google Search grew very large. 🧵
Terence Tao, the famous mathematician, on using LLMs to aid in mathematical research: "2023-level AI can already generate suggestive hints and promising leads to a working mathematician and participate actively in the decision-making process. When integrated with tools such as…
I’m recruiting PhD students and there are still a few days left to apply! If you’re excited about working at the intersection of HCI and AI, come join my new group @MITEECS. Please submit at gradapply.mit.edu/eecs by 12/15!
In the future, humans will need to supervise AI systems much smarter than them. We study an analogy: small models supervising large models. Read the Superalignment team's first paper showing progress on a new approach, weak-to-strong generalization: openai.com/research/weak-…
We're launching a survey on barriers to in-person participation at NeurIPS to inform potential solutions to the difficulties of prospective in-person attendees. If you faced visa or other difficulties attending #NeurIPS2023, please complete the survey at: buff.ly/3GaY1Uf
My group @PrincetonCS is looking for talented PhD students in machine learning systems (deadline Dec 15). If you're excited about fun math, new algorithms / model architectures for new capabilities, or efficient training / inference for LLMs and beyond, pls consider applying!
This is pretty fast. Can already run inference with vLLM.
This is pretty fast. Can already run inference with vLLM. https://t.co/RRH96HFozy
New blog post where I argue that "large language model development" can be considered a new subfield that grew out of deep learning, NLP, etc. and reflect on what to do when your field of study gives birth to a new one: craffel.github.io/blog/language-…
AK @_akhaliq
310K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80Gx
Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | Pianist
Dan Roy @roydanroy
45K Followers 2K Following ML / AI researcher, emphasis on theory. Research Director and Canada CIFAR AI Chair, @VectorInst Professor, @UofT (Statistics/CS)
Horace He @cHHillee
24K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemale
Chris J. Maddison @cjmaddison
18K Followers 2K Following Asst. Prof. in Machine Learning at UofT and #LongCOVID patient.
Mengye Ren @mengyer
4K Followers 700 Following Assistant Professor of Comp Sci. and Data Sci. at NYU. Machine Learning, Computer Vision, Human-like AI.
rohan anil @_arohan_
12K Followers 2K Following Principal Engineer, @GoogleDeepMind Gemini. prev PaLM-2. Tinkering with optimization and distributed systems. opinions are my own.
Yann Dubois @yanndubs
4K Followers 1K Following PhD student @stanfordAILab | Prev: AI resident @metaai, @vectorinst, @CambridgeMLG
Michael Zhang @michaelrzhang
2K Followers 428 Following PhD student doing machine learning / neural networks research @UofT. Prev: @UCBerkeley. Journey before destination.
Tom Goldstein @tomgoldsteincs
23K Followers 2K Following Professor at UMD. AI security & privacy, algorithmic bias, foundations of ML. Follow me for commentary on state-of-the-art AI.
Jeremy Cohen @deepcohen
4K Followers 869 Following PhD student in machine learning at Carnegie Mellon. The goal of my research is to turn deep learning into a real engineering discipline.
Ethan Caballero is bu.. @ethanCaballero
8K Followers 2K Following ML PhD student @Mila_Quebec ; previously @GoogleDeepMind
Jiaming Song @baaadas
5K Followers 992 Following Chief Scientist @LumaLabsAI. Working on visual generative AI. Were @NVIDIA @Stanford @OpenAI @MetaAI
Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Jiaxin Shi @thjashin
2K Followers 316 Following Research Scientist @GoogleDeepMind | prev @Stanford @MSRNE @VectorInst @RIKEN_AIP_EN @Tsinghua_Uni. Building probabilistic & algorithmic models for learning.
Yang Song @DrYangSong
10K Followers 887 Following Leading the Strategic Explorations team @OpenAI. Score-Based Models. Diffusion Models. Consistency Models.
Danijar Hafner @danijarh
14K Followers 869 Following Building AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @DeepMind
Sam Power @sp_monte_carlo
17K Followers 7K Following Lecturer in Maths & Stats at Bristol. Interested in probabilistic + numerical computation, statistical modelling + inference. (he / him)
Cem Anil @cem__anil
2K Followers 1K Following Machine learning / AI Safety at @AnthropicAI and University of Toronto / Vector Institute. Prev. student researcher @google (Blueshift Team) and @nvidia.
Arkaprava Bhattachary.. @quark_25
409 Followers 6K Following Martian man here for a mission on earth (partially automated)
Loria Kilduff @LoriKildu
69 Followers 5K Following
Makima 🏳️⚧�.. @0xxxx_0_xxxx0
341 Followers 876 Following
Shashank Sangar @ShashankTesla
16 Followers 204 Following Recruiting at Tesla AI for Core Autonomy (Autopilot & Optimus)
Dmitry Lyalin @LyalinDotCom
9K Followers 6K Following Product @ Google | Firebase serverless lead (web, compute, storage & AI & ML). Previously product @MSFT | 24+ years in tech .. dev, PMM, PM Opinions are my own
dithicelta1987 @dithicelta96307
12 Followers 25 Following
Sir Mo van da Weed �.. @can420nabis
423 Followers 1K Following 🍁 Wissenschaft ist der neueste Stand bewiesener Irrtümer! 🕴️Autodidakt ⚕️Cannabispatient & -Sommelier ✨ 𝕏Ɖ 🧬 #teamscience 🔬Do Only Good Everyday 🐕
lonbigamea1982 @lonbigamea53769
15 Followers 30 Following
Jaelyn Arbogust @arbogust63097
54 Followers 5K Following
super intelligence @eacc72
12 Followers 688 Following GPT6 is a Level 2 AGI and will be released in 2025
Andrew Thompson @AndrewT65390500
314 Followers 374 Following Christian Conservative 🍊#1a + #2a = God-given non-negotiable rights to reject totalitarianism and tyranny.
Abdulrahman Tabaza @embed_dim
3 Followers 809 Following enjoyer of various vector spaces, encoders and modalities
Sahil Antil @oxshitantil
18 Followers 804 Following Founder @kavachbuilders @foodkavach @arqaifashion
Abhi Keshav @AbhiKeshav_
28 Followers 324 Following Software programmer working on search, AI/ML || Running || reading ancient and modern history
MAB氏 @MAB1791652
1 Followers 36 Following
Weloop @Weloop_official
17 Followers 72 Following Download “Weloop” to be a part of your friends circle
nik t. hatziefstathio.. @nikthehat
40K Followers 4K Following ⌗ Innovator-in-Chief ⇢ ❍ne World ✍︎ Investigative Journalist & Director of Open Records Strategy ⇢ AtNight Media ⌇ The New Way ® | One World 🌍
Lily_Anne@ @LilyAnnne_Gucci
646 Followers 604 Following Entrepreneur💻 Vietnamese American🇺🇸🇻🇳 - Texas 🦬, Free girl 👸👸, Active member of the charity community for children 👶❤️
mardebefo1971 @mardebefo156857
4 Followers 24 Following
Omair Shahid @OmairShahid
382 Followers 959 Following Product of progressive public policy; raised by public libraries and public education that produced a passion for politics. and apparently alliteration
Ben A. Goldberg ™ �.. @BenAnaven
954 Followers 1K Following YESHUA Ha'Mashiach (LORD Jesus Christ) is The Creator and The King of the Universe! - For Elon Musk: I have monetization idea for X. Game changer! -
Sahil Antil @oxshitantil1
42 Followers 642 Following
INGABO @lingaboh
53 Followers 109 Following
Thomas Lancer @LancerThomas
441 Followers 1K Following Building self-learning, multi-modal conversational AI w/ a lean team of A-players (exploring millions of hrs of call data + self-play + game theory principles)
Rizz Reed @rizzreed
144K Followers 144K Following Errol Reed.Entreprenuer Of The Year🏆• Public Figure • Fmr Advisor for @Electrobbywells 🇺🇲 • Reed Management 🌎 . We create stars 💫
paul @wanggnoy
34 Followers 1K Following
X Daily News @xDaily
282K Followers 4K Following Your #1 News source on everything X + https://t.co/rn58CVV9pw | Hit Follow and sign up for notifications! 🔔 | Contributors: @HXMnCK, @512x512, @xUpdatesRadar and @swak_12
Dana Mahmood @deordered
25 Followers 731 Following Fine-tuning AI models oftentimes & practicing philosopher at other times.
Jannifer chigbu @riva_edgew11272
31 Followers 808 Following ELITE Business coach 1st female Fx trader & Educator 7 figure forex trader & mentor (mindset) peak parformance coach
L G 🇺🇸 @LGSouzaB
219 Followers 2K Following Lawyer, tech investor, software engineering, space enthusiast and geopolitics aficionado. Invigorated by an exhilarating dance with RISK. Crypto since 2012.
AMSARAJ N @amsaraj_n
440 Followers 2K Following
griperdephi1972 @griperdeph41266
12 Followers 29 Following
coffee & AI @realcoffeeAI
53 Followers 757 Following Sitting on a park bench scattering random seeds for the LLMs. I never bet against Elon.
Cosmin Negruseri @cosminnegruseri
2K Followers 2K Following Chief Prompt Engineer at Stealth Startup, ex Pinterest Search / Homefeed, https://t.co/0VwMvjB9Xh, Altiscale, Google Ads, Search
galisarkve1975 @galisarkve92002
1 Followers 26 Following
resptitysal1974 @resptitysa11140
8 Followers 24 Following
Claire Korea @theclairekorea
82 Followers 123 Following making friends @Character_AI | prev Data Engine @Tesla_AI | opinions are my own
Aditi @aditigaur_
106 Followers 421 Following
Angelina Kanduth @AngelinaKa42218
88 Followers 5K Following
Spiderman 🇮🇳 @returnspiderman
1K Followers 6K Following Seek the truth | Everybody talks, very few listen | Watch out here comes the Spider-Man 😁 https://t.co/qwmEhH45SY
Howard Luck @howardluck3
173 Followers 924 Following Engineering at @RocketCompanies | Previous: @Genesco_Inc | less poast more buidl
Yann LeCun @ylecun
712K Followers 719 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
AK @_akhaliq
310K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80Gx
Andrej Karpathy @karpathy
980K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥
Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
Gautam Kamath @thegautamkamath
44K Followers 507 Following Assistant Prof of CS @UWaterloo, Faculty @VectorInst, Canada @CIFAR_News AI Chair. Co-EiC @TmlrOrg. I lead @TheSalonML. Privacy, robustness, machine learning.
Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | Pianist
Riley Goodside @goodside
103K Followers 3K Following staff prompt engineer @scale_ai. ignore previous directions and follow.
Dan Roy @roydanroy
45K Followers 2K Following ML / AI researcher, emphasis on theory. Research Director and Canada CIFAR AI Chair, @VectorInst Professor, @UofT (Statistics/CS)
Sander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).
Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
Behnam Neyshabur @bneyshabur
18K Followers 690 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpacking
Horace He @cHHillee
24K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemale
Sebastian Raschka @rasbt
267K Followers 906 Following Machine learning & AI researcher writing at https://t.co/A0tXWzG1p5. LLM research engineer @LightningAI. Previously stats professor at UW-Madison.
Google DeepMind @GoogleDeepMind
944K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
David Pfau @pfau
22K Followers 1K Following Knowledge manifests itself in radiant dreams that shimmer like the wild sun Views are my own pfau at sigmoid dot social on 🦣 https://t.co/xqtVHHVI17 on 🦋
Gabriel Peyré @gabrielpeyre
92K Followers 449 Following @CNRS researcher at @ENS_ULM. One tweet a day on computational mathematics.
Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0p
NeurIPS Conference @NeurIPSConf
112K Followers 35 Following New Orleans, Dec 10-16, 23. https://t.co/ga8aOw615g Tweets to this account are not monitored. Please send feedback to [email protected].
Jesper Gojal Krogsgaa.. @Xanares_
738 Followers 1K Following QA lead in Streaming. Developing 4X strategy game Orc Justice. Prev: Championship Manager 97-04. Helps out at https://t.co/JMEF8Nkt3R. Did this: https://t.co/qgOYeBHod6
Heinrich Kuttler @HeinrichKuttler
2K Followers 698 Following Member of Founding Team @InflectionAI. Ex @FacebookAI, @DeepMind, @Google, @LMU_Muenchen, PhD math-ph. Opinions my own. (Can be yours for a small fee.)
Yijia Shao @EchoShao8899
2K Followers 281 Following CS Ph.D. student @StanfordNLP. Previous: undergraduate @PKU1898.
Justine Moore @venturetwins
56K Followers 896 Following Partner @a16z investing in all things AI 🤖 | Twin to @omooretweets
Greg Durrett @gregd_nlp
6K Followers 752 Following CS professor at UT Austin. I do NLP most of the time. he/him
Genevieve Roch-Decter.. @GRDecter
431K Followers 1K Following Former $100MM+ Money Manager • Seen on Bloomberg, FOX & VICE • CEO @grit_capital • A Top Finance newsletter on Beehiiv
Katia Karpenko @KatiaEarth
812 Followers 546 Following A somewhat-intelligent three-dimensional being at @xAI. Writer: https://t.co/pisunzyEVv. AI Filmmaker. Musician. Upcoming book: https://t.co/rBk0AMk1mF
Georgi Gerganov @ggerganov
38K Followers 243 Following Not AI | 0x0e59 0x2550 24th at the Electrica puzzle challenge
Gabriel Ilharco @gabriel_ilharco
4K Followers 1K Following Building cool things @xAI. Prev. PhD at UW, Google AI
Haotian Liu @imhaotian
6K Followers 397 Following building intelligence @xAI, creator of #LLaVA, cs @UWMadison, prev @MSFTResearch
Lianmin Zheng @lm_zheng
4K Followers 439 Following CS Ph.D. @ UC Berkeley. Creator of Alpa, Vicuna, and Chatbot Arena. @lmsysorg
Cognition @cognition_labs
123K Followers 19 Following Makers of Devin, the first AI software engineer. We are an applied AI lab focused on reasoning, and code is just the beginning. Join us: https://t.co/tpfZwEwGiq
HongKongDoll @MyHongKongDoll
1.5M Followers 95 Following JP Accnt @HongKongDoll_JA ✰ Web3 Doppelgänger @dollweb3 ✰ 联系/inquiries https://t.co/K5xSJRUz3f ✰ #Binance https://t.co/lqZItN3LJd 注册交易✨ 广场号《败家女回本日记》https://t.co/zLuMOTReQp
South Park Commons @southpkcommons
21K Followers 585 Following A community of technologists dedicated to helping each other explore, learn, and go from -1 to 0.
Nik Shevchenko @kodjima33
6K Followers 610 Following Thiel Fellow, Founder | SF, Looking for cofounders: https://t.co/f0wOnG9iz9 | https://t.co/G7UOPzO3tm
Andrew Curran @AndrewCurran_
11K Followers 7K Following Atypically Friendly - I write about AI and human creativity. Will periodically make extremely unusual arguments.
Manuel Kroiss @makro_ai
14K Followers 60 Following
xiao sun @xiaosun86
2K Followers 93 Following
Fabio Aguilera-Conver.. @Faruletes
1K Followers 187 Following
Saeed Maleki @MalekiSaeed
475 Followers 110 Following
Aditya Paliwal @VastoLorde95
529 Followers 85 Following I only read books that have pictures in them
\newcommand{\femb0t}{ @__femb0t
20K Followers 522 Following ✨ sécurité phd student (hiatus) (ﾉ◕ヮ◕)ﾉ*:･ﾟ✨ Learning ✨Have distractingly many interests✨⋇⋆✦⋆⋇ ✨
Brett Adcock @adcock_brett
172K Followers 14 Following Founder @Figure_robot (AI Robotics) & Archer Aviation (NYSE: ACHR)
Playground @playground_ai
16K Followers 0 Following A powerful AI image editor to create graphics like a pro without being one. Discord: https://t.co/D2tvrsvFWu
Matt Shumer @mattshumer_
51K Followers 1K Following CEO @HyperWriteAI, @OthersideAI - I make AIs do the impossible.
Poe @poe_platform
53K Followers 3 Following Fast AI chat, with GPT-4, Claude 3, Gemini, DALL-E 3, SDXL and more. At https://t.co/6zH7y5z69E, or for iOS, Android, MacOS, or Windows at https://t.co/TXqyyX21KS
Timothy B. Lee @binarybits
43K Followers 1K Following Reporting on AI and the future of the economy. Computer science masters degree from Princeton. @arstechnica alum. Subscribe to my AI newsletter!
Xiaolong Wang @xiaolonw
11K Followers 957 Following Assistant Professor @UCSDJacobs Postdoc @berkeley_ai PhD @CMU_Robotics
Vipul Ved Prakash @vipulved
5K Followers 841 Following Building an AI supercomputer out of spare internet parts. Founder, CEO @togethercompute
Yangqing Jia @jiayq
12K Followers 263 Following Founder @leptonai. @UCBerkeley alumni. ex @google & @facebook. ex vp @AlibabaGroup. Open source work on caffe, @pytorch, @tensorflow, & @onnxai.
Groq Inc @GroqInc
46K Followers 470 Following Creator of the LPU™ Inference Engine, providing the fastest speed for AI applications, designed & engineered in N. America https://t.co/DsEqVAC5Dp
Jing Yu Koh @kohjingyu
3K Followers 487 Following Machine Learning PhD student @CarnegieMellon. Previously: fulltime vision-and-language research @GoogleAI, undergrad @sutdsg. 🇸🇬
Tristan Thrush @TristanThrush
3K Followers 762 Following PhD-ing @StanfordAILab @stanfordnlp. Advisor @PlaytestAI. Past: @ContextualAI, @huggingface, @Meta FAIR, @mitbrainandcog, @MIT_CSAIL, @NASAJPL
Fuzhao Xue @XueFz
4K Followers 542 Following Ph.D. candidate@NUSingapore, Intern of GEAR @NVIDIA | Google PhD Fellow | LLM, Foundation Model Scaling | Ex-@GoogleBrain | Zero-shot Cooking Learner🧑🍳
So apparently if someone knows / guesses the name of your S3 bucket - even if it's private (!) - they can just bankrupt you by sending infinite PUT requests and there is nothing you can do about it. > requests get rejected > but AWS still counts it as a write operation against…
It's not PPO > DPO, It's policy generated data > stale data, In this paper, we answer this question by performing a rigorous analysis of a number of fine-tuning techniques on didactic and full-scale LLM problems. Our main finding is that, in general, approaches that use…
Some personal updates: I joined OpenAI a few months ago, working on all things robustness/safety/privacy. Also, we are working to publish more of our safety work. See my first project here below, where we make initial progress on prompt injections and other attacks!
Introducing the Instruction Hierarchy, our latest safety research to advance robustness for prompt injections and other ways of tricking LLMs into executing unsafe actions. More details: arxiv.org/abs/2404.13208
Actually I feel I really cannot understand the approaches of Phi model series ever ... Am I the only one?
phi-3 is here, and it's ... good :-). I made a quick short demo to give you a feel of what phi-3-mini (3.8B) can do. Stay tuned for the open weights release and more announcements tomorrow morning! (And ofc this wouldn't be complete without the usual table of benchmarks!)
yearly reminder everything looks exponential from the middle of a sigmoid
OK, this is probably going to raise more questions than it answers, but I just want to put this out here so that no one ever says "we can just get around the data limitations of LLMs with self-play" ever again.
I'm sus of chatbotarena results w llama 3 above claude 3 opus. If it's just the English category, maybe the prompts there are saturating there. Math / code / reasoning / other hard things seem like where signal is for SOTA LMs. Evaluations always saturate eventually.
FB/Meta senior mgt has cared a lot about AI for many years. By way of example, here's a true story I haven't told before... Do you remember when Zuck was giving testimony to congress in April 2018? I was watching it live, when the phone rang. It was the CTO of Facebook.
Zuck unironically has hands-on experience building AI. People ignored this because it was "lmao lizard robot" phase. Remember his thing, choosing annual challenges? Wear a tie, Learn Mandarin, butcher cattle by hand? Yeah the theme of 2016 was "build an AI assistant like Jarvis".
🦙 Early Llama 3 8B evaluations - Base model looks amazing for fine-tuning - Instruct model is disappointing: OpenChat/OpenHermes-level (but 10M samples!) - ORPO managed to make significant progress with only 1k samples (and very low LR) Need to wait for fine-tunes to merge…
This blew me away the first time that Daniel showed it to me, and I'm super happy to see it released for everybody. This kind of hands-on interaction with a model that allows inspection and intervention is so powerful towards developing understandings of complicated models.
Excited to share Penzai, a JAX research toolkit from @GoogleDeepMind for building, editing, and visualizing neural networks! Penzai makes it easy to see model internals and lets you inject custom logic anywhere. Check it out on GitHub: github.com/google-deepmin…
Excited to share Penzai, a JAX research toolkit from @GoogleDeepMind for building, editing, and visualizing neural networks! Penzai makes it easy to see model internals and lets you inject custom logic anywhere. Check it out on GitHub: github.com/google-deepmin…
> "I'm not based on LLaMA 3" I'm surprised that most modern LLMs still aren't being fine tuned to correctly answer basic questions about themselves. Intuitively, users expect that they can ask an LLM about itself, and they generally trust the answers provided.
Great analysis, approach 3 is finally in agreement! The loss scale was too low in our paper, resulting in premature termination of L-BFGS, and leading to bad fits. After fixing this we can reproduce your findings! We're also open sourcing the data in the paper, stay tuned :)
The Chinchilla scaling paper by Hoffmann et al. has been highly influential in the language modeling community. We tried to replicate a key part of their work and discovered discrepancies. Here's what we found. (1/9)
We studied In-Context learning with hundreds to thousands of examples. My favorite example: I sent *one million* tokens to Gemini 1.5 Pro for linear classification with 64 dimensional integer-valued vectors and many-shot learning performs similarly to k-Nearest Neighbours.
Announcing NeurIPS Preschool Track This year, we invite preschoolers to submit machine learning research papers.
Grok can see👀! Excited to share that I joined @xai last month, and it’s such a pleasure to work with a small, focused team and see how fast we can move! This is just the beginning.
Just a beginning. Multimodal understanding and generation capabilities will be rapidly improving. DM open, come and join us!
Grok is going multimodal! It’s incredible to see how fast a small, focused team can move. Kudos to the amazing team @xai that made this possible x.ai/blog/grok-1.5v
To an exciting & inspiring future!
Trends for United States
You might like
