Max Marion @maxdoesresearch
my machine learning research account where i tell you abt all my sick experiments | pfp: me w/ https://t.co/XWwMkEg1a1 | personal account: @maxisawesome538 maxisawesome.github.io San Francisco, CA Joined December 2022-
Tweets72
-
Followers464
-
Following97
-
Likes182
Zach is killing it in a paper that takes my previous work and expands on it considerably. Highly recommend reading it and following Zach!
Zach is killing it in a paper that takes my previous work and expands on it considerably. Highly recommend reading it and following Zach!
I've added support for Command-R to llama.cpp! Command-R is an exciting new 35B model with 128k context length for RAG and Tool Use I also converted the model to GGUF format (F16, Q8, Q4, Q2) HF: huggingface.co/andrewcanis/c4… Release: github.com/ggerganov/llam… @cohere @francoisfleuret
Data Selection is in vogue
Interesting trend in AI: the best results are increasingly obtained by compound systems, not monolithic models. AlphaCode, ChatGPT+, Gemini are examples. In this post, we discuss why this is and emerging research on designing & optimizing such systems. bair.berkeley.edu/blog/2024/02/1…
saw just how much work went into this and its nothing short of incredible. Grats to the whole team - its a huge milestone!
saw just how much work went into this and its nothing short of incredible. Grats to the whole team - its a huge milestone!
Thrilled to announce Aya 🌿, a massively multilingual instruction-tuned LLM, featuring 101 languages and the largest collection of multilingual instruction datasets. Over half of these languages are under-resourced. A monumental effort from @CohereForAI and Aya team 🚀
Thrilled to announce Aya 🌿, a massively multilingual instruction-tuned LLM, featuring 101 languages and the largest collection of multilingual instruction datasets. Over half of these languages are under-resourced. A monumental effort from @CohereForAI and Aya team 🚀
just saw (Marion et al., 2023) in a paper for the first time 🥲
LLMs improved using available data from the noisy Internet. @CohereForAI researchers achieved unexpected results by pruning data. Their research suggests removing most pretraining data while maintaining performance!
Neurips was so much fun that I'm determined to come back with a paper next year 😤
Neurips was so much fun that I'm determined to come back with a paper next year 😤
When Less is More: Investigating Data Pruning for Pretraining LLMs at Scale cohere.com/research/paper… @maxdoesresearch @ahmetustun89 @luizapzbn @W4ngatang @mziizm @sarahookr
In 2022, we Launched the Cohere For AI Scholars Program to help close the gap between research experience and opportunity. In our inaugural year, we welcomed 6 talented researchers - @luizapzbn, @lekeonilude, @maxdoesresearch, @aahmadian_, @tedzadouri and Meriem Boubdir.
Really proud of our work led by @maxdoesresearch w @ahmetustun89 @luizapzbn @W4ngatang @mziizm 🎉 LM datasets are huge. Is all text needed? How can we measure data quality in this setting? Enter data pruning: removing subsets least valuable while preserving performance.
Really proud of our work led by @maxdoesresearch w @ahmetustun89 @luizapzbn @W4ngatang @mziizm 🎉 LM datasets are huge. Is all text needed? How can we measure data quality in this setting? Enter data pruning: removing subsets least valuable while preserving performance.
really excited for this work and honored to have helped mentor the first cohort of C4AI Scholars! Nice work Max!
really excited for this work and honored to have helped mentor the first cohort of C4AI Scholars! Nice work Max!
🚨PREPRINT ALERT🚨 Super excited to share our new work: "Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning" Paper: arxiv.org/abs/2309.05444 w/ @ahmetustun89 @aahmadian_ @beyzaermis @acyr_l @sarahookr
Vadim Liventsev @vadimdotme
53 Followers 819 Following lead hip hop engineer @ https://t.co/y80r2iuMsN
Sanka Mohottala @Danny__SM
165 Followers 2K Following Graduate Research Assistant at SLIIT || DL Theory, GNN, Human Action Recognition, Network Science || British Humor || Rowing || Humanist
GruSome @DeepBNN
22 Followers 492 Following
Annie Hu @AnnieGraceHu
85 Followers 282 Following prev @sfcompute | aspiring volunteer firefighter | maybe a software engineer
Lwandlolubanzi T K Nd... @lwandlendebele
2K Followers 8K Following Human&Digital Rights Activist Telecommunications Engineer+CISCO Eng Medoola Innovation&Policy Institute Mechatronics Engineering Nelson Mandela University
Shrinidhi Mahesh @shrinimahesh
32 Followers 474 Following she/her | Your Friendly Neighborhood Dumpling 🥟
emirovic 🇹🇷🍉 @emrshn13
279 Followers 2K Following psych & cs @McGillU well well well, how the turntables @mcgillailab @theistchronicle
Matthew Alp @MatthewAlp
257 Followers 2K Following 🇨🇦 | Curious about compilers, databases, (noisy) systems of all sorts. Follows are footnotes, not endorsements
Iniyan @kafkasknight
278 Followers 3K Following @menerixofficial | Loves Chess, literature, Manufacturing, Startup, Equities in no order
Ill add something soo... @floreslgabriela
10 Followers 750 Following
Sujal @Sujaltwts
9 Followers 609 Following
Harshit Juneja @harshhiittyy
371 Followers 5K Following Understanding people and instructing machines. Thoughts and tweets are not mine or my employer's or my neighbour's. Probably they are yours.
mark @thisisnotmark_
508 Followers 1K Following AI/ML Research @ NASA Goddard | Founder @ Mosaic Voice AAC. Views my own not my employer’s.
Səbuhi Abbaszadə @SAbbaszad70856
16 Followers 1K Following
Kron @KronicPoseidon
11 Followers 2K Following
radu @radu87665328721
9 Followers 791 Following
LillianFrances @V7mtf3k68bm8S
99 Followers 4K Following Forever chasing serotonin & good WiFi signals 📶💻✨
alex peysakhovich �... @alex_peys
5K Followers 791 Following partner sutter hill ventures. ex-facebook ai. interests: dogs, ml, rl, game theory, multimodality, motorsports, embeddings, psych, bio, graphs
Adam Bali @adam_bal1
146 Followers 1K Following Research Scientist / MLE (ex-Meta) | ML, NLP, Maths | 🏳️🌈
Alberto Hojel @AlbyHojel
6K Followers 3K Following dreamer of dreams @LucidSimCorp (YC w25) // uc berkeley ‘24
Ricardo Monti @RicardoMonti9
284 Followers 1K Following @datologyai, previously CTRL-labs/META, @GatsbyUCL, @Imperial_Stats
Rob Haisfield @RobertHaisfield
9K Followers 4K Following cofounder of @websim_ai, imagining new internets with our users. GenAI, TfT, BeSci, HCI, UX. Ex-Tana, Edge & Node, Spark Wave
Cree @creebeauvoir
4K Followers 1K Following absurdist, writer, former pilot. now have approximate knowledge of many things
Xaouben @Xaouben717562
51 Followers 1K Following
jovial @grepNstep
353 Followers 8K Following Retweet ≠ endorsement. Trust those who seek the truth, doubt those who find it
IvyJubilee @Floumab492213
6 Followers 115 Following
Nandan Thakur @beirmug
2K Followers 3K Following PhD @uwaterloo🌲 IR & NLP | I like good evals🔎 l Prev: intern @DbrxMosaicAI @GoogleAI & RA @UKPLab | https://t.co/kxQprYr7Xn, https://t.co/YVvVjSyXOS, TREC-RAG and FreshStack! ✨
Parth Doshi @parthjdoshi
26 Followers 641 Following
Sean Kulinski @seankski
166 Followers 213 Following researcher @DBRXMosaicAI - i develop synthetic data and RL methods to test and improve agents. Ex @MSFTResearch and @Livermore_Lab. Ph.D. @PurdueECE
Matei Zaharia @matei_zaharia
44K Followers 1K Following CTO at @Databricks and CS prof at @UCBerkeley. Working on data+AI, including @ApacheSpark, @DeltaLakeOSS, @MLflow, https://t.co/94gROE5Xa0. https://t.co/nmRYAKG0LZ
John Dang @johnamqdang
763 Followers 914 Following LLM Post-Training Research @Cohere @Cohere_Labs | RL, Multimodality, Multilinguality
Ishan Khatri @i_ikhatri
615 Followers 686 Following Perception for "embodied AI" at StackAV. Visiting Researcher @CMU_robotics. Formerly @motionaldrive @argoai. Opinions are my own.
Justin Kay @__justinkay
1K Followers 2K Following PhD student @MIT. Co-founder & CTO https://t.co/1LGXaee5ui. https://t.co/yBlEyqXEOa
Guilherme Penedo @gui_penedo
4K Followers 2K Following Pre-training data @huggingface 🤗. Lisboeta 🇵🇹
Rong Ching Chang @AnnCC12
893 Followers 7K Following Fascinated by LLMs, Multimodal models, HAI. CS Ph.D. in progress @ucdavis
Saurabh Shah @saurabh_shah2
2K Followers 1K Following training olmos @allen_ai prev @Apple @Penn 🎤dabbler of things🎸 🐈⬛enjoyer of cats 🐈 and mountains🏔️he/him
Pradyumna @PradyuPrasad
10K Followers 2K Following Abundance mindset enjoyer Follow for tweets about: economic growth, AI progress, my side projects and more!
❤️🔥 xiq @exgenesis
5K Followers 2K Following genius schizo prince https://t.co/b3L7uD5lNz https://t.co/KhxD4fJvYE
Saksham @sgdescent
1K Followers 2K Following Interested in making LLMs go brrrrr x+1: MS @LTIatCMU x: LLM @Zomato x-N: https://t.co/ht5ObQh7RV & Program Synthesis with LLMs @ProseMsft
Cosmin Negruseri @cosminnegruseri
3K Followers 3K Following founder of rag startup, ex Pinterest Search / Homefeed, https://t.co/0VwMvjB9Xh, Altiscale, Google Ads, Search, Google Code Jam organizer
Meriem @mellem_boo
82 Followers 109 Following
Steven Ndung'u @stevenndungu_
199 Followers 2K Following Data Scientist || Artificial Intelligence || Fintech || Machine Learning || Astronomy || GIS and Remote Sensing
Andreas Kirsch 🇺�... @BlackHC
14K Followers 6K Following My opinions only here. 👨🔬 RS @DeepMind, @Midjourney 1y 🧑🎓 DPhil @AIMS_oxford @UniofOxford 4.5y 🧙♂️ RE DeepMind 1y 📺 SWE @Google 3y 🎓 TUM 👤 @nwspk
Junyuan "Jason" Hong @hjy836
990 Followers 3K Following Incoming AP @NUS ECE. Postdoc @MGH @HMS, prior @VITAGroupUT @MLFoundations. PhD @MSU. Ex @SonyAI. MLSys Rising Star 2024. Interests: Responsible AI, Health.
Yong Zheng-Xin (Yong) @yong_zhengxin
2K Followers 2K Following safety and reasoning @BrownCSDept || ex-intern/collab @AIatMeta @Cohere_Labs || sometimes write on https://t.co/cXhbz6Fx3t
Ted Zadouri @tedzadouri
596 Followers 273 Following PhD Student @PrincetonCS @togethercompute | Previously: @cohere @UCLA
Jascha Sohl-Dickstein @jaschasd
24K Followers 706 Following Member of the technical staff @ Anthropic. Most (in)famous for inventing diffusion models. AI + physics + neuroscience + dynamics.
Fraser Mince @fraser_mince
170 Followers 2K Following Sr. Software Engineer at Waymark, ML researcher, interested in RL, faith, urbanism, and abundance liberalism - Austin, Tx - https://t.co/zYNi59rdqz
Ahmet Üstün @ahmetustun89
1K Followers 625 Following Research Scientist at Cohere Labs (@Cohere_Labs, @cohere). Formerly @GroNlp, @naverlabseurope.
Marzieh Fadaee @mziizm
2K Followers 559 Following seeks to understand language. Head of @Cohere_Labs. PhD from @UvA_Amsterdam. https://t.co/YI5NC5J5e4. [email protected].
Abhishek Salian @acvsalian
99 Followers 683 Following Data Scientist @ Sherlock AI | Former Researcher @ IISc
Esra'a Saleh @TheEsraaSaleh
707 Followers 3K Following AI / ML / RL research @Mila_Quebec / @UMontreal, prev. research @Ualberta, @AmiiThinks, @rlai_lab. Open science community lead @Cohere_Labs .
minhash @BhavnickMinhas
1K Followers 1K Following Chief Hippo Caretaker @ChonkieAI (YC X25), @IITGuwahati Alum, Community lead @CohereForAI
Arash Ahmadian @aahmadian_
2K Followers 694 Following scaling Gemini RL & post-training @GoogleDeepmind prev: @Cohere @CohereForAI
Alon Albalak @AlbalakAlon
2K Followers 597 Following Open-endedness, Data-centric AI @LilaSciences Previously: RS @synth_labs, PhD @ucsbNLP, Internships @AIatMeta @MSFTResearch All puns are my own
Luiza Pozzobon @luizapzbn
479 Followers 316 Following PhD student @uwcse @uwnlp | prev scholar @CohereForAI | MSc @ Unicamp, Brazil
Vipul Gupta @vipul_1011
2K Followers 906 Following Research Scientist @Scale_AI. Past: PhD @Penn_State, FAIR @AIatMeta, @IITDelhi. Interested in model evaluation and responsible AI. I don’t hallucinate
niki parmar @nikiparmar09
15K Followers 901 Following Working @Anthropic. Views expressed here are my own.
Ashish Vaswani @ashVaswani
25K Followers 2K Following
Leo Gao @nabla_theta
10K Followers 550 Following working on AGI alignment. prev: GPT-Neo, the Pile, LM evals, RL overoptimization, scaling SAEs to GPT-4. EleutherAI cofounder.
Character.AI @character_ai
150K Followers 13 Following Unleash your imagination—chat, create, explore.
Stanislas Polu @spolu
18K Followers 624 Following _co-founder+engineer(https://t.co/SXBR0l9TrF @dusthq), _alumni(https://t.co/8jAnpFAkp1, https://t.co/e99AaHzlA0, https://t.co/4jg6knqi2S, https://t.co/kXE6PNf8xH)
Amanda Dsouza @amanda_dsouza
198 Followers 468 Following Applied research scientist @SnorkelAI. Previous: @heyjasperai, @fractalAI. MS (ML) @gtcomputing.
Roi Cohen @roicohen9
139 Followers 122 Following Master’s student at @TelAvivUni. Working on @NLProc https://t.co/3MKU7afk5V
Gabriel Peyré @gabrielpeyre
102K Followers 453 Following @CNRS researcher at @ENS_ULM. One tweet a day on computational mathematics.
Pablo Samuel Castro @pcastr
13K Followers 830 Following Señor swesearcher @ Google DeepMind. Adjunct prof @ U de Montreal & Mila. Musician. From 🇪🇨 living in 🇨🇦.
Jay Alammar @JayAlammar
46K Followers 1K Following Writer https://t.co/TquuQXlLOJ. O'Reilly Author https://t.co/Fl3uPAZHLg. LLM Builder @Cohere. Visualizing AI one concept at a time.
Luis Serrano 🍉 @SerranoAcademy
12K Followers 816 Following Author of Grokking Machine Learning, ML and QC popularizer, YouTuber: https://t.co/MGCYjf6M9K, Opinions are my own https://t.co/S1jvXnAa8UTrends for United States
You might like
