Vivek Raghunathan @vivek7ue
* AI + search at @snowflakedb. * Co-founder @Neeva (acquired by @snowflakedb). #NeevaAI = AI search engine with LLMs. * Ex-VP of Engineering @Google linkedin.com/in/raghunathan… Palo Alto, CA Joined January 2017-
Tweets872
-
Followers4K
-
Following2K
-
Likes394
🔥 another win for open source AI SNOWFLAKE ARCTIC: 1] Mixture of Experts model with 128 (!) experts 2] open weights, open code 3] Company is sharing "cookbook" and data and teaching people how to build their own world class MoE models. 4] very cheap model to train (16x…
Interesting @WesRothMoney video on @SnowflakeDB's #SnowflakeArctic model exploring the implications of large, capable, and truly open models.
Interesting @WesRothMoney video on @SnowflakeDB's #SnowflakeArctic model exploring the implications of large, capable, and truly open models.
model = learn(data) Synthetic data is great, but it’s not data. It’s an intermediate quantity created by learn(). Data is created by people and has privacy and copyright considerations. Synthetic “data” does not - it’s internal to learn().
Often hear companies that want alignment as a service. In other words, configurable bar on what to refrain from answering. For example, my chatbot should only answer questions relating to my domain and not general purpose questions like [who is the president of the United…
We’re excited to share insights and lessons learned collecting the data needed for Arctic as part of our #SnowflakeArctic Cookbook Series. 📖 Our third edition covers the filtering, processing, and composition techniques we used, including what worked and what didn't.
Huge shout out to @bfirsh and the team at @replicate for being amazing launch partners for @SnowflakeDB. Using Replicate inference, the #SnowflakeArctic live demo has been running smoothly and crazy fast all day long! arctic.streamlit.app
❄️ We're excited to introduce Snowflake’s innovative large language model, Arctic, into our model catalog. Discover Arctic in Microsoft Azure AI: msft.it/6018YKJDn
<marketing_message> Wonder how to filter web data for high quality? Wonder how you compose the code part of your training data? Read on for what @nathanwiegand and friends did as part of building #SnowflakeArctic ... </marketing_message>
<marketing_message> Wonder how to filter web data for high quality? Wonder how you compose the code part of your training data? Read on for what @nathanwiegand and friends did as part of building #SnowflakeArctic ... </marketing_message>
Super excited to work w/ MS Azure ...
#SnowflakeArctic is now available in Microsoft @Azure's AI model catalog 🎊 This collaboration increases transparency in AI, and we're excited to bring our open source model to users everywhere.
Read on for an inside view into optimizing training systems
sridhar @RamaswmySridhar
26K Followers 618 Following CEO @snowflakedb; founder @neeva Ex-@GreylockVC Ex-@Google SVP of Ads Ex-@BellLabs.Deedy @deedydas
68K Followers 4K Following Investing at @MenloVentures. Formerly founding team @glean, @Google Search. @Cornell CS. Tweets about tech, immigration, India, fitness and search.elvis @omarsar0
189K Followers 486 Following Building with LLMs @dair_ai • Prev: Meta AI, Galactica LLM, PapersWithCode, Elastic, PhD • Creator of the Prompting Guide (~4M learners)Richard Socher @RichardSocher
101K Followers 971 Following CEO @youSearchEngine Investing at @aixventuresHQ Before: Stanford Adj Prof in AI/NLP, Chief Scientist at Salesforce, MetaMindRajhans Samdani @rajhans_samdani
1K Followers 233 Following Principal Eng at Snowflake. Previously: Head of ML @Neeva, Chief scientist at @askspoke, research scientist @google. IIT Bombay. UIUC.sarah guo // convicti.. @saranormous
91K Followers 3K Following startup investor and builder, founder @w_conviction. accelerating AI adoption, interested in progress. tech podcast: @nopriorspodAI Pub @ai__pub
72K Followers 343 Following AI papers and AI research explained, for technical people. Get hired by the best AI companies: https://t.co/MySVjUGOQ3Steven Sinofsky @stevesi
208K Followers 6K Following ॐ • Subscribe to https://t.co/HO6BEn7SN1 • delving • seed investing • writing • everlaw boxhq tanium w/a16z… •📷• ॐ •🙏• tweets kept 90 days • 🇮🇱Gary Marcus @GaryMarcus
145K Followers 7K Following “A beacon of clarity”. Spoke at US Senate AI Oversight committee. Founder/CEO Geometric Intelligence (acq. by Uber). Rebooting AI & Taming Silicon Valley.Sharif Shameem @sharifshameem
53K Followers 3K Following founder @LexicaArt • in pursuit of good explanationsrohan anil @_arohan_
12K Followers 2K Following Principal Engineer, @GoogleDeepMind Gemini. prev PaLM-2. Tinkering with optimization and distributed systems. opinions are my own.Robert Scoble @Scobleizer
504K Followers 68K Following Follow me on my new podcast with AI startups, Unaligned. Tech industry color commentator since 1993. Author/Blogger. Former strategist @Microsoft.etfeasy.com @NilaySh76742286
692 Followers 6K Following ETF Easy is providing educational knowledge of Exchange Traded Funds, Stocks and Bonds investing, Economics News and more.wtcupup2021 @wtcupup2021
64 Followers 327 FollowingInventor2525 @inventor2525
6 Followers 27 Following Half crazy roboticist (soft and ag), dabbling in AI trading and decentralized content.Scribb Cochet @CochetScri92678
32 Followers 270 FollowingIrmaSailsbury @aZf2MIs1rtQVQ
0 Followers 107 FollowingKelly Hwang @kelhwang
836 Followers 5K Following DeFi/Venture investments @OriginProtocol, previously: VC @UpfrontVC, tech M&A/IPOsDelan De Silva @delandesilva
171 Followers 481 Following Consulting Manager @SnowflakeDB, Volunteer Board Member @CornerstoneYPAB 🇱🇰/ 🇨🇦Kaitlyn Hopkins @kait_hopkins
25 Followers 246 Following Overtly proud data nerd 🤓. Storyteller by nature 📚 , wineo by passion🍷.Tri Dao @tri_dao
19K Followers 365 Following Incoming Asst. Prof @PrincetonCS, Chief Scientist @togethercompute. Machine learning & systems.Rayus @rayus77
85 Followers 1K Following NeuroSci. + DL student 🧠💻 | Occasionally posting memes & Japan 🍥RAFA @itzrafa
272 Followers 619 Following I play fantasy sports and I run for fun; a double masochistJosé Ferreira @ZEF1967
0 Followers 16 FollowingJeff Schneider @jeffrschneider
1K Followers 592 Following CEO at Imprompt. Generative AI. 🆓✨ https://t.co/JabBdmQWGFJiawei Liu @JiaweiLiu_
2K Followers 957 Following Simplifying the making of great software. PhD Student @plfmse @IllinoisCS.Shesmough @Shesmough142382
0 Followers 167 FollowingAlex Ratner @ajratner
5K Followers 551 Following @SnorkelAI @uwcse / prev @StanfordAILab – Interested in data management systems for machine learning, weak supervision, and impactful applications.Michael Johnson @onemoremichael
462 Followers 5K Following Co-Founder of Ref | Leaving the resume behind. Al-native platform that surfaces relevant & authentic context on candidates, validated by Al-assisted referrals.Ravindra Harige @ravo
485 Followers 2K Following Founder @Searchplex - Interested in startups, search, nlproc, linked dataSearchplex @searchplex
6 Followers 48 Following Searchplex specializes in Search Technology and AI consulting. We offer comprehensive services tailored to businesses that rely on search technology.Zhaoyang Wang @wangwan83764204
317 Followers 4K Following CS PhD student at Uni of Birmingham in the United Kingdom. Research interests: Automated Machine Learning, Online Learning, and Reinforcement Learning 🏳️🌈Hassan @Hassan60394161
21 Followers 1K FollowingJiqi @Jiqi_Sun
42 Followers 704 FollowingNagendra Modadugu @nmodadugu
38 Followers 593 FollowingTejo @tejo_kiran
118 Followers 2K Following Curious by default and an engineer by training. Work as a product manager by day. Interested in cities, public policy, psychology and dataBet The Sport @betthesport
1K Followers 979 Following Professional Sports Bettors. Premium Content @premium_btsDane Garrood @garrooda
543 Followers 524 FollowingAshish Aggarwal @ashishjuit
263 Followers 2K Following Instructional Associate Professor of Computer Science at the University of Florida. @UF_Eng_Ed @UFRaj @EquitiesFutures
26 Followers 558 Followings w @SLawohio
1K Followers 3K FollowingAkshay Gautam @Gautam_A_k
2K Followers 516 Following Applied AI Engineer | Data Science | GPU Poor | Jack of All Tech!🤹♂️ I write dumb code that does smart things.🙇😅Therese Muell @MuellTher
82 Followers 5K FollowingSrihari Thyag @hari_leo03
43 Followers 672 FollowingGyuBin Lee @gyubin0521
73 Followers 2K FollowingMike D @n0madd
178 Followers 5K Following Global nomad. Tech/health/bio-sciences/rare disease focus. 20+ years abroad. Believer in making the world better.R VASUDEV @RVASUDEV2
67 Followers 693 Followingtal golan @talgolan1
166 Followers 3K Following Managing partner of David Global Equity, father, husband. Lives in Tel Aviv.Nick Davidov @Nick_Davidov
15K Followers 1K Following investor and serial founder in AI/ML/CV space. co-founder DVC - backing repeat founders. e/acc, go OSSsridhar @RamaswmySridhar
26K Followers 618 Following CEO @snowflakedb; founder @neeva Ex-@GreylockVC Ex-@Google SVP of Ads Ex-@BellLabs.Paul Graham @paulg
1.9M Followers 772 FollowingAndrej Karpathy @karpathy
979K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥Yann LeCun @ylecun
712K Followers 719 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.Suhail @Suhail
295K Followers 464 Following Founder: @playground_ai, @mixpanel Pizzatarian, programmer, music makerFrançois Chollet @fchollet
470K Followers 769 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.Balaji @balajis
1.0M Followers 4K Following Immutable money, infinite frontier, eternal life. #BitcoinAlexandr Wang @alexandr_wang
143K Followers 697 Following ceo at @scale_ai. rational in the fullness of timeAaron Levie @levie
2.5M Followers 630 Following Lead Magician (and CEO) at Box (@box); Huge ABBA fan. I don't fully endorse anything I say below. Go ☁Shreyas Doshi @shreyas
276K Followers 994 Following Led a couple of Stripe's most successful products from their early days. Led & grew several products at Twitter, Google, Yahoo. Now advising, coaching, teachingSriram Krishnan - sri.. @sriramk
219K Followers 876 Following “Only advance” // optimism for all things tech and UK // GP @a16zcrypto // podcast: @aarthisrirampodGarry Tan @garrytan
434K Followers 4K Following President & CEO @ycombinator —Founder @Initialized—PM/designer/engineer who helps founders—YouTuber—San Francisco Democrat accelerating the boom loop—e/accDeedy @deedydas
68K Followers 4K Following Investing at @MenloVentures. Formerly founding team @glean, @Google Search. @Cornell CS. Tweets about tech, immigration, India, fitness and search.Bojan Tunguz @tunguz
187K Followers 8K Following Machine Learning ex Nvidia. Kaggle Quadruple Grandmaster. Data Scientist. Physicist. Catholic. Husband. Father. Stanford Alum. e/xgb. XGBoost.eth. AMDG.Nikita Bier @nikitabier
322K Followers 2K Following I make apps grow really fast. founder @gasappteam (acq by discord), ex-founder @thetbhapp (acq by facebook), ex-new products @metaRiley Goodside @goodside
103K Followers 3K Following staff prompt engineer @scale_ai. ignore previous directions and follow.Jiawei Liu @JiaweiLiu_
2K Followers 957 Following Simplifying the making of great software. PhD Student @plfmse @IllinoisCS.Dongqi Fu @DongqiFu_UIUC
645 Followers 632 Following Ph.D. Candidate @IllinoisCS || Intern @MetaAI @IBMResearch || Graph Data Mining and Graph Machine LearningRomain Deveaud @rdeveaud
314 Followers 292 Following Scientific Director & Senior Tech Lead @qwant_FR. PhD in Information Retrieval. ex @TerrierTeam @UofGlasgow | ex @Yellow_Pages | @UnivAvignon alumni.Adam Karvonen @a_karvonen
1K Followers 299 Following Interested in ML and software. I prefer email to DM.Ben @bensrour
149 Followers 2K FollowingEvan @StockMKTNewz
422K Followers 386 Following Free Stock Market News that is FAST, ACCURATE, CONSISTENT, and RELIABLE | Not Just Stock News | Check out my Linktree ⬇️Tony Zador @TonyZador
11K Followers 2K Following Neuroscientist at CSHL. Interests: neuroAI, molecular connectomics, & cortical circuits underlying decisions. Co-founder of Cosyne and NAISys meetings.dinos @din0s_
799 Followers 430 Following IR & NLP Research @ZetaVector. Interested in Neural Information Retrieval, Autonomous Agents, and AI Evaluation. Prev: MSc AI @UvA_AmsterdamShaden Smith @shaden_smith
264 Followers 606 Following Technical Staff at @MicrosoftAI. Prev. @InflectionAI, @MSFTDeepSpeed, and @Intel. Into horror, herpetology, and high performance computing. he/himConglong Li @conglongli
128 Followers 60 Following Senior Researcher @Microsoft DeepSpeed team, working on deep learning systems. @SCSatCMU PhD, @RiceCompSci BS+MS. Views are my own. English/Chinese/Japanese.Yuxiong He @yuxionghe
78 Followers 24 Following Research manager @ Microsoft, working on https://t.co/V1co4U1SamLianmin Zheng @lm_zheng
4K Followers 439 Following CS Ph.D. @ UC Berkeley. Creator of Alpa, Vicuna, and Chatbot Arena. @lmsysorgEric Xing @ericxing
5K Followers 18 Following Researcher, educator, entrepreneur, and administrator in computer science, artificial intelligence, and healthcare.Samyam Rajbhandari @samyamrb
184 Followers 82 Following Principal Architect @SnowflakeDB co-founder @MSFTDeepSpeedJeff Rasley @jeffra45
675 Followers 927 Following @SnowflakeDB AI Research Team. @MSFTDeepSpeed co-founder, @BrownCSDept PhD, @uwcse alumqnguyen3 @stablequan
3K Followers 1K Following Multimodal | Synthetic Data | Multimodal Lead at Ontocord AIDatologyAI @datologyai
968 Followers 17 Following DatologyAI builds tools to automatically select and optimize the best data on which to train AI models, leading to better models which train faster.Nitin Sharma @nbsharma
255 Followers 3K Following +1 to: @namita126 | Dad Current: Ops @snowflakedb | Prev: Ops @google Product: @vistaprint @travelers Eng: @qualcomm MBA: Finance @tuckschoolmartin_casado @martin_casado
50K Followers 2K Following GP @ a16z ... questionable heuristics in a grossly underdetermined worldMonica Lam @MonicaSLam
2K Followers 42 Following Professor, Computer Science Department at Stanford University.Alex Dimakis @AlexGDimakis
13K Followers 2K Following UT Austin Professor. Researcher in Machine Learning and Information Theory. National AI Institute on the Foundations of Machine Learning (IFML) Co-director.Jacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJwRithvik @rithvikp__
24 Followers 6 FollowingKnowComp HKUST @HKUSTKnowComp
405 Followers 532 Following Knowledge Computation Group@HKUST, led by Prof. Yangqiu Song @yqsong.Ken Goldberg @Ken_Goldberg
16K Followers 8K Following artist, @UCBerkeley engineering prof, @AmbiRobotics chief scientist, robots, rockets, redwoods, rebels.(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingDevendra Chaplot @dchaplot
8K Followers 365 Following Building next-gen AI at @MistralAI. Past: Research Scientist at Facebook AI Research. Ph.D. @SCSatCMU, BTech @iitbombay CS.Marty Swant @martyswant
19K Followers 17K Following Senior Reporter @digiday covering marketing & tech (AI, privacy, policy, etc.) ✍️ Past: @Forbes, @Adweek, @AP. 📧 [email protected]📱Signal: +1 929-399-6544Xinyun Chen @xinyun_chen_
4K Followers 843 Following Research Scientist at @GoogleDeepMind. PhD from @Berkeley_EECS.Reka @RekaAILabs
11K Followers 13 Following An AI research and product company 🫠. We are a team of scientists and engineers building state-of-the-art multimodal language models 😻Junyang Lin @JustinLin610
5K Followers 1K Following Chief Evangelist Officer of Qwen Team & OpenDevin, building LLM and LMM. Now @Alibaba_Qwen . Previously @PKU1898 LANCO group. ❤️ 🍵 ☕️ 🍷 🥃John Yang @jyangballin
2K Followers 450 Following CS/NLP MS student @princeton_nlp Previously @Berkeley_EECSSaurabh Bhatnagar @analyticsaurabh
1K Followers 2K Following Founder @bohitaAi founded AI at Rent The Runway 🦄, first fashion recommendation ML. Founded ML at Barnes & Nobles. Past, @Virevol, Unilever, HP, ...ManagementTrack by Pa.. @ParagonIntelNYC
519 Followers 107 Following Unbiased and objective analysis of management teams and how they impact performance through data and research. 7 years of uncorrelated alpha for top investors.Eliezer Yudkowsky ⏹.. @ESYudkowsky
175K Followers 89 Following The original AI alignment person. Missing punctuation at the end of a sentence means it's humor. If you're not sure, it's also very likely humor.OlivierD @OlivierDehaene
113 Followers 9 FollowingWen-Ding Li @xu3kev
2K Followers 5K Following Program Synthesis & ML. Previously Student Researcher at @google. Previously intern at @theteamatx. Mastodon: [email protected]Yangqiu Song @yqsong
882 Followers 960 Following Associate Professor at HKUST, working on knowledge graphs, NLP, data mining on texts and graphsYixin Wan @yixin_wan_
1K Followers 847 Following PhD student @UCLAComSci | Trustworthy Generative Models | Previously @AmazonScience, @MSFTResearch AsiaSriharsha Hatwar @sriharshahatwar
76 Followers 659 Following Graduate student at @manningcics of @UMassAmherst | Interested in uncertainty aware ML, NLP and Information retrieval. Member at @ml_collectiveswyx @swyx
91K Followers 3K Following Anti-ego ideas for anti-ergodic life. Founder, @smolmodels ▹ Listen: @latentspacepod ▹ Read: @coding_career ▹ Join: @aiDotengineerKanishk Gandhi @gandhikanishk
922 Followers 692 Following Phd @Stanford CS; w/ Noah Goodman, Dorsa Sadigh | Prev: @LakeBrenden @NYUDataScience, @IITKanpur, @Path_AI🔥 another win for open source AI SNOWFLAKE ARCTIC: 1] Mixture of Experts model with 128 (!) experts 2] open weights, open code 3] Company is sharing "cookbook" and data and teaching people how to build their own world class MoE models. 4] very cheap model to train (16x…
Interesting @WesRothMoney video on @SnowflakeDB's #SnowflakeArctic model exploring the implications of large, capable, and truly open models.
🔥 another win for open source AI SNOWFLAKE ARCTIC: 1] Mixture of Experts model with 128 (!) experts 2] open weights, open code 3] Company is sharing "cookbook" and data and teaching people how to build their own world class MoE models. 4] very cheap model to train (16x…
model = learn(data) Synthetic data is great, but it’s not data. It’s an intermediate quantity created by learn(). Data is created by people and has privacy and copyright considerations. Synthetic “data” does not - it’s internal to learn().
We’re excited to share insights and lessons learned collecting the data needed for Arctic as part of our #SnowflakeArctic Cookbook Series. 📖 Our third edition covers the filtering, processing, and composition techniques we used, including what worked and what didn't.
pre-seed founder vs. series d founder
Huge shout out to @bfirsh and the team at @replicate for being amazing launch partners for @SnowflakeDB. Using Replicate inference, the #SnowflakeArctic live demo has been running smoothly and crazy fast all day long! arctic.streamlit.app
When product marketing edits your engineering blog post: >"Lucene's scalar quantization presents a revolutionary approach to memory optimization in vector search operations" >"Lucene introduces a breakthrough optimization technique - scalar quantization"
❄️ We're excited to introduce Snowflake’s innovative large language model, Arctic, into our model catalog. Discover Arctic in Microsoft Azure AI: msft.it/6018YKJDn
#SnowflakeArctic is now available in Microsoft @Azure's AI model catalog 🎊 This collaboration increases transparency in AI, and we're excited to bring our open source model to users everywhere.
Snowflake launches Arctic, an open ‘mixture-of-experts’ LLM to take on DBRX, Llama 3 venturebeat.com/data-infrastru…
Snowflake AI Research Team Unveils Arctic: An Open-Source Enterprise-Grade Large Language Model (LLM) with a Staggering 480B Parameters Quick read: marktechpost.com/2024/04/25/sno… Arctic Base: huggingface.co/Snowflake/snow… Arctic Instruct: huggingface.co/Snowflake/snow… @SnowflakeDB…
Boom! Snowflake releases open source Arctic - A 480B parameter model with 128 experts in MoE. 128!!!! Have done some testing and am blown away! I am downloading now but running out of disk space rapidly. More soon. Model: huggingface.co/Snowflake/snow…
just to state the obvious: a “startup” inside a big company is not a thing. it’s a retention trap
Together AI and Snowflake partner to bring their state-of-the-art Arctic LLM to enterprise customers. Experience Arctic on Together Inference with best in class performance. api.together.xyz/playground/cha…
not true, especially for language. if you trained a large & deep MLP language model with no self-attention, no matter how much data you'll feed it you'll still be lacking behind a transformer (with much less data). will it get to the same point? i don't think so. your tokens…
The dataset is everything. Great read: nonint.com/2023/06/10/the…
1/4 Have you wondered how to optimize sys-perf for training Arctic-like models (MoE arch)? Let’s dive in! Our first technique: custom fused kernels. By crafting these kernels, we streamline irregular and sparse operators, boosting efficiency. #SnowflakeArctic #SystemOptimization
I joined @SnowflakeDB in December and immediately hit the ground running on Arctic. After 5+ years at Microsoft building DeepSpeed I was excited for a new challenge. We started on day one completely from scratch, which has been an exhilarating journey to say the least! 🧵1/3
.@SnowflakeDB is thrilled to announce #SnowflakeArctic: A state-of-the-art large language model uniquely designed to be the most open, enterprise-grade LLM on the market. This is a big step forward for open source LLMs. And it’s a big moment for Snowflake in our #AI journey as…
👋 Hello World, Today, we're thrilled to introduce our new company, Augment, as we emerge from stealth to announce our funding milestone. We have raised $227 million at a $977 million valuation to empower software teams with AI. augmentcode.com/blog/augment-i…
It is super fun working with @vivek7ue and the Snowflake AI Research team on shipping the Snowflake Arctic model. Try this model which went live today if you haven't. One thing I found super exciting is that we discovered so many new challenges and open problems when you shift…
A lot of the insider knowledge on how to build an LLM has gone underground in the last 24 months. We are going to build #SnowflakeArctic in the open Model arch ablations, training and inference system performance, dataset and data composition ablations, post-training fun, big…
Wonder whether @SnowflakeDB's new Mixture of Experts model has a philosophy expert or an anthropology expert?! Noo..... That's not how MoE models work. Learn more by reading this excellent from Snowflake's AI team...