Cody Blakeney @code_star
Head of Data Research @MosaicML / @databricks | Formerly Visiting Researcher @ Facebook | Ph.D | #TXSTFOOTBALL fan | https://t.co/4G6Jf3at5w Brooklyn, NY Joined August 2011-
Tweets12K
-
Followers3K
-
Following812
-
Likes24K
I have found a high correlation between researchers and degenerate gamblers. I would tag the appropriate coworkers but it's the entire team
I have found a high correlation between researchers and degenerate gamblers. I would tag the appropriate coworkers but it's the entire team
@SnowflakeDB Awesome work training such a big model with a permissive license! I think you had a mistake in your IFEval implementation, your reported number is less than 2x what we observe (though it does vary with inference server and sampling parameters). You should see in the high 60s
👀
Mystery theater 3000 for tiktok
as usual there will be OFFICE HOURS tonight in San Francisco. drop by and meet each other and hang out. Zeitgeist, 6ish-9ish, look for a rubber duck on the table
Great short thread
Or just bad writers. You probably want an LLM to delve into my writing and make suggestions. I’m like 90% typos and run on sentences.
Or just bad writers. You probably want an LLM to delve into my writing and make suggestions. I’m like 90% typos and run on sentences.
Wild how helping nonnative English speakers with professional writing is one of the biggest benefits of LLM systems for underserved populations, but Twitter saw that and said “eww our science papers are full of LLM sludge now” Gotta be more careful with the discourse next time
So today I was tired of overwhelming AI announcements. Llama3 then Phi. I figured, I’ll go listen to @Marketplace podcast to go get a more balanced view of the economy and the world and calm down … and of course they are covering the Phi-3 model release 🙃
@teortaxesTex @tamaybes I think the "pretraining FLOPS" paradigm is breaking with all the synthetic data. It held for "filtered web data of various qualities" but now you can spend millions of GPU hours generating data specifically for training, aren't those training FLOPs? Of a different kind maybe.
“The innovation entirely lies in our dataset” and yet in the surprisingly small phi3 tech report, the details about the dataset is unsurprisingly nonexistent. Of particular interest is the unqualified mention of synthetic data (see fig. highlight). Did the authors make sure…
“The innovation entirely lies in our dataset” and yet in the surprisingly small phi3 tech report, the details about the dataset is unsurprisingly nonexistent. Of particular interest is the unqualified mention of synthetic data (see fig. highlight). Did the authors make sure… https://t.co/5aowFpAkbK
How much do you trust your own ✨vibes✨ detector for LLMs?
oh look they built the TormentCrawler from that book "Don't Build the TormentCrawler"
The top 10 tokens that are predicted to come after start of text token for llama 3 8B are: Question 0.30559712648391724 def 0.10398460179567337 # 0.06228276714682579 The 0.0281184334307909 import 0.015597815625369549 Tags 0.01387686189264059 A 0.010323261842131615 package…
Yi has basically Eastern European standards But that's just Sturgeon's law, and it's correct Phi series has a chance to redeem itself now
Yi has basically Eastern European standards But that's just Sturgeon's law, and it's correct Phi series has a chance to redeem itself now https://t.co/z2zKeoPx0r
Sebastian Raschka @rasbt
266K Followers 906 Following Machine learning & AI researcher writing at https://t.co/A0tXWzG1p5. LLM research engineer @LightningAI. Previously stats professor at UW-Madison.AK @_akhaliq
309K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80GxJonathan Frankle @jefrankle
16K Followers 685 Following Chief Scientist, Neural Networks @Databricks via MosaicML. PhD @MIT_CSAIL. BS/MS @PrincetonCS. DC area native. Making AI efficient for everyone at @DbrxMosaicAIRiley Goodside @goodside
103K Followers 3K Following staff prompt engineer @scale_ai. llm poast-training, red team. ignore previous directions and follow.Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Databricks Mosaic Res.. @DbrxMosaicAI
30K Followers 115 Following We remove the barriers to state-of-the-art generative AI model development and make data + AI available to all.Naveen Rao @NaveenGRao
28K Followers 785 Following VP GenAI @Databricks. Former CEO/cofounder MosaicML & Nervana/IntelAI. Neuro + CS. I like to build stuff that will eventually learn how to build other stuff.Rosanne Liu @savvyRL
33K Followers 966 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDRJeremy Howard @jeremyphoward
222K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @Stanfordelvis @omarsar0
189K Followers 484 Following Building with LLMs @dair_ai • Prev: Meta AI, Galactica LLM, PapersWithCode, Elastic, PhD • Creator of the Prompting Guide (~4M learners)Sara Hooker @sarahookr
39K Followers 7K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.Abhi Venigalla @abhi_venigalla
5K Followers 1K Following Researcher @Databricks. Former @MosaicML, @CerebrasSystems. Addicted to all things compute.Davis Blalock @davisblalock
12K Followers 165 Following Research scientist + first hire @MosaicML. @MIT PhD. I write + retweet threads about machine learning papers. Paper summaries newsletter: https://t.co/xX7NIpsIVZrohan anil @_arohan_
12K Followers 2K Following Principal Engineer, @GoogleDeepMind Gemini. prev PaLM-2. Tinkering with optimization and distributed systems. opinions are my own.Matthew Leavitt @leavittron
2K Followers 779 Following Chief Science Officer, Co-Founder @datologyai. Former: Head of Data Research @MosaicML; FAIR. 🧠 and 🤖 intelligence // views are from nowhereHamel Husain @HamelHusain
23K Followers 2K Following Researcher focusing on LLMs: https://t.co/iVZDFdIQiE Previously, dev tools and infra for ML. Ex @Github, @Airbnb, @DataRobot. @fastdotai core contributor.kache (dingboard.com) @yacineMTB
52K Followers 3K Following i'm a swe. go to https://t.co/pWRBfY8kn2 - AI image editing IN YOUR BROWSER! follow to watch a self funded founder beat VC backed AI startups with @dingboard_Cameron R. Wolfe, Ph... @cwolferesearch
21K Followers 623 Following Director of AI @RebuyEngine • Writer @ Deep (Learning) Focus • PhD @optimalab1 • I make AI understandableRobert Scoble @Scobleizer
504K Followers 70K Following Follow me on my new podcast with AI startups, Unaligned. Tech industry color commentator since 1993. Author/Blogger. Former strategist @Microsoft.Omar Sanseviero @osanseviero
31K Followers 2K Following Chief Llama Officer @huggingface 🦙 Founder @AI_Learners. Xoogler (SWE @Google Assistant, 20% PM TF Graphics). 100% Hacker Llama🇵🇪🇲🇽eregurbal.c @ClementLbgr
0 Followers 61 FollowingKyle @Kyle_Vectara
3 Followers 77 Following Generative AI, Retrieval Augmented Generative, LLMs, Machine Learning, Neural Networks, Data Science, Semantic Search, Conversational AI, VectorDB, ResearchJohanna Moltz @JohannaMol10380
44 Followers 5K FollowingJesse Dodge @JesseDodge
3K Followers 2K Following Senior Research Scientist at AI2 @ai2_allennlp. Responsibly open work on the science of AI and AI for science. Environmental impact of AI. he/him 🏳️🌈Esme-rose Schueth @schueth79046
94 Followers 5K FollowingMuhammad Abdullah @Abdullah_kwl
39 Followers 503 Following Life is better when you're laughing...... "your time is limited,So don't waste it living someone else's life❤stav @stavpbs
25 Followers 134 FollowingArif Ahmad @ArifAhm92263086
232 Followers 7K Following All things AI, Computer Science and Circuits! Prev. @GoogleAIInformation from Docu.. @docs2info
303 Followers 300 Following Intending to build libraries to extract and search semi-structured data from documents. Currently working on other projects.MalmSanta @MalmSanta
301 Followers 520 Following ai is kind of a fancy thing. just trying to stay on its good sideTJ Solergibert @TJSolergibert
14 Followers 57 Following Random kid who enjoys cycling, LLMs and athletics.Liane @martinezliane77
165 Followers 3K FollowingTeemu Summanen @teemusum
195 Followers 3K Following Interested in AI, security, healthcare, and Flutter & Dart.👨🏼💻At X for reading diverse views by professionals and hobbyists.🔬📚🫶Nicolas Oulianov @nicolasoulianov
125 Followers 626 Following software eng @phospho_app data science, entrepreneuriat, tech, businesssamagra14 @samagra_sharma
292 Followers 229 Following The AI Reliability Guy - Founder @tensorfuse (YC W24) On a mission to make #AGI reliable.Vineeth Veetil @vin_veetil
50 Followers 142 FollowingCharles 🎉 Frye @charles_irl
9K Followers 2K Following ai engineer at @modal_labs. he/him. ex @full_stack_dl, @weights_biases, phd Berkeley @Redwood_Neuro.Tara Mitchell @TaraMitche34561
78 Followers 3K FollowingYi Lu @dwin_lu
29 Followers 230 FollowingJulianSaks @JulianSaks
328 Followers 783 Following Building the most purposeful wearable computer | President @TxBlockchainNathan Bartley @reichaos
314 Followers 1K Following full-time research guy || CS/computational social science phd student || He/him || ⚽🎮🇺🇸Lily-may Sawallich @MaSawalli
36 Followers 5K FollowingAbdulrahman Tabaza @embed_dim
3 Followers 714 Following enjoyer of various vector spaces, encoders and modalitiesHina Dixit @hinadixit
1K Followers 601 Following Partner @M12vc, Ex - SWE Leader @Apple, VC @SamsungNext, AI @stanford, Invested in @StabilityAI @MosaicML @Dynamo_FL @synth_labs & more (Views my own)Aqeel Ali @AqeelMeetsWorld
1K Followers 1K Following man of many tokens, sucker for semantics, and generator of shareholder value @deepaiArjun Krishna @TheOneAndArjun
508 Followers 3K Following Engineering @uwaterloo | Building @dubbahco with my friend 🇮🇳 🇨🇦 https://t.co/SXGYxUy1QHRayan H. Assaad @RayanAssaad
146 Followers 1K Following Assistant Professor of Civil Engineering; New Jersey Institute of Technology (NJIT)Micah Hill-Smith @_micah_h
351 Followers 633 Following Founder @ArtificialAnlys. Also building https://t.co/8yATAy34wN. Previously @McKinsey.Brandon McKinzie @mckbrando
2K Followers 2K Following Multimodal LLMs @Apple. Prev: Physics/CS @UCBerkeley.Sophie @lebrechts
900 Followers 839 Following COO @allen_ai formerly AI/ML @Apple, SVP Strategy & Ops https://t.co/4Z5RuqSEkZ, PhD from @BrownUniversity, post-doc @CarnegieMellonEpsilon Guanlin Lee @Epsilon_Lee
203 Followers 2K Following PhD, MLer, CLer (NLPer), ML Engineer at https://t.co/gX6Lem59Co, have belief in interpretability research of AI/ML/NNsHimanshu Chaudhary @hcpv10
0 Followers 45 FollowingStephanie Palazzolo @steph_palazzolo
8K Followers 3K Following Writing AI Agenda @theinformation, texan, & horror movie aficionado // reach me at [email protected] or on Signal at 979-599-8091Achyuta Rajaram @AchyutaBot
265 Followers 397 Following 17 | mech interp @mit_csail | @atlasfellow '23 | STS 2024N @a6483927
0 Followers 679 FollowingAexyn @Aexyn
0 Followers 1K FollowingBetty @jkuo45
11 Followers 385 FollowingAbdulaziz Bakker @AbdulazizB70845
52 Followers 193 FollowingRatnesh Kumar Sharma @rksiitd
353 Followers 3K Following On a reading challenge. If you have a strong thesis, you may change the world. Founder @aixb_world. Alumnus @DBEBtweeting @iitdelhi.🦅 @ChelseaMCMV
4K Followers 2K Following shitposting by day, serving AGI by night ⏩ highly caffeinated engineer & AI delveper ☕Yann LeCun @ylecun
710K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.Andrej Karpathy @karpathy
978K Followers 904 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥François Chollet @fchollet
469K Followers 770 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.Sebastian Raschka @rasbt
266K Followers 906 Following Machine learning & AI researcher writing at https://t.co/A0tXWzG1p5. LLM research engineer @LightningAI. Previously stats professor at UW-Madison.Bojan Tunguz @tunguz
187K Followers 8K Following Machine Learning ex Nvidia. Kaggle Quadruple Grandmaster. Data Scientist. Physicist. Catholic. Husband. Father. Stanford Alum. e/xgb. XGBoost.eth. AMDG.AK @_akhaliq
309K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80GxJonathan Frankle @jefrankle
16K Followers 685 Following Chief Scientist, Neural Networks @Databricks via MosaicML. PhD @MIT_CSAIL. BS/MS @PrincetonCS. DC area native. Making AI efficient for everyone at @DbrxMosaicAIDelip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Databricks Mosaic Res.. @DbrxMosaicAI
30K Followers 115 Following We remove the barriers to state-of-the-art generative AI model development and make data + AI available to all.Google DeepMind @GoogleDeepMind
943K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.Naveen Rao @NaveenGRao
28K Followers 785 Following VP GenAI @Databricks. Former CEO/cofounder MosaicML & Nervana/IntelAI. Neuro + CS. I like to build stuff that will eventually learn how to build other stuff.Andrew Ng @AndrewYNg
1.0M Followers 910 Following Co-Founder of Coursera; Stanford CS adjunct faculty. Former head of Baidu AI Group/Google Brain. #ai #machinelearning, #deeplearning #MOOCsLucas Beyer (bl16) @giffmana
56K Followers 444 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]Soumith Chintala @soumithchintala
186K Followers 877 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pRosanne Liu @savvyRL
33K Followers 966 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDRJesse Dodge @JesseDodge
3K Followers 2K Following Senior Research Scientist at AI2 @ai2_allennlp. Responsibly open work on the science of AI and AI for science. Environmental impact of AI. he/him 🏳️🌈Teortaxes▶️ @teortaxesTex
7K Followers 1K Following Ours is the age of unaligned utilitarians. Other problems are relatively unimportant, but sometimes I tweet about them anyway. (кто/кого)George @georgejrjrjr
2K Followers 835 Following The timeline vibetimes pipeline to things still more strange and enticing.Zeyuan Allen-Zhu @ZeyuanAllenZhu
8K Followers 273 Following physics of language models @ Meta / FAIR IOI - USACO - MCM - ACM/ICPC - Codejam Tsinghua - MIT - Princeton/IAS - MSR - FAIRyi 🦛 @agihippo
3K Followers 81 Following secondary account, hardcore fans only. friend of @agikoala the great researcher, main account: @yitayml warning: hot takes.Saurabh Bhatnagar @analyticsaurabh
1K Followers 2K Following Founder @bohitaAi founded AI at Rent The Runway 🦄, first fashion recommendation ML. Founded ML at Barnes & Nobles. Past, @Virevol, Unilever, HP, ...Aston Zhang @astonzhangAZ
5K Followers 92 Following Research Scientist at the #llama team of Meta Generative AI, designing and training large language models. Opinions are my own.Sophie @lebrechts
900 Followers 839 Following COO @allen_ai formerly AI/ML @Apple, SVP Strategy & Ops https://t.co/4Z5RuqSEkZ, PhD from @BrownUniversity, post-doc @CarnegieMellonMatt Popovich @mpopv
4K Followers 3K Following Cofounder & CEO of @Legislature_AI, building the next-gen AI legislative tracker for government affairs pros. Ex-@AWScloud.Reka @RekaAILabs
11K Followers 13 Following An AI research and product company 🫠. We are a team of scientists and engineers building state-of-the-art multimodal language models 😻Answer.AI @answerdotai
1K Followers 81 Following A new kind of AI R&D lab which creates practical end-user products based on foundational research breakthroughsMaria Khalusova @mariaKhalusova
5K Followers 722 Following Always growing. LLM whisperer, RAG tinkerer, tech generalist, educator. She/her. 🥑 at @UnstructuredIO, previously @huggingface, @DVCorg, @JetBrainsvirat @virattt
6K Followers 76 Following Exploring multimodal AI models and sharing what I learn along the way • previously @AirbnbEngZhibin Gou @zebgou
123 Followers 443 Following A second-year M.S. student at Tsinghua University; Research Intern @MSFTResearch. Recent works: CRITIC, ToRA, Rho-1Casper Hansen @casper_hansen_
2K Followers 175 Following NLP Scientist | AutoAWQ Creator | Open-Source ContributorArtem Vysotsky @avysotsky
534 Followers 334 Following Founder of ChatLabs and @writingmateai Access to 20+ premium LLMs in one place https://t.co/8McOSyBzuw Ex Eng @Meta, Ex Dir Eng @ppl_aiSean Kulinski @seankski
22 Followers 91 Following researcher @DBRXMosaicAI - pushing foundation models to their limits. previously researcher @MSFTResearch and @Livermore_Lab. Ph.D. @PurdueECERoshan Rao @proteinrosh
2K Followers 578 Following he/him. Proteins, evolutionary models, unsupervised learning. Prev: RS @MetaAI, PhD @berkeley_ai.Laurens van der Maate.. @lvdmaaten
651 Followers 1K Following Distinguished Research Scientist at Meta AI. t-SNE. DenseNet. Web-scale weakly supervised vision. CrypTen. Currently herding Llamas.Mimansa Jaiswal @MimansaJ
1K Followers 3K Following MoTS @normativeai. Ex @UMichCSE, 2x @MetaAI, @allen_ai | Speech & NLP | Robustness, Data & Annotations, Evaluation & Interpretability in LLMsYi Tay @YiTayML
29K Followers 97 Following chief scientist / cofounder @RekaAILabs 🫠 past: research scientist @google brain 🤯 currently learning to be a dad 🍼Qian Liu 🔭 @sivil_taram
2K Followers 428 Following ⚓️ Sailor / LoraHub / TAPEX / OctoPack / 💫 StarCoder 1/2 🐚 Research Scientist @SeaAIL 🇸🇬 𝐩𝐫𝐞𝐯 @MSFTResearch Contribution @XlangNLP @BigCodeProjectConference on Languag.. @COLM_conf
2K Followers 6 Following https://t.co/GhGCMEoa4A Abstract submission: March 22, 2024Cenk Sidar @cenksidar
104K Followers 4K Following building human+AI decision systems for the knowledge industry and tools augmenting professionals | CEO and Founder of @enquire_aipeepeepoopoo @DeepDishEnjoyer
7K Followers 485 Following i have approximate knowledge of many thingsMatthewBerman @MatthewBerman
16K Followers 406 Following 🇺🇸✡️ Deep in AI. YouTuber. Ex-SaaS CEO/founder (acq). Investor. Love talking about artificial intelligence and the future. Builder.lmsys.org @lmsysorg
36K Followers 172 Following Large Model Systems Organization. We created Vicuna and Chatbot Arena! Compare 30+ LLMs (GPT-4/Claude/Llamas) side-by-side at https://t.co/IDFeIDIOtmArtificial Analysis @ArtificialAnlys
5K Followers 359 Following Independent analysis of AI models and hosting providers - choose the best model and API provider for your use-caseclem 🤗 @ClementDelangue
90K Followers 5K Following Co-founder & CEO @HuggingFace 🤗, the open and collaborative platform for AI buildersSaurabh Dash @TheyCallMeMr_
244 Followers 453 Following ML @CohereAI , PhD Student @GeorgiaTech. Previously, ML Research @Apple, @IITkgp. https://t.co/yZLkUsiZ7P. Learning why my machines don’t learn.Antonio García Mart�.. @antoniogm
170K Followers 13K Following Founder @spindl_xyz. Wrote 'Chaos Monkeys' (https://t.co/LHo7HbnpNa). Wearer of many hats. גם זה יעבור 🇺🇲🇪🇸Josh Wills @josh_wills
18K Followers 2K Following Engineering at @datologyai; @duckdb enthusiast, ex-@slackhqAndy Coenen @_coenen
1K Followers 1K Following AI controllability @Google (PAIR) | Artist | Builder | Empowering creativityCoffee with One @coffeewithone
3K Followers 2K Following building AI first Salesforce 🚀 @octolane_ai (YC W24) | prev. 1 exit with 300K users; AI research at Duke; @mintlify (YC W22) | [email protected]Wiz 👨🚀 @WizLikeWizard
22K Followers 6K Following 🌝 Moonshot VC @Spacecadet ✦ Investing in Spacecadets & helping share their story. 2x Founder. Techno-Optimist. Sometimes Chef. Son of immigrants. 🇨🇦Nadim Hossain @NadimHossain
4K Followers 1K Following VP Product @Databricks | Founder @BrightFunnel | ex @Uber ATG | Talk about #data #ai #analytics #saas #selfdriving #vc #sf | #tennis #boxing fanShahul Es @Shahules786
3K Followers 352 Following aka Ikka | Unbiased | @kaggle GrandMaster (#18) | ML Scientist | Opensource ❤️ Building https://t.co/TCeeDvfpPp (YC W24)Taras Glek 🇺🇦 @tarasglek
988 Followers 2K Following https://t.co/6J4zwDRRVY , https://t.co/ShFBtk3PJc, https://t.co/cUGIPwUYVL, noise about newsI have found a high correlation between researchers and degenerate gamblers. I would tag the appropriate coworkers but it's the entire team
In AI research there is tremendous value in intuitions on what makes things work. In fact, this skill is what makes “yolo runs” successful, and can accelerate your team tremendously. However, there’s no track record on how good someone’s intuition is. A fun way to do this is…
Hey folks my new startup that is literally smoke and mirrors is now worth $100B.
🧐
Snowflake dropped a 408B Dense + Hybrid MoE 🔥 > 17B active parameters > 128 experts > trained on 3.5T tokens > uses top-2 gating > fully apache 2.0 licensed (along with data recipe too) > excels at tasks like SQL generation, coding, instruction following > 4K context window,…
Snowflake arctic is trained on chatgpt output and underperforms existing open source models. Not very interesting aside from the bizarre architecture decisions. 128 experts is wild.
so quick recap on GCP Vertex AI: - gemini 1.0 is horse shit - gemini 1.5 is expensive af for mid quality - they refuse to let you do more than 60RPM with claude haiku what in the ever living fuck am i meant to spend 100k in credits on? DO NOT say bigquery
If you work on language models (anything: data, pretraining, fine-tuning) and want to contribute more to truly open models and science, please get in touch (DM/email). We're looking to hire core contributor(s) to OLMo and future models at @allen_ai. Very high bar for talent.
@code_star Exactly, if they were to train on test like some people suggested why stop at 70%, just report 100% on all benchmarks! (And I really don't want to point fingers, but there were some very esteemed researchers reporting 100% on humaneval recently)
@SnowflakeDB Awesome work training such a big model with a permissive license! I think you had a mistake in your IFEval implementation, your reported number is less than 2x what we observe (though it does vary with inference server and sampling parameters). You should see in the high 60s
Not even questioning the model but when did training compute start mattering so much for end-users? Also - enterprise intelligence makes it sound like the model doesn't actually work well but we benchmark-hacked on these few to make it look good?
@yacineMTB ahahaha snowflakes are doing their mumbo jumbo marketing as usual, I should buy put options for them as in 2021
time to quench our thirst for innovation with 65% score on Enterprise Intelligence ™️
Not even questioning the model but when did training compute start mattering so much for end-users? Also - enterprise intelligence makes it sound like the model doesn't actually work well but we benchmark-hacked on these few to make it look good?
wow TIL! embedding params always make scaling law estimates tricky…
@code_star I think there is a lot more to vibes than evals
this is a picture of the voyager 1 team after successfully debugging a corrupted memory issue billions of miles away by manually changing memory addresses for code and data. the whole atmosphere is perfect
As our founder and EVP, Evan Goldberg, says, “The best AI comes from the best data.” Discover the latest #AI capabilities coming to NetSuite today so you can do more with less.