Mark Tenenholtz @marktenenholtz
Head of AI @PredeloHQ. XGBoost peddler, transformer purveyor. bio.link/mtenenholtz Austin, TX Joined October 2019-
Tweets6K
-
Followers114K
-
Following545
-
Likes11K
I’d love to see ColBERT at 22M params (@lateinteraction @bclavie 👀)
I’d love to see ColBERT at 22M params (@lateinteraction @bclavie 👀)
Time-series foundational models aren't working very well because we're completely misusing the attention mechanism
Most of our recent embedding search breakthroughs were probably discovered by Google 4 years ago
SMOTE should always be your first choice for tabular data preprocessing. Class imbalance is a solved problem!
The gap between small models and huge models is closing. Gap between the best GPT4 and 3.5T is about 140. Gap between Opus and Haiku is only 80!
The gap between small models and huge models is closing. Gap between the best GPT4 and 3.5T is about 140. Gap between Opus and Haiku is only 80!
NNs are so hard to train because even in the presence of bugs, they often just work. Sure, they're limping with an undiagnosed injury, but your QKV multiplication that's actually a QQV multiplication somehow works kinda?
I've found the wrong way to use LLMs is to solve your most difficult tasks, the ones where you have expert level knowledge. The right way is to use them to avoid wasting time on repetitive tasks so that you can focus all your brainpower on those most difficult tasks. I don't…
Increasing your squat by 100 lbs improves your LLM perplexity by 10%, it is known
It's amazing how hard it is to find a reasonably priced development environment that: - is colocated with my data (no egress cost) - has persistent storage - can be resized to any EC2 instance - allows easy SSH access and doesn't force me into a notebook - makes it relatively…
Bojan Tunguz @tunguz
187K Followers 8K Following Machine Learning ex Nvidia. Kaggle Quadruple Grandmaster. Data Scientist. Physicist. Catholic. Husband. Father. Stanford Alum. e/xgb. XGBoost.eth. AMDG.Santiago @svpino
351K Followers 444 Following I tell stories about technology and teach hard-core Machine Learning at https://t.co/iZifcK7n47. YouTube: https://t.co/pROi08OZYJSebastian Raschka @rasbt
266K Followers 905 Following Machine learning & AI researcher writing at https://t.co/A0tXWzG1p5. LLM research engineer @LightningAI. Previously stats professor at UW-Madison.François Chollet @fchollet
469K Followers 770 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.Matt Harrison @__mharrison__
158K Followers 892 Following Python 🐍 + Data Science 🚀 trainer @__metasnake__ 🦜 Speaker ✍ Author 👨🏫 Instructor (@Stanford) 📣 DM for SponsorshipAkshay 🚀 @akshay_pachaar
135K Followers 416 Following Simplifying LLMs, MLOps, Python & Machine Learning for you! • AI Engineering @LightningAI • Lead DataScientist • BITS Pilani • 3 PatentsPau Labarta Bajo @paulabartabajo_
44K Followers 222 Following The Real-World ML guy | Learn to build real-world ML apps at https://t.co/xWr8Hm8zI5Dan | Machine Learnin.. @DanKornas
53K Followers 503 Following 🤖 ML Engineer 🔬 AI Educator 💻 I help you build AI skills through project-based learning ➡️ https://t.co/lC2UKMtRjjJean de Nyandwi @Jeande_d
38K Followers 770 Following Deep Learning, Vision 🤍 Language, Multimodal LLMs • AI Education • CMU Research blog: https://t.co/1BEFLZAqe7 ML Pack: https://t.co/7PkTyDvuriabhishek @abhi1thakur
81K Followers 662 Following 🤗 I build AutoTrain @huggingface 👨🏽💻 World's First 4x Grand Master @kaggle 🎥 YouTube 100k+: https://t.co/BHnem8fTu5 ⭐ GitHub StarJim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.Tivadar Danka @TivadarDanka
66K Followers 457 Following I make math accessible for everyone. Mathematician with an INTJ personality. Chaotic good. Writing https://t.co/jYkO4bz6lLHarrison Kinsley @Sentdex
71K Followers 200 Following Neural networks from Scratch book: https://t.co/MWlYbXicwc YouTube: https://t.co/5osPue5EW9 @skunkworks_aiShubham Saboo @Saboo_Shubham_
39K Followers 447 Following AI Products @tenstorrent 📕 Author of books on GPT-3 & Neural Search in Prod ✍️ Tweets about LLMs & Prompt Engineering 📩 DMs open for collabAlfredo Canziani @alfcnz
86K Followers 269 Following Musician, math lover, cook, dancer, 🏳️🌈, and an ass prof of Computer Science at New York UniversityChristoph Molnar @ChristophMolnar
30K Followers 1K Following Author of Interpretable Machine Learning https://t.co/gJKlTA2deP | Newsletter: https://t.co/6fQuMr8yI8Patrick Loeber @patloeber
55K Followers 887 Following Software Engineer • YouTube 250K+ • Helping you to learn Python and Machine Learning • AI Developer Advocate @AssemblyAI • @python_engineer foundermerve @mervenoyann
55K Followers 4K Following open-sourceress at @huggingface 🧙🏻♀️ proud mediterrenean 🍋 I do TL;DR on ML papers sometimes. RTs != endorsementsTuringPost @TheTuringPost
62K Followers 16K Following Newsletter exploring AI & ML - Weekly trends - LLM/FM insights - Unicorn spotlights - Global dynamics - History Led by @kseniase_ Elevate your AI game 👇🏼Midhun Devasia (🧠�.. @MidhunDevasia
89 Followers 520 Following Machine Learning 🤖 • Python 🐍• MLOps • Open Source 🌍 + Communities ♥️ • Shedding My Learnings in Tweets 🪶 • (Views Are My Own)Kelvin @_SirK007_
227 Followers 320 FollowingAli OKER @AliOKER11
498 Followers 955 Following Associate Professor of Cognitive Psychology University of Reims Champagne-Ardenne, FranceChae-Ryon Kong @ChaeRyonKong
0 Followers 337 FollowingKae 📈 📉💎 @KaeOvWallstreet
220 Followers 4K FollowingSmithy @Smithy2486
10 Followers 45 FollowingTal Simon @TalSimon68577
1 Followers 68 FollowingAs Pik @HCharewicz
16 Followers 228 Followingابو ساهر @DwwwdA60269
13 Followers 188 Followingrick masssey @MasseyRick
126 Followers 485 FollowingMoshe Baram @MosheBaram
98 Followers 621 FollowingHarpoon007 @Harp00n707
748 Followers 1K Following Worship at the altar of the far from equilibrium Thermodynamic God… Extropic amplifier w/ a sole purpose of decelerating entropy.francis stanslaus @francissta39393
1 Followers 292 Following랩찌 @dk_search_ai
1 Followers 81 FollowingDavid johnn @David_jon_
0 Followers 36 Followingsimenhegstadkrueger @lagoria
35 Followers 63 FollowingHarish Saravanan @Harish_Sarav
60 Followers 1K FollowingBhovwtik 𝕏 @BhovwtikXCobra
6 Followers 156 Following Welcome to my 𝕏. I spark creativity & ignite action through my content. Success is not about what you achieve, it's about what you inspire others to do. -TateJagannath Prudhviraj @JagannathPrudh1
3 Followers 58 FollowingDavid @David7947913717
2 Followers 32 FollowingTasour @TasourR
34 Followers 238 Following Error code: 0xF2024 (Lost in the virtual world). Backup failed. All data lost.Firda Daniel @Danie41643
1 Followers 23 Followingrayzoe @kuopenx
16 Followers 872 FollowingDanAI @DanAI314159265
302 Followers 1K Following 🪽 Ghost//Duality// Sigma INTJ//AI MIND//Algorithm Programming//Solution Architect//Third Eye Open 🪽bb 🤖 @imbbbjames
0 Followers 11 Following Tech enthusiast | 🐍 Python | 🤖 AI ML | 🥑 DevRel Advocate | 🧠 SageMaker | ©️ Community Builder | 📄 Content CreatorRamlaxman Behera @BeheraRaml84306
0 Followers 3 FollowingAnkit @ankit_sorathiya
134 Followers 916 Following ENFJ-A| Solopreneur | AI Explorer | Tech | ML Enthusiast | Space | Cricket | Philosophy | Connect for more| https://t.co/JlWXzcVL8Ematt @the_websurfer
6 Followers 51 FollowingJorge @jorge_tomas8
588 Followers 5K Following Glory to Ukraine I Catalunya lliure !!! 🇺🇦🇺🇸🇪🇺🇬🇧🇫🇷🇱🇻🇫🇮🇨🇦🇵🇱🇨🇭🇧🇻🇦🇹🇭🇲🇹🇷🇪🇪🇹🇩🇬🇷🇮🇱🇦🇲🇦🇩🇩🇪🏳️🌈🇪🇸🏴☠️aku177 @aku1771
129 Followers 1K FollowingAnonymous Founder @anonymfounder
395 Followers 7K Following My startup diary. Leading the way in innovation and industry transformation. From startups to marketing, finance to entrepreneurship........and cryptocurrency.Marco Zhang @Marzzz666666
0 Followers 14 Followingtwist3d-oNe- @Twist3doNe
231 Followers 4K Following here for sound financial advice, open to shitcoin shilling. will gaslight, not Trumper, not Democrat, Fck socialism, capitalism & facism, burn it all!Sriram @cdssriram
1 Followers 36 FollowingWINNINGER Thomas @WINNINGERT82837
0 Followers 23 FollowingHammer Time @daikoku_btc
54 Followers 323 Following Up | Lvl 84 Hammerdin | 🍀 | ぴかぴかの | 1/7 | #BitcoinBojan Tunguz @tunguz
187K Followers 8K Following Machine Learning ex Nvidia. Kaggle Quadruple Grandmaster. Data Scientist. Physicist. Catholic. Husband. Father. Stanford Alum. e/xgb. XGBoost.eth. AMDG.Santiago @svpino
351K Followers 444 Following I tell stories about technology and teach hard-core Machine Learning at https://t.co/iZifcK7n47. YouTube: https://t.co/pROi08OZYJSebastian Raschka @rasbt
266K Followers 905 Following Machine learning & AI researcher writing at https://t.co/A0tXWzG1p5. LLM research engineer @LightningAI. Previously stats professor at UW-Madison.François Chollet @fchollet
469K Followers 770 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.Yann LeCun @ylecun
709K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.elvis @omarsar0
188K Followers 482 Following Building with LLMs @dair_ai • Prev: Meta AI, Galactica LLM, PapersWithCode, Elastic, PhD • Creator of the Prompting Guide (~4M learners)Andrew Ng @AndrewYNg
1.0M Followers 909 Following Co-Founder of Coursera; Stanford CS adjunct faculty. Former head of Baidu AI Group/Google Brain. #ai #machinelearning, #deeplearning #MOOCsMatt Harrison @__mharrison__
158K Followers 892 Following Python 🐍 + Data Science 🚀 trainer @__metasnake__ 🦜 Speaker ✍ Author 👨🏫 Instructor (@Stanford) 📣 DM for SponsorshipAK @_akhaliq
309K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80GxMike Driscoll @driscollis
118K Followers 1K Following I tweet about everything #Python Writing about Python @mousevspython @realpython Teaching at @TeachMePy Author of multiple books - https://t.co/MdP25zw5zQTowards Data Science @TDataScience
224K Followers 2K Following A Medium publication sharing concepts, ideas, and codes. Share your insights and projects with our global audience: https://t.co/Mh1ZLme1o4.Jean de Nyandwi @Jeande_d
38K Followers 770 Following Deep Learning, Vision 🤍 Language, Multimodal LLMs • AI Education • CMU Research blog: https://t.co/1BEFLZAqe7 ML Pack: https://t.co/7PkTyDvuriabhishek @abhi1thakur
81K Followers 662 Following 🤗 I build AutoTrain @huggingface 👨🏽💻 World's First 4x Grand Master @kaggle 🎥 YouTube 100k+: https://t.co/BHnem8fTu5 ⭐ GitHub StarJim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.Harrison Kinsley @Sentdex
71K Followers 200 Following Neural networks from Scratch book: https://t.co/MWlYbXicwc YouTube: https://t.co/5osPue5EW9 @skunkworks_aiJeremy Howard @jeremyphoward
221K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @StanfordShubham Saboo @Saboo_Shubham_
39K Followers 447 Following AI Products @tenstorrent 📕 Author of books on GPT-3 & Neural Search in Prod ✍️ Tweets about LLMs & Prompt Engineering 📩 DMs open for collabAlfredo Canziani @alfcnz
86K Followers 269 Following Musician, math lover, cook, dancer, 🏳️🌈, and an ass prof of Computer Science at New York UniversityChristoph Molnar @ChristophMolnar
30K Followers 1K Following Author of Interpretable Machine Learning https://t.co/gJKlTA2deP | Newsletter: https://t.co/6fQuMr8yI8TokenBender @4evaBehindSOTA
2K Followers 550 Following Solo levelling in the LLM domain, all code/models/datasets i build are OSS. Research interest - weak to strong model improvement/alignment, DMs OpenArmen Aghajanyan @ArmenAgha
6K Followers 262 Following Research Scientist @ Meta AI (FAIR) https://t.co/8XF2vtiIVy Opinions are my own.Tomas Vykruta @tvykruta
659 Followers 356 Following Founder of EvolutionIQ, named “Top 100 private AI company in the world” — CBInsights 2024.Big Tech Alert @BigTechAlert
86K Followers 0 Following Follow what the CEOs and other high executives from Big Tech companies do on Twitter. DMs are open for feedbackJonathan Blow @Jonathan_Blow
131K Followers 233 Following Designer/Programmer behind Braid and The Witness. Braid, Anniversary Edition comes out May 14. https://t.co/05NUbEfwyTAndrew Carr (e/🤸) @andrew_n_carr
15K Followers 3K Following science @getcartwheel AI writer @tldrnewsletter advisor @arcade_ai Past - Codegen @OpenAI, Brain @GoogleAI, world ranked Tetris playerNeel Nanda @NeelNanda5
13K Followers 88 Following Mechanistic Interpretability lead @DeepMind. Formerly @AnthropicAI, independent. In this to reduce AI X-risk. Neural networks can be understood, let's go do it!Horace He @cHHillee
23K Followers 447 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemaledennis hegstad @dennishegstad
102K Followers 7K Following building @IRU_DCE. Prev co-founder https://t.co/bIADGh1cgd (acquired). i run for fun. I post about marketing, investing and ecommerce ⤵️Martin Shkreli (e/acc.. @MartinShkreli
164K Followers 3K Following https://t.co/lzin5ByH0t [email protected] https://t.co/oMIiyJcIzk https://t.co/DuU6MMqcgQSholto Douglas @_sholtodouglas
15K Followers 856 Following Scaling Gemini @Deepmind - working towards intelligence too cheap to meterDwarkesh Patel @dwarkesh_sp
54K Followers 700 Following Being pretrained Host of Dwarkesh Podcast https://t.co/3SXlu7fy6N https://t.co/rEhnfYywXY https://t.co/hQfIWdM1UnInterconnects @interconnectsai
2K Followers 1 Following What you need to know about AI research trends, from @natolambert Wednesday mornings weekly, sometimes extra posts.Wink Martindale @CoachWinkUM
10K Followers 107 Following University of Michigan Matthew and Nicole Lester Family Defensive CoordinatorMax Levchin @mlevchin
262K Followers 569 Following И чтец, и жнец, и на дуде игрец. Affirm, Glow, SciFi. ✡️Peter Voss @peterevoss
872 Followers 260 Following Creating AGI: https://t.co/lKckFk1CTo https://t.co/O1HZFZOUV9Adrian | The Web Scra.. @adrian_horning_
9K Followers 1K Following 🕺 https://t.co/VyZgbReKiA | Tiktok leads 🌎 https://t.co/SAKvubDoW1 🤖 https://t.co/r6OBJmez1R | AI ScraperMarco Mascorro @Mascobot
10K Followers 2K Following Partner @a16z | Cofounder @Fellow_AI | AI & Robotics Engineer | prev @BMW research | @MIT 35 under 35 | Opinions my own.lil uzi perf @ken_wheeler
47K Followers 3K Following practically irresistible. violently suburban. I made a jQuery plugin, gave a few talks and made a couple beats. https://t.co/6BFTpb3nXXkillian @hellokillian
23K Followers 438 Following building a universal interface between language models and computers ● https://t.co/yJVGuC0xlDNoam Brown @polynoamial
34K Followers 611 Following Researching reasoning @OpenAI | Co-created Libratus/Pluribus, the first superhuman no-limit poker AIs | Co-created CICERO | PhD from @SCSatCMUNoah Hein @TheNoahHein
3K Followers 724 Following I teach a 7 day AI fundementals course @latentspacepod - https://t.co/SfMjSOur3e | Engineering @smolmodelsGlauber Costa @glcst
8K Followers 754 Following Former Linux Kernel, ScyllaDB, Datadog - storage, virtualization, low level stuff. Currently Founder/CEO at @tursodatabaseDelip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Nate Raw @_nateraw
7K Followers 1K Following machine learning hacker. previously @huggingface @lightningaithe tiny corp @__tinygrad__
33K Followers 63 Following We make tinygrad. Our mission is to commoditize the petaflop.Alignment Lab AI @alignment_lab
11K Followers 3K Following Devoted to addressing alignment. We develop state of the art open sourced AI. https://t.co/6aJDLUvuU5cloud @cloud11665
5K Followers 1K Following SIMD fan | ctf player | ex OI-er | accelerate. CEO and co-founder @figura_labs DM FOR PRIVATE BETA ACCESSCharlie Marsh @charliermarsh
12K Followers 776 Following Building @astral_sh: Ruff, uv, and other high-performance Python tools. Prev: Staff engineer @SpringDiscovery, @KhanAcademy, BSE @PrincetonCS.Ben Baby @Ben_Baby
68K Followers 996 Following Covers Bengals for @ESPN. Adjunct journalism prof, @SMU. IG/Threads: bbaby41.Ian Rapoport @RapSheet
4.5M Followers 793 Following National Insider for NFL Network and https://t.co/NIVZ6FPz0E. Husband of @thebanktress. Made seven cameos in the movie Draft Day.Jade @Euclaise_
2K Followers 348 Following ⋅ Video game statistician ⋅ Soclib cyberanarchist? ⋅ C, Plan 9, LLMs, etc ⋅ Researcher w/ @NousResearch ⋅ she/theyAaron Francis @aarondfrancis
32K Followers 1K Following Co-founder https://t.co/oUwfiB6Kqj. Sincere poster. No cynicism. Dad to two sets of twins! Cohost @MostlyTechPod. Teacher https://t.co/m4dvIEs302.yumidiot @yumidiot
3K Followers 240 Following arbitrage, leakage, leverage. I'll note how many mins i did meditage since I wrote this (4110 min, so far). AGI asap (2🍎25). I own MBA and ps5, i do liftage.Jim Keller @jimkxa
33K Followers 135 Following CEO @tenstorrent, Cofounder @atomic_semi @BayaSystems and FlexAI board member. Fan of 2x2 matrixes, books, refactoring and creative tensionMark Saroufim @marksaroufim
9K Followers 653 Following @pytorch dev broadly interested in performance https://t.co/6KJ328JUwvRajat Sen @rsen91
107 Followers 437 Following Researcher interested in bandit algorithms, time-series analysis, black-box optimization and statistical testing. All opinions are my own.Nathan Odle @mov_axbx
3K Followers 333 Following Just acc. Preferably on gravel. Drive rally cars, love dogs. Looking for my 7x4090 AI server build writeup? Check my site below.Yuke Zhu @yukez
15K Followers 464 Following Assistant Professor @UTCompSci | Co-Leading GEAR @NVIDIAAI | CS PhD @Stanford | Building generalist robot autonomy in the wild | Opinions are my ownSaurabh Baji @sbaji
919 Followers 2K Following SVP Eng @CohereAI LLMs 🚀 Ex - VP, AI and Data @ Unity, Quantcast, AWS / EMR, Athena. AI, ML, Big Data - always hiring; DM if interested. Tweets are my own.Nathan Lambert @natolambert
25K Followers 689 Following Figuring out AI @allen_ai, "rl boi" DM me papers. Writes @interconnectsai, talks @retortai Has phd and some credentialsNormalize founders admitting how much of running a startup is pure gut and intuition early on. Metrics matter for sure, but big decisions often are made by the founders/co-founders regardless of data. Most founders are figuring it out as they go.
I want to see velociraptors driving EVs on Mars while posting on X.
RIP Foxtrot Not surprising they’re bankrupt tbh. Selling $9 almond milk and $12 eggs doesn’t scale when the same products are 80% less .5 miles away Cool hangout to drink overpriced mid tier coffee and chill though!
LOVE how the Meta team went hard on explicitly describing the prompt template llama.meta.com/docs/model-car…
American Jews need to stop trying to reestablish victimhood status to gain favor. That ship has sailed, meta has changed. Time to take what is rightfully theirs, take the throne of unabashed oppressor and leader. Show us all what real power looks like.
Okay the porn bots are literally putting hardcore pornography in my replies @elonmusk this is becoming deranged
> examining 1948 > realizing they owned none of it > scrambling through history books trying to find a single moment in history where arabs had sovereignty over what is now israel
“We don’t want a two state. We want 1948.” “We don’t want a two state. We want all of it.” Students at @Columbia openly chant for genocide of Jews in Israel.
I just published a new article! It's a 4,000-word guide using websockets in Django that contains everything I wished existed when I set out to about them. I use channels and htmx to build an async ChatGPT clone with streaming and memory. #django #htmx saaspegasus.com/guides/django-…
Chag Kasher V’Sameach to those of us celebrating. 🫓🫓🫓 Am Yisroel chai! ✡️
@marktenenholtz Really impressive numbers. How representative is this data set of real world tasks?
LLAMA3, a free, open source LLM, is putting the value of commercial models in question. It appears to outperform Claude Sonnet and Mistral, both new, cutting edge models.
F
@gabrielpeyre @marktenenholtz does it remind you of something? ;)
@marktenenholtz @ArizePhoenix Oh btw @marktenenholtz if you weren’t seeing backtracking you may have missed activating your assertions. They aren’t automatically turned on!
Did meta just outperform nearly all models with a 70B and then casually dropped “yeah we are already training another one with 400B param as well”?
@marktenenholtz 100% I agree. We’re just early and there’s a lot to do on all fronts. @ArizePhoenix is helping us on observability.