-
Tweets5K
-
Followers15K
-
Following129
-
Likes7K
Didn't know that there's a minimal Stable Diffusion implementation from @__tinygrad__ Clean 💧🫶 Do we have any benchmarks on the hardware families they support? github.com/tinygrad/tinyg…
SSD-1B was primarily developed by two undergrads from @IITIndore: @_yatharthg and Vishnu Jaddipal If you're looking for interns, I think you should seriously consider them. huggingface.co/segmind/SSD-1B
Hugging Face Hub pro-tip 👨🏫 You can inspect a safetensors file on the Hub right in your browser like this ❤️ Neat? Yes/Yes
Had to chance to visit @IITIndore yesterday and give a talk on ML Careers in 2024. I am no biggie, absolutely not a senior guy in the field in any way. I was there to just share what I have learned. Don't take it seriously. Slides ⬇️ docs.google.com/presentation/d…
Thanks for giving SPRIGHT a try!
Thanks for giving SPRIGHT a try!
Will I be judged or looked down upon if I say `print(f"{context.shape=}")` is my favorite kinda debugging experience in Python. This thing feels illegal.
If you have loads of large files to upload to the HF Hub, then the script below will be immensely helpful ⬇️ We used it for uploading SPRIGHT to the Hub 💫 Hat-tip to @Wauplin for coming up with this script 🧢 huggingface.co/datasets/SPRIG…
Future updates are coming, but this is really a good start on something I have been asking for a while. Please do contribute to the leaderboard -- it will also help the authors gather preference data to further alignment research for diffusion models. huggingface.co/spaces/TIGER-L…
Minnect app doesn't work in India. @patrickbetdavid @theminnectapp
Thanks for giving our work a try. For other, catch all the details in: x.com/RisingSayak/st…
Thanks for giving our work a try. For other, catch all the details in: x.com/RisingSayak/st…
Getting that cat "next" to a suitcase seems to be always a problem for T2I diffusion models 🤷♂️ In our latest work, we investigate the problem of spatial consistency, improve upon it, and offer multiple insights into solving it with systematic re-captioning methods. We make our…
Sebastian Raschka @rasbt
265K Followers 901 Following Machine learning & AI researcher writing at https://t.co/A0tXWzG1p5. LLM research engineer @LightningAI. Previously stats professor at UW-Madison.abhishek @abhi1thakur
81K Followers 661 Following 🤗 I build AutoTrain @huggingface 👨🏽💻 World's First 4x Grand Master @kaggle 🎥 YouTube 100k+: https://t.co/BHnem8fTu5 ⭐ GitHub StarJeremy Howard @jeremyphoward
221K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @StanfordJean de Nyandwi @Jeande_d
38K Followers 766 Following Deep Learning, Vision 🤍 Language, Multimodal LLMs • AI Education • CMU Research blog: https://t.co/1BEFLZAqe7 ML Pack: https://t.co/7PkTyDvuriSanyam Bhutani @bhutanisanyam1
34K Followers 993 Following 👨💻 Sr Data Scientist @h2oai | Previously: @weights_biases 🎙 Podcast Host @ctdsshow 👨🎓 International Fellow @fastdotai 🎲 Grandmaster @KaggleHugging Face @huggingface
339K Followers 188 Following The AI community building the future. https://t.co/VkRPD0VKaZ #BlackLivesMatter #stopasianhateRadek Osmulski 🇺�.. @radekosmulski
25K Followers 551 Following Resources to take your Machine Learning skills to the next level 🧪 Senior Data Scientist, RecSys @NVIDIAAI 🏫 @fastdotai trained DL Eng 📝 https://t.co/By87iXx5PuOmar Sanseviero @osanseviero
31K Followers 2K Following Chief Llama Officer @huggingface 🦙 Founder @AI_Learners. Xoogler (SWE @Google Assistant, 20% PM TF Graphics). 100% Hacker Llama🇵🇪🇲🇽Lior⚡ @AlphaSignalAI
84K Followers 882 Following Covering the latest in AI R&D • ML Engineer • Ex-Mila researcher • MIT Lecturer • Building AlphaSignal, a technical newsletter read by 180,000+ ML experts.Zach Mueller @TheZachMueller
10K Followers 388 Following 🤗 Technical Lead for the Accelerate Project | Passionate about Open Source | Nerd who enjoys touching the grass | #ADHD | He/HimChristoph Molnar @ChristophMolnar
30K Followers 1K Following Author of Interpretable Machine Learning https://t.co/gJKlTA2deP | Newsletter: https://t.co/6fQuMr8yI8Hamel Husain @HamelHusain
23K Followers 2K Following Researcher focusing on LLMs: https://t.co/iVZDFdIQiE Previously, dev tools and infra for ML. Ex @Github, @Airbnb, @DataRobot. @fastdotai core contributor.Ross Wightman @wightmanr
18K Followers 1K Following Computer Vision @ 🤗. Ex head of Software, Firmware Engineering at a Canadian 🦄. Currently building ML, AI systems or investing in startups that do it better.Martin Görner @martin_gorner
12K Followers 6K Following Product Manager for Keras and Tensorflow high-level APIs. Previously worked on Cloud TPUs (Tensor Processing Units). Passionate about democratizing ML.Nate Raw @_nateraw
7K Followers 1K Following machine learning hacker. previously @huggingface @lightningaiDmytro Mishkin 🇺�.. @ducha_aiki
18K Followers 590 Following Marrying classical CV and Deep Learning. I do things, which work, rather than being novel, but not working.Gus (🤖🧠+🐍+�.. @gusthema
21K Followers 1K Following AI Developer Advocate @google - Python🐍 - Machine Learning 🤖🧠 - Google AI ⚙️🧠 - DevRel 🥑🗣️ find me also at: https://t.co/3nrTwEJQTsKritika Prakash @kritipraks
9K Followers 1K Following Researcher and artist. PhD in Computer Science @UChicago. Loves coffee, cats, cafes, cinnamon rolls, and chai. ENFJ-T.Mitsuo Nishizawa @nishizawa
1K Followers 5K Following 医学/画像診断/医用工学/数学/物理学/論理学/プログラミング言語/外国語学/国際情勢/経済学/世界史/海外小説/iPhone Jailbreakなど。マイブームは統計学的手法。chris bator @chrisbator
1K Followers 5K Following Motion and interaction design since the turn of the century. AR/VR 360 video for marketing and elearning | whiskey | local food | #NFT #sfwbssAaron Disibio @DisibioAaron
136 Followers 2K Following Software Developer. Hobbies: archiving, video games, watching YouTube, and reading.crystalWen @JackLiuWen
21 Followers 453 FollowingManav ⚡🚀 @themanavkhadka
168 Followers 573 Following SDE intern @AlignTogether | Flutter | SpringBoot | NextJS | DeepLearning | Full Stack Engineer | #100DaysOfCode | building https://t.co/AN97j7s5zG Chess ♟️Muizz @muizzkhan77
21 Followers 759 FollowingBlenderOdysseyArt @andresvaloyes1
347 Followers 5K Following 3D Virtuoso building the Metaverse one Blender project at a time. Weekly digital place tours await 🗺️Srushti M Kandagal @srushtikandagal
34 Followers 631 Following ᕙ( • ‿ • )ᕗ "🚀 Coding enthusiast | 🐍 Python wizard in training | Embarking on #100DaysOfCode to explore, learn & grow. Here to share my journey & connectSukrit Singh 𝕏 @DatabySingh
9 Followers 74 Following I predict trends. Like, I knew you’d read this.🤖 #DataScience 🤖 #MachineLearning 📍 #ArtificialIntelligence 👾 #BusinessAnalytics 🤌🏻HARSH @HARSH01619
117 Followers 1K Following 20| Fullstack Developer💻 Tweeting my Learnings 📚 and thoughts🤔💭Yash @yashere_9
115 Followers 319 Following Data Science intern at Reliance | AI/ML(exploring LLM magic) | developer in stealth | yash_suthar.lens | 📧: [email protected]Shyam Sunder @shyam_curious
0 Followers 31 FollowingAlen Capalik @capalik
182 Followers 862 Following Founder of CounterTack (now GoSecure) & https://t.co/snWLnZolVI, Entrepreneur, Hacker, Computer Programmer, AI/ML, GPUs, Cybersecurity, Investing, Long Time Options TraderOC @xiaoliwe
754 Followers 1K Following Programmer, AGI/Cloud {Azure, AWS} and decentralized {IaaS, PaaS} of Web3, formerly: @Qiniu, @Microsoft, @shanda_group Speaking only for myself.Shivani P @shivv_p
411 Followers 1K Following 🧮 Investments & Finance 🛠Music Metaverse - @pixelynx_io @blackmirror_xp @korus_ai 🍜 Foodie ✈️ TravellerJohn K Steel ⚡️So.. @SocialMediaTWTR
2K Followers 5K Following Artist, curator, STEAM advocate, gamer, digital storyteller. Residential Solar Consultant @BlueRavenSolar Cash App $SMTWIT #BitcoinJoe Fox @JosephDFox
1K Followers 2K Following I research entrepreneurship, angel investing, startups, iatrogenesis. Following calling w @Alexakaye3 & thanking God for it. Like != endorsementkent newmark @KentNewmark
102 Followers 1K Followingjj🟠 @JarretNoDegree
2K Followers 3K Following Kitty Pics | if 🫵 come here twice, you have to follow. Noti 🔔 for free 💰 | Probably Leeching | #bitcoin #SP500 ❌block = Win | Elon validated my existenceDigital Utopian @soldierofgod0
271 Followers 2K Following Nuovo Nero - Emerging Technology GTM Lead - Faithful to Bottega VenetaJinani @jinaniLXD
141 Followers 1K Following Learning Designer with a knack for AI, curriculum design and e-learning. Exploring the intersection between AI and no-code.wuido.lens @guiddddo
498 Followers 4K FollowingGene Sigalov @genesigalov
258 Followers 916 Following Father to two beautiful girls. Co-founded/Exited @SimpleTexting.Emmy @emmycorich
1K Followers 4K Following Family First 🙏Creator, Web 3, Artist❤️💜💖🩵🌳🌷🌸Heal the world.. make it a better place🌍☮️🌚🌝🎶✨Nirupama Ratna @ratna_kandala
162 Followers 1K Following Ph.D. Linguistics @ IIT Hyderabad #NLP#AI#NeuroscienceJaison @jaisonsaji
486 Followers 908 Following ML Engineer @Camcom_ai | Computer Vision | മലയാളി | Retweets are bookmarksGuillaume Salou @guillaume_salou
1K Followers 1K Following ML Infrastructure Lead @Huggingface, ex AI IT Director @OVHcloud, Father x3Adhil Parammel @adhil_parammel
112 Followers 1K FollowingTony Lek @lek_tony
18 Followers 87 FollowingAaditya Agarwal @not__Aaditya
190 Followers 2K Following Data Science, ML, Web dev, and Curious in general.jacob @hatchseed
23 Followers 2K Following熊猫爸爸 @Teddybearqa
85 Followers 2K FollowingSanyam Chaturvedi @SanyamChat15281
199 Followers 2K Followingwhyoverfitting @whyoverfitting
72 Followers 404 Following Machine Learning Engineer at a Big Tech Company. Physicist. Mathematician. Recent Kaggler. All opinions are my own. (e/SARIMAX).Tom Huang @tuturetom
2K Followers 2K Following Full-stack developer at @BytedanceTalk, 30K+ fans of WeChat public account 图雀社区 and ELab. Love AI、Design、Productivity Tools. Preparing to start a business ⚡️🏄Dave Mullin @DataMCML
158 Followers 1K Following Building data and analytics teams for healthcare, manufacturing, and consulting. #data #analytics #economics #publichealth #digitalhealthSebastian Raschka @rasbt
265K Followers 901 Following Machine learning & AI researcher writing at https://t.co/A0tXWzG1p5. LLM research engineer @LightningAI. Previously stats professor at UW-Madison.abhishek @abhi1thakur
81K Followers 661 Following 🤗 I build AutoTrain @huggingface 👨🏽💻 World's First 4x Grand Master @kaggle 🎥 YouTube 100k+: https://t.co/BHnem8fTu5 ⭐ GitHub StarJeremy Howard @jeremyphoward
221K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @StanfordPyTorch @PyTorch
378K Followers 77 Following Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundationHugging Face @huggingface
339K Followers 188 Following The AI community building the future. https://t.co/VkRPD0VKaZ #BlackLivesMatter #stopasianhateLucas Beyer (bl16) @giffmana
56K Followers 442 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]Soumith Chintala @soumithchintala
185K Followers 869 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.TensorFlow @TensorFlow
377K Followers 117 Following TensorFlow is a fast, flexible, and scalable open-source machine learning library for research and production.DeepLearning.AI @DeepLearningAI
219K Followers 28 Following We are an education technology company with the mission to grow and connect the global AI community.Andrew Trask @iamtrask
74K Followers 184 Following @openminedorg, @GoogleDeepMind ethics team, @OxfordUni phd candidate, @UN pet lab, @GovAI_, creator of #GrokkingDeepLearning, NALU, and sense2vecJürgen Schmidhuber @SchmidhuberAI
106K Followers 0 Following Invented principles of meta-learning (1987), GANs (1990), Transformers (1991), very deep learning (1991), etc. Our AI is used many billions of times every day.Sasha Rush @srush_nlp
51K Followers 463 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzAakash Kumar Nain @A_K_Nain
9K Followers 669 Following Sr. ML Engineer | Keras 3 Collaborator | @GoogleDevExpert in Machine Learning | @TensorFlow addons maintainer l ML is all I do | Views are my own!Thomas Wolf @Thom_Wolf
67K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-scienceLaurence Moroney 🇮.. @lmoroney
29K Followers 294 Following AI Advocate // Teacher of millions // Author of best selling AI books https://t.co/7aUZxG0w6z // Creator of Stargate-AI // Sci Fi Comic, Book and Movie authorSara Hooker @sarahookr
39K Followers 7K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.Hila Chefer @hila_chefer
2K Followers 204 Following PhD candidate @TelAvivUni, student researcher @GoogleAI, interested in Deep Learning, Computer Vision, explainable AIAritra Roy Gosthipaty @ariG23498
1K Followers 121 Following Learning with a LR of 1e-10 at @PyImageSearch, ex-@weights_biases | @huggingface fellow | @GoogleDevExpert in ML | Keras Team ContractorPin-Yu Chen @pinyuchenTW
3K Followers 837 Following Principal research scientist@IBM Research & Chief Scientist@RPI-IBM AI Research Collaboration & PI@MIT-IBM AI Lab. IJCAI Computers & Thought Award Winner.Shakir Mohamed @shakir_za
44K Followers 1K Following ML with Social Purpose. @[email protected] | Research Scientist @DeepMind | Strengthening African ML @DeepIndaba. He/Him. South African 🇿🇦🏳️🌈🌍Made With ML @MadeWithML
10K Followers 3 Following Learn how to responsibly develop, deploy & manage machine learning. Maintained by @GokuMohandasStanford Online @StanfordOnline
28K Followers 117 Following The official account for Stanford Online. Stanford Online is the Stanford School of Engineering’s portal for academic and professional education.Russ Salakhutdinov @rsalakhu
100K Followers 140 Following UPMC Professor of Computer Science at Carnegie Mellon University, ex-Director of AI research at @Apple, co-founder Perceptual Machines (acquired by Apple)Oriol Vinyals @OriolVinyalsML
166K Followers 82 Following VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead. Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.Sergey Levine @svlevine
79K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical IntelligenceJoel Grus 🤠 @joelgrus
17K Followers 922 Following engineering • ML • AI • NLP • author Data Science from Scratch • https://t.co/UJpCHsY5mM • I don't like notebooks • etc...Colin Raffel @colinraffel
30K Followers 655 Following nonbayesian parameterics, sweet lessons, and random birds. Friend of @srush_nlpMIT Quest for Intelli.. @MIT_Quest
3K Followers 806 Following Fueling new discoveries in natural intelligence to produce the next breakthrough in artificial intelligencearXiv Daily @Arxiv_Daily
48K Followers 2K Following Daily feed of this week's top research articles published to https://t.co/ULrW4yLt6n. AI Research Papers, Curated by @DeepAISam Witteveen @Sam_Witteveen
20K Followers 1K Following Co-founder @ Red Dragon AI, Google Developer Expert for Machine Learning/ Deep Learning,Josh Tobin @josh_tobin_
11K Followers 1K Following ML-powered products @gantry_ml @full_stack_dl. Previously @Berkeley_EECS PhD and @openaiarxiv @arxiv_org
14K Followers 0 Following Unofficial bot posting recent scientific paper e-prints every hour, run by @yddtTim Kennedy @TimKennedyMMA
488K Followers 351 Following UFC Fighter, Ranger, sniper, and Special Forces Operator. Unapologetically American, New York Times best selling author.Jocko Willink @jockowillink
846K Followers 154 FollowingThe Full Stack @full_stack_dl
22K Followers 180 Following News, community, and courses for people building AI-powered products.Microsoft Research @MSFTResearch
553K Followers 2K Following We advance science and technology to benefit humanity. https://t.co/kz0nARXbwT Register for Microsoft Research Forum on June 4 ⬇️ Get our newsletterUCLA @UCLA
259K Followers 241 Following The official account for the #1 public university in the nation 7 years in a row. Dedicated to research, education and service.UC Berkeley @UCBerkeley
244K Followers 713 Following Official account of the University of California, Berkeley. “Bk” stands for Berkelium, one of the 16 elements discovered here. #BerkeleyNews #BerkeleyResearchCornell University @Cornell
402K Followers 642 Following Learning. Discovery. Engagement. Join the #Cornell conversation.Princeton University @Princeton
547K Followers 1K Following The official account of Princeton University. In the nation’s service and the service of humanity.Stanford University @Stanford
1.0M Followers 603 Following One of the world's leading research and teaching institutions. Official account of Stanford University.Massachusetts Institu.. @MIT
1.3M Followers 573 Following The Massachusetts Institute of Technology is a world leader in research and education. Related accounts: @MITevents @MITstudents @MIT_alumniedX @edXOnline
343K Followers 378 Following Your next career move starts here. #FueledByedX Discover thousands of job-relevant programs and courses at https://t.co/rJSfZAidn8Microsoft @Microsoft
13.9M Followers 2K Following We're on a mission to empower every person and every organization on the planet to achieve more. Support: @MicrosoftHelpsTim Cook @tim_cook
14.6M Followers 70 Following Apple CEO Auburn 🏀 🏈 Duke 🏀 National Parks 🏞️ “Life's most persistent and urgent question is, 'What are you doing for others?'” - MLK. he/himMIT OpenCourseWare @MITOCW
219K Followers 866 Following @MITOCW provides free learning materials from @MIT's classes. No sign-up or registration. Part of @mitopenlearning. Verification: https://t.co/QaHinns7YcIlya Sutskever @ilyasut
370K Followers 2 Following towards a plurality of humanity loving AGIs @openaiGuido van Rossum @gvanrossum
290K Followers 493 Following Python's BDFL-emeritus, Distinguished Engineer at Microsoft, Computer History Fellow, fully vaccinated. Opinions are my own. He/him.FiveThirtyEight @FiveThirtyEight
1.3M Followers 330 Following Data-driven news and analysis from @ABC News’s 538.Grant Sanderson @3blue1brown
364K Followers 360 Following Pi creature caretaker. Contact/faq: https://t.co/brZwdQfdifPapers with Code @paperswithcode
117K Followers 10 Following Our mission is to organize science by converting information into useful knowledge.Friday was my last day at NVIDIA. Working there was a unique experience, and being at the forefront of the AI revolution over the past year and a half in particular was incredible. After four and a half years the time has come for me to move on to the next chapter of my…
@RisingSayak Welcome to the joy of tinygrad :) If you run with BEAM=3 (slow to compile, fast to run) it's competitive with torch everywhere. Run with DEBUG=2 to see compilation progress. It caches, so your second run will be fast.
We added P2P support to 4090 by modifying NVIDIA's driver. Works with tinygrad and nccl (aka torch). 14.7 GB/s AllReduce on tinybox green!
@RisingSayak @IITIndore @_yatharthg Bravo! We are looking for people who can train multimodal models. If interested, please do feel free to DM us.
🔥 A New Massive Multilingual Dataset for High-Performance Language Technologies" [~5.6 trillion word tokens de-duplicated]. 🔥 ✨ There are 75 languages in this release (22 TB of raw files, 11 TB of deduped files and 8.4 TB of clean files) provided as JSONL files compressed…
After some intense plotting (and MS Paint lines), I'd like to share the updated performance projections from our top minds.
THE REVENGE OF PYTORCH just kidding :) @cHHillee (from PyTorch team) was kindly able to help improve the PyTorch baseline, done by 1) upgrading to nightly, 2) using the "compound" F.sdpa (scaled dot product attention) layer directly, and turning on a torch compile flag:…
THE REVENGE OF PYTORCH just kidding :) @cHHillee (from PyTorch team) was kindly able to help improve the PyTorch baseline, done by 1) upgrading to nightly, 2) using the "compound" F.sdpa (scaled dot product attention) layer directly, and turning on a torch compile flag:…
Highly amusing update, ~18 hours later: llm.c is now down to 26.2ms/iteration, exactly matching PyTorch (tf32 forward pass). We discovered a bug where we incorrectly called cuBLAS in fp32 mathmode 🤦♂️. And ademeure contributed a more optimized softmax kernel for very long rows…
A few new CUDA hacker friends joined the effort and now llm.c is only 2X slower than PyTorch (fp32, forward pass) compared to 4 days ago, when it was at 4.2X slower 📈 The biggest improvements were: - turn on TF32 (NVIDIA TensorFLoat-32) instead of FP32 for matmuls. This is a…
@RisingSayak @IITIndore @_yatharthg we are hiring at fal.ai! reach out to me in DMs, always love open source ML people
This seems exceptionally powerful and simple to use.
50M parameter dense model test. No Infini-Attention yet (I need help with that). Scale up to 3B parameters?
- 13B parameter BitNet + infini-Attention + DenseFormer + MoD + In Context-Pretraining + 2 stage pretraining - upcycle w c-BTX to an 8 expert sparse MoE + MoA I’m sure I’m missing about 20 other techniques to throw into a pretrained model/architecture 🤓 In all seriousness…
I've gotten (understandably) a ton of questions about why the P2P support matters. Here's an excellent article comparing some older GPUs that visualize why it matters: TL;DR P2P (even non-NVLink) matters even more on 4+ cards pugetsystems.com/labs/hpc/p2p-p…
Result - Throughput of the system increased by almost 5x. The bottom line - 1. Do *Everything* to keep the most expensive compute resource busy! 2. When the GPUs are doing compute, make the CPUs do I/O 3. Use SSDs attached to machines to buffer more bytes to feed into GPUs if…
Immediately ended up - 1. Parallelizing downloads 2. Making the batch sizes dynamic to make GPUs work and not wait until all the files finish downloading 3. Speculatively download more files as the GPUs were bust transcribing the downloaded audio
Started stress testing Indexify by making it transcribe and embed 5000 audio files using Distil-Whisper and Sentence Transformer, the task scheduler created tasks for compute in less than 3 ms after ingestion, but downloads on the data plane turned out to be the choke point and…
We started building a PDF extraction module and after a couple of hours I now understand why there are 100 pdf extraction companies 😂 There are a bunch of open source libraries which does well with a particular type of PDF, but no other open source library besides unstructured…
@diptanu I mean Markov chains predicts the next word w/ ngrams