After 3-4 hours of experimenting I can say that the datasets for Tiny Language Model stage 1 are available:
huggingface.co/collections/Sh…
Synthetic Datasets for the win !
Couldn't agree more with Linus here. Making your code running as fast as possible (or just faster than someone's else code) is the best feeling you can get from programming
The issue that it is extremely hard to find the project that will pay you for instruction level efficiency
1/N
This is a thread on how ancient Indian (Hindu) mathematicians and astronomers invented the concept of second-order interpolation - a foundational leap in mathematics that would later evolve into what the modern world calls Calculus.
#selfvisionmath
I find it so interesting (and smart) that Meta / LLaMA is eliminating the dependence of their models on the HuggingFace stack.
The LLaMA models now:
- Have their own website to download weights.
- Have one of the best LLM cookbooks that's available.
- Provide extensive…
India salutes the Supreme Sacrifice of Indian Army Officers Captain Shubham Gupta of 9 Para Special Forces and Captain MV Pranjal of 63 Rashtriya Rifles in the Rajouri anti-terror Ops of Jammu & Kashmir. Two soldiers also made supreme sacrifice, names yet to be released. 🇮🇳 💔
Prayers are powerful. As the nation prays & India battles Australia in the #Worldcupfinal2023 today, 41 men are battling for survival in a trapped tunnel in #Uttarkashi for the past 7 days. Let's also have them in our thoughts & let's all pray for their safety & early evacuation!
#KPSGill —man who knew what the fight was about, stayed the course when everyone had given up, led from front, and salvaged the honor of #Sikh turban.
In my estimation he’s greatest Indian since independence, greatest Hindu general since Baji Rao, greatest Jatt Sikh of all times.
I am a Maharashtrian. I hardly ever had to speak in Hindi till graduation. Even when I was doing my PG in Hyderabad, working in Blore, Delhi or Mumbai it was mostly English we spoke.
Then I worked in Chennai. Ironically, I learned to speak in Hindi in Chennai. Mainly because my…
40 Followers 1K FollowingAlberta’s mountains are tall but I’ll take you even higher. DM me if ur ready to break all the rules and feel FREE like never before 🔥👇
21K Followers 3K FollowingAn Army Veteran,Fought wars of Bangladesh & Kargil.Captured TIGER HILL during Kargil War.War Wounded, Proud of 48 stitches than the gallantry award.
91K Followers 80K FollowingComposer, poet. On a journey to find the mind and soul of humanity. Care for all Earthlings; the Sea, the Earth. In a creative trio of @KyaZora @ElektraMadrigan
142K Followers 1 FollowingClaude is an AI assistant built by @anthropicai to be safe, accurate, and secure. Talk to Claude on https://t.co/ZhTwG8dz3D or download the app.
3K Followers 554 FollowingMTS, Software Generation lead @xai | PhD student @berkeley_ai (on leave), working on RL for LLM agents, prev @AIatMeta, Opinions my own
610K Followers 5K FollowingPresident & CEO @ycombinator —Founder @Initialized—designer/engineer who helps founders—San Francisco Dem accelerating the boom loop—e/acc—technology brother
27K Followers 1K FollowingGenAI @Youtube | Building AI powered video editing | ex : @Google Search & @Microsoft Azure | 3x hackathon winner | Views my own
4K Followers 2K FollowingSenior Principal Systems Engineer @cloudfare ETI
prev. @opstrace (co-founder/CEO, acq. by @gitlab), @redhat, @mesosphere, @cloudflare. @docker (co-founder)
5K Followers 826 FollowingPostdoctoral fellow at @Harvard_Data | Former computer science PhD with @Blei_Lab at @Columbia University | Researching AI + world models
2K Followers 160 FollowingComputational Neuroscientist. Building neural networks to reverse-engineer the brain and human intelligence. Assistant Professor @UofT Research Scientist @UHN
29K Followers 543 FollowingThe Vector Institute is dedicated to AI, excelling in machine & deep learning research. AI-generated content will be disclosed. FR: @InstitutVecteur
108K Followers 4 FollowingCohere builds secure, scalable, and private enterprise-grade AI solutions for real-world business problems. Join us: https://t.co/Yb2xItMObl
121K Followers 639 FollowingMila Scientific Director. Ex @Google DeepMind & Twitter Cortex. Father of 4. // Directeur scientifique à Mila. Ex @Google DeepMind & Twitter Cortex. Père de 4.
109K Followers 167 FollowingUPMC Professor of Computer Science @ CMU, President Elect ICML Board, VP of Research @ Meta (Multimodal LLMs, AI Agents), ex-Director of AI research at @Apple
19K Followers 1K FollowingPretraining @xAI. Previously: @InflectionAI, @AIatMeta, @DeepMind, @Google, @LMU_Muenchen, PhD math-ph. Opinions my own. (Can be yours for a small fee.)
2K Followers 455 FollowingAsst Prof. @ UCSD | PI of LeM🍋N Lab | Former Postdoc at ETH Zürich, PhD @ NYU | computational linguistics, NLProc, CogSci, pragmatics | he/him 🏳️🌈
8K Followers 612 FollowingAmii – the #Alberta Machine Intelligence Institute – advances leading-edge #AI & #ML research and translates scientific advancement into industry adoption
47K Followers 4K FollowingLeader in Graph Database & Analytics.
Developers: https://t.co/XrnpLCVglr. Our community: https://t.co/mWzXAcVzve
Same handle on all other platforms.
325 Followers 7 FollowingSIGGEN is the ACL (Association for Computational Linguistics) special interest group for Natural Language Generation.
https://t.co/QVffdt379k