labml.ai @labmlai
📝 Annotated paper implementations https://t.co/qeO4UTbrJ3 labml.ai Joined December 2020-
Tweets609
-
Followers12K
-
Following8
-
Likes556
Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking arxiv.org/abs/2403.09629 It trains language models to generate rationales at each token to explain future text, to improve their predictions. 🧵👇
Hoping to add more paper implementations. Any suggestions?
Hoping to add more paper implementations. Any suggestions?
✨ 40k stars for our annotated research paper implementation project. Thanks for the love! Annotated code: nn.labml.ai Github: github.com/labmlai/annota…
Annotated @PyTorch implementation of U-Net 📝 Code nn.labml.ai/unet/index.html 🖥 Github github.com/labmlai/annota… 📎 Paper papers.labml.ai/paper/1505.045… U-Net is a symmetric U shaped model with conv layers. Used for modeling feature map->feature map data such as segmentation.
🎉 You can now click on maths expressions to highlight them across the page! Annotated deep learning paper implementations in @PyTorch: 📝 nn.labml.ai We just added this feature so let us know if you come across any bugs and have thoughts for improvements.
Annotated PyTorch papers! 🔥 @labmlai has the best resources for learning how to really implement ideas This is a no-nonsense website with a side-by-side implementation of papers in @PyTorch The transformers section is my fav: nn.labml.ai/index.html
Trending repository of the day 📈 annotated_deep_learning_paper_implementations by @labmlai 🧑🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; in... Main language: Jupyter Notebook Last 24h: 633 ⭐ Total: 29175 ⭐️ github.com/labmlai/annota…
🥳 Our "Annotated Research Paper Implementations" Github repo reached 25,000 stars! github.com/labmlai/annota… It has over 50 paper implementations. Thank you everyone for the support!
Apologies for the inconvenience caused by the interruption in our tweets featuring popular research papers on papers.labml.ai. We regret to inform you that we have encountered issues with our previous Twitter data collection app, which has been discontinued due to new…
Proximal Policy Optimization is the RL technique often used for RLHF. @labmlai has provided a PPO implementation with equations and explanation side-by-side. Check it out here → nn.labml.ai/rl/ppo/index.h…
Updated the GeoV-9b model weights at 80 billion tokens trained by @gharik 📀 huggingface.co/GeoV/GeoV-9b We evaluated the model with @AiEleuther LM eval harness. Results 👉 github.com/geov-ai/geov/b… We'll continue to upload weights and evaluate the model as training progresses.
Updated the GeoV-9b model weights at 80 billion tokens trained by @gharik 📀 huggingface.co/GeoV/GeoV-9b We evaluated the model with @AiEleuther LM eval harness. Results 👉 github.com/geov-ai/geov/b… We'll continue to upload weights and evaluate the model as training progresses.
Updated the GeoV-9b model weights at 74 billion tokens trained @gharik 📀 huggingface.co/GeoV/GeoV-9b And we are working on adding it to @huggingface transformers github.com/huggingface/tr…
Updated the GeoV-9b model weights at 74 billion tokens trained @gharik 📀 huggingface.co/GeoV/GeoV-9b And we are working on adding it to @huggingface transformers github.com/huggingface/tr…
RoPER does better than rotational embeddings (RoPE) on algorithmic tasks and works a little better in our initial tests on language modeling too. Here is the RoPER paper (research.labml.ai/RoPER.html) and the annotated implementation (nn.labml.ai/transformers/r…).
RoPER does better than rotational embeddings (RoPE) on algorithmic tasks and works a little better in our initial tests on language modeling too. Here is the RoPER paper (research.labml.ai/RoPER.html) and the annotated implementation (nn.labml.ai/transformers/r…).
GeoV-9b language model @gharik & @labml is releasing a 9 billion parameter LM with open licenses to be useful in a variety of settings. The current version is trained for ~69B tokens and they will continue training for 300B tokens. 📗 Google Colab notebook:…
Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.Jeremy Howard @jeremyphoward
222K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @StanfordDaily AI Papers @papers_daily
16K Followers 2 FollowingJean de Nyandwi @Jeande_d
38K Followers 773 Following Deep Learning, Vision 🤍 Language, Multimodal LLMs • AI Education • CMU Research blog: https://t.co/1BEFLZAqe7 ML Pack: https://t.co/7PkTyDvuriLior⚡ @AlphaSignalAI
84K Followers 897 Following Covering the latest in AI R&D • ML Engineer • Ex-Mila researcher • MIT Lecturer • Building AlphaSignal, a technical newsletter read by 180,000+ ML experts.Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Tanishq Mathew Abraha.. @iScienceLuvr
54K Followers 1K Following PhD at 19 | Founder and CEO at @MedARC_AI | Research Director at @StabilityAI | @kaggle Notebooks GM | Biomed. engineer @ 14 | TEDx talk➡https://t.co/xPxwKTq6QbOmar Sanseviero @osanseviero
31K Followers 2K Following Chief Llama Officer @huggingface 🦙 Founder @AI_Learners. Xoogler (SWE @Google Assistant, 20% PM TF Graphics). 100% Hacker Llama🇵🇪🇲🇽Rosanne Liu @savvyRL
33K Followers 968 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDRGowthami Somepalli @gowthami_s
6K Followers 978 Following Grad student @UMDCS. Past: @AIatMeta, @AmazonScience, @IITMadras. Currently working on #Diffusion and #Multimodal understanding. GPU poor. She/her.Thomas Simonini ᯅ @ThomasSimonini
6K Followers 1K Following Game Developer making games with AI 🪄 @huggingface 🤗 Writing ML for Games course ➡️ https://t.co/bvW8PMeARO Wrote Deep RL Course ➡️ https://t.co/5Pk3rwOjjqDavis Blalock @davisblalock
12K Followers 165 Following Research scientist + first hire @MosaicML. @MIT PhD. I write + retweet technical machine learning content. If you write a thread about your paper, tag me for RTTom Goldstein @tomgoldsteincs
23K Followers 2K Following Professor at UMD. AI security & privacy, algorithmic bias, foundations of ML. Follow me for commentary on state-of-the-art AI.Jonathan Whitaker @johnowhitaker
7K Followers 955 Following Data scientist and AI researcher. R&D at https://t.co/9xrxRrGfEE.RekingQin @RekingQin
1 Followers 24 Followingsimrat hanspal @simsimsandy
84 Followers 448 Following Exploring LLMs | Data scientist with a curious engineering mindKane Toh @kane953o
243 Followers 2K Following Bioinformatics research fellow @BGI_Research, working on spatial transcriptomics. PhD @Cambridge_Unijr @jamesrichmanx
16K Followers 219 Followingxiongmiaomiaoxiong @HaoLi1735005
1 Followers 2 FollowingAnanya Raval @just_ananya
11 Followers 324 FollowingDavid Gu @suespostgra
1 Followers 25 FollowingHongbin Na @naze30072664
7 Followers 199 Following MRes student @UTSAAII. AI for Social Good. #NLProc. INTJ 5w4close @cy_991221
3 Followers 16 Followingar4499 @ar4499_
0 Followers 161 FollowingMitsuo Nishizawa @nishizawa
2K Followers 5K Following 医学/画像診断/医用工学/数学/物理学/論理学/プログラミング言語/外国語学/国際情勢/経済学/世界史/海外小説/iPhone Jailbreakなど。マイブームは統計学的手法。yanhui li @LiYanhui61806
0 Followers 1 FollowingIftekhar Uddin, MD MS.. @iftekhxr
116 Followers 1K Following Robotics Engineer. Prev: @HopkinsMedicine @JohnsHopkinsSPHSalma Shaik @salma2vec
866 Followers 3K Following engineering (MLOps, Platform) | prev: Store @Microsoft; applied research @CarnegieMellon, @OpenMinedorghyzhak_en🇺🇦 @hyzhak_en
243 Followers 464 Following SDE/ML expert (LLM, NLP, CV, GNN and etc.) and Open Source contributor. Btw, I'm slowly moving to Threads.北落师门 @yellowbig1
26 Followers 177 FollowingVikram Dutt @vd_
836 Followers 7K FollowingChris Hsu @chrishsu88
6 Followers 46 Followingzlsin @JingSr13126
0 Followers 18 Followingyep @guokeyumao
39 Followers 143 Followinghou zard @ZardHou496
2 Followers 68 FollowingMatthew Joseph Smith @Mikuk84
110 Followers 1K Following I’m a multi-lingual chemical engineer turned machine learning engineer living in Asiask @sk80104705
22 Followers 225 FollowingMuhammad Z. Ahmed @MoZayed007
153 Followers 1K Following Aspiring ML Engineer / Applied Scientist / Research Scientist 🤖 TFT, MMORPGs🎮Wojtekk @wojtekk23
139 Followers 3K Following Prefab Sprout stan, making computers go brrrrr 🌱 | he/him, on/go/muRohan Thakker @RoboticistRohan
166 Followers 379 Following Autonomy Lead, Project EELS (Space Snake Robot 〰️) Robotics Researcher @NASAJPL 🚀Zhhsj @Zhhsj16
7 Followers 307 FollowingAnthony Tan🇺🇦 @anthony_s_tan
43 Followers 70 Following individual researcher of #deeplearning and #reinforcementlearning want to apply a phd project of reinforcement learningVineeth Veetil @vin_veetil
50 Followers 142 FollowingJ YOUNG @JYOUNG62915356
0 Followers 83 FollowingBrix Sun @brix_sun
9 Followers 101 FollowingHanane @ODD21855402574
2 Followers 12 Followingumi @um68595275
1 Followers 99 FollowingRevan @WinBlue10
7 Followers 117 FollowingIsaac Oduro @IOduro43136
2 Followers 16 Followinglionel choucha @Paipai5834
0 Followers 5 Followingyyyyy @yyyyy389778
1 Followers 18 Following両さん @voldemoet1231
317 Followers 457 Following Clash of Clans りょう 8エリ隠居 カルダノ サッカーとスキーが好き。 皆さんよろしくお願いしますm(._.)mxbbk @xbbk1111239
0 Followers 55 FollowingDaily AI Papers @papers_daily
16K Followers 2 FollowingRalph Harik @ralphimo
493 Followers 3K FollowingGeorges Harik @gharik
4K Followers 3K Following early google employee. worked on ai, gmail. like to invest and think about ai.Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking arxiv.org/abs/2403.09629 It trains language models to generate rationales at each token to explain future text, to improve their predictions. 🧵👇
Worked with @ericzelikman @EchoShao8899 @vpj @nickhaber @noahdgoodman on this awesome paper to train LLMs to reason before they speak, from data at large. arxiv.org/abs/2403.09629
Hoping to add more paper implementations. Any suggestions?
✨ 40k stars for our annotated research paper implementation project. Thanks for the love! Annotated code: nn.labml.ai Github: github.com/labmlai/annota…
Nice work!
⏳ A simple @PyTorch implementation of hourglass transformer with side-by-side notes from the paper Hierarchical Transformers Are More Efficient Language Models 📝 code/notes nn.labml.ai/transformers/h… 📎 paper papers.labml.ai/paper/768de41e… 🧵👇
🎉 You can now click on maths expressions to highlight them across the page! Annotated deep learning paper implementations in @PyTorch: 📝 nn.labml.ai We just added this feature so let us know if you come across any bugs and have thoughts for improvements.
@bhutanisanyam1 @labmlai @PyTorch Glad you liked it! Thanks for sharinf
Annotated PyTorch papers! 🔥 @labmlai has the best resources for learning how to really implement ideas This is a no-nonsense website with a side-by-side implementation of papers in @PyTorch The transformers section is my fav: nn.labml.ai/index.html
Super impressed by @labmlai! One of the best ways to understand papers.
@hnipun1 @labmlai @papers_daily I understand. The Twitter API is indeed quite expensive. I appreciate your persistence, and I hope it continues to improve. Thank you.🥳
Ek hi Dil hai kitni baar jeetoge? Translation: I've just one heart, how many times do you wanna win it?
🥳 Our "Annotated Research Paper Implementations" reached 30,000 stars on Github! Thank you! github.com/labmlai/annota… It has 60 paper implementations in @PyTorch 📝 Here's the code with side-by-side notes: nn.labml.ai
catching up with the latest research after a break is easy thanks to @labmlai 😀 papers.labml.ai/papers/recent/
Trending repository of the day 📈 annotated_deep_learning_paper_implementations by @labmlai 🧑🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; in... Main language: Jupyter Notebook Last 24h: 633 ⭐ Total: 29175 ⭐️ github.com/labmlai/annota…
Apologies for the inconvenience caused by the interruption in our tweets featuring popular research papers on papers.labml.ai. We regret to inform you that we have encountered issues with our previous Twitter data collection app, which has been discontinued due to new…
@iScienceLuvr @labmlai Thanks for sharing. Glad you found it useful. PPO was the first annotated paper implementation.
I'm trying to better understand how PPO works, and I figured I'd check to see if this website has an implementation. It has implementations of many papers, from transformers to diffusion models, with side-by-side equations and explanations. Such an awesome resource!
Proximal Policy Optimization is the RL technique often used for RLHF. @labmlai has provided a PPO implementation with equations and explanation side-by-side. Check it out here → nn.labml.ai/rl/ppo/index.h…
Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoning ai.papers.bar/paper/49552082… Table-based reasoning has shown remarkable progress in combining deep models with... 🧵 👇
@vgoklani_ai @labmlai @_akhaliq @AiEleuther Will try to do those things may take a bit.