Nguyễn Đức Ánh @duc_anh2k2
Joined May 2024-
Tweets43
-
Followers1
-
Following98
-
Likes33
Nice cheat sheet for LLM terminology!
Couldn't resist. Here's a pure PyTorch from-scratch re-implementation of Gemma 3 270M in a Jupyter Notebook (uses about 1.49 GB RAM): github.com/rasbt/LLMs-fro…
Couldn't resist. Here's a pure PyTorch from-scratch re-implementation of Gemma 3 270M in a Jupyter Notebook (uses about 1.49 GB RAM): github.com/rasbt/LLMs-fro… https://t.co/9vF9U29pWh
🎯 Andrej Karpathy on how to learn.
Summary of GPT-OSS architectural innovations: 1. sliding window attention (ref: arxiv.org/abs/1901.02860) 2. mixture of experts (ref: arxiv.org/abs/2101.03961) 3. RoPE w/ Yarn (ref: arxiv.org/abs/2309.00071) 4. attention sinks (ref: streaming llm arxiv.org/abs/2309.17453)
what are large language models actually doing? i read the 2025 textbook "Foundations of Large Language Models" by tong xiao and jingbo zhu and for the first time, i truly understood how they work. here’s everything you need to know about llms in 3 minutes↓
As promised, my SOP draft is here: algoroxyolo.github.io/assets/pdf/lrz… Please lmk if you have any suggestions or you have any recommendations where you think I should apply or what I should do in my future research. As always RT appreciated!! #PhDApplication #NLP #HCI
New lecture recordings on RL+LLM! 📺 This spring, I gave a lecture series titled **Reinforcement Learning of Large Language Models**. I have decided to re-record these lectures and share them on YouTube. (1/7)
Despite theoretically handling long contexts, existing recurrent models still fall short: they may fail to generalize past the training length. We show a simple and general fix which enables length generalization in up to 256k sequences, with no need to change the architectures!
Are attention heads the right units to mechanistically understand Transformers' attention behavior? Probably not due the attention superposition! We extracted interpretable attention units in LMs and found finer grained versions of many known and novel attention behaviors. 🧵1/N
Statistical Learning Theory by Percy Liang web.stanford.edu/class/cs229t/n…
New paper - Transformers, but without normalization layers (1/n)
I've been reading this book alongside Deepseek. The math is mathing. The code is coding. The Deepseek is deepseeking! @deepseek_ai you made god!
Stanford “Statistics and Information Theory” lecture notes PDF: web.stanford.edu/class/stats311…
Stanford “Statistics and Information Theory” lecture notes PDF: web.stanford.edu/class/stats311… https://t.co/bJ097Zg52K
Excited to share a new project! 🎉🎉 doi.org/10.1101/2024.0… How do we navigate between brain states when we switch tasks? Are dynamics driven by control, or passive decay of the prev task? To answer, we compare high-dim linear dynamical systems fit to EEG and RNNs🌀 ⏬
Announcing MatMamba - an elastic Mamba2🐍architecture with🪆Matryoshka-style training and adaptive inference. Train a single elastic model, get 100s of nested submodels for free! Paper: sca.fo/mmpaper Code: sca.fo/mmcode 🧵(1/10)
A cool Github repo collecting LLM papers, blogs, and projects, with a focus on OpenAI o1 and reasoning techniques.
Excited to share a blog series I've been working on, diving deep into CUDA programming! Inspired by the #PMPP book & #CUDA_MODE!! Check out the links below...
[VAE] by Hand ✍️ A Variational Auto Encoder (VAE) learns the structure (mean and variance) of hidden features and generates new data from the learned structure. In contrast, GANs only learn to generate new data to fool a discriminator; they may not necessarily know the…
EVLM An Efficient Vision-Language Model for Visual Understanding In the field of multi-modal language models, the majority of methods are built on an architecture similar to LLaVA. These models use a single-layer ViT feature as a visual prompt, directly feeding it into the
Just got around to trying ColPali arxiv.org/abs/2407.01449 but for more general extraction tasks than poorly formatted/scanned documents with complicated SEC tables*. Pretty impressive! VLMs for efficient indexing and late interaction matching gives a sizeable boost.
VWAP_Strategy🇺🇸 @Itauror6509380
43 Followers 2K Following 15-30% Monthly | 2 High-Conviction Stocks.Short-Term Gains: 15-20% in Days/Weeks.DM "JOIN" for WhatsApp Alerts. Live Trade Signals • Market Analysis
Machine Learning Dept... @mldcmu
18K Followers 366 Following The top education and research institution in the 🌎 for #AI and #machinelearning | Research → https://t.co/jUD0hZ8SFx | Learn more ↓
Chhavi Yadav @chhaviyadav_
3K Followers 3K Following @mldcmu | Trustworthy and Reliable AI | ZKPs | PhD from @ucsd_cse | @trustworthy_ml
Fred Sala @fredsala
1K Followers 659 Following Assistant Professor @WisconsinCS. Chief scientist @SnorkelAI. Working on machine learning & information theory.
Dimitris Papailiopoul... @DimitrisPapail
20K Followers 1K Following Researcher @MSFTResearch, AI Frontiers Lab; Prof @UWMadison (on leave); learning in context; thinking about reasoning; babas of Inez Lily.
JHU Computer Science @JHUCompSci
2K Followers 722 Following A diverse and collaborative community on the cutting edge of computing and technology within @HopkinsEngineer at @JohnsHopkins. https://t.co/3hwXFTdGyw
Grigoris Chrysos @Grigoris_c
604 Followers 240 Following Assistant Professor at @UWMadison. Interested in representation learning and trustworthy ML. https://t.co/Sy3v4o7vHo
Ezgi Korkmaz @EzgiKorkmazAI
1K Followers 0 Following Machine Learning Researcher, PhD in Machine Learning. Reinforcement Learning. Been at @UCL | @GoogleDeepmind | @UCBerkeley
Maya Bechler-Speicher @mayabechlerspei
601 Followers 63 Following AI Research Scientist@Meta, CS PhD@TAU, Lecturer of "Machine Learning with Graphs"@ CS-TAU, Mathematician.
F. Güney @ftm_guney
9K Followers 2K Following research on computer vision, teaching, and movies. tweets in TR, EN
Sebastian Raschka @rasbt
358K Followers 1K Following ML/AI researcher & former stats professor turned LLM research engineer. Author of "Build a Large Language Model From Scratch" (https://t.co/O8LAAMRzzW).
Dylan Foster 🐢 @canondetortugas
3K Followers 1K Following Foundations of RL/AI @MSFTResearch. Previously @MIT @Cornell_CS https://t.co/vQIdUzsw8B RL Theory Lecture Notes: https://t.co/bhgL3aKIk0
Ai2 @allen_ai
74K Followers 410 Following Breakthrough AI to solve the world's biggest problems. › Join us: https://t.co/MjUpZpKPXJ › Newsletter: https://t.co/k9gGznstwj
EMNLP 2025 @emnlpmeeting
15K Followers 51 Following EMNLP 2025 - The 2025 Conference on Empirical Methods in Natural Language Processing, 2025 Hashtag: #EMNLP2025 Dates: November 5-9 Submission Deadline: May 19th
Sharon Y. Li @SharonYixuanLi
11K Followers 807 Following Prof @WisconsinCS. Making AI reliable for the open world.
Ming Yin @MingYin_0312
2K Followers 922 Following ML, RL, AI. @Princeton Postdoc. PhDs in CS & STATs. Ex @awscloud AI. undergrad @USTC Math. Area Chair @NeurIPS @ICML.
Zixiang Chen @_zxchen_
1K Followers 2K Following Research Scientist at @SalesforceAI | Ph.D. from @UCLA | B.S. from @Tsinghua_Uni | Foundation Model, Theory, Reinforcement Learning | Opinions are my own
Dongruo Zhou @DongruoZ
391 Followers 150 Following Assistant Professor of Computer Science, Indiana University
Subhabrata Sen @subhabratasen90
643 Followers 150 Following Assistant Professor of Statistics, @Harvard. Opinions are my own.
Kaixuan Huang @KaixuanHuang1
1K Followers 929 Following PhD Student @Princeton; Google PhD Fellowship 2024, Ex-Intern @GoogleDeepMind; undergrad @PKU1898. opinions my own
Guanyang Wang @GuanyangW
489 Followers 321 Following Assistant professor of statistics @RutgersU, former Ph.D of math @Stanford, undergrad of math @USTC.
Tianhao Wang @0920wth
199 Followers 252 Following Assistant Professor @HDSIUCSD. Previously Research Assistant Professor @TTIC_Connect and PhD in Statistics & Data Science @Yale.
Lunjia Hu @LunjiaH
468 Followers 284 Following Assistant Prof @Northeastern @KhouryCollege. Prev Postdoc Fellow @Harvard @HCRCS. CS PhD @StanfordTheory, Yao Class undergrad @Tsinghua_Uni
Zhiyuan Li @zhiyuanli_
2K Followers 317 Following Assistant Professor @TTIC_Connect. Previously Postdoc @Stanford and PhD @PrincetonCS. Deep Learning Theory.
Hieu Pham @hyhieu226
34K Followers 25 Following @openai | ex: @xai, @augmentcode, @GoogleBrain, @LTIatCMU, @Stanford, ACM ICPC, IMO🥈 Opinions are my own.
Khurram Javed @KhurramJaved_96
2K Followers 155 Following Developing efficient algorithms for real-time reinforcement learning. Research Scientist at Keen, a startup led by John Carmack. Prev ~ PhD with Richard Sutton
Alexander Terenin - o... @avt_im
8K Followers 1K Following Decision-making under uncertainty, machine learning, artificial intelligence, from theory to practice · anti-ideological · Assistant Research Professor @Cornell
Sarath Chandar @apsarathchandar
6K Followers 608 Following Associate Professor @polymtl and @Mila_Quebec; Canada CIFAR AI Chair; Machine Learning Researcher. Pro-bono office hours: https://t.co/tK69DKRf9N?amp=1
Reinforcement Learnin... @rlai_lab
6K Followers 24 Following The official twitter handle of the RLAI lab at the University of Alberta
Rohan Paul @rohanpaul_ai
97K Followers 8K Following Compiling in real-time, the race towards AGI. The Largest Show on X for AI. 🗞️ Get my daily AI analysis newsletter to your email 👉 https://t.co/6LBxO8215l
Ben Lamm @BenLamm
58K Followers 2K Following Present: @Colossal Past: Founder w/ exits to @liveperson @zynga @accenture. Love startups, science, defense, space. Fellow/Board of Trustee @explorersclub
Chenfeng_X @Chenfeng_X
1K Followers 973 Following Incoming Assistant Professor @UTCompSci, Senior Researcher @togethercompute, PhD @UCBerkeley. Working on building cooler things with fewer cost 😊
Sanae Lotfi @LotfiSanae
3K Followers 374 Following AI Research Scientist @MetaAI (FAIR) | PhD from @nyuniversity
Arnav Goel @_goel_arnav
684 Followers 372 Following MSML @mldcmu | Pre-training, alignment and memorization | ex - @MSFTResearch, @nlp_usc, @Mila_Quebec, IBM | CSAI @IIITDelhi '25
Percy Liang @percyliang
85K Followers 420 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | Pianist
Tengyu Ma @tengyuma
37K Followers 564 Following Assistant professor at Stanford; Co-founder of Voyage AI (https://t.co/wpIITHLgF0) ; Working on ML, DL, RL, LLMs, and their theory.
Elad Hazan @HazanPrinceton
14K Followers 220 Following machine learning and optimization @PrincetonCS & Google DeepMind Princeton, dad^3
Ahmad Beirami @abeirami
10K Followers 4K Following sth new // ex Gemini RL+Inference @GoogleDeepMind // Chat AI @Meta // RL Agents @EA // ML+Information Theory @MIT+@Harvard+@GeorgiaTech // زن زندگی آزادی
Albert Gu @_albertgu
18K Followers 88 Following assistant prof @mldcmu. chief scientist @cartesia_ai. leading the ssm revolution.
AAAI @RealAAAI
30K Followers 93 Following Founded in 1979, AAAI is an international, nonprofit, scientific society devoted to promote research in, and responsible use of Artificial Intelligence.
Ernest Ryu @ErnestRyu
6K Followers 349 Following Professor of Mathematics at UCLA. Interested in deep learning and optimization.
Dakuo Wang @dakuowang
2K Followers 827 Following Associate Professor @Northeastern, DistinguishedSpeaker @TheOfficialACM Prev. @IBMResearch @StanfordHAI Ph.D. @UCIrvine #HCI #AI #CSCW #HumanAICollaboration
Trapit Bansal @TrapitBansal
32K Followers 250 Following AI Research @Meta | Co-Creator of OpenAI o1 | Previously @OpenAI, @MSFTResearch, @GoogleAI, @facebook, @iiscbangalore, and undergrad @IITKanpur
Arpit Bansal @arpitbansal297
1K Followers 831 Following Currently interning with Llama @Meta, PhD Candidate @UMDCS. Past @AmazonScience, @IITKgp. A brick in the creation of Artificial General Intelligence.
Science Magazine @ScienceMagazine
4.5M Followers 460 Following Cutting-edge research, news, commentary, and visuals from the Science family of journals. Follow @NewsfromScience for stories from our News team.
Chris @chatgpt21
17K Followers 830 Following Agi 2029 - Applied in RL, CL, and generalization | Program Manager | Investing in early startups 📈 E/CC 🦾🤖
Hunyuan @TencentHunyuan
27K Followers 6 Following Tencent's large model, encompasses text generation, image generation, video generation, and 3D generation.Trends for United States
You might like
