Andy J Yang @pentagonalize
Joined May 2020-
Tweets170
-
Followers142
-
Following1K
-
Likes3K
"A calculator app? Anyone could make that." Not true. A calculator should show you the result of the mathematical expression you entered. That's much, much harder than it sounds. What I'm about to tell you is the greatest calculator app development story ever told.
Rare footage of the brilliance of Zakir Hussain
BPE is a greedy method to find a tokeniser which maximises compression! Why don't we try to find properly optimal tokenisers instead? Well, it seems this is a very difficult—in fact, NP-complete—problem!🤯 New paper + P. Whittington, @GregorBachmann1 :) arxiv.org/abs/2412.15210
Drop by @pentagonalize's poster tomorrow on the relationship between transformers and first-order logic! neurips.cc/virtual/2024/p… Wed 4:30-7:30 East Exhibit Hall A-C #2310
Excited to head to @NeurIPSConf today! I'll be presenting our work on the representational capabilities of Transformers and RNNs/SSMs. If you're interested in meeting up to discuss research or chat, feel free to reach out via DM or email!
First-time NeurIPS attendee here! Super excited to talk about our paper with @yveitsman, @mhahn29 and to discover the amazing work by everyone else :D neurips.cc/virtual/2024/p…
First-time NeurIPS attendee here! Super excited to talk about our paper with @yveitsman, @mhahn29 and to discover the amazing work by everyone else :D neurips.cc/virtual/2024/p…
A new gate was needed at the South Bend airport, so officials decided to upgrade the business center at the same time. southbendtribune.com/story/news/202…
📜New preprint w/ @nlpnoah and @yanaiela that evaluates the novelty of LM-generated text using our n-gram search tool Rusty-DAWG 🐶 Code: github.com/viking-sudo-rm… Paper: arxiv.org/abs/2406.13069
Stick-Breaking Attention: Out-of-box length extrapolation, thanks to removing the position embedding; Better performance than Softmax+RoPE on almost every task; Similar efficient implementation like Flash Attention. Do we still need Softmax+RoPE for Language Models?…
Automata ; Robotic arm
The World's First Transformer ASIC You ask, “What would you do with 500,000 tokens per second?” Build real AI applications! Current inference limitations hold us back from doing anything beyond immediately generating the first response for users. etched.com
❓ Thank You, Stingray ❓ Today’s LLMs are so powerful with strong general problem solving capabilities spanning across multiple languages. But, can LLMs disambiguate the semantic meaning across different languages? Our new paper delves deeper to answer this very question!
When do transformers length-generalize? Generalizing to sequences longer than seen during training is a key challenge for transformers. Some tasks see success, others fail — but *why*? We introduce a theoretical framework to understand and predict length generalization.
Joint work with @pentagonalize, Dana Angluin, Peter Cholak, and Anand Pillay
Joint work with @pentagonalize, Dana Angluin, Peter Cholak, and Anand Pillay
Fabの続き。タマコロへの変形まとめて変換しました。テーマ決めてやったほうがモチベあがっていいかも。これで4分の1くらいは終わったかな。カブクワが多いので標本みたいに一つにまとめたほうがいいかもな〜
Fabの続き。タマコロへの変形まとめて変換しました。テーマ決めてやったほうがモチベあがっていいかも。これで4分の1くらいは終わったかな。カブクワが多いので標本みたいに一つにまとめたほうがいいかもな〜 https://t.co/yzJZdecU9L
What makes some LM interpretability research “mechanistic”? In our new position paper in @BlackboxNLP, @sarahwiegreffe and I argue that the practical distinction was never technical, but a historical artifact that we should be—and are—moving past to bridge communities.
Pigmy hippopotamus Designed by Busi Folded by Monica #origami
Congratulations to @taguchi_c for winning a @lucy_institute Societal Impact Award for his work on creating language technologies for the Kichwa language community in Ecuador! @ND_CSE youtube.com/watch?v=HjsNOE…
Noah Ziems @NoahZiems
1K Followers 1K Following Visiting Researcher @MIT_CSAIL under @lateinteraction. PhD student @NotreDame advised by @Meng_CS. Creator of Arbor RL framework for @DSPyOSS
OωR)'gyami @T_oru_2ru
318 Followers 673 Following 蛇腹と遊んでます...TOReC @TOrigamiRCircle →いまじろ〜/松ヶ崎のいまじろ〜/きっと、機b1
Francine @Irxirlu6780
49 Followers 2K Following Your value doesn’t decrease based on someone’s inability to see your worth.
Antonis Anastasopoulo... @anas_ant
3K Followers 2K Following Assist. Prof at George Mason CS #nlproc MT, ASR, and documentation of endangered languages.
Godelieve @MZ7I28gBT9H78
27 Followers 1K Following
llvmvsllm @llvmvsllm
3 Followers 336 Following
Nahid Hasan @shishir9159
17 Followers 471 Following
Kenton Murray @kentonmurray
973 Followers 809 Following Natural Language Processing Research Scientist JHU. | PhD from Notre Dame. | Formerly at QCRI, CMU, and Princeton.
Joshua Ackerman @b_l_c_k
117 Followers 1K Following CS PhD Student at Dartmouth, B.S. in Discrete Math from Carnegie Mellon. Focused on AI for cyber security with a growing interest in global security.
Louisa Conwill @louisaconwill
178 Followers 114 Following PhD candidate at @nd_cse. Bringing philosophical + religious traditions into ethical HCI. Formerly @focuscatholic and @amazon. @BrownUniversity and @asij alum.
AnarchEmber 🏳️�... @emberceptible
36 Followers 712 Following What if we kissed while destroying gender? | Bad back baddie | they/xe/she | 28, queer, leftist, t4t | 21+ please, MDNI
David Atkinson @diatkinson
229 Followers 1K Following PhD student @KhouryCollege. AI interpretability. Previously @EpochAIResearch.
Jackson Petty @jowenpetty
1K Followers 894 Following the passionate shepherd, to his love • ἀρετῇ • מנא הני מילי
galvanize (gail weiss... @gail_w
1K Followers 319 Following Trying to get off of here, dms checked rarely. Better to send an email postdoc, understanding neural networks. https://t.co/lnaKoR7vmc .
Narutatsu (Edward) Ri @narutatsuri
426 Followers 248 Following PhD Student @PrincetonPLI | BS @Columbia ‘24
alcuin ❄️ @scheminglunatic
6K Followers 1K Following pure, lazy, immutable ✝️ "In programming language theory, there is only moral correctness." 🐱👉investi(gati)bg ... #TRAD_YAOI and #AuDHD_NetSlop 🐢🦀🦥❄️🍛🐓
Ofir Press @OfirPress
15K Followers 7K Following I build tough benchmarks for LMs and then I get the LMs to solve them. SWE-bench & SWE-agent. Postdoc @Princeton. PhD @nlpnoah @UW.
Herbert Zhou @zh_herbert_zhou
88 Followers 162 Following 3rd year PhD @YaleLinguistics; Computational psycholinguistics.
Alexander Clark @alexandersclark
2K Followers 2K Following Linguist, philosopher, computer scientist, foodie, wine geek etc. I follow some people I disagree with. Don’t interpret my likes please.
Tom McCoy @RTomMcCoy
4K Followers 584 Following Assistant professor @YaleLinguistics. Studying computational linguistics, cognitive science, and AI. He/him.
⟦Simon Charlow⟧ @SimonCharlow
722 Followers 878 Following
Yana Veitsman @yveitsman
43 Followers 117 Following Research assistant - https://t.co/JL0k36OEQ1 Master student @LstSaar
Ruochen Zhang @ruochenz_
797 Followers 2K Following Interning @cohere, PhDing @Brown_NLP & @health_nlp, working on multilingual NLP and interpretability. Prev: Undergrad @sutdsg, she/they
Xinting Huang @huangxt233
130 Followers 124 Following PhD student https://t.co/9nBzEDGpxu currently working on interpretability of neural models https://t.co/5aNeNJBqnF
🌤️ beagle.bsky.s... @beagles_bagel
427 Followers 3K Following a genderqueer monkey that's figured out how to use every single computer program. i am without the binery, they/them. put alt text on yer memes.
Michael Hanna @michaelwhanna
614 Followers 440 Following PhD student at the University of Amsterdam / ILLC, interested in computational linguistics and (mechanistic) interpretability. Current Anthropic Fellow.
Eva Louise Marie Gabr... @e681554349
11 Followers 7K Following
Jun (Richard) Wang @AI_richard
36 Followers 1K Following
utkarsh @utkarsh_2105
667 Followers 3K Following he/him | CS undergrad BITS Pilani | (distributed, large, fast and so on) Systems for ML @MSFTResearch, prev @Inria
Yakmaz @yYakmazz
328 Followers 6K Following
Yining Lu @Yining__Lu
220 Followers 559 Following Second year CS PhD student @NotreDame | Prev: @amazon @JHUCLSP 🦋: https://t.co/gPXvdPuesy
Ningzhi Tang @TangNingzhi
137 Followers 515 Following Ph.D. Student @ND_CSE | HCI+SE+AI | B.Eng. @SUSTechSZ
Ken Sible @kensible
35 Followers 109 Following PhD Student in Computer Science at University of Notre Dame
Yash Sarrof @yashYRS
136 Followers 144 Following Research Assistant https://t.co/iSGrDEoxG6 Pursuing Masters in NLP @LstSaar
Kantism-Chomskyism @improved_ends
120 Followers 2K Following
Mark Rofin @ ICML @broccolitwit
96 Followers 261 Following Research assistant at https://t.co/YkJnuIppPm & NLP student at @LstSaar
Michael Hahn @mhahn29
1K Followers 864 Following Professor at Saarland University @LstSaar @SIC_Saar. Previously PhD at Stanford @stanfordnlp. Machine learning, language, and cognitive science.
Richard Sutton @RichardSSutton
52K Followers 64 Following Student of mind and nature, libertarian, chess player, cancer survivor. @ Keen, UAlberta, Amii, https://t.co/u8za2Kod54, The Royal Society, Turing Award
bnu 🐇🍓 @bunnyluvr__
15K Followers 299 Following CEO of #bunnytwt - bringing bunny images on your TL! - PFP by @doodlenoodleh - DM SUBMISSIONS! - Right Wingers get blocked
Simran Arora @simran_s_arora
5K Followers 207 Following building ai systems, cs phd @stanford @hazyresearch, incoming asst. prof. @caltech
Noah Ziems @NoahZiems
1K Followers 1K Following Visiting Researcher @MIT_CSAIL under @lateinteraction. PhD student @NotreDame advised by @Meng_CS. Creator of Arbor RL framework for @DSPyOSS
Ezgi Korkmaz @EzgiKorkmazAI
1K Followers 0 Following Machine Learning Researcher, PhD in Machine Learning. Reinforcement Learning. Been at @UCL | @GoogleDeepmind | @UCBerkeley
RoboHub🤖 @XRoboHub
6K Followers 731 Following Follow @XRoboHub | Chinese: @X科技馆 🚀 🤖 Focused on Robotics × AI 🌍 Covering the latest in global robotics 📩 [email protected]
Sadhika Malladi @SadhikaMalladi
2K Followers 227 Following Postdoc researcher at MSR NYC; incoming faculty at UCSD CSE; CS PhD at Princeton
Aryeh Kontorovich @aryehazan
10K Followers 610 Following probability, statistics, metric spaces, Markov chains, freedom (social & academic), Israel, Jew stuff. opinions represent my employer & all other groups I'm in
Bunnies @Bunnies
97K Followers 134 Following A bunny a day will keep the doctor away. DM YOUR BUNNY!
BurdenWalker ✦ @Burden_Walker
3K Followers 565 Following I must create art because if I don't, it means all the pain I've endured was for nothing.
Paolo Benanti @paolobenanti
7K Followers 131 Following Francescano. Docente di etica e bioetica. Etica della tecnologia e Artificial Intelligence, neuro-etica e post-umano.
Math, Inc. @mathematics_inc
6K Followers 0 Following A new company dedicated to autoformalization and the creation of verified superintelligence.
Garand Thumb @GarandThumb1
534K Followers 155 Following Retired Military, shooter, survivalist, fitness lover
Ross Ulbricht @RealRossU
527K Followers 0 Following Sentenced to die in prison. Pardoned by President Trump after spending 4,130 days (11+ years) in max security. Freedom is sweet!
Mira @_Mira___Mira_
11K Followers 2K Following
Dan Allison @danallison
8K Followers 3K Following Drawing pictures and building @ibis_coord & @TetraSeattle
OωR)'gyami @T_oru_2ru
318 Followers 673 Following 蛇腹と遊んでます...TOReC @TOrigamiRCircle →いまじろ〜/松ヶ崎のいまじろ〜/きっと、機b1
Kyla Scanlon @kylascan
194K Followers 974 Following All decisions made on the basis of incoming data and the balance of risks | Author of "In This Economy?” | [email protected]
King Randall, I. @NewEmergingKing
213K Followers 2K Following Leader, Teacher, and Guide for The X for Boys. 💪🏿👑 No labels necessary. Discover. 🌍 Email: [email protected]
thebes @voooooogel
15K Followers 900 Following "peaceful, albeit ominous" ꙮ website → https://t.co/aykxqKippW ꙮ games → https://t.co/3Pz19vHOwd ꙮ 💞💍📝 @holotopian ꙮ she/they 🏳️⚧️
Adam Tauman Kalai @adamfungi
2K Followers 86 Following
Gilad @giladturok
1K Followers 3K Following CS phd student @cornell_tech 🐻 | probabilistic ml research 🤖 | novelty seeker 🤠 | Prev: @Uber @FlatironInst @Columbia
Your Friend Andy @OhHaiAndy
81K Followers 391 Following I like magic internet money and passive income.
yuwen lu @yuwen_lu_
3K Followers 3K Following phd candidate @nd_cse, human-ai interfaces, creativity, design | x @apple, @google, @midjourney
Antonis Anastasopoulo... @anas_ant
3K Followers 2K Following Assist. Prof at George Mason CS #nlproc MT, ASR, and documentation of endangered languages.
Tinaᛏᛁᚾᚨ ከ�... @ninja_lt60
3K Followers 605 Following Linguistics and the world's ancient classics Architecture.Ancient tomb structures 𐎢𐎰𐎠𐎵𐎺𐎴𐎡𐎹𐏐𐎺𐏀𐎼𐎣𐏐🏹 ᠮᡳᠨᡳ ᠪᡝᡵᡳ ᡩᡝ ᡠᠯᡳ ᠪᡝ ᡨᡝᠪᡠᡥᡝᠪᡳ🏹ᚠᛁᛗᛁᚱ ᚨ ᛒᛟᚷᚨ🏹
heiner @HeinrichKuttler
19K Followers 1K Following Pretraining @xAI. Previously: @InflectionAI, @AIatMeta, @DeepMind, @Google, @LMU_Muenchen, PhD math-ph. Opinions my own. (Can be yours for a small fee.)
Lance Fortnow @fortnow
6K Followers 370 Following Professor. Complexity Theorist @iitcomputing @[email protected] @lance.fortnow.com
maria @avramidou
373 Followers 427 Following ai evals and consciousness / prev. philosophy @uniofoxford, applied maths & stats @cambridge_uni, physics @ucl
David Atkinson @diatkinson
229 Followers 1K Following PhD student @KhouryCollege. AI interpretability. Previously @EpochAIResearch.
Jack Lindsey @Jack_W_Lindsey
6K Followers 237 Following Neuroscience of AI brains @AnthropicAI. Previously neuroscience of real brains @cu_neurotheory.
Hideaki Sakaguchi @MannequinsJapon
942 Followers 49 Following SENSUAL MODERN COSTUMES designer / pattern maker /杉野学園ドレスメーカー学院特任教授/ 主に日々の制作を 📸https://t.co/FjZ7Rbh7RU
Shai Shalev-Shwartz @shai_s_shwartz
3K Followers 174 Following Computer Science @HebrewU; CTO @Mobileye #selfdrivingcars #ai #machinelearning Opinions are my own.
Yuxi on the Wired @layer07_yuxi
3K Followers 71 Following [email protected]:~$ whoami tech enby (agi/asi pronouns) (math ⊗ physic ⊗ comput).ist
Kenton Murray @kentonmurray
973 Followers 809 Following Natural Language Processing Research Scientist JHU. | PhD from Notre Dame. | Formerly at QCRI, CMU, and Princeton.
isabelle 🪐 @isabelleboemeke
86K Followers 953 Following Building a rad future with nuclear electricity | @isodope
Liv Boeree @Liv_Boeree
267K Followers 564 Following Host of the Win-Win Podcast. Slaying Moloch & Chasing Horizons 🚀 🌳🦾
🇺🇦 Dzmitry Bahd... @DBahdanau
10K Followers 37 Following Team member at something young. Adjunct Prof @ McGill. Member of Mila, Quebec AI Institute. Stream of consciousness is my own.
Agrim Gupta @agrimgupta92
6K Followers 321 Following Simulating reality @GoogleDeepMind | co-created: Veo2, Genie3, WALT | prev PhD @Stanford
Dimitris Papailiopoul... @DimitrisPapail
20K Followers 1K Following Researcher @MSFTResearch, AI Frontiers Lab; Prof @UWMadison (on leave); learning in context; thinking about reasoning; babas of Inez Lily.
Silvi Rouskin @silvirouskin
9K Followers 663 Following Asst. Prof. at Harvard Medical School. #RNA biology#viruses #AI # https://t.co/Ihy7mZhjL5 @harvardmicro ; opinions are my own. https://t.co/9lMkSHvpn9
Rabbit Lovers Communi... @RabbitLoversUSA
22K Followers 1K Following I have always wanted a bunny and I'll always have a rabbit the rest of my life. 🇺🇸🇺🇸 🛍 Rabbit Lovers Shop Here 👇Trends for United States
You might like
