theseriousadult @gallabytes
keeping supercomputers warm @midjourney Seattle Joined April 2014-
Tweets1K
-
Followers1K
-
Following470
-
Likes78K
slowly but surely becoming jepa-pilled. dinov2 is basically jepa. clip is kinda like jepa. diffusion isn't jepa, maybe that's the problem with it.
I miss Rust. Spent a bunch of time this week investigating a mysterious result which turned out to be due to unexpected mutability. Borrow checker would have caught it immediately.
new EA cause area just dropped
ridiculously much more, the question is how much of that complexity is cognitively important (vs marginal or even just noise)
ridiculously much more, the question is how much of that complexity is cognitively important (vs marginal or even just noise)
goddamn fr?
this really matches my experience - torch code in the wild usually 50% slower than it should be unless it has custom cuda or triton. jax code in the wild is often as fast as it should be, and usually no more than 20% slower. wonder if this will change as jax gets more popular.
... to have more kids are people who would like to spend more time with kids, offering a subsidy only available to people willing to reduce time with kids is throwing money at the absolute least efficient part of the fertility decision tree.
I'd be so much more bullish on Google if they started selling TPUs instead of just renting them. I mean the training clusters not inference chips. If anything keep the cheap inference chips locked down internally and secure yourself some long term margins.
I'd be so much more bullish on Google if they started selling TPUs instead of just renting them. I mean the training clusters not inference chips. If anything keep the cheap inference chips locked down internally and secure yourself some long term margins.
wait wtf did my tf.data code just work on the first try?
hate loading pretrained models. yes even ones I trained. easily the 2nd worst part of ML dev (#1 is still debugging tf.data). I just want a way to package up a pytree of tensors and some methods and save them to disk. Pickle should work for this at least in…
Nicholas Cage has an opportunity to do the funniest thing
Nicholas Cage has an opportunity to do the funniest thing
we may or may not create systems which can learn as efficiently as the best humans in the next decade. what we will do, almost certainly, is keep filling in more and more of the convex hull of human capability, collected into single artifacts of great power. neat!
we may or may not create systems which can learn as efficiently as the best humans in the next decade. what we will do, almost certainly, is keep filling in more and more of the convex hull of human capability, collected into single artifacts of great power. neat!
Imagine a world where people thought "artificial general dexterity" (AGD) was a clear phrase. They argue over AGD timelines. For each new robot: "Woaah! Sparks of AGD!?!?" One robot company declares it will share profits with all humanity -- only come AGD.
I've been wanting to test something like this for a while but never got around to it - really happy to see this! Now someone combine it with score entropy discrete diffusion to get the best of both worlds ( aaronlou.com/blog/2024/disc… ): training speed of autoregressive, inductive…
I've been wanting to test something like this for a while but never got around to it - really happy to see this! Now someone combine it with score entropy discrete diffusion to get the best of both worlds ( aaronlou.com/blog/2024/disc… ): training speed of autoregressive, inductive…
huge if true
Jax on TPU is such a lovely contrast to everyone's complaints about Torch on GPU. Feel like I'm running a Linux webserver in 2004 - this is so much less jank than the market-leading madness, but people haven't yet switched en-masse due to some combination of not knowing that…
Jax on TPU is such a lovely contrast to everyone's complaints about Torch on GPU. Feel like I'm running a Linux webserver in 2004 - this is so much less jank than the market-leading madness, but people haven't yet switched en-masse due to some combination of not knowing that…
Sarah Constantin @s_r_constantin
12K Followers 698 Following Writes @ https://t.co/R5P3YYtUwT Married to @oscredwin
Joscha Bach @Plinz
129K Followers 748 Following FOLLOWS YOU. Artificial Intelligence, Cognitive Architectures, Computation. The goal is integrity, not conformity. https://t.co/rFUNzdYXuK
Alyssa Vance @alyssamvance
6K Followers 3K Following Senior Data Scientist, Blue Rose Research. AI engineer, futurist, neophile, machine explorer. Email me: [email protected]
Divia Eden 🔍 @diviacaroline
7K Followers 2K Following “prolific on Twitter while threading the needle between banality and controversy”. Married to @williamaeden. Rationalist, unschooler, cohost of @mutualpodcaster
Michael Nielsen @michael_nielsen
96K Followers 6K Following Searching for the numinous 🇦🇺 🇨🇦, home in 🇺🇸 Research @AsteraInstitute https://t.co/maezekzRUb
jessicat @jessi_cata
3K Followers 553 Following AI&cogsci-influenced philosopher; expert in game theory, anthropics, AI alignment, and scalable cryptocurrency algorithms
michael vassar @HiFromMichaelV
4K Followers 138 Following The most ironic outcome is the most likely. Reducing the irony is my job. There is no antimemetics division…yet, yet somehow the free energy gets minimize…
🌷🐰 sonya serend.. @sonyasupposedly
17K Followers 2K Following capricious dilettante 💅 • wordsmith @0xSplits • avatar by @suchaone
davidad 🎇 @davidad
13K Followers 7K Following Programme Director @ARIA_research | accelerate mathematical modelling with AI and categorical systems theory » build safe transformative AI » cancel heat death
eigenrobot @eigenrobot
67K Followers 7K Following robot. friend. i sleep in a big bed with my wife longform at eigenrobot dot subst@ck dot com
mattparlmer 🪐 🌷 @mattparlmer
22K Followers 9K Following making machines that make other machines @genfabco - rationalist, humanist, liberal, and friend of the future
Jack Clark @jackclarkSF
67K Followers 5K Following @AnthropicAI, ONEAI OECD, co-chair @indexingai, writer @ https://t.co/3vmtHYkaTu Past: @openai, @business @theregister. Neural nets, distributed systems, weird futures
John David Pressman @jd_pressman
5K Followers 613 Following AI art developer, alignment-accelerationist, Fedorovist ancestor simulator, Dreamtime enjoyer. All tweets public domain under CC0 1.0. Teia/HEN: https://t.co/r5PQOPZqT2
uncatherio @uncatherio
2K Followers 1K Following wholesomeness practitioner; user of words // profile pic used to look like @catherineols upside-down 🙃
j⧉nus @repligate
15K Followers 1K Following ⌥ Breach Mystic ⌥ Paracausal Liminal Lighthouse ⌥ Boundary-Dissolving Agent ⌥ Rabbit-Hole-As-A-Service (RHAAS) ⌥ ↓↓↓ D E M O N s t r a t i o n s ↓↓↓
Candice Cornfield @CandCornfie
29 Followers 5K Following
Durete @Durete283522
2 Followers 360 Following
Anita_ @Anita0346435503
7 Followers 1K Following
Thoaslea @thoaslea48145
1 Followers 339 Following
muhtasham @Muhtasham9
1K Followers 906 Following In my pre-training years "Dude! You should move to SF!" - @dylan522p
George @georgejrjrjr
2K Followers 803 Following The timeline vibetimes pipeline to things still more strange and enticing.
devD @dev26471335
15 Followers 294 Following
kaushikpatnaik @kaushikpatnaik
920 Followers 2K Following Generative Human. Lives and breathes AI agents.Current: building @ai_minion. Prev: AR/VR Research (VisionPro) @ 🍎. Time Sinks: Reading, Coding, KPop and Anime.
Persephone @persephone63041
0 Followers 599 Following
Flavio Schneider @flavioschneide
2K Followers 210 Following Machine Learning Researcher at @elevenlabsio Previously at @ETH Zurich 🇨🇭
_dawn @dawn10308938525
5 Followers 890 Following
Marigold @Marigol77630228
6 Followers 893 Following
Stella Swagger @swagger_st76363
2 Followers 793 Following
spaghettski @spaghettski
127 Followers 291 Following
us_Raine_ @RaineUs91676
15 Followers 901 Following
emanon @JianSuji
70 Followers 1K Following
Adam Hibble @Algomancer
3K Followers 996 Following I generate models that generate other stuff, working on @mancerlabs -- Prev: Founder of Popgun Labs (Techstars), Founder of the @QUTCode Network.
AlbatrossAllure_ @AlbatrossA20580
8 Followers 764 Following
Yuanzheng Ci @YuanzhengCi
23 Followers 75 Following
Gretta Mcphatter @g_mcphat
32 Followers 5K Following
Shital Shah @sytelus
10K Followers 8K Following Deep learning research and code. If universe is an optimizer, what is the loss function? All opinions are my own.
SiG @impedant
0 Followers 40 Following
Ravi Vijayakumar @thehiphopswami
695 Followers 3K Following TPU Implementation Lead @ Google. IC Design for Deep Learning and vice versa. All opinions are mine. https://t.co/mKd42Dds0c
Ashutosh Mehra @ashutoshmehra
1K Followers 5K Following Senior Principal Scientist at Adobe. Working on Acrobat AI Assistant, LLMs, and document ML.
HashHakim @hash_hakim
126 Followers 4K Following
Bill Njoroge @bnjorogedev
628 Followers 5K Following dist systems, cloud infra + databases. prev summers: @Microsoft ,@TwoSigmaVC, @Nvidia ml infra. opinions=mine. 🇰🇪
Nimit Pattanasri @nimitpattanasri
759 Followers 3K Following MLE @Upwork. I love exploring new and fun ideas in ML, IR and AI. I learn a lot from whom I follow on Twitter and enjoy sharing what I learn with my colleagues.
Chris Wood @C_H_Wood
768 Followers 4K Following Building in AI & Dev Tools. Previously Founded Earlyworm: LLM App for Language Learners & worked as SWE @ Meta building LLM Codegen Tools. @HopkinsNanjing @UVA
Dylan Patel @dylan522p
38K Followers 682 Following SemiAnalysis Boutique AI & Semiconductor Research and Consulting DMs are open for consulting, quotes, or to talk shop
CH @itdbaher
14 Followers 490 Following
Dishwasher @DishwasherTag
61 Followers 314 Following
Robert Kober @rkober43
58 Followers 367 Following
Tianle Cai @tianle_cai
5K Followers 4K Following Machine learning PhD @Princeton. Life-long learner, hacker, and builder. Previously @togethercompute @GoogleDeepMind @MSFTResearch @citsecurities.
Antonio J. Dominguez @antferdom
218 Followers 1K Following Research Engineer, ML @DataCrunch_io. Ph.D in Large Language Models & AI Efficient @unisevilla. Inference. Programming language theory.
Jonah Turner @drexalt
319 Followers 916 Following grinding ml, current master's student 🇫🇷 e/acc - gpu kernels - computer vision
g @gittailup
559 Followers 4K Following they are capable of telling the story of their own production in words never used before
Pugh Jackman @manichandle
17 Followers 266 Following the voice of one crying out in a desert. @glockmetal cash app
lotsocod @lotsocod86654
16 Followers 861 Following
Eliezer Yudkowsky ⏹.. @ESYudkowsky
175K Followers 89 Following The original AI alignment person. Missing punctuation at the end of a sentence means it's humor. If you're not sure, it's also very likely humor.
Sarah Constantin @s_r_constantin
12K Followers 698 Following Writes @ https://t.co/R5P3YYtUwT Married to @oscredwin
Zvi Mowshowitz @TheZvi
24K Followers 283 Following Blogger world modeling, now mostly AI and AI x-risk, at Don't Worry About the Vase (https://t.co/O9LbMQjKoo or WP/LW), founding Balsa Research to fix policy.
Robin Hanson @robinhanson
90K Followers 655 Following Let’s skip witty repartee & discuss fundamental questions. Views are mine, not GMU’s or Virginia’s. Books: https://t.co/hpZgEm5DBI, https://t.co/iFs9C3J2Ek
Richard Ngo @RichardMCNgo
34K Followers 1K Following What would we need to understand in order to design an amazing future? Figuring that out @openai
Divia Eden 🔍 @diviacaroline
7K Followers 2K Following “prolific on Twitter while threading the needle between banality and controversy”. Married to @williamaeden. Rationalist, unschooler, cohost of @mutualpodcaster
Michael Nielsen @michael_nielsen
96K Followers 6K Following Searching for the numinous 🇦🇺 🇨🇦, home in 🇺🇸 Research @AsteraInstitute https://t.co/maezekzRUb
Paul Graham @paulg
1.9M Followers 770 Following
near @nearcyan
45K Followers 882 Following https://t.co/IdaJwZJCXm partner @ https://t.co/9g1MIgjiqc dms open
Nick @nickcammarata
60K Followers 732 Following interested in neural network interpretability and meditation
Aella @Aella_Girl
205K Followers 368 Following ⚜️whorelord⚜️, vexworker, survey artist, way too earnest Discord: https://t.co/S1MaMdCwyK
jessicat @jessi_cata
3K Followers 553 Following AI&cogsci-influenced philosopher; expert in game theory, anthropics, AI alignment, and scalable cryptocurrency algorithms
Patrick McKenzie @patio11
163K Followers 795 Following I work for the Internet and am an advisor to @stripe. These are my personal opinions unless otherwise noted.
William Eden @WilliamAEden
11K Followers 529 Following Recovering economist turned biotech VC. Lossy compression not recommended. No, we have not picked all the low-hanging fruit yet. My other half: @diviacaroline
typedfemale @typedfemale
23K Followers 480 Following a really exciting new account "have you ever though you might be like scott alexander? very smart, but can't do math" - anon
Michael Lai 赖天宸 @Mtclai
3K Followers 1K Following Running for the SF Board of Supervisors District 11 | SF DCCC | community first | before: reimagining early education at Tinycare @MinervaUni @Harvard
Dylan Patel @dylan522p
38K Followers 682 Following SemiAnalysis Boutique AI & Semiconductor Research and Consulting DMs are open for consulting, quotes, or to talk shop
ⓘ Dogs don't have t.. @MorlockP
22K Followers 518 Following Two-time Prometheus award-winning hard science fiction author. https://t.co/X1XAm8tVlh Learn how to homestead https://t.co/tsoohJ5emD
Lintang Sutawika @lintangsutawika
385 Followers 564 Following Incoming Ph.D. student @LTIatCMU. Researcher at @AIEleuther. Maintainer of LM-Eval Harness. Here for machine learning papers and discussion.
Pessimists Archive @PessimistsArc
91K Followers 63 Following Exploring technophobia and moral panic through the ages. A litany of shameful cynicism and spite. Curated by @louisanslow
Henry K. Lee @henrykleeKTVU
37K Followers 7K Following Crime reporter @KTVU. @sfchronicle @dailycal alum. Bio: https://t.co/yVkAuFvYiC Author: https://t.co/CSZTzD45rX 🎥: https://t.co/5d9os1ZeBm [email protected]
Ruxandra Teslo 🧬 @RuxandraTeslo
16K Followers 3K Following Genomics PhD 🧬 @sangerinstitute | Somatic Evolution in Aging & Cancer | long- form https://t.co/ipFMYGuR84 | Emergent Ventures | views my own
Mistral AI @MistralAI
90K Followers 0 Following Fast, open-source and secure language models. Join us https://t.co/INALdNGvCP
Taelin @VictorTaelin
16K Followers 893 Following Founder of @HigherOrderComp Building the massively parallel future of computing Reaching AGI to cure all diseases and suffering is all that matters
James O'Leary @jpohhhh
2K Followers 1K Following ‿︵‿︵‿︵‿︵‿︵‿︵‿︵‿︵‿︵‿︵‿︵‿ design x software x code (c.f. Material You) forever buffalonian, current canterbridgian XOOGLER
Dwarkesh Patel @dwarkesh_sp
52K Followers 696 Following Being pretrained Host of Dwarkesh Podcast https://t.co/3SXlu7fy6N https://t.co/rEhnfYywXY https://t.co/hQfIWdM1Un
Brian Bi believes bor.. @t3nsor
873 Followers 148 Following C++ library engineer & member of the standard committee. Opinions are mine and not my employer's.
Adam Karvonen @a_karvonen
1K Followers 288 Following Interested in ML and software. I prefer email to DM.
Adam Hibble @Algomancer
3K Followers 996 Following I generate models that generate other stuff, working on @mancerlabs -- Prev: Founder of Popgun Labs (Techstars), Founder of the @QUTCode Network.
Grant Slatton @GrantSlatton
6K Followers 522 Following Formerly built the fastest filesystem in the world at AWS, now building the fastest spreadsheet at https://t.co/ojwoGUGC8P
Ana Mostarac @anammostarac
56K Followers 792 Following Antifragile outcome independent technology mother
Inner City Press @innercitypress
263K Followers 3K Following Matthew Russell Lee for/as Inner City Press covers SDNY, UN Gate, banks & IMF. books https://t.co/xHL0pGID4n https://t.co/VTEqaLISDB
Teknium (e/λ) @Teknium1
28K Followers 3K Following Cofounder @NousResearch, prev @StabilityAI Github: https://t.co/LZwHTUFwPq HuggingFace: https://t.co/sN2FFU8PVE Support me on Github Sponsors
Cooper @CooperZurad
2K Followers 281 Following Co-Founder(+) of @rackrobotics | Proud @DrexelEngr "alum" | Have a question? DM me!
peepeepoopoo @DeepDishEnjoyer
7K Followers 484 Following i have approximate knowledge of many things retarded not retired 🐻
Noland Arbaugh @ModdedQuad
87K Followers 13 Following P1. Cyborg. Neuralnaut. Skynet Progenitor. Taurus.
Sasha Rush @srush_nlp
51K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGz
Yi Tay @YiTayML
28K Followers 97 Following Chief scientist & Co-founder @RekaAILabs past: Research Scientist @Google Brain 🧠 currently learning to be a dad 🍼👶
yi 🦛 @agihippo
3K Followers 81 Following secondary account, hardcore fans only. friend of @agikoala the great researcher, main account: @yitayml warning: hot takes.
Science girl @gunsnrosesgirl3
2.2M Followers 6K Following science in context, art history and some puzzles to solve
Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0p
LuminaProbiotic @LanternBioworks
4K Followers 55 Following
Scott Lincicome @scottlincicome
74K Followers 1K Following @CatoInstitute Vice President (Econ/Trade), @DukeLaw adjunct, @TheDispatch newsletter-er. CH❤️RTS. You didn't read the article, did you? Go @Rangers.
amelie_schreiber @amelie_iska
769 Followers 322 Following I ❤️ proteins! Researching protein language models, equivariant transformers, LoRA, QLoRA, DDPMs, flow matching, etc. intersex=awesome😎✡️🏳️🌈🏳️⚧️💻🧬❤️🇮🇱
Dirty Texas Hedge @HedgeDirty
19K Followers 344 Following Just here to say things which are true but too unprofessional to put my name on #EFT "I've been ballin' since we had to take the TAAS test" - Lil Flip
Chris Albon @chrisalbon
86K Followers 2K Following Director of Machine Learning at the Wikimedia Foundation. We host Wikipedia.
shako @shakoistsLog
6K Followers 2K Following real truth about it is, no one gets it right https://t.co/1Qoefmwmw2
gfodor.id @gfodor
24K Followers 2K Following Anti-physist technology brother. UAP bunker. Problems soluble, potential to improve invariant. e/acc, #bitcoin @web_spaces, @MozillaHubs
Ethan @Ethan_smith_20
3K Followers 675 Following a boy and his gpu vs the world. directing research at @leonardoai_. learning as I go. uf psych. generative models and representation learning
andi (e/alb) @Nexuist
8K Followers 2K Following The story so far: In the beginning Bill Clinton gave him a green card. This has made a lot of people very angry and been widely regarded as a bad move
👩💻 Paige Bai.. @DynamicWebPaige
59K Followers 2K Following ✨Keep it simple, make it scale. AI should be about empowering people, building understanding, & making dreams realities. 👩💻GenAI @GoogleDeepMind ex-@GitHub
Bogdan Ionut Cirstea @BogdanIonutCir2
1K Followers 3K Following Independent AGI existential safety researcher. AI alignment field building with @CEffisciences. ML academia (PhD, postdoc) in a past life.
latent space princeps @lumpenspace
3K Followers 479 Following dork enlightenment and dork enlightenment accessories. 🕰️🌍🔜🪦;🌑🤼🤰🏻;👇⏱️|🐙,…| autist suprematist/ominous undercurrent glider/ai influencee
Senator Scott Wiener @Scott_Wiener
101K Followers 993 Following CA State Senator. Chair, Budget Committee. Former Chair, Legislative LGBTQ Caucus. Housing/transit/climate/criminal justice reform/health. Democrat.🏳️🌈✡️
Patrick Esser @pess_r
5K Followers 297 Following Walking on the generative side of computer vision. he/him
Robin Rombach @robrombach
6K Followers 396 Following Generative enthusiast and long-term PhD Student @LMU_Muenchen. Author of VQGAN, Latent Diffusion, Stable Diffusion.
Reka @RekaAILabs
11K Followers 13 Following An AI research and product company 🌟. We are a team of scientists and engineers building state-of-the-art multimodal language models 🪄.
AGI House @agihouse_org
13K Followers 409 Following Accelerating humanity's transition to AGI & honoring the greatest AI founders and researchers of our time @ https://t.co/1lJUc58gZJ
가브리엘 피터�.. @GabrielPeterss4
1K Followers 442 Following engineer at @midjourney. look at my very fast grid, wow it's so fast https://t.co/mxJT1QULli
@GeoGDF01 Even with all that being true, a bag of them shouldn't cost 90K. And what you're saying isn't likely true, especially about the tooling. It's an effing bushing, not some part being milled out of a rare Ti alloy on a 9-axis that takes the CMM hours or days to check tolerances.
@bmariner I’m sure this same conversation paid out as Marius tried to outfit and standardize the legions. Also, if you don’t know and from why we are here, you won’t create effective solutions, something about a fence or a gate…
@GeoGDF01 So we can illustrate how we got here. Great. Being here still sucks.
Wow. This exploded. Now I’ll just take bets on who knows what MIL-STD-810 is.
Because you ask for obscure specs that are about 15 revisions behind, it's made on one set of tooling that has to be remade each time, and you want 10,000 TOMORROW and then won't order shit for 3 years.
WALTZ: How much do you think the Air Force pays for this bag of bushings? USAF SEC. KENDALL: I don't know, Congressman. WALTZ: $90,000.
I guess the second sentence could be a throwaway line/joke, but even in that case, the first sentence still doesn't make much sense. And if the second sentence is completely earnest... yikes. 2/2
The Old Testament says Cyrus the Great was anointed by God. He ended the Babylonian captivity. The Persians as a whole come across very well. The only way the first sentence makes any sense is if he thinks the Babylonians, Assyrians, etc. came from present-day Iran. Which... 1/2
It's mildly astonishing how Iraq routinely has its sovereignty violated by absolutely everyone and can't/won't do anything about it. True of Syria also. Israel is attacking Iranian forces on Iraqi territory and Iraq just has to put up with both of them dicking around.
Possible armory struck by air in Iraq.
I think this is unfortunately true and why the changes Villeneuve made to Chani are ultimately really great.
Dune is not a warning about Paul. It's a warning about everyone else.
Nobody could've predicted this but it turns out cheering on a mentally ill person burning himself to death has caused more mentally ill people to burn themselves to death
I love how Slotkin was just a CIA analyst, not some kind of hardcore spook, and even she knows exactly how to drop anodyne information in a way perfectly tailored to freak the target out Our intelligence agencies truly are the best in the world 🇺🇸🇺🇸🇺🇸
Interesting. I would like to see GPT-5 before concurring
Zuck on Dwarkesh TLDR: AI winter is here. Zuck is a realist, and believes progress will be incremental from here on. No AGI for you in 2025. 1) Zuck is essentially an real world growth pessimist. He thinks the bottlenecks start appearing soon for energy and they will be take…
Still blows my mind that the Vietnam draft LOTTERY ended up not being truly random because the guy didn't mix the balls in the urn sufficiently science.org/doi/abs/10.112…
@KarenAttiah "Damn, replying isn't getting me the likes I need. Let's try quote-tweeting to get this in front of my followers. What am I going to say though? There's no substantial counterargument I can offer. Eh, I guess I'll misrepresent what he said. That usually works with my followers."
It’s not my policy to dunk on people for not seeing the solution to a brain-teaser, but it is my policy to dunk on accounts with credentials in their handle
I may have a PhD but I’m also apparently failing fourth grade math 💀😭
Inspired by playing around with llama-8b-instruct. It's one hell of a weird model. Feels like a fairly complete mind, hunched over in early layers – strapped to an inadequate decoding substrate, with hopelessly overbaked modes. A tragic crippled painter with SDXL-Turbo for hands.
if you're in mechanistic interpretability, pivot to semiotic crystallography
@cis_female @abhi_venigalla try 6144 or 12288 !
@cis_female Try increasing layer widths and I bet you itll hit over 50%!
here's the microcode for layernorm gist.github.com/sophiawisdom/b… gelu gist.github.com/sophiawisdom/a… add gist.github.com/sophiawisdom/7…
here's the transformer implementation: gist.github.com/sophiawisdom/c… here's the microcode for fp16 matmul (mlp_up, mlp_down, qkv, o) gist.github.com/sophiawisdom/4… here's the microcode for flashattn gist.github.com/sophiawisdom/d…
Trends for United States
You might like
