Mario Sieg @_mario_neo_
ML | game engines | compilers | HPC Research Engineer @PrimeIntellect Building my custom pytorch: https://t.co/5PnTE712WQ github.com/MarioSieg Berlin, Germany Joined February 2024-
Tweets106
-
Followers3K
-
Following112
-
Likes2K
Built a new workstation. Zen 5 Threadripper here I come!
my matrix multiplication kernels for magnetron now beat PyTorch's performance on my CPU: Magnetron matmul: 1955.2 GFLOP/s Torch matmul: 1752.3 GFLOP/s check out the kernel code: github.com/MarioSieg/magn… magnetron detects cache sizes and uses state of the art block tuning…
My attempt at creating a creepy "Jarvis like" sci-fi horror AI assisant. Built him a year ago in C++ with raylib for rendering and whisper.cpp for speech recognition. The mouth animation definitely needs some work
magnetron's GPT-2 inference example is working!! one year ago I wrote the first C file to build a small pytorch clone, today LLMs can be implemented by it. Took a lot of hours and work to get everything right and I can't wait to continue with even more advanced models like…
@chrisbarber @GabrielPeterss4 @polynoamial @_jasonwei @_arohan_ @willccbb @finbarrtimbers @jeremyphoward @_xjdr @doomslide @FlintCasey great list, missing (totally unbiased selection): @johannes_hage @samsja19 @MatternJustus @Grad62304977 @jackminong @mike64_t @_mario_neo_
Upcoming features of piquant - our blazingly fast quantization library - int2 quantization - direct quanitization of bf16 tensors - sign quantization - SIMD kernels for stochastic rounding
Sometimes I have random creative "attacks" where I build random stuff. Last time it was techno music generated with pure code, this time it's a small cryptocurrency... It's not about money, it's about exploring, learning and having fun. This approach taught me 99% of what I…
Launching SYNTHETIC-2: our next-gen open reasoning dataset and planetary-scale synthetic data generation run. Powered by our P2P inference stack and DeepSeek-R1-0528, it verifies traces for the hardest RL tasks. Contribute towards AGI via open, permissionless compute.
Our fast quantization library piquant will support 2-bit quantization and new 4-bit kernels for even higher performance on AVX-512 CPUs in the next release. Get ready to crunch those packed integers!
Seems like I've come to a point where my C code crashes a modern LLVM compiler and makes it spit out LLVM IR 🙄
This is not PyTorch. It’s Magnetron - my tiny ML framework with a PyTorch-like API, designed for microcontrollers and IoT. Now supports nn.Module, nn.Linear, nn.Sequential, nn.ModuleList, nn.ModuleDict, and more. The API got very close to PyTorch the last month, more to come!…
To implement a GPT-2 in my custom PyTorch-like ML framework, I added boolean tensors. Boolean tensors are used for filtering, indexing and as attention and loss masks and much more. The main logical operators AND, OR, XOR and NOT are now supported. Another more step towards LLM…
Awesome work by @_mario_neo_ to accelerate quantization of pseudo-gradients in decentralized training settings like DiLoCo - already integrated in pccl (prime collective communication library)
Awesome work by @_mario_neo_ to accelerate quantization of pseudo-gradients in decentralized training settings like DiLoCo - already integrated in pccl (prime collective communication library)
mohit @myaccountgood
0 Followers 11 Following
Abi Aryan @GoAbiAryan
7K Followers 3K Following 🛠️ Founder @AbideAI 👐 ML Engineer 👩💻☕ 📚 Book Author: LLMOps (2025), ✍️ GPU Engg for AI Systems (2026) 💬🐦 Talk to me about LLMs, MLSys & GPU Training
Jeremy Cheng @Jerrawik
11 Followers 6K Following
Men1scus @Men1scus
166 Followers 4K Following Junior@Nankai University | Major in CS | Research in CV, GenAI | Full Stack Developer | Beginner in Crypto | Runner, Cyclist, Gym-goer | Rap enthusiast
viishwavijay @viishwavijay
161 Followers 5K Following This profile is digital library for me - Learn, Save, Share, repost
Enio Fernandes @bob_123456789__
49 Followers 3K Following
ruzz @findwildruzz
16 Followers 133 Following Current Quests: Automate all simple parts of my job with LLMs; 225lbs bench press
!.! @xypyth
46 Followers 4K Following
Alex Cameron @tetsuo_cpp
59 Followers 472 Following Compilers, infosec, systems-programming. Compilers @FabricCrypto. Prev: @trailofbits.
frenlyfren:) @frenlyfrenforu
30 Followers 615 Following gittin ziggy with it | big eeper | SIGSEGV enjoyer | I load my elf under 0x1000 and die 😎
hauryu123 @hauryu123
12 Followers 303 Following
333satoru🦣 @333satoru
250 Followers 7K Following
quivague @quivague
76 Followers 1K Following
sky @skydotcs
8K Followers 953 Following
For the love of Oink ... @CryptO_Oink
123 Followers 2K Following 🚀 Gem Hunter | MemeCoin Maniac 💎 Hunting for 100x opportunities in the wild west of crypto! 🌐 Stay ahead, stay degen. #CryptoGems #MemeCoinMadness
bearonchain.eth @bearonchain
2K Followers 2K Following 🐻 7+ yrs AI × Blockchain dev Building DeepFocus & @bemeos_ curiosity runs me, love writing getting started guides and deep tech reports on web3 and AI products
Drin @dringrayson
199 Followers 4K Following
鬣狗 @hy3na_xyz
2K Followers 2K Following
Rusty Rob @robertkingNZ
450 Followers 2K Following Previously Head of Software at Thred, realtime simulation of factories at scale. Previously @ Meta, co-founder SCR & Perplexico Rusty Rob on Youtube
Ahmad Beirami @abeirami
10K Followers 4K Following sth new // ex Gemini RL+Inference @GoogleDeepMind // Chat AI @Meta // RL Agents @EA // ML+Information Theory @MIT+@Harvard+@GeorgiaTech // زن زندگی آزادی
Yuvraj Singh @YuvrajS9886
2K Followers 523 Following Ex - @turboml, @puch_ai | @iitmadras (left), @iiserkol, @UofMaryland, AIISC | YESIST '24 Finalist | Multimodal LLMs Research| Building SmolHub ☺️, NeatRL
wang @wangzhr4
3K Followers 845 Following I like putting `GNU` in front of `Linux` | HPC Dev | C, Shell, & Cloud | Music
suprememe @_suprememe
47 Followers 813 Following
Ramneet Singh @Ramneet_Singhh
848 Followers 5K Following Research Fellow @MSFTResearch India | Ex RA @gatech_scs, (B. + M.) Tech. CSE IITD | PL, Verification and Theorem Proving | Sports + Music + Food (in that order)
Elep @Cjz9M9tCAYX6vU
14 Followers 111 Following
Juanom21 @Juanom_21
2 Followers 124 Following
Luigi Pagani @Luigi1549898
38 Followers 898 Following
innernull @innernull
42 Followers 968 Following
Jerome Ku @KuJerome
57 Followers 5K Following
Adel Bennaceur @adel_bennaceur
16 Followers 742 Following
Panda Rawat @KarlM70626
0 Followers 9 Following Studying ELECTRONICS trying to learn Coding, AI , finance stuff Just a Rookie in the wild Jungle 😔
Jonas Brecht @Haiku4m
73 Followers 195 Following Alles meine private Meinung. Gym rat 💪 Informatiker 👨💻. Investor 📈 Freiheitlich, liberal, teilweise konservativ, pro kapitalistisch. Pronomen mon/ey.
vitalik.eth @VitalikButerin
5.8M Followers 503 Following I choose balance. First-level balance. mi pinxe lo crino tcati https://t.co/gCQrmCb0ih
Framework @FrameworkPuter
95K Followers 197 Following Remaking consumer electronics to respect people and the planet. 💻🪛 For support visit https://t.co/OcUxJ6ebU3
Rem // Kowloon's Curs... @KowloonsCurse
9K Followers 988 Following Developer of next-generation interactive entertainment experiences born from infinite wisdom. Currently working on Kowloon's Curse.
Jim Keller @jimkxa
43K Followers 153 Following CEO @tenstorrent, Cofounder @atomic_semi @BayaSystems, FlexAI, AheadComputing board member. Fan of 2x2 matrixes, books, refactoring and creative tension
Daniel Lemire @lemire
29K Followers 2K Following Software performance expert. Ranked in the top 2% of scientists globally (Stanford/Elsevier 2024) and among GitHub's top 1000 developers.
HIDEO_KOJIMA @HIDEO_KOJIMA_EN
4.1M Followers 247 Following Game Creator: 70% of my body is made of movies.
János Turánszki @turanszkij
10K Followers 331 Following Developer of Wicked Engine. El. Psy. Kongroo.
Ray @raysan5
15K Followers 2K Following Passionate about gamedev technologies. I create things. Created #raylib, #raygui, #rres and many other tools as @raylibtech. FOSS at: https://t.co/sIUDDNc2tV
Panos Karabelas @panoskarabelas1
4K Followers 594 Following Podcast Host | Creator of Spartan Engine | Explored AMD, Codemasters, Sony
neural oscillator of ... @mycoliza
21K Followers 1K Following wow, everything’s computer at @oxidecomputer
Ioannis Koukourakis @JKoukourakis
899 Followers 176 Following Gameplay Designer/Programmer @AntistaticTeam (Phantom Line). Past: Unannounced, Amnesia: Bunker/Rebirth, Lethe Ep1. Opinions are my own.
Thorsten Ball @thorstenball
35K Followers 961 Following Author of https://t.co/arW0hnVET0 and https://t.co/RN9xXOzhON. @sourcegraph working on @ampcode. Ex-@zeddotdev. Programming where the rubber hits the road.
Mikulas Florek @mikulasflorek
1K Followers 200 Following Programmer Weeks of coding can save you hours of planning.
US-Botschaft Berlin @usbotschaft
30K Followers 662 Following Diplomatische Vertretung der 🇺🇸Vereinigten Staaten von Amerika in Deutschland. Terms of Use: https://t.co/w9CHNzi9D5
Morning Brew ☕️ @MorningBrew
534K Followers 2K Following Everything you need to know about the world of business and the business of the world. ☕️
Ukraine / Украї�... @Ukraine
2.2M Followers 28 Following Yes, this is the official X account of Ukraine. Офіційний акаунт твоєї Неньки.
dr. Jonas Birch @drJonasBirch
3K Followers 8 Following Making low level popular again - 47 000 programmers turned.
Meta @Meta
13.6M Followers 689 Following Connect with what you love to make things happen. It’s Your World.
PyTorch @PyTorch
451K Followers 77 Following Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation
Pavel Durov @durov
2.7M Followers 1 Following Founder, CEO at @telegram (2013), founder, ex-CEO of @vkontakte (2006), part-time troll.
Charlie Callahan @ccallac7
1K Followers 492 Following game engine development - building an open world crafting game - PhD MechE Univ. Colorado (laser sensing) day job = methane detection and mitigation technology
Dmitrii Kovanikov @ChShersh
42K Followers 204 Following Dysfunctional Programming account #1. Senior SWE at Bloomberg. I write C++ for money. ex-Haskell, ex-OCaml. All opinions are my own.
Eskil Steenberg @EskilSteenberg
6K Followers 270 Following C, Game design, Story telling, and progress. Work @quelsolaar https://t.co/xHje5WbRyi
Tom Dörr @tom_doerr
101K Followers 2K Following Follow for posts about GitHub repos, DSPy, and agents Subscribe for top posts DM to share your AI project (Due to volume of DMs I'll prioritize subscribers)
Alexander Yee @Mysticial
1K Followers 96 Following Computers, HPC, and Anime... Author of y-cruncher. https://t.co/rvlTfugM7J
SemiAnalysis @SemiAnalysis_
34K Followers 16 Following
Volodymyr Zelenskyy /... @ZelenskyyUa
8.2M Followers 1 Following President of Ukraine / Президент України
nr.bln @nr_bln
26 Followers 75 Following
OpenAI @OpenAI
4.3M Followers 3 Following OpenAI’s mission is to ensure that artificial general intelligence benefits all of humanity. We’re hiring: https://t.co/dJGr6Lg202
Christian Gilli @nirw4nna
178 Followers 266 Following I like building software | Working on a tensor library from scratch: https://t.co/CPhWN3O8rq | Blog: https://t.co/aoUjpbPpw9
Prince Canuma @Prince_Canuma
7K Followers 1K Following Apple MLX King 🤴🏽• ML Research Engineer👨🏾💻 • VLMs • LLMs • Speaker • Writer • Ex-@arcee_ai • @neptune_ai • https://t.co/iZnxoefJBU
Phoronix @phoronix
61K Followers 119 Following Founded by @MichaelLarabel in 2004, Phoronix is the largest #opensource news, #Linux hardware reviews & Linux PC/server/HPC performance benchmark site.
Olex (Solo gamedev Di... @OlexGameDev
1K Followers 568 Following Game dev making a Diablo-like. Live stream on https://t.co/ChCp2Z6YSF
Infornomics @infornomics
1K Followers 1K Following Data Science, AI & Energy Transition, RSWE economics/ Logic-Weaver, Data-Mancer, Charmer of machines, Wonder-Walker (bestowed by Claude) Goal: emotion spinner
SzymonOzog @SzymonOzog_
2K Followers 151 Following Maximizing throughput at @Aleph__Alpha Educating people about GPUs at https://t.co/81rRJ4KWK1
Elon Musk @elonmusk
225.3M Followers 1K Following
Bryan Johnson @bryan_johnson
646K Followers 759 Following Conquering death will be humanity’s greatest achievement.
Dougall @dougallj
3K Followers 432 Following he/they | mastodon: https://t.co/d5YdiePIr8 / @[email protected]
Leonardo @leonardofed
7K Followers 382 Following Desi@n on the edge @primeintellect, @openprest, @ogcompanyops
logic destroyer @splinedrive
18K Followers 337 Following Software engineer and logic design hobbyist. Since 2021, Building RISC-V SoCs from scratch and hacking xv6/Linux to life, TU Berlin graduatedTrends for United States
You might like
