The narrative around LLMs is that they got better purely by scaling up pretraining *compute*. In reality, they got better by scaling up pretraining *data*, while compute is only a means to the end of cramming more data into the model. Data is the fundamental bottleneck. You can't…
If you use Chrome and have upgraded to macOS Tahoe, disable "experimental prediction for scroll events" at chrome://flags to make it not feel like you just downgraded to a RAM-starved Windows 98 PC.
(Thank you, @jespervega!)
“What I cannot create I do not understand” - This is why I started Penny, my own version of NCCL.
Today I'm releasing a first part of a worklog of creating it. It explains GPU communication and shows progress on coding a fast AllReduce(Inter&Intranode) algorithm using NVSHMEM🧵
Ghostty is such a delight to use. Seeing that little progress indicator popping up in Claude now just makes it feel like we're finally modernizing the terminal for real!
The murder of Iryna Zarutska on a North Carolina train should force America's urbanists to confront an unpleasant truth: Without public order and safety, Americans will NOT embrace transit-centric cities.
noahpinion.blog/p/good-cities-…
Canada’s government is getting back into the business of building affordable homes.
We’re going to build at a pace not seen since the Second World War — using the latest technology to build faster, smarter, and more sustainably.
I tutor my own kids a lot so I can learn to build Synthesis tutor. The two biggest mistakes I make:
1. Throw too much at them at once. Almost always because I don’t realize how much knowledge is embedded in the concept I’m trying to teach. I think I’m teaching one thing, but…
we bought all these singapore math books before our kid was born
for some reason we thought the series started at 6 years old, he's 4 and it's clear we should've started at 3
he blew through the first two workbooks in two days
and i've done a 180 on the power of worksheets
Amid the noise and fury of the fall of Britain, this. Almost unnoticed. Far more significant.
Joel is a friend, and a very smart man, but not a storyteller.
Lemme help out.
What, you ask is a "capture bag", and why should you care?
A capture bag is a butterfly net for…
Amid the noise and fury of the fall of Britain, this. Almost unnoticed. Far more significant.
Joel is a friend, and a very smart man, but not a storyteller.
Lemme help out.
What, you ask is a "capture bag", and why should you care?
A capture bag is a butterfly net for…
Last night, Russia launched another brutal attack on Kyiv that deliberately targeted civilians and killed more than a dozen people, including children. By murdering when he should be talking, Putin demonstrates in the most horrific manner that his mission to subsume the Ukrainian…
When a model gives you the right answer to a reasoning question, you can't tell whether it was via memorization or via reasoning.
A simple way to tell between the two is to tweak your question in a way that 1. changes the answer, 2. requires some reasoning to adapt to the…
Unexpectedly, one of the subjects of our investigations, Tim Stigal - core former member of GRU Unit 29155's hacking team - speaks to the press and admits nearly everything we disclosed here: theins.ru/en/inv/281731
The debate around whether every pixel in a photo from your phone's camera is "real" misses a fundamental fact about how digital cameras have always worked for the last 20 years. The camera sensor only captures ONE color (red, green, or blue) per pixel. The rest are made up
1/4
Canada’s new government will soon launch the major projects office to streamline the approval of highways, ports, energy corridors, and other nation-building infrastructure.
It’s time to build big, build bold, and build now.
145 Followers 6K FollowingTesla | Building the future of sustainable transport | Working with Elon Musk to accelerate the world’s shift to clean energy ⚡
12K Followers 13 FollowingHi👋 We're Flow, an AI filmmaking tool from Google, powered by Veo. Follow along for product news and creative tips to bring your cinematic stories to life.
80K Followers 1 FollowingDemocratizing AI research, education, and technologies. Learn how to build with AI in our new AI Academy: https://t.co/zQXQt0Pem8
429K Followers 2K FollowingI am a technology enthusiast, writer, and modder. Founder of @ModRetro, @Oculus VR, and @Anduriltech. Keeping American superheroes safe with autonomous systems.
5K Followers 139 FollowingDad. SWE and Design Director at a US Fintech. Startup consultant and mentor. Neuroscience enthusiast. Avid reader. Speak 4 languages. e/acc
47K Followers 111 FollowingMy new LM book: https://t.co/YXNQUy7O3t
PhD in AI, author of 📖 The Hundred-Page Language Models Book and 📖 The Hundred-Page Machine Learning Book
565K Followers 137 FollowingFather of three, Creator of Ruby on Rails + Omarchy, Co-owner & CTO of 37signals, Shopify director, NYT best-selling author, and Le Mans 24h class-winner.
80K Followers 3K FollowingFounder and CEO of Viahart, a consumer products company. Founder and former CEO of Edison, a legal tech company. Doer of many things.
609K Followers 5K FollowingPresident & CEO @ycombinator —Founder @Initialized—designer/engineer who helps founders—San Francisco Dem accelerating the boom loop—e/acc—technology brother
376K Followers 1K FollowingInternational man of history, Flying Scotsman. Author, @HooverInst senior fellow, @TheFP and @thetimes columnist. Opinions my own.
3K Followers 308 FollowingМуж, отец, живу на Пхукете, пишу про frontend, архитектуру, AI и petы.
И вообще: Когда мы делимся — мы умножаемся
Поддержку репостами
226K Followers 38 FollowingThe Gemini app turns research into reality, bringing frontier AI experiences like Veo 3, Deep Think, Nano Banana and more to hundreds of millions of people.
255K Followers 568 Followingnew book *Talent: How to Identify Energizers, Winners, and Creatives Around the World*, https://t.co/7bU5cUdOBc, Conversations with Tyler, Bloomberg Opinion.
34K Followers 246 FollowingStanford student learning without teachers. Writing about education & how to help your kid thrive. I tell you what your kid thinks so you don't have to guess.
37K Followers 174 FollowingYes, I *am* that ESR. Well, it's the question people usually ask.
Programmer, wandering philosopher, accidental anthropologist, troublemaker for liberty.
373K Followers 3K FollowingCosmologist, pilot, author, connoisseur of cosmic catastrophes. She/her. Dr. Personal account; not representing employer or anyone else.
35K Followers 638 FollowingMLST is by Dr. Tim Scarfe @ecsquendor w/ cameos from @DoctorDuggar https://t.co/5YCv2SdFwN (early access/priv.discord) - Sponsor us!
3K Followers 482 FollowingResearch Scientist GenAI NY @AIatMeta working on video generation (Meta Movie Gen) | PhD @Oxford_VGG with Andrew Zisserman, Previously @oxengsci
94K Followers 500 FollowingDistinguished Scientist at Google. Computational Imaging, Machine Learning, and Vision. Tweets = personal opinions. May change or disappear over time.