Yann LeCun's latest talk at ETH Zürich
"You should not work on LLM. At least if you're in academia, you should absolutely not work on LLMs. There is nothing you can bring to the table.
If you're interested in making real progress in AI, in sort of grounded AI for the real world, if you want physical AI, don't work on LLMs, and don't work on generative models either.
So, as you can probably guess, this does not make me very popular in Silicon Valley."
----
From "Perfology Clips" YouTube channel, (link in comment)
The foundations of physics are ultimately mathematical, the foundation of math are ultimately computational, and the foundations of computation are ultimately physical.
Following the excellent Stanford Autonomous Organizations Summit a few months ago, Scaling Trust is co-hosting a follow-up event with AO Commons -- the London AO Summit -- on Nov 5th and 6th. Join us!
aocommons.org/london-ao-summ…
Been refreshing my understanding of Bayesian Neural Networks recently
I love them conceptually - they learn a probability distribution over their weights rather than learning a single static set of frozen weights (thats the case for most neural nets).
Basically you can generate multiple variants of the same neural network by sampling from these weight distributions. And you can use these variations to estimate of how uncertain the model is given a prediction.
IE the uncertainty of a prediction is measured by sampling the weights multiple times and seeing how much outputs change with each set of weights.
This illustration is from: cs.ox.ac.uk/people/yarin.g…
We raised $3.6M to do something slightly insane: map the beliefs of the world.
How? A surprisingly simple, fun social game about how well you can read the room.
Chomp V1 had 50K users share 2M answers.
Now it’s time to stop gatekeeping the fun and let everyone Chomp 🧵
We built recursive meta-intelligence, an AI that creates its own scientific instruments, turns them into persistent worlds that an agent ecology with hundreds of AIs inhabits, and uses those worlds to discover mechanistic principles in one of the hardest classes of physical problems: how complex hierarchical materials (nested structures of matter that give rise to new function through organization) evolve and fail. The AI reasons across enormous spaces of possible physical trajectories, where every rupture changes what can happen next, and compresses those histories into principles (which humans can understand and design with) - complex chains of causal events, highly nonlinear, and intricate.
Scientific superintelligence is tangible here - machine-scale exploration opening cognitive channels into complexity that has been extremely difficult for humans to traverse directly. AI builds the spaces in which its next level of reasoning becomes possible; a representation becomes an instrument, the instrument becomes an executable world, and that world becomes the substrate for further intelligence. Intelligence then grows by constructing new spaces to think in.
The task we explored started from a seemingly simple prompt to explore a biological material system - the AI then chose the representation, mechanics and experiments, built a fracture laboratory to push materials to their limit, tested hypotheses and generated scientific conclusions. The swarm explored a combinatorial universe in which architecture controls function and every rupture changes the future state of the material.
The AI discovered a compact principle that defines how multiscale material architecture can program the evolution of failure. Material placement and geometric order determine how forces redistribute, whether damage cascades or remains distributed, and whether function survives substantial flaws. For this discovery to happen the AI had to reason across long path-dependent histories, simulate alternative futures and compress them into generative invariants (model-based causal reasoning, counterfactual simulation and temporal abstraction applied to an evolving physical world). It is incredible to witness this transition to a new form of intelligence and capability through scaling swarms.
A lot of positive will come out of this because it expands the human epistemic horizon as AI can traverse thousands of possible histories and return mechanisms compact enough for us to understand, test and build from. Intelligence compounds through its artifacts!
A few lessons we learned:
▶️ Learning and discovery are flows through spaces of possibility. Early work has shown how backpropagation flows through parameters, reinforcement learning through action and consequence, and autonomous swarms through representations, instruments and executable worlds, bringing it all together. Flows create structure; structure redirects future flows in the recursive instrument.
▶️ Nonlinear physics actually defines a larger principle, where high-dimensional dynamics generate stable invariants; invariants become effective variables; those variables become the substrate for a new level of cognition.
▶️ Recursion then becomes level creation - one possibility space compresses into a principle, and that principle opens a larger space above it.
AI for science is one of the greatest positive forces we have, and I cannot think of anything more human than to understand nature and to use the power to create new technologies that improve our lives, civilization and allow us to reach beyond. x.com/i/article/2099…
the fastest inference is no inference. instead of building the final thing, try to build a parametric space that could generate all the possibilities. then move through that space, at zero inference, to locate what you want.
code itself is free and instant. don't we dare to forget that.
Today we’re releasing Adam and Eve, the most human-like AI voices ever built.
Adam ranks #1 among AI models on @DesignArena’s AudioRealismBench.
We believe we’ve crossed the uncanny valley. API access on our Website!
Listen: freyavoice.ai
Leaderboard: designarena.ai/leaderboard/au…
Special thanks to @alpsencerozturk, @ahmeterdempmk, and the entire Freya team for making this possible.
We’re just getting started. Join us!
253 Followers 141 FollowingA coin for the everyday person. The blue collars that keep this country up and running. Find us on https://t.co/XEZzxXe4cr $TDT
13 Followers 94 FollowingFounder building PAI | Programmable agreements tied to payments | TypeScript/Node.js, React, Solidity, Stellar/Soroban | Istanbul | Open to engineering roles
1K Followers 2K FollowingUna cooperativa hispana de innovación y aprendizaje web3. Impulsamos proyectos abiertos, eventos y oportunidades en distintos ecosistemas blockchain 🤝🌎
1K Followers 913 FollowingAll things #WordPress, dogs, the outdoors, craft beer, and bourbon. Find me @ https://t.co/atMVMecvmt, https://t.co/gO0bjfzYx3 and https://t.co/5s7MaB6AgO.
48K Followers 23 FollowingCo-founder and CEO @lanyon_ai, making the universe computable.
Part-time math/physics research @Princeton
Previously @Cambridge_Uni @WolframResearch
4K Followers 25 FollowingAn engineering physicist sometimes masquerading as a biologist or, on one occasion, a chemist. Aspiring astronaut. Nuclear is the way.
3K Followers 768 FollowingBuilding a Web3 ecosystem on @StellarOrg
Interactive Wallet App & DeFi with regular public updates
Current version: 0.9.2-beta (ZK Payments and Asset Creation)
4K Followers 2K FollowingThe Official X of StellarSKULL & SkullFriend
!! https://t.co/1eoEar3Xfu is NO LONGER OURS!!
Chocolatier, Engineer, Bird Admrier.
Viva Stellar!
12K Followers 10K FollowingWeb3 Muse. Building signal on Stellar. Love wins. #FindTheOthers ✨ @BRAINFROGXLM | Founder | @BLINKOASM Co-Founder 👁️ | Co-Founder BEAM AR |