Minimizing Kullback-Leibler divergence can be interpreted as an information projection wrt to Fisher orthogonality and exponential or mixture connection.
Uniqueness of projection proof may be proved with a generalization of the Pythagoras' theorem!
Bill Gates just released his original source code for Basic - with a beautifully designed article - a huge piece of tech history - someone should make some art with this source code!
The Norwegian Academy of Science and Letters has decided to award the Abel Prize 2025 to professor Masaki Kashiwara. Kashiwara-san is the first Japanese mathematician to receive the Abel Prize.
#Abelprize#Abelprize2025 #mathematics#science
NEW 🧵: Is human intelligence starting to decline?
Recent results from major international tests show that the average person’s capacity to process information, use reasoning and solve novel problems has been falling since around the mid 2010s.
What should we make of this?
BREAKING NEWS
The Royal Swedish Academy of Sciences has decided to award the 2024 #NobelPrize in Physics to John J. Hopfield and Geoffrey E. Hinton “for foundational discoveries and inventions that enable machine learning with artificial neural networks.”
700곳이 넘는 출판사와 물류센터가 함께 사용하는 전산망이 해킹을 당하면서 수천만권의 재고 데이터가 사라져 도서 배송에 차질을 빚고 있습니다. 해커들은 이미 한 차례 돈을 뜯어냈고, 더 큰 돈을 요구하고 있습니다. news.jtbc.co.kr/article/articl…
구글 데이터센터 하루 물 사용량이 안양CC 잔디에 한번 물주는데에 필요한 양의 반도안된다
구글이 2021년 미국에서 쓴 물 총량이 골프장 30개보다 적다
watercalculator.org/news/news-brie…
AI가 물을 저렇게 많이 쓴다는 주장 자체도 과장이지만, 사실이라해도 구글/AI 없앨 시간에 안양 CC를 없애는게 낫다
구글 데이터센터 하루 물 사용량이 안양CC 잔디에 한번 물주는데에 필요한 양의 반도안된다
구글이 2021년 미국에서 쓴 물 총량이 골프장 30개보다 적다
watercalculator.org/news/news-brie…
AI가 물을 저렇게 많이 쓴다는 주장 자체도 과장이지만, 사실이라해도 구글/AI 없앨 시간에 안양 CC를 없애는게 낫다 https://t.co/hbtP5YkdqA
kaist @kaistpr professor jinjoon "vendetta" lee @jinjoon_lee forced me to send a fairly large sum of money to his wife's bank account, under threat of withdrawing an offer to be a postdoc in his lab. university leadership such as president kwang hyung lee did nothing about this
now seems as good a time as ever to remind people that the biggest breakthroughs at OpenAI came from a previously unknown researcher with a bachelors degree from olin college of engineering
New blog post: Yet Another ICML Award Fiasco
The story of the @icmlconf 2023 Outstanding Paper Award to the D-Adaptation paper with worse results that the ones from 9 years ago
Please share it to start a needed conversation on mistakenly granted awards
parameterfree.com/2023/08/30/yet…
I've proven the strangest result of my career..
The classic idea that gradient descent's rate is best with constant stepsizes 1/L is wrong. The idea that we need stepsizes in (0,2/L) for convergence is wrong.
Periodic long steps are better, provably.
arxiv.org/abs/2307.06324
Is this the end of @Google/@DeepMind as leading presences at machine learning conferences? @JeffDean said: Things had to change. Google would take advantage of its own AI discoveries, sharing papers only after the lab work had been turned into products.
washingtonpost.com/technology/202…
233 Followers 402 Following프로그래밍과 증명을 합니다.
I write programs and proofs. Love Haskell, Martin-Löf type theory, Nix package manager, and Hoare logic.
https://t.co/KGHmRVtwWb
659 Followers 1K FollowingLarge Language Models Researcher. Reviewer @NeurIPSConf Women in Machine Learning and Data Science @wimlds . Opinions are my own.
#Deeplearning #MachineLearning
26K Followers 281 FollowingMathematics and philosophy of the infinite. Professor of Logic @NotreDame @UniofOxford #ProofandtheArt #PhilMaths #InfinitelyMore #BookOfInfinity
20K Followers 1K Following@OpenAI Language agents (ReAct, Reflexion, Tree of Thoughts, SWE-agent, CoALA) for digital automation (WebShop, SWE-bench, tau-bench)
26K Followers 229 Followinggetting us to singularity with friends
computers can be understood: https://t.co/doHE1Qv2Sj
x @GoogleDeepMind @Microsoft
tensor core maximalist
9K Followers 1K FollowingA research group in @StanfordAILab working on the foundations of machine learning & systems. https://t.co/JHK58TDorG Ostensibly supervised by Chris Ré
9K Followers 866 Followingbuilding @vllm_project |
cs phd @ 🌁 uc berkeley |
machine learning system |
the real agi is the friends we made along the way
167K Followers 167 FollowingCo-founder of Thinking Machines Lab @thinkymachines; Ex-VP, AI Safety & robotics, applied research @OpenAI; Author of Lil'Log
46K Followers 3K FollowingWe're in a race. It's not USA vs China but humans and AGIs vs ape power centralization.
@deepseek_ai stan #1, 2023–Deep Time
«C’est la guerre.» ®1
3K Followers 255 FollowingLLMs and AI Research (Llama 2 & 3 lead) @Meta | ex @Google (PaLM lead, T5), ex @Baidu (Deep Speech 2, Sparse Neural Networks), ex @Nvidia
14K Followers 3K Followingresearch @MIT_CSAIL @thinkymachines. work on scalable and principled algorithms in #LLM and #MLSys. in open-sourcing I trust 🐳. she/her/hers
5K Followers 51 FollowingLatest news from the Linux world and open-source software. Reviews, analyses, tutorials, and more—everything FOSS, all in one place.
8K Followers 416 FollowingDad and associate professor at @KAUST_News.
Formerly @BU_ece, @sbucompsc, @YahooResearch, @TTIC_Connect.
ML theory&practice, obsessed with history of science
24K Followers 1 Followingcovering the latest AI & LLM research /// see "highlights" for all previous weekly threads /// building the best AI paper search engine @findmypapersai
83K Followers 324 FollowingAll things AI for developers from @NVIDIA.
Additional developer channels: @NVIDIADeveloper, @NVIDIAHPCDev, and @NVIDIAGameDev.
55K Followers 0 FollowingWe are building a world class AI R&D company in Tokyo. We want to develop AI solutions for Japan’s needs, and democratize AI in Japan. https://t.co/1q07mb3TzE
109K Followers 167 FollowingUPMC Professor of Computer Science @ CMU, President Elect ICML Board, VP of Research @ Meta (Multimodal LLMs, AI Agents), ex-Director of AI research at @Apple
38K Followers 485 FollowingDigital Geometer, Assoc. Prof. of Computer Science & Robotics @CarnegieMellon @SCSatCMU and member of the @GeomCollective. There are four lights.