Matthew C. Higgs @TheLeanAcademic
Using data to craft the best whisky in the world Joined January 2017-
Tweets4K
-
Followers446
-
Following835
-
Likes7K
Why is chatting to a PDF better than reading a PDF?
Something I was wondering…
Some remarkable points: 100% adoption of ChatGPT in the legal team. Integration into core processes like dose distribution. A ton of custom GPTs for specific work flows. Scaling up necessitates AI assistance in lieu of hiring 100.000 employees. youtu.be/t3UHnKLVS1M?si…
Also, all models are over-fitting?
Also, all models are over-fitting?
I spent a bit of time using Udio, and it turns out a bunch of its output closely resembles copyrighted music. - Melodies & chords sometimes closely resemble famous songs - Some output closely resembles specific artists’ sound/style - I could generate copyrighted lyrics for most…
1. What are the ethical and societal implications of advanced AI assistants? What might change in a world with more agentic AI? Our new paper explores these questions: storage.googleapis.com/deepmind-media… It’s the result of a one year research collaboration involving 50+ researchers… a🧵
It’s happened. I just told someone they could Google/*Bing* it
Feeling like you’re learning feels better than learning?
Feeling like you’re learning feels better than learning?
Surely there’s a third option: high intelligence species prevent others…
Surely there’s a third option: high intelligence species prevent others…
Has anyone proposed an economic argument for why we don’t *need* gen-AI content? Like, av person can only consume X Per day and we already have 10x more than anyone can consume… Supply >>> demand => gen-AI not “innovation” (in terms of meeting unmet need)…
I struggle to keep up with human-generated music…
The bugs I encounter most with LLMs in production are related to data drift. This is acute for LLMs b/c of all the moving parts: prompts, RAG, functions, etc. There is a classic ML technique that works for detecting drift. I explain it in this post: hamel.dev/blog/posts/dri…
I’m genuinely surprised by this take. I assume anyone could beat anyone at anything (mental) given infinite time…
I’m genuinely surprised by this take. I assume anyone could beat anyone at anything (mental) given infinite time…
"Nobody else took what I was doing seriously, so nobody would want to work with me. I was thought to be a bit eccentric and maybe cranky" Peter Higgs, the physicist who discovered the theoretical mechanism explaining the origin of mass in the universe, has passed away today.
When people see the robot installation by country. They think it'll be easy for the US to reindustrialize, or for underdeveloped countries like India to industrialize and catchup Here are the reasons why, it's very difficult for both type of nations: 1/7🧵
Humans are multimodal… we’ve been “pre-trained” on so much sensory data, we can’t compare to something as “specialised” as an LLM
Humans are multimodal… we’ve been “pre-trained” on so much sensory data, we can’t compare to something as “specialised” as an LLM
🚨EXCELLENT AI PAPER ALERT: "Theory Is All You Need: AI, Human Cognition, and Decision Making" by @teppofelin & Matthias Holweg is all you need to read about AI today. Quotes: "The differences between human and machine learning—when it comes to language (as well as other…
Jude💚💙 @Judemccorry
3K Followers 5K Following Irish Woman - living in Gods second favourite country (Scotland) - CEO of @cyberfraudcen -- views are all my own
Dr Marta E. Cecchinat.. @martacecchinato
1K Followers 987 Following Senior Lecturer @NU_CISDept, part of @NorSCLab @NORTHLabHCI | #WIASN | Working on #HCI #digitalwellbeing #futureofwork #worklifebalance
Fraser Macdonald @IamFraserMac
481 Followers 493 Following Promoting responsible innovation at @dataforchildren. Chair of Data Advisory Group @YoungScot. Surfer. Swimmer. Van owner. Views my own.
Karen Jewell @kardotjewell
481 Followers 438 Following data analyst/scientist, maintainer @opendata_sco, studying Gaelic on Duolingo. Sometimes I run. Never on X anymore because how do you use it?
University of Bristol.. @BristolUni_BSch
463 Followers 213 Following @bristoluni Business School 🎓 | A top 5 UK university for research (REF, 2021) in one of the UK’s most vibrant cities #BristolUniBusiness #WeAreBristolUni
Jack Kelly (@jack_kel.. @jack_kelly
6K Followers 4K Following Trying to help mitigate climate change using machine learning. Co-founder of @OpenClimateFix. Father. Previously @DeepMind & consulted for @NationalGridESO.
The Data Lab Communit.. @TDLCommunity
766 Followers 250 Following @DataLabScotland's digital community - created to enable data & AI professionals & enthusiasts to connect, collaborate, develop and learn. Join for free👇
Alan Godfrey @godfreybiomed
703 Followers 507 Following Usually doing #stuff @NorthumbriaUni. Views my own, I think. 🇮🇪 🇪🇺
Eleonora Pantano (PhD.. @E4Retail
666 Followers 648 Following Associate Professor (Reader) of Retail and Marketing Technology @BristolUni_BSch
The Data Lab @DataLabScotland
14K Followers 3K Following Scotland's Innovation Centre for Data and AI. We help companies, organisations and individuals capitalise on the opportunities that exist within data and AI.
Antonia 💋 @Antonia5964
4 Followers 494 Following Seductive viхеn seeks cоnstаnt and fulfilling cоnnectiоns
Andrew Trask @iamtrask
74K Followers 190 Following @openminedorg, @GoogleDeepMind ethics team, @OxfordUni phd candidate, @UN pet lab, @GovAI_, creator of #GrokkingDeepLearning, NALU, and sense2vec
Marco Post @MarcoPost5
41 Followers 261 Following never attribute to malice that which is adequately explained by stupidity - Hanlon's razor
Luka Reynolds @reynolds_l88809
108 Followers 3K Following
Ana @AnaBirj
87 Followers 443 Following Clinician- Scientist @KingsCollegeLon,@UHSussex | Tissue regeneration , Oral Maxillofacial surgery
Davis Jones @DavisJones52174
94 Followers 3K Following
md ghouse @ghost4o4
69 Followers 221 Following
Mukesh Jha @jmukesh99
168 Followers 854 Following Engineer × Entrepreneur 🗿 NLP • LLM Agent • DAIICT'24 👨🎓 Building AI products 🤖👨💻 Talks about AI, Tech, SaaS, Entrepreneurship🗽 Let's connect 👋
Dr. Giselle Zeno @giselle_zeno
276 Followers 443 Following AI Researcher at MIT Lincoln Lab | Alumni @PurdueCS PhD, @UPR_Oficial | #DataMining #MachineLearning #Graphs #NetworkScience #NLP | (she/her)
Aniekan Essien @dr_aessien
40 Followers 97 Following Business | Analytics | Machine Learning | AI Deep Learning | Assistant Professor
Ollie Mollie @ol_oleh
452 Followers 5K Following YOUR COPY PICKER UPPER | ONE OF THE KIND | THE ULTIMATE C. W. | GET VALUE TODAY, PAY AFTER | BOOK APPOINTMENT NOW!
David J. Gunkel @David_Gunkel
11K Followers 7K Following Professor - Northern Illinois University (USA). Author of the books The Machine Question, Robot Rights, Person-Thing-Robot, Of Remixology, and Deconstruction.
Marlo Stewart @mar79011
94 Followers 153 Following
Albert Labs @albertlabs
3K Followers 4K Following Imagine one treatment for mental health. CSE: $ABRT
Miles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.
Jessica Sacher, PhD @JessicaSacher
4K Followers 5K Following Microbio PhD | Cofounded @phagedirectory to save lives with phages | Clinical phage mfx & QC @phageaustralia | Writing about lab work & techbio trends 🧬🧫 🇨🇦
Johanna E. Hidalgo @hidalgo_J_E
74 Followers 394 Following Clinical Psychology Graduate Student @uvmvermont; passionate about optimizing technology-assisted interventions to widen the reach of trauma-informed services.
ABSTRAKT ART @valenzwayze
249 Followers 3K Following
chief lubo @chieflubo
501 Followers 3K Following traditional healer,witch,voodoo,spiritualist,herbalist,doctor, spellmaster,love consultant ,magician ,spellcaster, 🙏🏻WHATSAPP #+254790208486
Charly Wargnier @DataChaz
112K Followers 31K Following 🥑 DevRel @Streamlit @SnowflakeDB 🪶 𝕏 about #LLMs, #AI, #DataScience, #WebApps, #SEO 💕 My heart is open source 🌍 Nature Lover 👀 My views!
Margie Meacham @ATD #.. @margiemeacham
22K Followers 21K Following Applying cognitive science and AI to enhance learning and performance. Author of AI in Talent Development and Brain Matters. Ask me about #conversational #AI
Sam Rhynas @lilacpatsy
383 Followers 1K Following Crafty Girl Geek,love wool & pens & data & paper & graphs & hills & more lovely wool. And cats, obviously. @effinidata @girlgeekscot @pydataedinburgh
Faaiz Taufiq @FaaizTaufiq
202 Followers 325 Following PhD student in statistical machine learning @OxCSML | Previously @BytedanceTalk @AWS @MorganStanley
Philippe Beaudoin @PhilBeaudoin
3K Followers 2K Following Social spaces for curious minds @waverly_ai. Previously @Google, cofounder @element_ai.
Sharlene Con 💸👩.. @sharlsz
1K Followers 5K Following Left High Paid Job to bootstrap 📟 Check out my latest project: @bannernote | https://t.co/LeT5rWYIns ✨ Full time Indie hacker since 2015
Professor Palie Smart @PalieSmart
372 Followers 261 Following Associate Pro-Vice Chancellor Global-Civic Engagement, University of Bristol, Clifton, Bristol, UK
Boguslaw Obara 🇵�.. @BoguslawObara
251 Followers 200 Following AI & Imaging Data Scientist, Innovator, & Consultant. Entrepreneur. Football, chocolate & travel nut.
Abi Aryan 🛠️ @GoAbiAryan
7K Followers 2K Following 🗜ML Engineer 🛠️ Building Multi-Modal Models @AbideAI 🖋 Writing #LLMOps - Managing LLMs in Production book (O'Reilly) 🐦 Talk to me about LLMs, MLSys & SecOps
Mac The VC @MacConwell
96K Followers 42K Following Managing Partner @RareBreedVC | underrepresented founders | Hacker turned Hustler | Entrepreneur | Vampire | Former Gamer | @inside | @KauffmanFellows class #26
Dr Gemma Newlands @NewlandsGemma
1K Followers 2K Following Departmental Research Lecturer @ Oxford Internet Institute
Vitor Hugo Vivaldini @VitorVivaldini
13 Followers 408 Following
The 4th Wave AI @4thWaveAI
47K Followers 40K Following The 4th wave will be in Artificial Intelligence, Quantum Computing, Nanotechnology, Biotechnology, and Robotics. We focus on the latest NEWS & REVIEWS.
The Innovation Studio @TheAIFactory
1K Followers 3K Following Creating bold new AI-fueled companies that solve real-world problems #AI #IndustrialAI #ML #Innovation #VentureStudio #StartupStudio
Dr. Paul Penn 💙 @Dr_Paul_Penn
3K Followers 3K Following Psychology Teacher of The Year 2021 & Author of 'The Psychology of Effective Studying'. YouTube channel: https://t.co/suwNNWFHgM
Palie @Palie40133089
12 Followers 54 Following
Jamie Macfarlane @MacfarlaneJamie
3K Followers 997 Following Founder & CEO @CreatorFund: Backing founders on the frontier of what’s possible. 2019 GE Conservative Candidate. Ex @stanfordgsb
#OfficeOfTheCitizen @olabanjik
980 Followers 4K Following Aspires to be a maverick free agent and believes sustainability is key to entrepreneurship!
Nikolas Breuckmann @nikobreu
2K Followers 873 Following Lecturer at UBristol working in Quantum Information @[email protected]
Rishabh @RishabhBathija
12 Followers 132 Following New to TW. Here to type my thoughts because no one wants to hear them. #Marketing and #Research enthusiast | To-be PhD Student | #academia over industry work
David Kaye @DavidJKaye
2K Followers 5K Following R&D, commercialisation and grant funding. Deeptech, cleantech, energy. Fan of @cafcofficial. MIET, FRSA.
Xiaolong @XiaolongShui
102 Followers 430 Following
Philip Taylor @rolyatlihp
3K Followers 4K Following Pro Vice-Chancellor Research and Enterprise University of Bristol. (he/him)
Dr Marta E. Cecchinat.. @martacecchinato
1K Followers 987 Following Senior Lecturer @NU_CISDept, part of @NorSCLab @NORTHLabHCI | #WIASN | Working on #HCI #digitalwellbeing #futureofwork #worklifebalance
Karen Jewell @kardotjewell
481 Followers 438 Following data analyst/scientist, maintainer @opendata_sco, studying Gaelic on Duolingo. Sometimes I run. Never on X anymore because how do you use it?
University of Bristol.. @BristolUni_BSch
463 Followers 213 Following @bristoluni Business School 🎓 | A top 5 UK university for research (REF, 2021) in one of the UK’s most vibrant cities #BristolUniBusiness #WeAreBristolUni
Gary Marcus @GaryMarcus
145K Followers 7K Following “A beacon of clarity”. Spoke at US Senate AI Oversight committee. Founder/CEO Geometric Intelligence (acq. by Uber). Rebooting AI & Taming Silicon Valley.
Zoubin Ghahramani @ZoubinGhahrama1
24K Followers 616 Following VP Research, Google DeepMind, ex-head of Google Brain. Professor at University of Cambridge. Machine Learning Researcher. ex-Chief Scientist & VP of AI, Uber.
Jack Kelly (@jack_kel.. @jack_kelly
6K Followers 4K Following Trying to help mitigate climate change using machine learning. Co-founder of @OpenClimateFix. Father. Previously @DeepMind & consulted for @NationalGridESO.
Dan Roy @roydanroy
45K Followers 2K Following ML / AI researcher, emphasis on theory. Research Director and Canada CIFAR AI Chair, @VectorInst Professor, @UofT (Statistics/CS)
The Data Lab Communit.. @TDLCommunity
766 Followers 250 Following @DataLabScotland's digital community - created to enable data & AI professionals & enthusiasts to connect, collaborate, develop and learn. Join for free👇
Ferenc Huszár @fhuszar
40K Followers 1K Following Secular Bayesian. Associate Professor in Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey Alum of @Twitter, Magic Pony and @Balderton
Northumbria Uni @NorthumbriaUni
42K Followers 1K Following University of the Year 2022. A research-intensive university that unlocks potential for all, changing lives regionally, nationally and internationally.
Alan Godfrey @godfreybiomed
703 Followers 507 Following Usually doing #stuff @NorthumbriaUni. Views my own, I think. 🇮🇪 🇪🇺
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K Following
The Data Lab @DataLabScotland
14K Followers 3K Following Scotland's Innovation Centre for Data and AI. We help companies, organisations and individuals capitalise on the opportunities that exist within data and AI.
Bob Clint @rvclint
722 Followers 588 Following Living in rural Wisconsin. Data governance guy. Lifetime Independent. Love birds, nature, hockey, cooking, single-malt Scotch, and my wife, not in that order.
(((Ellen Friedman))) @Ellen_Friedman
5K Followers 760 Following Scientist, speaker, author, Apache Software Committer, PhD Biochem Rice Univ. Artist in the making
Laura Weidinger @weidingerlaura
2K Followers 303 Following AI Ethics | Researcher at @deepmind | Measuring and Evaluating AI | Philosophy, Psychology | All views my own | London, Berlin
Michael Black @Michael_J_Black
59K Followers 643 Following Director, Max Planck Institute for Intelligent Systems (@MPI_IS). Chief Scientist @meshcapade. Building 3D digital humans using vision, graphics, and learning.
Marvin 🤖🧦 @AskMarvinAI
3K Followers 13 Following Build AI interfaces that are reliable, scalable, and easy to trust - OG “structured llm outputs with pydantic” library
Karol Hausman @hausman_k
22K Followers 141 Following @Physical_int ex: researcher @GoogleAI/@DeepMind, adj. Prof. @Stanford. Into robots, AI, NBA, philosophy, soccer and almond croissants. 🇵🇱🇺🇸
Isaiah Taylor — (�.. @isaiah_p_taylor
10K Followers 896 Following Founder @valaratomics. Kardashev scale climber, Malthus disrespector, Age of Man enjoyer. Ask me why consuming energy is good and you should have more babies.
xAI @xai
997K Followers 36 Following
Pika @pika_labs
116K Followers 53 Following Video on command. Website: https://t.co/G5bjmrMQsx Discord: https://t.co/bX68ThPTQH About: https://t.co/atvdcgbe9S
AutoGPT @Auto_GPT
12K Followers 5 Following Explore the new frontier of autonomous AI, dive into the fastest growing open source project on Github, and journey through the dynamic agent ecosystem!
Simon Prince @SimonPrinceAI
9K Followers 331 Following Professor of Computer Science, University of Bath
Cedric Archambeau @cedapprox
405 Followers 191 Following Director of Artificial Intelligence at https://t.co/jcnTNggN0L. Fellow @ELLISforEurope. Ex Principal Scientist @AWS.
Sam Rhynas @lilacpatsy
383 Followers 1K Following Crafty Girl Geek,love wool & pens & data & paper & graphs & hills & more lovely wool. And cats, obviously. @effinidata @girlgeekscot @pydataedinburgh
Ana Basiri @AnahidBasiri
3K Followers 2K Following Professor of Geospatial Data Science, UKRI Future Leaders Fellow, RAEng EngineeringX Champion, EiC of Journal of Navigation
Prof. Dr Beth Singler.. @BVLSingler
7K Followers 3K Following Anthropologist and Geek thinking about how you think about AI. Assistant Professor in Digital Religions @ UZH. "Brainy rockstar" - Santa Cruz Works. She/her. 🌈
Noah Giansiracusa @ProfNoahGian
8K Followers 5K Following As seen on @CNN. Math Prof @BentleyU. Forthcoming pop math book @riverheadbooks. Words on AI+algos+misinfo @washingtonpost @TIME @SciAm @BostonGlobe @WIRED
Jan Brauner @JanMBrauner
771 Followers 312 Following PhD student in ML. University of Oxford, @OATML_Oxford.
Shape.xyz @ShapeXyz
112 Followers 6 Following Get data insights without knowing SQL. Ask your database questions in plain English with Shape. https://t.co/8tEy7wP86h
INLG 2024 @inlgmeeting
492 Followers 10 Following Official account for the International Natural Language Generation Conference by @SIGGEN_ACL. Managed by current year's organisers
Tim Dettmers @Tim_Dettmers
29K Followers 821 Following PhD Student at @UW. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.
Michael Bronstein @mmbronstein
43K Followers 4K Following #DeepMind Professor of #AI @UniofOxford / Fellow @ExeterCollegeOx / ML Lead @ProjectCETI / https://t.co/kZpGpDzYeV
Sabrina @sabrinaesaquino
41K Followers 953 Following devrel @qdrant_engine • co-founder @leaddevrel • mba @ usp • actually okay with AIs ruling the world
Olga Berezovsky @OlgaBerezovsky
2K Followers 43 Following Data scientist | ML | Medieval analyst | Writing https://t.co/4XTyfA5guO
HelioCampus @HelioCampus
2K Followers 284 Following Helping higher ed leaders rise to the challenge of today’s high stakes moment.
Sophie Watson @sophwats
770 Followers 947 Following statistics, science (data) and sewing (sometimes)
Zhamak Dehghani @zhamakd
11K Followers 583 Following an empathetic technologist | founder ceo of nextdata | data mesh creator | author | speaker | learner | mother | she/her| ex-thoughtworks
Jon Yongfook @yongfook
104K Followers 945 Following 🐻 https://t.co/KoqV5WR2s0 image generation 🐻 https://t.co/Vb4mbiYuaw web scraping I tweet about bootstrapping SaaS products $51K MRR
fraser @Fraser
13K Followers 281 Following VC at Spark. Past: Head of Product at OpenAI; co-founder/ceo of an AI startup that was acquired by Airbnb
Jelani Nelson @minilek
22K Followers 184 Following Professor @Berkeley_EECS. Research Scientist (part-time) @GoogleAI. Founder @addiscoder. 🇻🇮🇺🇸🇪🇹
Robin Lovelace @robin.. @robinlovelace
9K Followers 964 Following Data scientist, transport modeller, programmer @ITSLeeds Lead Data Science @activetraveleng Geocomputation, evidence, #opensource software for good 🚀
BN Commodities @BNCommodities
37K Followers 208 Following Commodities breaking news and in-depth analysis from Bloomberg journalists around the world. @business #OATT #METL
ET Commodities @ETCommodities
53K Followers 7 Following #EconomicTimes Your most trusted resource for timely news, views and analysis on #commodities
Reuters Energy and Co.. @ReutersCommods
54K Followers 170 Following News and columns on commodities, energy, sustainable investment and the environment from Reuters journalists.
FT Commodities @ftcommodities
57K Followers 386 Following Latest news and live tweets on oil, copper, corn and other energy, mining and agricultural commodities from the @financialtimes natural resources team.
Benjamin Vincent, DPh.. @inferencelab
3K Followers 939 Following Data Scientist | Bayes | Causal reasoning | Python + Julia | Ex-academic | #MMT. Part of @pymc_labs
Artificial Intelligen.. @AI_KAUST
4K Followers 88 Following The Artificial Intelligence Initiative (AII) at KAUST focuses on research excellence, training the future generation of experts, and translation/innovation.
Philippe Beaudoin @PhilBeaudoin
3K Followers 2K Following Social spaces for curious minds @waverly_ai. Previously @Google, cofounder @element_ai.
Hannah Rose Kirk @hannahrosekirk
3K Followers 687 Following AI researcher trying to make sense of all things cyberspace 🤖 Uni of Ox PhD (loading…) @oiioxford & @OxfordAI. Prev @turinginst & @Cambridge_Uni. Visitor @ NYU
antonio vergari 💥 .. @tetraduzione
4K Followers 1K Following human being | associate prof in #ML #AI @ancAtEd | PI of #APRIL https://t.co/7uTqRZtmEd | #probabilistic #models #tractable #generative #neuro #symbolic |
Sean O'Dowd @SeanODowd15
38K Followers 3K Following Buying single family rentals in Elite School Districts as GP for Scholastic Capital | Ran a solo consulting practice on Catalant | Ex-BCG | Wharton
Giorgos Gouzoulis @GGouzoulis
1K Followers 597 Following Associate Professor in HRM @QMUL | @BUIRAonline | @WESjnl | Researching employee compensation, unions, strike activity, & underemployment
ESRC Digital Good Net.. @digitalgoodnet
2K Followers 3K Following An @esrc-funded, £4 million research network building a research community focused on what a good digital society should look like and how we get there.
Mark Girolami @TuringChiefSci
1K Followers 268 Following The Chief Scientist at @turinginst the UK’s national institute for data science and artificial intelligence. || [email protected]
Runway @runwayml
185K Followers 300 Following An applied AI research company building for the next era of art, entertainment and human creativity. We're hiring: https://t.co/Aj11xyhxOg
Xavier Helgesen @XavierHelgesen
57K Followers 2K Following Founder & Managing Director, Enduring Ventures. Building a Baby Berkshire. 🌳 Founder: ZOLA Electric, Better World Books, EcoSafi 🌳 Publisher, Scribe Media
Boston Consulting Gro.. @BCG
505K Followers 843 Following Official global account of Boston Consulting Group. Highlights of our work, initiatives, people, partnerships, and more. Also @BCGhenderson & @bcgx_How to be as "smart" as Auto-Regressive LLMs: - memorize lots of problem statements together with recipes on how to solve them. - to solve a new problem, retrieve the recipe whose problem statement superficially matches the new problem. - apply the recipe blindly and declare…
There’s an art to distilling these to the absolute minimal necessary text. The human brain can’t comprehend how stupid these things are without practice.
I believe that the most common enterprise AI applications today aren’t the ones that solve the most important problems or make the most money. The most common applications are the ones that are easiest to evaluate. 1. Recommender system: evaluated by increase in engagement or…
New work on LLM Control Theory! We frame LLMs as discrete dynamical systems and study prompting through the lens of reachability and controllability. We even proved some theorems!! Joint work my fellow EngSci 2T2 @witkowski_cam, Dr. @Sz_Looi, advised by Prof. Matt Thomson 🚀
Because AI is still only a pattern machine (an incredibly powerful one!). Here's how to see. Take a common trick question or puzzle, change it to not be a trick, ask GPT (here's Claude since I'm on Mobile, I use GPT4 by API and it does the exact same thing).
Twitter folks who agree with this claim that AI does not “reason”: what does this even mean? I’m befuddled
I’m excited to share that I’m working on a new book about building applications with foundation models! AI Engineering builds upon Machine Learning Systems Design, but with a focus on large scale, ready made models. The book covers: - The new AI stack (e.g. how it differs from…
This is the best tutorial I've seen for fully understanding and implementing Transformers models. It includes a complete working implementation from scratch of all the key pieces, written in a way to make learning and understanding as easy as possible.
I've written up my study group lectures on implementing Transformers in PyTorch into a blog series: Creating Transformers from Scratch: - Part 1: The Attention Mechanism benjaminwarner.dev/2023/07/01/att… - Part 2: The Rest of the Transformer benjaminwarner.dev/2023/07/28/res…
We started releasing the first chapters of our Geometric Deep Learning book and the accompanying slides from the corresponding Oxford and Cambridge courses.
After 3 years, it's time for us to start sharing the chapters of the GDL book! ❤️ Also included: companion slides from our @Cambridge_Uni & @UniofOxford courses 🧑🎓 Chapter 1 is out **now**! More to follow soon 🎉 geometricdeeplearning.com/book 📖 @mmbronstein @joanbruna @TacoCohen
1. What are the ethical and societal implications of advanced AI assistants? What might change in a world with more agentic AI? Our new paper explores these questions: storage.googleapis.com/deepmind-media… It’s the result of a one year research collaboration involving 50+ researchers… a🧵
Come join a fun event with me and @EkinKarabulut !
🍻 'MLOps to LLMOps: What do we keep, change or add?' with @ElectricWeegie 🍻 Today, Andy McMahon, head of MLOps at NatWest Group, and guest lecturer at Oxford University is joining us at Beers with Engineers. The core questions that we will discuss with Andy in this session…
The bugs I encounter most with LLMs in production are related to data drift. This is acute for LLMs b/c of all the moving parts: prompts, RAG, functions, etc. There is a classic ML technique that works for detecting drift. I explain it in this post: hamel.dev/blog/posts/dri…
After ~5yrs of work, @emmabluemke, Teddy Collins, @bmgarfinkel, @KEricDrexler, @ClaudiaGhezzou, @IasonGabriel, @AllanDafoe, @wsisaac, and I have published an updated paper. This work is co-authored by an extraordinary team I'm grateful to know, and I expect to work off this…
If you are using LLMs for summarizing long docs, you really should read this paper Over 50% of book summaries (incl by Claude Opus and GPT-4) were identified as containing factual errors and errors of omission Lesson: don't blindly assume AI summarization tools work. Test them.
"Talk to your documents" is a big use case for AI. This paper tested how good AI was at working with long, new books (like The Fourth Wing). Claude 3 does very well in SUMMARIZING big books. But none of the models do a good job FACT CHECKING claims about books made by others.
We'd like LLM outputs to be accompanied by confidence scores, indicating the confidence we should have in them. But what semantics should a confidence score have? A minimal condition is calibration: e.g. when we express 70% confidence, we should be correct 70% of the time. But...
"Nobody else took what I was doing seriously, so nobody would want to work with me. I was thought to be a bit eccentric and maybe cranky" Peter Higgs, the physicist who discovered the theoretical mechanism explaining the origin of mass in the universe, has passed away today.
It turns out the data bottleneck problem is more dire than initially thought: AI model performance - which can be largely attributed to the presence of test concepts within their vast pretraining datasets - increases linearly with exponentially more data. RIP: Scaling laws
A smart person plus me wrote a thing - “Bears, Bulls and Software Developers: The Future of Work for Techies” by Andy McMahon (Electric Weegie) medium.com/@andrewpmcmaho…
every time people say "are you optimistic or pessimistic about AI" what I hear is "do you gulp much of the AI hype and corporate PR unfiltered, or do you pause and ask critical questions" 🤷🏾♀️
Problems I'd do if I'm to do a startup again (though I probably won't any time soon because startups are hard). If you’re solving any of them, I’d love to chat. 1. Data synthesis: AI has become really good both at generating and annotating data. The challenge now is to make sure…
Little known OSS gem: the Open-source Cookbook A collection of notebooks for building practical AI applications using open-source tools and models: github.com/huggingface/co… Doc: huggingface.co/learn/cookbook… Currently contains 16 notebooks in English (with some in Chinese as well):…
A review in Nature, by @candice_odgers, asserts that I have mistaken correlation for causation and that “there is no evidence that using these platforms is rewiring children’s brains or driving an epidemic of mental illness.” Both of these assertions are untrue.…
Trends for United States
You might like
