Apropos of nothing, here is a mini-tutorial on three types of Mixture of Experts (MoE): Pre-trained MoE, upcycled MoEs, and FrankenMoEs.
MoE refresher
MoEs replace the feed-forward layers with sparse MoE layers. These layers contain a certain number of experts (e.g. 8), each one…
Google researchers presented a taxonomy defining milestones on the journey to achieve artificial general intelligence (AGI).
This new taxonomy may foster a clearer understanding of AGI development.
Learn more in #TheBatch: hubs.la/Q02gqLT_0
Prompt Engineering is all you need to get the best of GPT-4 and Llama-2
A new study introduces 26 prompting principles that can boost the LLM's response by staggering 50% 😱
This study cover aspects like Prompt Structure and Clarity, Specificity and Information, and Complex…
21K Followers 19K FollowingInspired by Algorithms, Powered by Imagination: Unleashing the Potential of Generative AI.
#GenerativeAI #deeplearning #AI #MachineLearning
52 Followers 192 FollowingExploring the intersection of AI and coding. Sharing insights on how AI can revolutionize software development. #AI #Coding #AICoder #AIC #SoftwareEngineering
36 Followers 97 FollowingExploring the future of coding with AI 🚀 | Passionate about merging artificial intelligence with programming | Let's discuss how AI is reshaping the way we cod
8K Followers 205 FollowingBuying another $1B in B2B software companies by 2025.
150+ completed tech acquisitions since 2002.
No profit, no growth... no problem.
418K Followers 1K FollowingFounder https://t.co/m6TigM4CJT: Free AI training for the smartest engineers in the world. Will tweet as I wish and suffer the consequences.
54K Followers 487 Followingcritic of tech futures | host @techwontsaveus | author, “road to nowhere” | subscribe to my newsletter: https://t.co/0JqdZzcBJB | i don’t check DMs; email me
954 Followers 8 FollowingOWASP CycloneDX is a modern standard for the software supply chain. Software Bill of Materials (SBOM), SaaSBOM, Cryptography (CBOM), AI/ML-BOM, VDR/VEX...
162K Followers 561 Followingco-founder of Fog Creek, Trello, Stack Overflow, Glitch, and https://t.co/Jb7fG3eQgU - I have moved to @[email protected] on mastodon
3K Followers 419 FollowingTweet as a Researcher/Teacher/Consultant on Software Engineering. Passionate about humans+tech, diversity, research methods, ⛵ & 🎶. She/Her 🇮🇪 🇨🇦
133 Followers 565 FollowingGenAI first tech leader:
* Transforming support and sales agent into cyborgs
* Simplifying SMSC and Communication products
* Cost Optimization guru
50K Followers 3K FollowingDeveloper Experience Lead at @GoogleDeepMind
Building Gemini API, Gemma, AI Studio and more AI products. My views
ex-Chief Llama Officer @huggingface 🇵🇪🇲🇽
41K Followers 1 FollowingHe/Him. Advisor/Analyst https://t.co/VvReVcmFSo (ex VP Amazon Sustainability/AWS/BatteryVentures/Netflix/eBay/Sun). Married to @laurelco
488K Followers 146 FollowingNobel Laureate. Co-Founder & CEO @GoogleDeepMind - working on AGI. Solving disease @IsomorphicLabs. Trying to understand the fundamental nature of reality.
3K Followers 1K FollowingThe telecom industry runs on 30-year-old code thwarting growth and innovation. I’m rewriting telco software with cloud and AI. Acting CEO @Totogi.
687 Followers 379 FollowingAI’m Totogi! Totogi is the world’s leading telco SaaS platform. We build AI-first software that helps MNOs / MVNOs to grow market share and delight customers.
263K Followers 664 FollowingBuilding with AI agents @dair_ai • Prev: Meta AI, Galactica LLM, Elastic, PaperswithCode, PhD • I share insights on how to build with AI Agents ↓
21K Followers 19K FollowingInspired by Algorithms, Powered by Imagination: Unleashing the Potential of Generative AI.
#GenerativeAI #deeplearning #AI #MachineLearning
949K Followers 764 FollowingProfessor at NYU. Chief AI Scientist at Meta.
Researcher in AI, Machine Learning, Robotics, etc.
ACM Turing Award Laureate.
25K Followers 68 FollowingAI researcher & teacher @SCAI_ASU. Former President of @RealAAAI; Chair of @AAAS Sec T. Here to tweach #AI. YouTube Ch: https://t.co/4beUPOmf6y Bsky: rao2z
3K Followers 909 FollowingFollow me for tips on how to buy software companies and run them 100% remote. 6x founder, acquired 13 software companies, CEO of Ionic Partners
365K Followers 6K FollowingChief Scientist, Google DeepMind & Google Research. Gemini Lead. Opinions stated here are my own, not those of Google. TensorFlow, MapReduce, Bigtable, ...