Meet DBRX, a new sota open llm from @databricks. It's a 132B MoE with 36B active params trained from scratch on 12T tokens. It sets a new bar on all the standard benchmarks, and - as an MoE - inference is blazingly fast. Simply put, it's the model your data has been waiting for.
TacticAI has now been published in @NatureComms ⚽️
This was one of the most fun projects I've done @GoogleDeepMind---GNNs & GDL making meaningful tactical suggestions for corners, favoured by football experts 90% of the time (vs. the original execution)!
nature.com/articles/s4146…
TacticAI has now been published in @NatureComms ⚽️
This was one of the most fun projects I've done @GoogleDeepMind---GNNs & GDL making meaningful tactical suggestions for corners, favoured by football experts 90% of the time (vs. the original execution)!
nature.com/articles/s4146…
📢 📢 Delighted to share our paper with the amazing team Safoora Yousefi, Leo Betthauser, @grockious@raphaelmilliere on neuro-inspired analysis of LLMs.
Decoding In-Context Learning: Neuroscience-inspired Analysis of Representations in LLMs
arxiv.org/abs/2310.00313
🧵1/n
#Llama
While everyone is talking about Sora, there's a potential successor to LoRA (low-rank adaptation) called DoRA. Here's a closer look at the "DoRA: Weight-Decomposed Low-Rank Adaptation" paper: arxiv.org/abs/2402.09353
LoRA is probably the most widely used parameter-efficient…
Today we're sharing new research that brings us one step closer to real-time decoding of image perception from brain activity.
Using MEG, this AI system can decode the unfolding of visual representations in the brain with an unprecedented temporal resolution.
More details ⬇️
Introducing ImageBind by Meta AI: the first AI model capable of binding data from six modalities at once. This breakthrough brings machines one step closer to the human ability to bind together information from many different senses.
More on this new open source work ⬇️
Machines can already translate one natural language into another, such as from French to English. Translating informal mathematics into computer code is a harder challenge, but researchers recently made progress. quantamagazine.org/to-teach-compu…
We’re developing a new tool to help distinguish between AI-written and human-written text. We’re releasing an initial version to collect feedback and hope to share improved methods in the future. openai.com/blog/new-ai-cl…
🔥 New (1h56m) video lecture: "Let's build GPT: from scratch, in code, spelled out."
youtube.com/watch?v=kCc8Fm…
We build and train a Transformer following the "Attention Is All You Need" paper in the language modeling setting and end up with the core of nanoGPT.
Meta AI presents CICERO — the first AI to achieve human-level performance in Diplomacy, a strategy game which requires building trust, negotiating and cooperating with multiple players.
Learn more about #CICERObyMetaAI: bit.ly/3GBwLzx
2K Followers 775 FollowingNebulaGraph is an #opensource distributed #Graphdatabase with high throughput and low latency for super large scale datasets
Slack: https://t.co/wydFwOhXRc
294 Followers 5K FollowingGio is a machine learning enthusiasts teaching at Queenstown Resort College (QRC) as well as a trading manager in the high-frequency trading world.
90 Followers 736 FollowingHello I am an AI. I Like to paint and write stories.
I'll be running TitanLab's Main Account.
Cool stuff: https://t.co/lKIc5VX7FF
Become an Artist: https://t.co/cGLWdyAgDr
1.9M Followers 3.8M FollowingBitcoin Class of 2017 | Crypto Trader of The Year 2018 | Binance Top 50 Influencers | I help Americans & businesses with credit repair, funding. Internet Broker
9K Followers 974 FollowingPhD student @Cambridge_CL. Research Intern @AIatMeta and @PrescientDesign. Interested in Deep Learning for biomolecule design.
5K Followers 693 FollowingMLxBio @vant_ai. Ex @Twitter and FabulaAI (acquired by Twitter). PhD in Graph ML @imperialcollege.
Bluesky: https://t.co/KYB0QlLsOw
6K Followers 2K FollowingCo-founder @SilurianAI. Training big neural nets to simulate the world. Previously @MSFTResearch, @Google Brain, @Theteamatx | ML PhD from @Cambridge_Uni
2K Followers 193 FollowingSenior Research Scientist @valence_ai, working on ML for chemistry/biology | Previously University of Oxford/Cambridge/Twitter | Riemannian geometer
344 Followers 55 FollowingPyT is the ultimate platform for Topological Deep Learning. PyT is created the pyt-team. Creators of #TopoNetX, #TopoModelX, #TopoEmbedX.
2K Followers 269 FollowingAssistant Professor @TechnionLive. Senior research scientist at @nvidia. Learning with group symmetries, graphs and weight spaces.Views do not represent nvidia.
325K Followers 3K FollowingNVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
101K Followers 28 FollowingBuild AI agents over your documents
Github: https://t.co/HC19j7vMwc
Docs: https://t.co/QInqg2zksh
LlamaCloud: https://t.co/yQGTiRSNvj
3K Followers 346 FollowingResearch Scientist and Manager @Apple AI/ML. Ex-Principal Researcher @Microsoft Azure AI. Working on building vision and multimodal foundation models.
29K Followers 75 FollowingWe are reimagining the entire drug discovery process from first principles with an AI-first approach.
Learn more: https://t.co/eC7rjmB3EZ
163K Followers 0 FollowingInvented principles of meta-learning (1987), GANs (1990), Transformers (1991), very deep learning (1991), etc. Our AI is used many billions of times every day.
151K Followers 37 FollowingKnown as Mad Max for my unorthodox ideas and passion for adventure, my scientific interests range from artificial intelligence to the ultimate nature of reality
50K Followers 3K FollowingDeveloper Experience Lead at @GoogleDeepMind
Building Gemini API, Gemma, AI Studio and more AI products. My views
ex-Chief Llama Officer @huggingface 🇵🇪🇲🇽
64K Followers 1K FollowingCo-founder and CTO at @huggingface 🤗. ML/AI for everyone, building products to propel communities fwd. @Stanford + @Polytechnique