Picture

AI21 Labs @AI21Labs

AI21 Labs builds Foundation Models and AI Systems for the enterprise that accelerate the use of GenAI in production. 🥂Meet Jamba https://t.co/xUBjKZHKVH ai21.com Joined August 2019
  • Tweets
    251
  • Followers
    6K
  • Following
    89
  • Likes
    279
AI21 Labs retweeted
NYSE Profile Picture

NYSE 🏛 @NYSE

a week ago

.@origoshen, Co-Founder + Co-CEO of @AI21Labs, talks about growth opportunities for the company following a $208 million Series C funding round, and shares his perspective on the future of AI on #NYSEFloorTalk with @JudyKShaw

AI21Labs Profile Picture

AI21 Labs @AI21Labs

4 weeks ago

Building a RAG solution is easy. Building a great one is not. In our guest blog on @streamlit, our team explores the intricacies of how AI21's Contextual Answers Task-Specific Model & our RAG Engine generate context-based answers grounded in your proprietary organizational data.…

AI21 Labs retweeted
shao__meng Profile Picture

meng shao @shao__meng

4 weeks ago

Paper of Jamba: A Hybrid Transformer-Mamba Language Model Jamba, a novel architecture which combines Attention and Mamba layers, with MoE modules, and an open implementation of it, reaching state-of-the-art performance and supporting long contexts. We showed how Jamba provides…

_akhaliq Profile Picture

AK @_akhaliq

4 weeks ago

Paper of Jamba: A Hybrid Transformer-Mamba Language Model Jamba, a novel architecture which combines Attention and Mamba layers, with MoE modules, and an open implementation of it, reaching state-of-the-art performance and supporting long contexts. We showed how Jamba provides… https://t.co/7Q0DgpVSSA

AI21 Labs retweeted
_akhaliq Profile Picture

AK @_akhaliq

4 weeks ago

Jamba A Hybrid Transformer-Mamba Language Model present Jamba, a new base large language model based on a novel hybrid Transformer-Mamba mixture-of-experts (MoE) architecture. Specifically, Jamba interleaves blocks of Transformer and Mamba layers, enjoying the benefits of

AI21 Labs retweeted
_philschmid Profile Picture

Philipp Schmid @_philschmid

4 weeks ago

Last Week @AI21Labs released the production-scale Mamba implementation, and today, they released their paper. 🧐 Jamba introduces a new hybrid Transformer-Mamba mixture-of-experts architecture offering state-of-the-art performance but with significant improvements on long…

AI21 Labs retweeted
_philschmid Profile Picture

Philipp Schmid @_philschmid

a month ago

Yesterday AI21 Labs released Jamba, the first production-scale Mamba implementation as a hybrid SSM-Transformer MoE 🐍 And today, you can already finetune it with Hugging Face TRL. @Dorialexander shared a working Qlora script using 4-bit quantization on an A100 GPU (for now,…

AI21 Labs retweeted
1littlecoder Profile Picture

1LittleCoder💻 @1littlecoder

4 weeks ago

🥹 Jamba is truly amazing! Everyone speaks about Long Context. But it's been mostly useful for ingesting in-context learning. But Jamba seems to be the first Model offering a great throughput even for higher context!

AI21Labs Profile Picture

AI21 Labs @AI21Labs

4 weeks ago

This Jamba overview is a great way to quickly understand the novel features Jamba brings to the dev community. Thanks @AiFlux!

AiFlux Profile Picture

Ai Flux @AiFlux

a month ago

This Jamba overview is a great way to quickly understand the novel features Jamba brings to the dev community. Thanks @AiFlux!

AI21 Labs retweeted
maximelabonne Profile Picture

Maxime Labonne @maximelabonne

a month ago

I played a little with Jamba: it looks like an amazing model. In terms of architecture, the MoE implementation is very close to Mixtral's. What's great about it is that it hasn't been fine-tuned. Curious to see how much improvement we can get through SFT. I made a little…

AI21Labs Profile Picture

AI21 Labs @AI21Labs

a month ago

I played a little with Jamba: it looks like an amazing model. In terms of architecture, the MoE implementation is very close to Mixtral's. What's great about it is that it hasn't been fine-tuned. Curious to see how much improvement we can get through SFT. I made a little… https://t.co/g01vjsZxvx

AI21 Labs retweeted
gordic_aleksa Profile Picture

Aleksa Gordić 🍿🤖 @gordic_aleksa

a month ago

Extremely cool new model release from @AI21Labs - Jamba - and it's not even a transformer! It's a hybrid model that combines Mamba (structured state space model), transformer layers and MoE technique, and it's a first production-grade Mamba based model! * It's a 52B MoE with 12B…

AI21 Labs retweeted
swyx Profile Picture

swyx @swyx

a month ago

incredibly impressed by @AI21Labs' Jamba today. This is the first legitimate Mixtral-killer we've seen and it came out of "nowhere": buttondown.email/ainews/archive… They've helped me redefine my idea of a model "weight class" from "number of parameters" (increasingly outdated with MoEs…

AI21 Labs retweeted
IntuitMachine Profile Picture

Carlos E. Perez @IntuitMachine

a month ago

OMG! Jamba! 3X throughput and fits 140K context on a single GPU!

AI21Labs Profile Picture

AI21 Labs @AI21Labs

a month ago

Find our new model on @huggingface.

_philschmid Profile Picture

Philipp Schmid @_philschmid

a month ago

Find our new model on @huggingface.

Trends for United States

Lakers
247 B posts
Jamal Murray
78,3 B posts
Lebron
144 B posts
Darvin Ham
51,2 B posts
Hamilton Hall
38,5 B posts
Jokic
35,4 B posts
Nuggets
116 B posts
Nuggets
116 B posts
TROUBLESHOOTING OUT NOW
5.246 posts
#꿈을꾸는_엑디즈_첫정규_축하해
7.496 posts
Good Tuesday
15,1 B posts
$SKR
837 B posts
Anthony Davis
12,5 B posts
#tuesdayvibe
8.364 posts
Reaves
18,4 B posts
#Wordle1046
Vando
13,2 B posts
#WWERaw
156 B posts
SUSTAINOVATIVE LIVING WITH APO
271 B posts
Cancun
19,8 B posts

You might like

We remove the barriers to state-of-the-art generative AI model development and make data + AI available to all.
Databricks Mosaic Res..
@DbrxMosaicAI
30K Followers
We're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant Claude at https://t.co/aRbQ97uk4d.
Anthropic
@AnthropicAI
262K Followers
ML Researcher, co-leading Superalignment @OpenAI. Optimizing for a post-AGI future where humanity flourishes.
Jan Leike
@janleike
44K Followers
Amplify your team's potential with customizable and secure AI assistants.
Dust
@dust4ai
7K Followers
Researching reasoning @OpenAI | Co-created Libratus/Pluribus, the first superhuman no-limit poker AIs | Co-created CICERO | PhD from @SCSatCMU
Noam Brown
@polynoamial
34K Followers
Give your technology language.
cohere
@cohere
99K Followers
Making AI systems that reason, so they can safely accomplish larger goals for us in the real world. Join us: https://t.co/9UF0rR6YUr
Imbue
@imbue_ai
6K Followers
chief scientist / cofounder @RekaAILabs 🫠 past: research scientist @google brain 🤯 currently learning to be a dad 🍼
Yi Tay
@YiTayML
29K Followers
Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGz
Sasha Rush
@srush_nlp
52K Followers
Director of Machine Learning @Cohere | ex-huggingface | Creator of SBERT (https://t.co/MKKOMfuQ4C)
Nils Reimers
@Nils_Reimers
10K Followers
I build tough benchmarks for LMs and then I get the LMs to solve them. Postdoc @Princeton. PhD from @nlpnoah @UW. Ex-visiting researcher @MetaAI & @MosaicML.
Ofir Press
@OfirPress
10K Followers
Open and responsible research and development of large language models for code. #BigCodeProject run by @huggingface + @ServiceNowRSRCH
BigCode
@BigCodeProject
9K Followers
An all-in-one GenAI platform where you can edit, summarize, generate text, and more. Save time & boost productivity—create a free account today: https://t.co/FOhY7VlHcC
Wordtune
@wordtune
5K Followers
Large language model safety
Ethan Perez
@EthanJPerez
6K Followers
AI Aligned with Your Vision. We’re doing cutting edge research for transparent, auditable AI alignment.
SynthLabs
@synth_labs
12K Followers