The new bitsandbytes is here:
~15% faster 4-bit
~70% faster 8-bit inference
8-bit support for H100s
github.com/bitsandbytes-f…
Great engineering from @mattkdouglas. bitsandbytes now receives about 100,000 installations daily.
A little history on 8-bit implementations in bnb 🧵
234 Followers 275 FollowingResearch Intern @samaya_AI | PhD student at @nlp_usc | Former: BS/MS student doing research in #NLProc at @uwcse @uwnlp | Previously research at @apple, @amazon
11K Followers 3K FollowingThe Paul G. Allen School of Computer Science & Engineering educates tomorrow's innovators while developing solutions to humanity's greatest challenges.
473 Followers 825 FollowingNLP + PL research at @bardeenai Opinions my own. Also at @gcampax on https://t.co/R2zDScOmuS and https://t.co/yQw8XzXxgb . he/him
5K Followers 2K FollowingAssistant Prof @CIS_Penn and ML Researcher at @Apple (MLR) | exFAIRer | PhD @HKUniversity | Research on Generative AI for multimodal. また日本語もできます。
327K Followers 3K FollowingNVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
42K Followers 111 Following• Center for AI Safety Director
• xAI and Scale AI advisor
• GELU/MMLU/MATH/HLE
• PhD in AI
• Analyzing AI models, companies, policies, and geopolitics
1K Followers 371 FollowingNatural language processing group at UMass Amherst @umasscs. Led by @thompson_laure @MohitIyyer @brendan642 @andrewmccallum #nlproc
4K Followers 361 FollowingThe NLP group at @USCViterbi. @DaniYogatama+@_jessethomason_+@jieyuzhao11+@robinomial+@swabhz+@xiangrenNLP at @CSatUSC + researchers @USC_ICT, @USC_ISI.
8K Followers 248 FollowingResearch @Meta Superintelligence Labs, I led Llama 2, built post-training from scratch. Also Toolformer, GAIA, Llama-3.0, CodeLlama, Galactica
167K Followers 167 FollowingCo-founder of Thinking Machines Lab @thinkymachines; Ex-VP, AI Safety & robotics, applied research @OpenAI; Author of Lil'Log
9K Followers 52 FollowingThe official account of the Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics.
165K Followers 0 FollowingInvented principles of meta-learning (1987), GANs (1990), Transformers (1991), very deep learning (1991), etc. Our AI is used many billions of times every day.
No recent Favorites. New Favorites will appear here.