Axolotl is the premier open source LLM fine tuning framework. find us on discord https://t.co/wlcE2wlJa9 or email us at [email protected]axolotl.ai San Francisco, CAJoined December 2023
Want to fine-tune gpt-oss-120b?
We teamed up with Axolotl to launch a new recipe to run fine-tuning out of the box — multi-node training, one-line deployments from the CLI, and built-in observability included.
Finally, we also release a blogpost 📖, explaining these strategies in a comprehensive manner, comparing them to each another and explaining how they combine. This also comes with amazing visualisations and tips on when to you use which combination!
huggingface.co/blog/accelerat… 4/5
We have cooked some something nice with @axolotl_ai for 🤗 accelerate v1.10.
Have you ever wanted to train a large model, but couldn't setup your env? Current multi-gpu frameworks are hard to install, the configuration has like 100 options. Here comes ParallelismConfig 🚀 1/5 🧵
🚨 Introducing the Axolotl-LLM Compressor integration, designed to make fine-tuning sparse models easier and more efficient than ever! Now you can fine-tune sparse models for specific data while preserving their sparse structure and recovering any accuracy lost during pruning.…
Looking to fine-tune models?
Meet @axolotl_ai 💚 an open-source tool that simplifies the entire fine-tuning pipeline. Learn how to get started with our tutorial covering how to fine-tune Llama 3 🦙
koyeb.com/tutorials/usin…
1K Followers 972 FollowingIncoming Assistant Professor @UTCompSci, Senior Researcher @togethercompute, PhD @UCBerkeley. Working on building cooler things with fewer cost 😊
125 Followers 176 FollowingEntrepreneur, Data Evangelist in Big Data, AI, ML, NLP, LLMs, Cloud... Above all, Curious George to learn New stuff to build New things.
1K Followers 8K FollowingAI inference, speculative decoding, open source. Built novel decoding algorithms – default in Hugging Face Transformers (150+ ⭐). Making AI faster + cheaper
157 Followers 1K Followingindependent tech and contract services, focusing on dev ops, container optimization, site reliability engineering, and disaster recovery
4K Followers 1K Followingsince age of 6, it's been me & the code. architecting tech for a fortune 500 + a lot of hobby projects (some slightly profitable). currently focusing on ai.
474 Followers 995 FollowingData Scientist at BDiM GmbH | PhD in Seismology | Digital Signal Processing | Applied Deep Learning | AI Dev | Prev.: @GFZ_Potsdam and @DIAS_Dublin
453 Followers 2K FollowingA Certain Imprisoned Fox. Im not responsible for any mental scars created by my excessive need to talk about card games and gacha's
268 Followers 2K FollowingApplied Scientist @Amazon Alexa,
CS Masters - UMass Amherst,
CE Undergrad - Aligarh Muslim University,
Views my own | Narendra Modi is a fascist
385 Followers 2K Following25, applied researcher & technologist. on device model maxxing. building https://t.co/25TLHHPpct. publishing https://t.co/PJ38iC4XaW. community https://t.co/7tTyptKfRX.
395 Followers 202 FollowingDemocratize Intelligence. Open-Source AGI. Own the infrastructure of the future.
https://t.co/P2oRSUU12a
CA: 0x66641e5919d4296f7c396fa3205428f9ce8d1b1d
4K Followers 44 FollowingThe official Twitter handle for the Podman project, https://t.co/GthMfAW60K. An OpenSource project found on GitHub: https://t.co/Q2dC7tNfDn
13K Followers 4K FollowingDevoted to addressing alignment. We develop state of the art open sourced AI.
https://t.co/oANsMnut7V
https://t.co/6aJDLUvuU5