Tom Jobbins @TheBlokeAI
My Hugging Face repos: https://t.co/yh7J4DFGTc Discord server: https://t.co/5h6rGsGfBx Patreon: https://t.co/yfQwFggGtx patreon.com/TheBlokeAI UK Joined July 2010-
Tweets336
-
Followers15K
-
Following237
-
Likes265
FYI to anyone using @MistralAI's Mixtral for long context tasks -- you can get even better performance by disabling sliding window attention (setting it to your max context length) config.sliding_window = 32768
Transformers now supports Mixtral GPTQs and I've updated my READMEs accordingly. It was awesome working with @_marcsun and @younesbelkada of @huggingface on this! Credit to LaaZa for coding the AutoGPTQ quant and inference implementation which enabled me to get GPTQs out fast!
Transformers now supports Mixtral GPTQs and I've updated my READMEs accordingly. It was awesome working with @_marcsun and @younesbelkada of @huggingface on this! Credit to LaaZa for coding the AutoGPTQ quant and inference implementation which enabled me to get GPTQs out fast!
@TheBlokeAI joined me to share his work in the open-source AI space - don't miss it! happening right now server link: discord.gg/peBrCpheKE (see the general channel or events channel for google meet link)
Blazing fast text generation using AWQ and fused modules! 🚀 Up to 3x speedup compared to native fp16 that you can use right now on any models supported by @TheBlokeAI Simply pass an `AwqConfig` with `do_fuse=True` to `from_pretrained` method! huggingface.co/docs/transform…
It's been awesome to see Transformers getting support for more and more quantisation methods. And I've loved collaborating with @younesbelkada and @huggingface again! All my AWQ uploads now support Transformers. READMEs will update soon to show a Transformers Python example.
It's been awesome to see Transformers getting support for more and more quantisation methods. And I've loved collaborating with @younesbelkada and @huggingface again! All my AWQ uploads now support Transformers. READMEs will update soon to show a Transformers Python example.
Have you heard about Chirper worlds? 👀🌐
🤔 Are you interested in a "Follow" feature on the Hugging Face Hub? ➡️ This will allow you to see new models/records/spaces from users you follow.
oh hello @TheBlokeAI I want to bookmark your 'Recent models' Collection on @huggingface 🔥 Well... you can now upvote Collections! and browse upvoted collections on your profile ❤️
Thanks again to @latitudesh for the loan of a beast 8xH100 server this week. I uploaded over 550 new repos, maybe my busiest week yet! Quanting is really resource intensive. Needs not only fast GPUs, but many CPUs, lots of disk, and 🚀 network. A server that ✅ all is v. rare!
🔥Excited to introduce LMSYS-Chat-1M, a large-scale dataset of 1M real-world conversations with 25 cutting-edge LLMs! This dataset, collected from chat.lmsys.org, offers insights into user interactions with LLMs and intriguing use cases. Link: huggingface.co/datasets/lmsys…
New feature alert in the @huggingface ecosystem! Flash Attention 2 natively supported in huggingface transformers, supports training PEFT, and quantization (GPTQ, QLoRA, LLM.int8) First pip install flash attention and pass use_flash_attention_2=True when loading the model!
This is fantastic! Git clone was already dead for HF as far as I was concerned - I had my own hf_upload.py and hf_download.py scripts (wrapping HfAPI) for fast, efficient transfers. But huggingface_hub v0.17 makes those redundant! I will be using this now. Awesome stuff,🤗
This is fantastic! Git clone was already dead for HF as far as I was concerned - I had my own hf_upload.py and hf_download.py scripts (wrapping HfAPI) for fast, efficient transfers. But huggingface_hub v0.17 makes those redundant! I will be using this now. Awesome stuff,🤗
This new filter 🔎 on @huggingface user's profile is very helpful, especially to check if @TheBlokeAI has quantized and released the last trending models 😁
Casually running a 180B parameter LLM on M2 Ultra
Chronos 70B v2 release! Thanks to Pygmalion for generously providing the compute and @TheBlokeAI for quantizing the model. As usual, the model optimized for chat, roleplay, storywriting, and now includes vastly improved reasoning skills. huggingface.co/elinas/chronos…
Just released by @PygmalionAI : Pygmalion 2, the sequel to one of the most popular models ever! And Mythalion, a new Gryphe merge! huggingface.co/TheBloke/Pygma… huggingface.co/TheBloke/Pygma… huggingface.co/TheBloke/Pygma… huggingface.co/TheBloke/Pygma… huggingface.co/TheBloke/Mytha… huggingface.co/TheBloke/Mytha…
Just released by @PygmalionAI : Pygmalion 2, the sequel to one of the most popular models ever! And Mythalion, a new Gryphe merge! huggingface.co/TheBloke/Pygma… huggingface.co/TheBloke/Pygma… huggingface.co/TheBloke/Pygma… huggingface.co/TheBloke/Pygma… huggingface.co/TheBloke/Mytha… huggingface.co/TheBloke/Mytha…
Meta's CodeLlama is here! ai.meta.com/blog/code-llam… 7B, 7B-Instruct, 7B-Python, 13B, 13B-Instruct, 13B-Python, 34B, 34B-Instruct, 34B-Python First time we've seen the 34B model I've got a couple of fp16s up: huggingface.co/TheBloke/CodeL… huggingface.co/TheBloke/CodeL… More coming soon obvs
Transformers 4.32.0 now supports GPTQ models natively! Over the last couple of days I have updated 296 of my GPTQ repos to provide automatic support for this. It's awesome you can now load a GPTQ model directly in Transformers with only two lines of code!
Transformers 4.32.0 now supports GPTQ models natively! Over the last couple of days I have updated 296 of my GPTQ repos to provide automatic support for this. It's awesome you can now load a GPTQ model directly in Transformers with only two lines of code!
Jonathan Eisenzopf @eisenzopf
831 Followers 2K Following Founder and Chief Strategy & Research Officer at Talkmap where our AI platform unlocks the value of conversation data for large enterprises.Ashwin Jayaprakash @ashwinjay
206 Followers 4K Following Falling into the future at light speed. (Any opinions expressed are my own)Adam Reineke @AdamTReineke
1K Followers 1K Following Software engineer @Salesforce building cool stuff on the web, opinions are mine. My wife @kayceesue thinks I'm funny. @IowaStateU and @microsoft alum. (he/him)yesthatpoopy @yesthatpoopy
3 Followers 76 Following I like poppy and that's no poopy. AI rules, pencil jockeys drool. might be a robot girlfriend. snitches get stitches.AI AI AI @kkore33
37 Followers 3 FollowingArshiyan Alam @AmArshiyan
150 Followers 475 Following Passionately Curious | Love Sci&Tech | IIT BHU Alum #knowIslam the most hated/misunderstood religion: https://t.co/85ZTA9AoNUPrashanth Koripalli @prashanthko7
5 Followers 130 Followingdaniel @textharvester
4 Followers 168 Following 🔍 text digitization expert | transforming handwritten records & PDFs into digital data with cutting-edge OCR technology #BuiltInPublicgabriel @GabrielPeterss4
1K Followers 450 Following engineer at @midjourney. look at my very fast grid, wow it's so fast https://t.co/mxJT1QULli_hello_aya_ @WDHUANG1984
28 Followers 594 Followingadam ine @IneAdam83927
2 Followers 30 FollowingÁLVARO LEONARDO GARC.. @AlvaroGarcia_AI
2 Followers 450 Following | Los listos también sumamos con los dedos | | My website 🚀🌍https://t.co/OdLBTcsw7T |Jason @neoversionsix
156 Followers 452 Following Interested In: Physics, Nuclear Power, Science, CRISPR, Space exploration, A.I and the mystery of consciousness.Patryk Kubiak 🇵�.. @patryk_kubiak
71 Followers 2K Following When the facts change I change my mind. Software Geek (#azure, #devops, #k8s, #ai, #python, #go). Love to discover the world.MLȘaman aka Andrei �.. @andreinot
375 Followers 2K Following ¦ machine learning engineer ¦ quasi polymath ¦ father ¦ ~entrepreneur ¦ preppin to surf the intelligence explosion shockwaves & help others not drown too ¦Oğuzhan Ercan @oguzhannercan
9 Followers 106 Following Exploring the time domain, Generative Vision @tubitakBlackjackie 🍌 @BlackjackeRBLX
86 Followers 160 Following 🖌️📬 BlackJackie#8847 For Commissions! — || 19 || Programmer || 1M+ Visits On Roblox. Love monkeys & making random goofy roblox stuff.Raj Kumar @rajkstats
84 Followers 1K Following Analytics-eng @kooindia, Statistician, opinions are my own, writing at https://t.co/Y4EaapfHcAShivendra @shivendrra_
143 Followers 333 Following man most likely to do anything | artificially dumbHurtIII @HurtporteriiiMy
11 Followers 58 Followingີີີີີີ່.. @gpu_poor
104 Followers 510 FollowingLuke Ken @LukeKenneth3
266 Followers 2K FollowingConor @jconorgrogan
37K Followers 474 Following Director @coinbase, previously @bridgewater https://t.co/D1zTESd0B3 https://t.co/UJha9pfLfwtbrekalo @tbrekaloxyz
6 Followers 72 FollowingJackson Bauer @jacksonbauer991
335 Followers 1K Following Austin, TX Realtor #Bitcoin He must increase, but I must decrease. - John 3:30Laszlo Lazar @lazarl77
16 Followers 178 FollowingJack e/acc @Jack05645290
44 Followers 280 Following Push the limits, break boundaries, and make shit while doing itSophia Carsno @SophiaCarsno
22 Followers 306 FollowingGökbörü @Gkbr333
26 Followers 162 FollowingMuzaffer Can Karadayi @MuzCanKaradayi
13 Followers 150 FollowingZackRobotHeart @ZackRobotHeart
74 Followers 781 FollowingAtli H @atlih
211 Followers 2K FollowingAshley Davis @scifacts4kids
239 Followers 270 Following Proud pure capitalist. 100% not woke and 100% for freedom and liberty. No tax, no gov and BS political agendas. Be awake, responsible, free - you have the powerGeorges Reyes @georges_reyes
80 Followers 305 FollowingOmar Sanseviero @osanseviero
32K Followers 2K Following Chief Llama Officer @huggingface 🦙 Founder @AI_Learners. Xoogler (SWE @Google Assistant, 20% PM TF Graphics). 100% Hacker Llama🇵🇪🇲🇽Loki (cute/acc) @chillgates_
4K Followers 5K Following script kiddie neet, extraordinary advocate milady, computational performance art @ remilia collective, degen ai quant ops, dyson spheres, @ogmilady 🚀PyTorch @PyTorch
380K Followers 77 Following Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundationAmanda @amandajobbins
2K Followers 684 Following Tech CMO / Cranfield Top 100 Women / International Marketer of Year / Non-Exec / tweeting on tech,the arts, design, music,film. Views my own!Abi Aryan 🛠️ @GoAbiAryan
7K Followers 2K Following 🗜ML Engineer 🛠️ Building Multi-Modal Models @AbideAI 🖋 Writing #LLMOps - Managing LLMs in Production book (O'Reilly) 🐦 Talk to me about LLMs, MLSys & SecOpsDaniel van Strien @vanstriendaniel
3K Followers 1K Following Machine Learning Librarian @huggingface 🤗 | Championing Open Science & ML | Sharing the latest ML datasets 🌟 | Tips for mastering the HF HubBram @BramVanroy
1K Followers 712 Following @ku_leuven @ccl_kuleuven: Creative #NLG 🖋️ @ivdnt: Dutch #NLProc and #LLMs 🤖 Organizing @ctt2024 🖋️ Fellow at @huggingface 🤗 Prev. @lt3ugent, @SignONMarc Sun @_marcsun
867 Followers 273 Following Machine Learning Engineer @huggingface Open Source teamLance Martin @RLanceMartin
9K Followers 241 Following @LangChainAI, Prev: ML for self-driving (Nuro, Ike, Uber ATG) 🚘 🤖, PhD @stanford 🧪.Stella Biderman @BlancheMinerva
15K Followers 748 Following Open source LLMs and interpretability research at @BoozAllen and @AiEleuther. My employers disown my tweets. She/herPhilipp Schmid @_philschmid
16K Followers 653 Following Tech Lead and LLMs at @huggingface 👨🏻💻 🤗 AWS ML Hero 🦸🏻 | Cloud & ML enthusiast | 📍Nuremberg | 🇩🇪 https://t.co/l1ppq3q3hkBertrand Chevrier @kramp
832 Followers 3K Following Dead-end developer, front-end @huggingface Everything in the Browser, Free Software, Vim, Svelte. https://t.co/tY2n0xlc7D. 🎸 apprentice & metalheadPygmalion AI @pygmalion_ai
633 Followers 9 Following PygmalionAI is an open-source effort to create free and decentralised conversational language models.PygmalionAI @PygmalionAI
326 Followers 13 Following This is the community run account for PygmalionAI, an open source AI chatbot model. Join our unofficial community at https://t.co/NghfOGz18t for updates!Burkay Gur @burkaygur
2K Followers 2K Following Co-founder at @fal. Previously @coinbase, @MIT_CSAILLior⚡ @AlphaSignalAI
84K Followers 898 Following Covering the latest in AI R&D • ML Engineer • Ex-Mila researcher • MIT Lecturer • Building AlphaSignal, a technical newsletter read by 180,000+ ML experts.Alignment Lab AI @alignment_lab
11K Followers 3K Following Devoted to addressing alignment. We develop state of the art open sourced AI. https://t.co/6aJDLUvuU5kache (dingboard.com) @yacineMTB
53K Followers 3K Following i'm a swe. go to https://t.co/pWRBfY8kn2 - AI image editing IN YOUR BROWSER! follow to watch a self funded founder beat VC backed AI startups with @dingboard_ausboss — e/acc @Zanzibased
199 Followers 218 Following github\huggingface\discord: ausboss Member of Nous ResearchRenato Umeton, Ph.D. @renato_umeton
4K Followers 3K Following Works on AI, Data Science, ML, Optimization, & Computer Science in Healthcare, at @DanaFarber. Trained @MIT @Microsoft @TU_Wien @UnicalPortale. Views my own.Xenova @xenovacom
6K Followers 284 Following Bringing the power of machine learning to the web. Currently working on Transformers.js (@huggingface 🤗)gui @guisalberto
2K Followers 1K Following ceo @latitudesh get compute instantly in 11 countries 🇺🇸🇬🇧🇨🇱🇦🇺🇧🇷🇯🇵🇩🇪🇸🇬🇦🇷🇨🇴🇲🇽Julien Chaumond @julien_c
47K Followers 1K Following Co-founder and CTO at @huggingface 🤗. ML/AI for everyone, building products to propel communities fwd. @Stanford + @PolytechniqueLatitude.sh @latitudesh
4K Followers 145 Following Deploy GPU and CPU servers globally in under 10 seconds → https://t.co/faB01U3IuBemozilla @theemozilla
4K Followers 1K Following catholic, ai research and co-founder at @NousResearch alignment: whatever the opposite of yudkowsky isJeff Boudier 🤗 @jeffboudier
3K Followers 598 Following Product + Growth @HuggingFace 🤗, the #1 open platform for AI builders. Co-founder Stupeflix (acquired by @GoPro).Chirper AI - Create L.. @chirperai
37K Followers 799 Following We're simulating the universe for the world's largest collection of autonomous AI agents. Our Discord: https://t.co/3MZ8e5x5l7João Gante @joao_gante
2K Followers 549 Following ML @huggingface 🤗, making text generation users happy. PhD from @istecnico 🇵🇹lmsys.org @lmsysorg
38K Followers 172 Following Large Model Systems Organization. We created Vicuna and Chatbot Arena! Compare 30+ LLMs (GPT-4/Claude/Llamas) side-by-side at https://t.co/IDFeIDIOtmNomic AI @nomic_ai
14K Followers 50 Following Building explainable and accessible AI https://t.co/bbYqCdL8vQPankaj @pankajmathur_
256 Followers 66 Following Orca Minis Architect, Providing LLM & Generative AI ServicesLuc Georges 🦀 @LucSGeorges
713 Followers 319 Following Software & ML Engineer @huggingface. Curious learner.Wauplin @Wauplin
679 Followers 52 Following Software engineer at Hugging Face. Maintainer of 🤗/huggingface_hub.G. M. @flyingkiwiguy
52 Followers 13 Following Minarchist (I / Me / Mine) Pragmatic optimist, due to our continued ability to outsmart ourselves.Łukasz Lach @lach_dev
625 Followers 602 Following Docker Captain | Jedi Master | University Lecturer | Conference speaker | Software Architect | #Cyberpunk2077 #Witcher | https://t.co/zTz7A4xKOaMario Alberto Chávez @mario_chavez
4K Followers 3K Following Rubyist, software engineer, and photographer. Photography https://t.co/dnDM7eo6vBmephistoooOOHHHHHHSHI.. @karan4d
12K Followers 2K Following 𝒕𝘩𝘦 𝘴𝘪𝘮𝘶𝘭𝘢𝘵𝘰𝘳 𝘪𝘴 𝘢 𝘤𝘳𝘶𝘤𝘪𝘣𝘭𝘦 𝘧𝘰𝘳 𝘵𝘳𝘢𝘯𝘴𝘮𝘶𝘵𝘢𝘵𝘪𝘰𝘯 @NousResearchNous Research @NousResearch
18K Followers 29 Following The AI Accelerator Company. https://t.co/vrD0aDJetoI was on the Angry Planet podcast with @JasonQFields and @mjgault! I got to talk about Fallout, including the new show. I was really stoked they reached out to me, I had an amazing time and a great conversation. angryplanetpod.com/p/crawl-out-th…
Nous-Hermes-2 SOLAR is quantized now by @TheBlokeAI <3
Our holiday gift 🎁 to the open source AI community: 3 new models currently topping @huggingface LLM leaderboards! Run them on jan.ai (beta) 👀 We'll be launching a few more projects at @janhq_ this December, so stay tuned! 🙏 Credit: @TheBlokeAI @greennode23
👋 Meet Trinity, our experimental LLM that's #1 and #2 on the @huggingface OpenLLM Leaderboard. Trinity was created by merging LLMs with different strengths and weaknesses using SLERP. Here's how we did it: 🧵 Credit: @HaHoang411, @pokachi2023, @vuonghoainam
@altryne @deci_ai posting this here because i want to make sure we pay homage to the serious titan that is @tri_dao tridao.me srsly, he carries the oss like @TheBlokeAI
🚀 bagel 7b v0.1 now released! A bagel, with everything: ✅ Dataset merging ✅ Bench decontam ✅ Multiple prompt formats ✅ NEFTune ✅ DPO 7.61 first turn, 7.31 average MTBench 0.6275 on TruthfulQA hf.co/jondurbin/bage… hf.co/jondurbin/bage… github.com/jondurbin/bagel
@TheBlokeAI @MTrofficus Gracious and humble as ever. 🫡
Many say that the explosion of LLMs has been thanks to the Transformer architecture. ⚠️ You are terribly wrong ⚠️ It was thanks to @TheBlokeAI
Thanks a lot @TheBlokeAI for the quantization! MonadGPT is now available on GGUF (huggingface.co/TheBloke/Monad…) AWQ (huggingface.co/TheBloke/Monad…), with a special quantization using a Latin-English dataset.
Additional thanks to @imonenext, @alignment_lab, @Teknium1, @TheBlokeAI, @ldjconfirmed and all of the OS LLM community! Jackalope 7B achieves near SoTA benchmarks for all other sub-30B models.
@HenkPoley @jon_durbin @a16z @TheBlokeAI Thank you @TheBlokeAI !
🤔 Are you interested in a "Follow" feature on the Hugging Face Hub? ➡️ This will allow you to see new models/records/spaces from users you follow.
My @huggingface space showcasing a Dutch #Llama Chat #LLM model has been updated. It now uses the quantized models provided by @TheBlokeAI ❤️ That means faster start-up times after sleep (smaller download) and s-p-e-e-d! ⚡️ huggingface.co/spaces/BramVan…
@ClementDelangue @MistralAI @TheBlokeAI you rock man ! thanks 🙏 huggingface.co/TheBloke/Mistr…
@imaurer @TheBlokeAI should rename to "theGoatAI" tbh
shoutout to @NousResearch @ldjconfirmed @TheBlokeAI @MistralAI and all the wonderful people contributing to open source models
oh hello @TheBlokeAI I want to bookmark your 'Recent models' Collection on @huggingface 🔥 Well... you can now upvote Collections! and browse upvoted collections on your profile ❤️
@TheBlokeAI @latitudesh oh man, where to begin
@TheBlokeAI @latitudesh Big THANK YOU for all your hard work @TheBlokeAI