BigCode @BigCodeProject
Open and responsible research and development of large language models for code. #BigCodeProject run by @huggingface + @ServiceNowRSRCH bigcode-project.org Joined August 2022-
Tweets266
-
Followers9K
-
Following3
-
Likes229
Happy to release SWE Arena, your vibe coding platform! SWE Arena supports real-time code execution and rendering, covering various frontier LLMs & VLMs! We actually had this idea two years ago inside @BigCodeProject with @ArjunGuha and @dan_fried. However, there wasn't much tech…
Happy to release SWE Arena, your vibe coding platform! SWE Arena supports real-time code execution and rendering, covering various frontier LLMs & VLMs! We actually had this idea two years ago inside @BigCodeProject with @ArjunGuha and @dan_fried. However, there wasn't much tech…
BigCodeBench @BigCodeProject evaluation framework has been fully upgraded! Just pip install -U bigcodebench With v0.2.0, it's now much easier to use compared to the previous v0.1.* versions. The new version adopts the @Gradio Client API interface from @huggingface Spaces by…
Evaluating LM agents has come a long way since gpt-4 released in March of 2023. We now have SWE-Bench, (Visual) Web Arena, and other evaluations that tell us a lot about how the best models + architectures do on hard and important tasks. There's still lots to do, though 🧵
People may think BigCodeBench @BigCodeProject is nothing more than a straightforward coding benchmark, but it is not. BigCodeBench is a rigorous testbed for LLM agents using code to solve complex and practical challenges. Each task demands significant reasoning capabilities for…
By popular demand, I have released the StarCoder2 code documentation dataset, please check it out ⬇️ hf.co/datasets/Sivil…
This work will appear at OOPSLA 2024. New since last year: the StarCoder2 LLM from @BigCodeProject uses MultiPL-T as part of its pretraining corpus.
This work will appear at OOPSLA 2024. New since last year: the StarCoder2 LLM from @BigCodeProject uses MultiPL-T as part of its pretraining corpus.
Today, we are happy to announce the beta mode of real-time Code Execution for BigCodeBench @BigCodeProject, which has been integrated into our Hugging Face leaderboard. We understand that setting up a dependency-based execution environment can be cumbersome, even with the…
Today, we are happy to announce the beta mode of real-time Code Execution for BigCodeBench @BigCodeProject, which has been integrated into our Hugging Face leaderboard. We understand that setting up a dependency-based execution environment can be cumbersome, even with the… https://t.co/xweePkDKNX
Releasing BigCodeBench-Hard: a subset of more challenging and user-facing tasks. BigCodeBench-Hard provides more accurate model performance evaluations and we also investigate some recent model updates. Read more: huggingface.co/blog/terryyz/b… Leaderboard: huggingface.co/spaces/bigcode…
BigCodeBench dataset🌸 Use it as inspiration when building your Generative AI evaluations. BigCodeBench h/t: @BigCodeProject @terryyuezhuo @lvwerra @clefourrier @huggingface (to name just a few of the people involved)
Ppl are curious about the performance of DeepSeek-Coder-V2-Lite on BigCodeBench. We've added its results, along with a few other models, to the leaderboard! huggingface.co/spaces/bigcode… DeepSeek-Coder-V2-Lite-Instruct is a beast indeed, similar to Magicoder-S-DS-6.7B, but with only…
Ppl are curious about the performance of DeepSeek-Coder-V2-Lite on BigCodeBench. We've added its results, along with a few other models, to the leaderboard! huggingface.co/spaces/bigcode… DeepSeek-Coder-V2-Lite-Instruct is a beast indeed, similar to Magicoder-S-DS-6.7B, but with only… https://t.co/fC2NCmDire
It is time to deprecate HumanEval! 🧑🏻💻 @BigCodeProject just released BigCodeBench, a new benchmark to evaluate LLMs on challenging and complex coding tasks focused on realistic, function-level tasks that require the use of diverse libraries and complex reasoning! 👀 🧩 Contains…
In the past few months, we’ve seen SOTA LLMs saturating basic coding benchmarks with short and simplified coding tasks. It's time to enter the next stage of coding challenge under comprehensive and realistic scenarios! -- Here comes BigCodeBench, benchmarking LLMs on solving…
In the past few months, we’ve seen SOTA LLMs saturating basic coding benchmarks with short and simplified coding tasks. It's time to enter the next stage of coding challenge under comprehensive and realistic scenarios! -- Here comes BigCodeBench, benchmarking LLMs on solving… https://t.co/w3Z6N5wnVk
Going "Beyond #OpenResearch" in session 3, @jen_gineered (@turinginst) discusses how we can scrutinise the reliability of data-based applications like #models & #AI and the key role of public involvement. Who has a stake in the technology and at which points can they be involved?
Foundation models are central to AI's impact on the economy and society, making transparency crucial for accountability and understanding. The Foundation Model Transparency Index v1.1 (FMTI) analyzes transparency of 14 leading foundation model developers with 100 indicators. 🧵
Check out this collection I made to show what you can create using this pipeline. It focuses on a sentence transformer model for detecting coding prompt similarities in a @BigCodeProject dataset. huggingface.co/collections/da…
It’s been a year since the release of @BigCodeProject’s 💫 StarCoder models and paper: May the source be with you! Join us as we celebrate the anniversary, and share what you’ve done using #StarCoder. Read how StarCoder has helped ServiceNow developers: servicenow.com/blogs/2024/big…
Self-Instruct for CodeLLMs! 👀 @BigCodeProject released a new StarCoder2-Instruct, the first entirely self-aligned code LLM trained with a transparent and permissive pipeline. 🧑🏻💻 It used itself to generate thousands of instruction-response pairs, which were then used to…
Jim Fan @DrJimFan
325K Followers 3K Following NVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
Hugging Face @huggingface
560K Followers 208 Following The AI community building the future. https://t.co/VkRPD0Vclr
clem 🤗 @ClementDelangue
155K Followers 5K Following Co-founder & CEO @HuggingFace 🤗, the open and collaborative platform for AI builders
Omar Sanseviero @osanseviero
50K Followers 3K Following Developer Experience Lead at @GoogleDeepMind Building Gemini API, Gemma, AI Studio and more AI products. My views ex-Chief Llama Officer @huggingface 🇵🇪🇲🇽
merve @mervenoyann
80K Followers 5K Following open-sourceress at @huggingface 🧙🏻♀️proud Aegean, I work on computer vision, VLMs & agents | gençleri serbest bırakın
Jeremy Howard @jeremyphoward
259K Followers 6K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Prev: professor @ UQ; Stanford fellow; @kaggle president; @fastmail/@enlitic/etc founder https://t.co/16UBFTX7mo
Thomas Wolf @Thom_Wolf
94K Followers 6K Following Co-founder at @HuggingFace - open-source and open-science
Soumith Chintala @soumithchintala
250K Followers 1K Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Jay Hack @mathemagic1an
55K Followers 3K Following Building @codegen. Tweets about AI, computing and dev tools. Previously did startups, @palantir. Not a pseudonym.
Brendan Dolan-Gavitt @moyix
30K Followers 6K Following Building offsec agents: https://t.co/G9EtnC2Gl3 PGP https://t.co/3WXr0RfRkv
👩💻 Paige Bai... @DynamicWebPaige
69K Followers 2K Following ✨ AI should be about empowering humans, building understanding, and making dreams realities. 👩💻 DevX Eng. Lead @GoogleDeepMind ex-@GitHub || views = my own!
EleutherAI @AiEleuther
25K Followers 89 Following A non-profit research lab focused on interpretability, alignment, and ethics of artificial intelligence. Creators of GPT-J, GPT-NeoX, Pythia, and VQGAN-CLIP
near @nearcyan
86K Followers 1K Following i help make https://t.co/jZh799yNH4, the best AI for self-improvement, introspection, and emotional processing. https://t.co/ac0cp4UZ9h
Sasha Luccioni, PhD �... @SashaMTL
22K Followers 4K Following Climate & AI Lead of @HuggingFace | Member of ClimateChangeAI | @TEDTalks speaker . (She/her/Dr/🦋)
MMitchell @mmitchell_ai
80K Followers 1K Following Interdisciplinary researcher focused on shaping AI towards long-term positive goals. ML & Ethics. Similar content in the Skies (this bird has flown).
🍉 Abubakar Abid @abidlabs
14K Followers 2K Following The Israeli army has burned, shot, or bombed 23,000 Palestinian children this year alone. Please speak up: https://t.co/ToigfsQCPo
Sharif Shameem @sharifshameem
62K Followers 4K Following playing with models at https://t.co/nilsSlNY9X • made @LexicaArt • the best way to predict the future is to invent it
Sara Hooker @sarahookr
49K Followers 9K Following I lead @Cohere_Labs. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, ML reliability. Changing spaces where breakthroughs happen.
askturing.ai @askturingai
53 Followers 489 Following Turn your documents into a private AI knowledge base with AskTuring. SOC 2 secure, zero training on your data. Join the waitlist today 👇
云创兽Ai @Srucea7481
0 Followers 85 Following 😊 tracking market trends lover, dream chaser! passionate about trends. DM me about dividend investing! ✨ #Nasdaq #Stocks
HumanistAtypik @HumanistAtypik
447 Followers 4K Following Humaniste donc écosocialiste. Radical mais réformiste. Neuroatypique : #hpi #tdah #dysgraphique. Iconoclaste anticonformiste mais pas anti-tout ! ;-) #ric
Victor Hugo @VictorHugo45995
0 Followers 7K Following
童小飞 @5iCAHhAqP897443
51 Followers 892 Following
boyu zhang @gjiowgj
0 Followers 5 Following
EpicProspector @EpicProspector
18 Followers 28 Following EpicCash rookie with a pickaxe—dug into privacy tech, found some gold & here to spill all the beginner’s secrets.
Scary Sandwich @scarysandwich13
21 Followers 221 Following
FreeDom Yemen @Face_Freedom
384 Followers 2K Following إذا اعتاد الملوك على الهوان فذكرهم بأن الموتَ دانِ
Vincenzo Gallo @gallo50503
0 Followers 14 Following 📈 Data Analysis | Machine Learning | Generative AI 🧩 Costruisco e analizzo dataset per LLM & AI solutions 🌍 Open-Source & BigCode Contributor 💻 Web Develope
Owen Parsons @oeparsons
553 Followers 2K Following Lead Machine Learning Researcher at @MindFoundry. Previously cognitive neuroscience PhD at @ARC_Cambridge.
ြৰদঁረ @0xfi_lt_eb_anks
64 Followers 476 Following
Manjunath Reddy K @Manju_111
56 Followers 805 Following
engbryanwills @bryan_wills
40 Followers 1K Following
Sanjeev Kushwaha @SanjeevKus58098
9 Followers 123 Following Aspiring Data Analyst | SQL, Python,Power Bi, Statistics
freedom @freedom1297299
2 Followers 114 Following
JacobRedner @RednerJacob
12 Followers 129 Following
vedicquant 🇵🇹�... @vedicquant
81 Followers 110 Following Blending ancient vedic timing with machine learning to generate signals. Educational. There is no token.
Santosh Patapati @ IC... @santoshpatapati
146 Followers 477 Following Computer Vision Optimization and Theory. prev @3blue1brown, @UW, & Stealth (acq $1M+)
virtuosos 🛡️🐸 @virturex1
63 Followers 448 Following
Shilin HE @ShilinHe
99 Followers 421 Following AI4SE, AI Coding, LLM, Agent Applied Scientist @Bytedance, Prev MSRA Researcher @Microsoft , Ph.D. @CUHKOfficial
堀田吉伸 @woodstock8594
25 Followers 1K Following
Aditya Vipradas @aditya_vip97379
0 Followers 71 Following
Brickroad @TryBrickroad
65K Followers 334 Following The front door to the world's data. A full-stack agentic data procurement and monetization network, built on Irys. Beta is out now.
Myrtis Spencer @MyrtisSpen61411
82 Followers 4K Following
Nir Zilberman @nirzilberman
87 Followers 8K Following
Fabiano Falcão @fabianumfalco
320 Followers 163 Following Engenheiro de Software | Mestrando em Segurança Cibernética | AWS Certified Machine Learning Specialty
TheGabsAI @TheGabsAI
33 Followers 826 Following
HW_Duan @haowucgc
218 Followers 2K Following Physicist to AI researcher. Building AI assistant for scientific discovery. Interpretability. Connection between ML and renormalization group
Jordi Mon Companys @JordiMonPMM
791 Followers 1K Following Product | Software Delivery, Langtech and Software Supply Chain Security. @openuk_uk 🇬🇧 ambassador
Abhinav Srivastava @Abhinav47001998
20 Followers 58 Following The beauty you see in others is the beauty within you.
Angela amine @Angela70023053
51 Followers 1K Following
CodeStackDev @CodeStackDev
0 Followers 17 Following 📊 Data Engineer specializing in code datasets for ML 🏆 Creator: "The Stack Processed V2" - top performing processed dataset 💡 Dataset optimization | Quality
xOhoomfAy @jfFxjfgLrmKRr
102 Followers 1K Following
Matt Lamb @MattLamb13219
0 Followers 4 Following
teeds @aliceteeds
3 Followers 381 Following
Carlos Lemos @carloslemosbr
17 Followers 1K Following
BritishWerewolf @BritWerewolf
364 Followers 423 Following LLM | AI Engineer | Transformers | Contributor to @HuggingFace open models & resources🤗 Building @WolfAgentAi FnTx9JED8mQuhXPyet9KTwdSDm2VHjLtU9krhHiopump
Blunero @bluneroinc
17 Followers 147 Following Posting about technology and science. https://t.co/LsuNhl21kq
Jaycee Feest @FeestJayce33232
47 Followers 3K Following
Synapse Squad 🧠 @synapsesquad
82 Followers 170 Following AI implementation consultancy | Helping small & medium businesses unlock productivity with proven AI tools | Training teams, not replacing them.
Hugging Face @huggingface
560K Followers 208 Following The AI community building the future. https://t.co/VkRPD0Vclr
ServiceNow Research @ServiceNowRSRCH
18K Followers 1K Following Unlock work experiences of the future. Join @ServiceNowRSRCH as we advance the state-of-the-art in Enterprise AI. #ServiceNowResearch #LifeAtNow #Hiring
BigScience Research W... @BigscienceW
14K Followers 1 Following A research workshop on large language model gathering 1000+ researchers around the world Follow the training of the 176B multilingual model live @BigScienceLLMTrends for United States
You might like
