Human data for AGI. Our mission: to raise AGI with the richness of human intelligence — curious, witty, imaginative, and full of unexpected brilliance.surgehq.aiJoined June 2020
How do you know Gemini is seriously next-level?
Because as Demis says, it's “the most preferred chatbot in blind evaluations with third-party raters” 😎
🪅 Congrats to all our Google friends! 🪅
How do you know Gemini is seriously next-level?
Because as Demis says, it's “the most preferred chatbot in blind evaluations with third-party raters” 😎
🪅 Congrats to all our Google friends! 🪅
🎉Congrats on the massive achievement by Meta AI on Llama 2!
We are proud to accelerate and power the next generation of AI and LLMs and excited to see the wider adoption of Llama and the deep innovation happening in the ecosystem.
Llama is being used for all sorts of…
🎉Congrats on the massive achievement by Meta AI on Llama 2!
We are proud to accelerate and power the next generation of AI and LLMs and excited to see the wider adoption of Llama and the deep innovation happening in the ecosystem.
Llama is being used for all sorts of…
Making LLMs reliable is a tough task.
But this is where a lot of the LLM research and development work is focused.
Let's take a look at how LLMs are made reliable:
At Surge AI, we work with the top AI companies to improve LLM reliability.
This effort is essential to enable…
The most powerful LLMs in the world are trained on Surge AI’s RLHF.
Some of these models include code LLMs which are going to be huge for progress in AI!
Let’s look at some of the recent developments in code LLMs:
Foundational Code LLMs - Research indicates that foundational…
Human Evaluation in LLMs
One of the more challenging aspects of LLM research is evaluation.
Here are some of our observations based on past and ongoing research:
At Surge AI, we provide human evaluation for finetuning and RLHF and for both closed and open-source LLMs.
Human…
What is SFT data and what role does it play in state-of-the-art LLMs?
Supervised finetuning (SFT) in the context of RLHF deals with further tuning an initial language model using demonstration data.
At Surge AI, we provide SFT data for top LLM teams to finetune their LLMs. Here…
RLHF enables some of the most powerful LLMs today.
One of the key components in RLHF LLMs is human preference data which makes it possible to align LLMs with human preferences.
Here are some key insights:
The reward model fundamentally enables tuning an RLHF LLM to align with…
RLHF continues to accelerate innovation in both closed and open-source LLMs.
What exactly is accelerating this innovation?
Here are 4 general patterns we are observing:
- In the RLHF framework, collecting high-quality SFT data is key to achieving high-quality results and…
Red teaming is a critical part of ensuring LLMs are safe, but it’s not often discussed.
At Surge AI, we red team LLMs for many of the major AI labs, including Anthropic and Microsoft.
We care deeply about this problem as it aligns with our core mission to build safe and useful…
50K Followers 3K FollowingAI alignment + LLMs at Anthropic. On leave from NYU. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
325K Followers 3K FollowingNVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
1.9M Followers 27K FollowingYes, I can see some risk that your threat to jail Internet company executives for not censorsing aggressively enough could backfire.
263K Followers 669 FollowingBuilding with AI agents @dair_ai • Prev: Meta AI, Galactica LLM, Elastic, PaperswithCode, PhD • I share insights on how to build with AI Agents ↓
77K Followers 2K Followinga combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre physicist at @nyuniversity (@CILVRatNYU) & @PrescientDesign
9K Followers 2K FollowingMachine learning scientist and engineer speaking πtorch & C++. Past @LTIatCMU, @awscloud. Opinions sampled from MY OWN 100T param LM.
9K Followers 5K FollowingResearch in ML/NLP at the U of Edinburgh (tenured faculty @InfAtEd @EdinburghNLP), Co-Founder @Miniml_AI, @ELLISforEurope Scholar, https://t.co/5dUI3EFexo
57 Followers 977 FollowingLeading MehtaCognition, a management consultancy and coach serving leaders of education, nonprofits, and companies wishing to build their strategic muscle.
8K Followers 2K FollowingAI will be controlled by people—or control them.
Building AI of, for, and by the people.
Prev: Yale | Stanford | Co-founder, Pi Network.
136 Followers 1K FollowingS/W Engineer; Loves History, Father & Husband and above all trying to LIVE my life. Born in Trichy, grew up in Mumbai, living in Hyderabad. My Tweets r my own
24 Followers 1K FollowingRalph Waldo Emerson once said, “The purpose of life is not to be happy. It is to be useful, to be honorable, to be compassionate, to have it make some differenc
264 Followers 1K Followingex-neuroscience researcher turned pre-seed & seed investor @VenrexVC. obsessed w research, start ups, and jiu jitsu. DMs open if you're building something!
1K Followers 5K Followingentrepreneur with a passion to help build great brands. bibliophile, traveler, policy, politics, economist, Executive Fellow @ccaforum; Founder @the_gutenberg
2K Followers 746 FollowingBuilding the next-gen agentic products
Founder plus_aifounders, angel investor, investing through a community of 2000+ AI founders
123 Followers 2K FollowingDefinite optimist - bred by effort. Software engineer - making an effort to put quality in quantity. Staying upwind. recovering from knowledge porn.
50K Followers 3K FollowingAI alignment + LLMs at Anthropic. On leave from NYU. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
637K Followers 35 FollowingWe're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant @claudeai on https://t.co/FhDI3KQh0n.
325K Followers 3K FollowingNVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
263K Followers 669 FollowingBuilding with AI agents @dair_ai • Prev: Meta AI, Galactica LLM, Elastic, PaperswithCode, PhD • I share insights on how to build with AI Agents ↓
2K Followers 464 FollowingGemini training @ GDM
PhD from @NYUDataScience, previously @Princeton 🐅
angie-chen at 🦋
Interested in LLMs, pastries, and running
31K Followers 877 FollowingVP GenAI @Databricks. Former CEO/cofounder MosaicML & Nervana/IntelAI. Neuro + CS. I like to build stuff that will eventually learn how to build other stuff.
487 Followers 186 FollowingResearch scientist at @scaledcognition, previously PhD at @BerkeleyNLP, interested in better control and factuality for LLM outputs especially for long context.
9K Followers 175 FollowingProfessor of the Practice @MITSloan | Co-founder CultureX | Using AI to measure and improve corporate culture | Diehard @OhioStateFB fan.
8K Followers 2K FollowingAI research-eneur. Hiring eng: https://t.co/fv5QBjsv90. Was Research Scientist @ Google Brain / DeepMind, language model research. 🇨🇦🇺🇸
418 Followers 485 FollowingEnthralled by machine learning / artificial intelligence, robot•me CTO, software engineer, Dai the robot co-creator, president of impactIA foundation, Genève
3K Followers 3K FollowingAcademic Co-Lead of UK National Robotarium, Edinburgh Centre for Robotics;
Professor, Director of Interaction Lab: generative AI and robotics
8K Followers 247 FollowingResearch @Meta Superintelligence Labs, I led Llama 2, built post-training from scratch. Also Toolformer, GAIA, Llama-3.0, CodeLlama, Galactica
497 Followers 1K FollowingDeep learning @nvidia
MS in Data Science from GalvanizeU/University of New Haven.Working on deep learning for computer vision and language understanding.
806 Followers 506 FollowingResearch Scientist at @AIatMeta @meta | ex Ph.D. at @uncnlp @unccs | ex M.S. at @uchicagocs @uchicago | Past Intern at @AIatMeta @microsoft | #NLProc & #AI