Freddie Vargus @freddie_v4
CTO & Co-founder @quotientai — Aya Multilingual @cohereforai — past: @github Copilot, @quantopian — Tico 🇨🇷🇺🇸 quotientai.co/post/building-… Boston, MA Joined June 2012-
Tweets326
-
Followers619
-
Following1K
-
Likes11K
Is your RAG model stuck in good-but-not-great territory? Join @atitaarora and @DeannaLEmery on May 7th to learn how to transform your RAG applications from functional to exceptional with Qdrant and @QuotientAI Register here ⤵️ try.qdrant.tech/qdrant-quotien…
Excited to announce our partnership with Qdrant! Check out the thread for info on our upcoming webinar with @atitaarora and @DeannaLEmery on May 7th 😀
Excited to announce our partnership with Qdrant! Check out the thread for info on our upcoming webinar with @atitaarora and @DeannaLEmery on May 7th 😀
💡Join @atitaarora and @DeannaLEmery on May 7 to learn how you can build high-quality RAG applications with @qdrant_engine and @QuotientAI! Register here 👇 try.qdrant.tech/qdrant-quotien…
We're excited to announce our partnership with @qdrant_engine! This collaboration marks a significant step forward in AI development by offering developers a comprehensive, end-to-end solution for building, evaluating, and shipping LLM products using RAG.
We showed building enterprise-grade customer support AI requires domain-specific evaluation! Everyone already suspected it, and we brought the data 😉
We showed building enterprise-grade customer support AI requires domain-specific evaluation! Everyone already suspected it, and we brought the data 😉
Lack of real-world, domain-specific tests is a big reason for the viral stories of premature AI deployments w/ negative consequences for companies. At @QuotientAI we proved this for the most popular gen AI use-cases: customer support agent augmentation. Here's how 👇
i feel like we should focus more on developing evals aligned with the actual economic value of models. isn't the biggest risk to scaling that these capacities may grow too slowly relative to cost?
Congrats on the awesome panel @tecoker (@felicis), @nabsicle (@CellinoBio), @freddie_v4 (@QuotientAI) and @alex (@TechCrunch)!
Congrats on the awesome panel @tecoker (@felicis), @nabsicle (@CellinoBio), @freddie_v4 (@QuotientAI) and @alex (@TechCrunch)!
Had a blast sharing the stage with @nabsicle, Freddie Vargus, and @alex @TechCrunch #earlystage to discuss TAM. It ended up being a packed house! Super fun to also co-host with @bioagelabs and meet 80+ operators focused on longevity and AI in biotech. Thanks Boston for a great…
DMs are overflowing and I am grateful. Please check out our posting here instead - this way I can share your details with the team more efficiently: jobs.lever.co/cohere/435b2b7…
DMs are overflowing and I am grateful. Please check out our posting here instead - this way I can share your details with the team more efficiently: jobs.lever.co/cohere/435b2b7…
Good fast evals are the way. Excited for what @JuliaANeagu and @freddie_v4 have cooking at @QuotientAI !
Good fast evals are the way. Excited for what @JuliaANeagu and @freddie_v4 have cooking at @QuotientAI !
It's odd to be in a stage of life where your best friend up and starts a company that raises eyebrows. But here we are. I'm def biased and I don't know much about LLMs. But imho "data" generated w/o systematic evals can't get far & if anyone can build a sol'n it's @JuliaANeagu
It's odd to be in a stage of life where your best friend up and starts a company that raises eyebrows. But here we are. I'm def biased and I don't know much about LLMs. But imho "data" generated w/o systematic evals can't get far & if anyone can build a sol'n it's @JuliaANeagu
This is so exciting. I think Julia's company is filling a really important niche in the brave new world of LLM and AI applications.
This is so exciting. I think Julia's company is filling a really important niche in the brave new world of LLM and AI applications.
Our vision for @QuotientAI is rooted in first-hand knowledge of what is needed to build and launch powerful genAI products. At @github, we built the evaluation infrastructure behind @githubCopilot. We are committed to helping those embarking on similar journeys reach their goals.
Hello World, we’re Quotient👋
I am excited to announce @QuotientAI! Quotient enables developers to evaluate, improve and ship high quality AI products through fast, real-world, data-backed experimentation.
Hamel Husain @HamelHusain
23K Followers 2K Following Researcher focusing on LLMs: https://t.co/iVZDFdIQiE Previously, dev tools and infra for ML. Ex @Github, @Airbnb, @DataRobot. @fastdotai core contributor.
Seyshuth @SeyshutheKj5hH
0 Followers 74 Following
วิไลวาว.. @BEn5J5amGOVxB
73 Followers 1K Following ไม่อยากพลาดช่วงเวลาการออกเดทที่น่าตื่นเต้นที่สุดใช่ไหม ถ้าอย่างนั้นก็รีบตามฉันมา! จะอัปเดตข้อมูลการติดต่อของฉันได้ตลอดเวลา
Sheteighs @sheteighs72340
52 Followers 2K Following
Anish @athreesh
501 Followers 1K Following vibing @brevdev, prev. @agora_io | @utaustin🤘 | 2x Jeopardy! contestant
alex (tired) @alex
104K Followers 6K Following Ada’s dad. Journalist. @TechCrunch. @EquityPod. No dms. Introvert. He/They. Black Lives Matter. @OwenThomas's adopted son.
Tobi Coker @tecoker
595 Followers 909 Following venture @felicis thoughts: https://t.co/OMm08iIoSL | 📷: https://t.co/kcntgPWauQ SF based, ATL native
VMV Lord Button @FponkNevets
295 Followers 1K Following Quality Engineering | Ukulele | Am Dram | Food. Views expressed are rarely my own. @[email protected]
Joe Mayo @JoeMayo
14K Followers 6K Following Building @generellem - #AI, #opensource, and #startups. Writing my own content.
AIProductDB @AIProductDB
655 Followers 2K Following AI Product Database, a site dedicated to discovering and sharing the latest and greatest AI-powered products for every use case and industry.
Garrett Mooney @GarrettRMooney
421 Followers 3K Following LATELY: "Open Source CS Masters" or something ¯\_(ツ)_/¯ PREVIOUS: Baby Bayesian...wanting to learn more, ML generalist Basketball and metal on occasion.
Agyaat Coder @AgyaatCoder
7 Followers 25 Following
Julia Cohn @Jcohnacceler8T1
2 Followers 37 Following I'm a part of the AI/ML team at Acceler8 Talent USA which pairs exceptional individuals with industry-leading companies
Thomas FASTIER @TFastier83115
16 Followers 81 Following
Peter Szerzo @peterszerzo
209 Followers 435 Following neighborhood creative programmer // design and frontend at @nlxai and others // shaders and sketches // algo-frenchhouse // maps and folds // trigonometry
Adam Kornafeld @AdamFromHungary
44 Followers 98 Following
Robert Talling @roberttalling
88 Followers 243 Following My passions: AI, sustainable tech & user-centered design. Gamedev → https://t.co/7aSY52PDDr
Anjalika Nande @AnjalikaNande
179 Followers 165 Following Postdoctoral fellow @JohnsHopkins | Physics PhD @Harvard | Infectious disease modeling
Abhay Gupta @gupta__abhay
163 Followers 1K Following ML @CerebrasSystems | previously @CMU_Robotics | music, soccer & travel.
William Lehmann @wnlehmann
275 Followers 324 Following pre-seed and seed investor in dev tools + cloud infra companies. prev: @BainCapVC, @Dartmouth. londoner in the usa. proud girldad & husband.
Joel Dean @sirjoeldean
3K Followers 4K Following I tweet about mobile app development, Generative AI & remote work. My code powers apps that impact billions of people worldwide.
Stale @Stale156976
45 Followers 2K Following
Ashutosh Mehra @ashutoshmehra
1K Followers 5K Following Senior Principal Scientist at Adobe. Working on Acrobat AI Assistant, LLMs, and document ML.
Poornima Devi @Poornim14
84 Followers 2K Following Machine Learning Engineer | Deep learning | Natural Language Processing
Aniket Mishrikotkar @aniketmishri
4 Followers 138 Following MLOps Engineer @themathcompany 🤖⛅🚀 I love building AI systems
Charles 🎉 Frye @charles_irl
9K Followers 2K Following ai engineer at @modal_labs. he/him. ex @full_stack_dl, @weights_biases, phd Berkeley @Redwood_Neuro.
ishan @0xishand
197 Followers 840 Following ml @brevdev | prev. @agora_io (acq.), @columbia, @stlouisfed, @sparkcognition
Daniel Han @danielhanchen
7K Followers 941 Following Building @UnslothAI. Finetune LLMs 30x faster https://t.co/aRyAAgKOR7. Prev ML at NVIDIA. Hyperlearn used by NASA. I like maths, making code go fast
Yifei Hu @hu_yifei
315 Followers 380 Following Ph.D. Candidate @LifeAtPurdue | NLP | LLM | UX | Programmer On job market for any AI related industry/academia roles
Deanna Emery @DeannaLEmery
9 Followers 62 Following
Sebastian Schuster @sebschu
2K Followers 2K Following Lecturer @LinguisticsUCL, and starting in 2025, Assistant Professor @univienna. #nlproc, computational and experimental semantics and pragmatics. he/him.
Luis Oala @LuisOala
452 Followers 2K Following head of machine learning @dotphoton building towards https://t.co/DFHTlHkDwH
Joe Stacey @_joestacey_
568 Followers 1K Following PhD student at Imperial and Apple Scholar. I love running, NLP and travelling (in no particular order). Ex teacher and PwC Consultant. #NLProc
Groovy Whirl @GroovyWhirl
503 Followers 3K Following We may all play different instruments, but together we make beautiful music.😍🥁
Steymme @steymme7654
157 Followers 3K Following
Sitethi @sitethi33012
34 Followers 2K Following
Erin LeDell - ledell@.. @ledell
11K Followers 7K Following CEO @ https://t.co/IevLGfnUT0 | fmr Chief ML Scientist @h2oai PhD in #biostatistics @UCBerkeley, founder @wimlds, co-founder @RLadiesGlobal. 🏕️🏳️🌈
Atlas Research @atlas_res
728 Followers 1K Following LLM powered quant research workflows // mapping the system // free fundamental data @ https://t.co/76ApJwYlfd
Sebastian Raschka @rasbt
267K Followers 906 Following Machine learning & AI researcher writing at https://t.co/A0tXWzG1p5. LLM research engineer @LightningAI. Previously stats professor at UW-Madison.
Hamel Husain @HamelHusain
23K Followers 2K Following Researcher focusing on LLMs: https://t.co/iVZDFdIQiE Previously, dev tools and infra for ML. Ex @Github, @Airbnb, @DataRobot. @fastdotai core contributor.
Senior PowerPoint Eng.. @ryxcommar
42K Followers 3K Following Risk manager @AlamedaResearch. | Prev: QA engineer at Knight Capital Group | he/him | https://t.co/Z2YNAksZLO
Pat Verga @pat_verga
753 Followers 252 Following NLP researcher @cohere. Formerly Google DeepMind and @umass_nlp
sophiaalthammer @sophiaalthammer
940 Followers 595 Following Member of Technical Staff in Retrieval-Augmented Generation Team @cohere, previously PhD in neural Information Retrieval @tu_wien
yeswondwerr @yeswondwerr
557 Followers 297 Following
Tobi Coker @tecoker
595 Followers 909 Following venture @felicis thoughts: https://t.co/OMm08iIoSL | 📷: https://t.co/kcntgPWauQ SF based, ATL native
Yichen (Zach) Wang �.. @YichenZW
172 Followers 181 Following 24Fall Incoming NLP Ph.D. @UChicago @UChicagoCI | Interning @UWNLP @Tsvetshop (@BerkeleyNLP before) | Senior @XJTU1896 Honored CS 24’
Mihir Patel @mvpatel2000
3K Followers 385 Following Research Engineer @MosaicML | cs, math bs/ms @Stanford
Ansong Ni @AnsongNi
1K Followers 384 Following Final-year PhD student @Yale, #NLProc, LLM for Code. (ex-)intern @GoogleDeepMind, @MetaAI, @MSFTResearch, @allen_ai. MS from @SCSatCMU. Opinions are my own.
Weiyan Shi @shi_weiyan
3K Followers 697 Following Postdoc @StanfordNLP, incoming assistant professor @Northeastern, PhD @Columbia| Prev Intern @MetaAI |Co-created CICERO | persuasive chatbots + privacy #nlproc
kamilė @kamilelukosiute
215 Followers 88 Following where do we come from? what are we? where are we going?
Arcee.ai @arcee_ai
260 Followers 192 Following Arcee is the leader in domain-adapted LLMs w/ our Small Language Models (SLMs) & our Model Merging innovations https://t.co/ZjIQuOcokn
Claudia Zhao @_claudiazhao
528 Followers 463 Following something new | previously at Meta, Pave, and Carnegie Mellon
Nicholas Tomlin @NickATomlin
694 Followers 620 Following PhD Student @Berkeley_EECS. Natural language processing. He/him.
William Lehmann @wnlehmann
275 Followers 324 Following pre-seed and seed investor in dev tools + cloud infra companies. prev: @BainCapVC, @Dartmouth. londoner in the usa. proud girldad & husband.
Joe Merrick @JoeMerrick
186K Followers 204 Following Geek. Pokémon Master. Webmaster of https://t.co/TIJrqRwlXV @SerebiiNet. Freelance Journalist. Also @VirtuallyMarti's Player 2. Business Email: [email protected]
Sandra Kublik @itsSandraKublik
3K Followers 1K Following LLM = Live + Love + Make 🌈 DevRel @Cohere I write and make videos about things I'm trying to grasp. The latest baby is my podcast. She/her. Views are mine!
margaret jennings @mjmj1oo
659 Followers 646 Following building tools 🎀 produit @mistralai we’re hiring: https://t.co/IAQ1hUfJwT
Joël Niklaus @joelniklaus
342 Followers 470 Following Postdoc in #legal #NLProc @unibern @bfh_wirtschaft, previously: @Google @Theteamatx @StanfordCRFM @thomsonreuters
Tristan Hume @trishume
6K Followers 330 Following Performance optimization lead @AnthropicAI. Profiling, distributed systems, dev tools, interpretability. [email protected]
John Yang @jyangballin
2K Followers 450 Following CS/NLP MS student @princeton_nlp Previously @Berkeley_EECS
jasmine collins @jazcollins_
6K Followers 703 Following research scientist @databricks! previously @berkeley_ai phd, @googleai and @metaai. interested in human brains and computer brains 💫
Horace He @cHHillee
24K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemale
Tony Lee @tonyh_lee
397 Followers 86 Following Incoming PhD Candidate @StanfordAILab @StanfordNLP @Stanford. Author of HELM + extensions (https://t.co/f9UOXPWkpR). Prev: Research Eng at @StanfordCRFM.
eugene @eugeneyalt
129 Followers 61 Following I sell 📚 at a bookstore. @eugeneyan's Id & Superego. Care a lot, try hard, have fun.
Jon Ander Campos @jaa_campos
238 Followers 313 Following Member of Technical Staff @cohere. PhD in Natural Language Processing. Previously @IxaGroup, @Apple, @AIatMeta, @CNRS and @nyuniversity.
Matthew Leavitt @leavittron
2K Followers 778 Following Chief Science Officer, Co-Founder @datologyai. Former: Head of Data Research @MosaicML; FAIR. 🧠 and 🤖 intelligence // views are from nowhere
Meaning Alignment Ins.. @meaningaligned
936 Followers 10 Following The Meaning Alignment Institute is a research organization with the goal of ensuring human flourishing in the age of AGI.
Ryan Lowe @ryan_t_lowe
5K Followers 358 Following what is the place from which we are creating? ❤️✨🤠❤️
Eitan Turok @EitanTurok
169 Followers 892 Following AI Researcher @DbrxMosaicAI. Sorting in exponential time, training on the test set, and praying for geometric revelations.
Tessa @tessybarton
602 Followers 751 Following Exploration agent. Research scientist at @MosaicML. Prev: @NYTimes
Costa Huang @vwxyzjn
3K Followers 1K Following RLHF @huggingface 🤗; main dev of @cleanrl_lib; CS PhD @DrexelUniv; Ex @CuraiHQ @weights_biases @NVIDIAAI @riotgames.
Sasha Doubov @sashadoubov
487 Followers 1K Following research scientist @mosaicml | ML research + skiing | studied @uoft & @uwaterloo
Matei Zaharia @matei_zaharia
39K Followers 1K Following CTO at @Databricks and CS prof at @UCBerkeley. Working on data+AI, including @ApacheSpark, @DeltaLakeOSS, @MLflow, https://t.co/94gROE5Xa0. https://t.co/nmRYAKG0LZ
Daniel Han @danielhanchen
7K Followers 941 Following Building @UnslothAI. Finetune LLMs 30x faster https://t.co/aRyAAgKOR7. Prev ML at NVIDIA. Hyperlearn used by NASA. I like maths, making code go fast
Vitaliy Chiley @vitaliychiley
2K Followers 606 Following Head of NLP Pretraining @Databricks / @MosaicML | Former @CerebrasSystems | What do we want? FLOPS! When do we want it? TOKENS!
Sasha Sheng 🫶🏼 @hackgoofer
4K Followers 2K Following Builder, Dancer; @aiengfoundation & on a mission to help people be well. Lover of hackathons and updating my beliefs. Staying grounded. Prev: @MetaAI
Lintang Sutawika @lintangsutawika
382 Followers 565 Following Incoming Ph.D. student @LTIatCMU. Researcher at @AIEleuther. Maintainer of LM-Eval Harness. Here for machine learning papers and discussion.
Language Technologies.. @LTIatCMU
9K Followers 233 Following The Language Technologies Institute in Carnegie Mellon University's @SCSatCMU
Ian Arawjo (@ianarawj.. @IanArawjo
1K Followers 955 Following Asst Prof @UMontreal, PhD @CornellInfoSci. Creator of ChainForge. Programming and culture, intercultural CS, notational programming. Prev: Postdoc @HarvardHci
Yifei Hu @hu_yifei
315 Followers 380 Following Ph.D. Candidate @LifeAtPurdue | NLP | LLM | UX | Programmer On job market for any AI related industry/academia roles
mfer straight up called drake cringe lmfao
Personal Update: I’m thrilled to share that I've joined as a Research Engineer on the phenomenal team led by @sarahookr at @CohereForAI !!!💙😍 Still can’t believe I finally get to pursue research “full-time” 🪄
Is your RAG model stuck in good-but-not-great territory? Join @atitaarora and @DeannaLEmery on May 7th to learn how to transform your RAG applications from functional to exceptional with Qdrant and @QuotientAI Register here ⤵️ try.qdrant.tech/qdrant-quotien…
Awesome work from the @QuotientAI team showing domain-specific evals are needed to identify the best AI models for your use case. Relying on general benchmarks can lead ppl to select underperforming LLMs! To figure out eval for your AI app, talk to @JuliaANeagu & @freddie_v4!
We showed building enterprise-grade customer support AI requires domain-specific evaluation! Everyone already suspected it, and we brought the data 😉
💡Join @atitaarora and @DeannaLEmery on May 7 to learn how you can build high-quality RAG applications with @qdrant_engine and @QuotientAI! Register here 👇 try.qdrant.tech/qdrant-quotien…
As part of our partnership, @qdrant_engine users can take advantage of @QuotientAI's features through an expanded free developer tier, with 10x the number of weekly evaluation jobs! Request access at quotientai.co and add "Qdrant" in the Company section!
We're excited to announce our partnership with @qdrant_engine! This collaboration marks a significant step forward in AI development by offering developers a comprehensive, end-to-end solution for building, evaluating, and shipping LLM products using RAG.
openai's competition: three obscenely specc'd out mac studios with thunderbolt based interconnect
Full house at @TechCrunch Early Stage yesterday for a panel on TAM in new and existing markets - featuring @tecoker @nabsicle @alex and our CTO @freddie_v4.
@freddie_v4: "The existing focus that people have for evaluating AI products is not really applicable in a business context. A lot of potential users are still pretty early, so part of the solution is meeting them where they are today."
like very
We showed building enterprise-grade customer support AI requires domain-specific evaluation! Everyone already suspected it, and we brought the data 😉
Lack of real-world, domain-specific tests is a big reason for the viral stories of premature AI deployments w/ negative consequences for companies. At @QuotientAI we proved this for the most popular gen AI use-cases: customer support agent augmentation. Here's how 👇
Lack of real-world, domain-specific tests is a big reason for the viral stories of premature AI deployments w/ negative consequences for companies. At @QuotientAI we proved this for the most popular gen AI use-cases: customer support agent augmentation. Here's how 👇
i feel like we should focus more on developing evals aligned with the actual economic value of models. isn't the biggest risk to scaling that these capacities may grow too slowly relative to cost?
Packed room ahead of panel on TAM with @tecoker @alex and Freddie of quotientAI at @TechCrunch Boston! Thanks for coming and engaging. Now back to building @CellinoBio
Congrats on the awesome panel @tecoker (@felicis), @nabsicle (@CellinoBio), @freddie_v4 (@QuotientAI) and @alex (@TechCrunch)!
Had a blast sharing the stage with @nabsicle, Freddie Vargus, and @alex @TechCrunch #earlystage to discuss TAM. It ended up being a packed house! Super fun to also co-host with @bioagelabs and meet 80+ operators focused on longevity and AI in biotech. Thanks Boston for a great…
Had a blast sharing the stage with @nabsicle, Freddie Vargus, and @alex @TechCrunch #earlystage to discuss TAM. It ended up being a packed house! Super fun to also co-host with @bioagelabs and meet 80+ operators focused on longevity and AI in biotech. Thanks Boston for a great…
I am building GitHub Copilot (chat/code completion). I'm also writing a book about Prompt Engineering for building LLM applications (oreillymedia.pxf.io/c/5303529/1975…). I'm interested to hear how your company is building with LLM applications. Ping me if you'd like to chat.
We are improving our system before we release it (hopefully in the near future). I am grateful for my fantastic co-authors (@jdzamfi, @bjo3rn, @adityagp, @IanArawjo) and the LLM practitioners who generously gave us their time. For more insights, please read the preprint!
Trends for United States
You might like
