Small Data SF: Think Small, Build Big @smalldatasf
Rethinking AI & data from the ground up. A community for those building smarter AI and data systems with real workloads, not petabytes. smalldatasf.com SF Joined June 2024-
Tweets266
-
Followers549
-
Following60
-
Likes733
Sometimes you need to crash, burn, and refactor to really see the value in “small first.” Scott Haines will unpack four hard lessons where embracing smallness didn’t just rescue projects, but led to better product, better performance, better dev happiness. If you want avoidable…
What if instead of chasing larger models, we chased smarter ones—models that do more with less, generalize better, and are easier to deploy? Shelby Heinecke will share what "smaller models" truly mean and how they unlock impact in real settings. If you're building AI and worried…
We ran a bench mark of DuckDB vs Spark and found that data sets under 20 GBs ran about 100 times faster on DuckDB than they did on Apache Spark! You don't need a multi-node cluster for your smaller data sets! This benchmark uses plain parquet files and COUNT distinct to truly…
Are you ready to explore when Apache Spark might not be the best tool for your data projects? Join us at Small Data SF on November 4 and 5 in San Francisco for an insightful talk by Holden Karau, a prominent figure in the world of big data.
Small data means breaking existing paradigms, simplifying, speeding things up and lowering costs This insight from #smalldatasf 2024 is just a taste of what's coming in 2025!
🚀 Small News! Estuary is a Gold Sponsor of @smalldatasf 2025, happening Nov 4-5!! Two days of hands-on workshops, talks, and community, all centered around efficient, local-first development and smarter ways to work with data and AI. See you there! #smalldatasf
"Don't duck up the numbers: Where AI hype meets BI reality." This is going to be a fun panel with Barr Moses (Monte Carlo), Barry McCardel (Hex), Colin Zima (Omni) and Tristan Handy (dbt). Join us!
Small data slaps. Tagging all our Spark friends out there.
Small data slaps. Tagging all our Spark friends out there.
Dr Shelby Heinecke, who leads AI research at Salesforce, will speak at Small Data SF November 5th on how small models don't need more parameters, they just need better data. She'll speak about the highly efficient xLAM family of small action models her team built at Salesforce.
Miss Small Data SF in 2024? Catch out our highlight reel below and learn why one attendee said: "Small Data SF was on another level. The lineup was unbeatable, the content was razor-sharp, and the people were next-level inspiring."
Small Data SF may be a small conference, but the density of talent amongst the speakers and attendees is unmatched. Learn from industry luminaries, on stage and in the audience, on how and why to make your data and AI stack more efficient.
Last year, Wes McKinney of pandas fame, spoke about how people have written a lot of Spark code, making our industry sticky to Spark. This year, we're joined by Holden Karau, Spark PMC member and author of a number of Spark books, talking about when *not* to use Spark.
George Fraser, CEO of Fivetran, has been a pioneer in advocacy around small data. Watch his thoughts from a panel at Small Data SF 2024. This year he returns November 5th to share more wisdom in a talk, alongside many other data luminaries.
Guess who’s back… back again at Small Data SF. 🎤 The data Jedi, Benn Stancil is returning 💎 Missed his epic talk last year? Here’s your chance to feel the force in action. #smalldatasf
🎁Our Small Data, Big Gift to you! ⏳We've extended early bird pricing until Aug 8! We know summer calendars are chaotic, so we're giving you extra time to snag these savings! Join us for 2 days of practical innovation + insights from top minds in small data & AI.
Last chance! Early Bird Ticket Sales to Small Data SF End Monday! smalldatasf.com
🚨 SPEAKER DROP! Small Data SF just got even more stacked! 🔥 5 incredible new speakers just joined our Nov 5 lineup -including CEOs from @_hex_tech & @getdbt , a Databricks MVP, and more O'Reilly authors! ⏰ $295 Early bird tickets end in exactly ONE WEEK smalldatasf.com
Starts in 20 minutes!
Kushal Khandelwal @kushal124
631 Followers 355 Following Building – AI-powered DataOS | Ex Head of Data @JioCinema @DisneyPlusHS | Data, AI, GTM Analytics | Scaling data platforms & teams 🚀
HomosexualMan @HomosexualMan_
217 Followers 185 Following
Yurii Filipchuk🇺�... @yfilipch
1K Followers 3K Following OpenBabylon | Boosting Global GDP with AI for Underrepresented Languages | Chaotic Good | helping AI nerds @goatstackai ¯\(ツ)/¯
Mina Yacoub @MinaYacoub7
403 Followers 5K Following Data Enthusiastic | Splunker | Observability | Web3 | Blockchain | Tech Lead
chengjilai @chengjilai
23 Followers 966 Following
Lil Bindle @YungBindlestiff
117 Followers 3K Following
Airbyte @AirbyteHQ
14K Followers 2K Following The open data movement platform. Move data from any (un)structured sources to any (vector) DB and warehouses! Take our code 🌟 https://t.co/qT1xJ2yOhk
DuckDB @duckdb
21K Followers 36 Following DuckDB is an analytical in-process SQL database management system. "DuckDB" and the DuckDB logo are registered trademarks of the DuckDB Foundation.
Carol Monroe @CarolMonroe
8K Followers 5K Following AI Strategist & Music Lover. @WomenTechmakers Ambassador| @techloversfm Founder building https://t.co/IWgeO4mxiP
nana lana @nanalana954688
1 Followers 39 Following 🚀 مشروع Datanova – المستقبل يبدأ من البيانات مشروعي يركز على البيانات (Data) وكيفاش نقدر نحولوها من مجرد أرقام إلى قرارات ذكية وفرص حقيقية. 🌍 📊 نعتمد على ا
Scott Haines @newfront
822 Followers 839 Following Developer Relations Engineer @ Buf • Speaker • Trainer | #DatabricksMVP | Author @OReillyMed | ❤️ #ApacheSpark. ❤️ #Dogs. #DatabricksMVP. Views are my own
Owen Barford @SQLOB1
77 Followers 611 Following Vehicles, SQL Server and Virtualisation...and maybe a touch of cooking.
congli gao @congligao
0 Followers 90 Following
Marco @marcoporracin
3K Followers 2K Following Data & AI Solutions | Founder: https://t.co/YZiZLJ05vO 📊
MetaDada @irregularbi
3K Followers 3K Following https://t.co/McY9Yq7p0M Founder, Head of R&D at https://t.co/YXYXmtC1hg - a GenAI data startup (stealth mode), Inventor of Astrato Engine
joaquindiez @joaquindiez
972 Followers 978 Following Father of one. @calliopeBI helping at Switchfleet and @onnessfinance former VP of engineering @taiger_CO @clarityAIEng co-founder of @devo_inc
HFCrypto📈 @HFCrypto_
149 Followers 144 Following || Crypto trader || Content & Technical writer || Web3 business developer || DM is open for collabs
天舒79 @zhhzhfya
1 Followers 55 Following
DataAgentz @DataAgentz
5 Followers 88 Following Powering AI innovation with secure workflows - Boost productivity, protect data, and scale smarter! 🚀 #MCP #MCPTools #AIAgents #SecureWorkflows
Felix Peña @kaisen2350
773 Followers 6K Following Helping people to consume less and create more, 1% per day. What you don't share, you lose. Serial quiter. :P Ready, fire, aim
Heneli @henelidotdev
136 Followers 928 Following Haskeller, Alum @recursecenter Sp2'17, alt: @anthrolawnmower
Eddie A Tejeda @eddietejeda
2K Followers 2K Following building caches. VP of Engineering @thoughtspot @modeanalytics
Y C @YC87148229
0 Followers 1K Following
Anne Brandes @annembrandes
2K Followers 786 Following Founder at Conway (@conwayinc), prev: President at Prod, CS @harvard
Nir Zilberman @nirzilberman
89 Followers 8K Following
Feng Tao Ning @ftning
45 Followers 237 Following
ripes @626ripes
99 Followers 2K Following
Julia REPL stan now a... @miguelraz_
3K Followers 3K Following Julia REPL's #1 fan. él/him. @[email protected] https://t.co/zHNPzwcTlf Trainer/Engineer @ferroussystems
Nitish Sharma @Nitish65502345
31 Followers 720 Following Engineering at Azure Data (MySQL), love reading about databases, distributed systems, and financial markets
BhavSawaar @SJWPMI
200 Followers 3K Following
vandamme @vandamme2015
8 Followers 471 Following
Saurabh Bhoir @saurabhbhoir8
198 Followers 4K Following
Cagatay Goncu @__chatai__
35 Followers 194 Following Data Engineer @TennisAustralia; Adjunct Research Fellow @MonashUni; Co-founder @raisedpixels
Ian Vaz Araujo @ianvazaraujo
373 Followers 1K Following Investing, tech and AI. Data Scientist working in finance.
Samunder Adhikari @Samunder12or8
36 Followers 440 Following tech nerd, sketching level== -100,music lover, researcher, writer
𝑱𝒂𝒗𝒊𝒆�... @estraviz
777 Followers 1K Following ɟlǝsɹnoʎ ʎluo sı ʇı 'spuǝq ʇɐɥʇ uoods ǝɥʇ ʇou sı ʇI. Data Engineer @FrontiersIn #openscience past @Lookiero_es @StubHub @eBay @Ticketbis
Oliver Lamp @uilify
189 Followers 876 Following Business Analyst. Head Of Digital Transformation. AEC Industry. Inhouse Consultant. Views my own.
Francesco B @fbullini
105 Followers 2K Following CTO - Helping companies to innovate and grow AI-products | Multi Agent Systems | LLMs | ML | NLP | Symbolic-AI
Lisa N. Cao @lisancao
477 Followers 689 Following Product @ Datastrato, DataOps Initiative Lead, Terry Fox Gold Medal Recipient. Data Engineering & OSS Bluesky: https://t.co/LBgVMpvu4D
Teague Sterling @teaguesterling
76 Followers 181 Following
Zain @ZainHasan6
5K Followers 2K Following AI builder & teacher | AI/ML https://t.co/PDkARZyitK | Eng ℕΨ @UofT | ex-(Vector DBs, Health tech, Lecturer) | decoding AI’s future - follow for insights!
Barr Moses @BM_DataDowntime
3K Followers 965 Following Co-Founder and CEO of Monte Carlo. https://t.co/FUUJPkkyDt
Tristan Handy @jthandy
8K Followers 327 Following Building a modern analytics workflow. Founder & CEO @ dbt Labs, creators and maintainers of dbt.
DoSomething.org @DoSomethingO
58 Followers 112 Following
Scott Haines @newfront
822 Followers 839 Following Developer Relations Engineer @ Buf • Speaker • Trainer | #DatabricksMVP | Author @OReillyMed | ❤️ #ApacheSpark. ❤️ #Dogs. #DatabricksMVP. Views are my own
Barry McCardel @barrald
3K Followers 974 Following co-founder and CEO of Hex (https://t.co/hbgguInF1h / @_hex_tech) - former @PalantirTech @formationbio - personal site: https://t.co/c38nDG5Dfl
Shelby Heinecke @shelbyh_ai
523 Followers 836 Following Leading innovation in agentic, efficient, and on-device AI. ML Theory PhD @thisisUIC, Math BS @MIT Let's build the future! 🙌🏽 🚀
Divya Ranganathan @divs1101
25 Followers 11 Following
RK @rukku
2K Followers 2K Following Code. Comics. Cartography. Information junkie. Researcher at @stamina4space (formerly @phlmicrosat). @maptimediliman
Søren Bramer Schmidt @sorenbs
3K Followers 1K Following Founder and CEO of Prisma. If you are building for a global audience, you should give @prisma a try. DMs open - please reach out.
JosH100 @josh_wills
18K Followers 2K Following Engineering at @datologyai; @duckdb enthusiast, ex-@slackhq
Julia Schottenstein @j_schottenstein
3K Followers 710 Following Building @LangChainAI | ex-product @getdbt | angel investor 👼 | @Stanford CS engineer | NYC native + SF transplant | runner (sometimes)
Ravit Jain (The Ravit... @RavitJain
3K Followers 2K Following Founder & Host of "The Ravit Show" | Head Community Evangelist | Official LinkedIn Creator | Data Community Builder | Data Professional | Media
Tobiko Data @TobikoData
260 Followers 46 Following Empowering data scientists by automating SQL workflows.
Estuary @EstuaryDev
267 Followers 42 Following Data Movement for The Enterprise. 👉 Reach out: https://t.co/U58bhgyFDl
Hex @_hex_tech
6K Followers 315 Following the world's most advanced platform for collaborative analytics and data science. Create a free account 👉https://t.co/ejDVlOl1RP
Tigris Data @TigrisData
2K Followers 13 Following Tigris is a globally distributed S3-compatible object storage service that provides low latency anywhere in the world.
Outerbase @outerbase
2K Followers 5 Following AI-powered database UI that doesn't suck ✨ Now part of @Cloudflare
evidence @evidence_dev
2K Followers 309 Following https://t.co/Gn735YnbMP is an open source framework for building data products with SQL and markdown
Omni @omni
4K Followers 94 Following Omni is a business intelligence & embedded analytics platform that empowers everyone—regardless of technical ability—to easily analyze data.
RavinKumar @canyon289
3K Followers 510 Following NotebookLM Audio overviews at Google because that's all the rage these days and its now my entire personality
sxalexander @sxalexander
353 Followers 473 Following Product Engineer & Entrepreneur. Former Agency founder. Current: Product Developer & Consultant. Products, Data & AI
holden karau @holdenkarau
16K Followers 2K Following she/her, OSS Big Data. ❤️🛵 ☕️ spark. I don't represent my employer. Live @ https://t.co/uOyeZtBXx0 , https://t.co/GB3Ok0vbVA
Benn Stancil @bennstancil
7K Followers 296 Following I have a blog | benn.substack I had a job | https://t.co/PPUWbMIeFC Join my professional network | https://t.co/f6QIgfaKSu My janky linktree | https://t.co/5YOf0jrVq6 Fine | https://t.co/OvT9Wq4ata
George Fraser @frasergeorgew
4K Followers 338 Following I mostly tweet about software, data, and the difficulty of changing our opinions based on what the data tell us.
Adi Polak @AdiPolak
15K Followers 841 Following Director @ Confluent • Author • Databricks MVP • From distributed data to real-world AI systems
bem @bem_hq
72 Followers 31 Following We turn unstructured ops inputs into structured, decision-ready workflows. Programmable, embeddable, operator-friendly infrastructure.
Simon Willison @simonw
117K Followers 6K Following Creator @datasetteproj, co-creator Django. PSF board. Hangs out with @natbat. He/Him. Mastodon: https://t.co/t0MrmnJW0K Bsky: https://t.co/OnWIyhX4CH
Timothy Chen @tnachen
6K Followers 5K Following Founder of @EssenceVenture, Co-host of @ossstartup, @theinfrapod. Ex-CEO of @hyperpilotio. SVP of Engineering @cosmos.
Alexy 🤍💙🤍 @ChiefScientist
6K Followers 7K Following AI Community Architect @Neo4j. Chair, OSSci @NumFOCUS. Cofounder, AI Alliance, GenAI Commons. Run @scalebythebay: https://t.co/VG37Z4xowL. Join https://t.co/1CPrpnF1KU!
Jacob Matson @matsonj
8K Followers 2K Following excel user & data enthusiast. Dev Advocacy @MotherDuck
Jennifer Li @JenniferHli
11K Followers 2K Following GP @a16z AI x Infra. 💙 Data, AI and dev tools. Portcos: @elevenlabsio @FAL @Ideogram @mintlify @motherduck @usepylon @resend @StainlessAPI
Ideogram @ideogram_ai
66K Followers 0 Following Turn your ideas into creative graphic designs, in a matter of seconds. What will you create?
DuckDB Labs @duckdblabs
4K Followers 2 Following DuckDB Labs is a small artisanal data processing company that provides services around DuckDB directly from its creators.
Fei-Fei Li @drfeifei
526K Followers 1K Following Prof (CS @Stanford), Co-Director @StanfordHAI, Cofounder/CEO @theworldlabs, #AI #SpatialIntelligence #GenAI #computervision #robotics #AI-healthcare
Maggie Appleton @Mappletons
38K Followers 1K Following I've mostly abandoned this trashfire 🔥 for Bluesky 🦋 @maggieappleton.com Design engineer. Writes about design, code, & anthropology.
DuckDB @duckdb
21K Followers 36 Following DuckDB is an analytical in-process SQL database management system. "DuckDB" and the DuckDB logo are registered trademarks of the DuckDB Foundation.
Wes McKinney @wesmckinn
58K Followers 900 Following Principal Architect @posit_pbc, GP @ComposedVC, Co-founder @voltrondata. OSS: @ApacheArrow @pandas_dev @IbisData, "Python for Data Analysis" book
Zach Wilson @EcZachly
48K Followers 1K Following Founder @ https://t.co/CWvLDHU2Lx $150k/month | https://t.co/F5VqLpyMZn $5k/month | ADHD | 10 yrs big data experience | ex @meta, @netflix, and @airbnb
Gergely Orosz @GergelyOrosz
292K Followers 3K Following Writing @Pragmatic_Eng, the #1 technology newsletter on Substack. Author of @EngGuidebook. Formerly Uber & Skype.
Mistral AI @MistralAI
158K Followers 1 Following Frontier AI in your hands. https://t.co/VdyEwpQsiy Apps: https://t.co/1vZA5XdBYo https://t.co/rj5G4u5sHu
Pekka Enberg @penberg
13K Followers 1K Following Founder & CTO @tursodatabase; previously @ScyllaDB and Linux kernel. Author of "Latency" (https://t.co/XWRFq71WaJ).Trends for United States
You might like
