DuckDB @duckdb
DuckDB is an in-process SQL OLAP database management system. "DuckDB" and the DuckDB logo are registered trademarks of the DuckDB Foundation. duckdb.org Amsterdam, The Netherlands Joined May 2019-
Tweets633
-
Followers12K
-
Following3
-
Likes3K
DuckDB was recently covered in @andy_pavlo's Advanced Database Systems course at CMU. The lecture covers DuckDB's history, internals, and integration with other systems. Slides: 15721.courses.cs.cmu.edu/spring2024/sli… Recording: youtube.com/watch?v=4iD4h4…
Did you know that you can connect to a DuckDB database file via HTTPS or S3 with just two SQL statements? We have a new guide that explains how to do this. duckdb.org/docs/guides/ne…
Save the date: DuckCon #5 will take place in Seattle on 2024-08-15. For details and the registration link, see duckdb.org/2024/08/15/duc…
Looking forward to my keynote at #PyConDE / #PyDataBerlin tomorrow morning - will be talking about “Creating Software like @duckdb in Academic Institutions” @PyConDE - happy to chat about anything DuckDB, just find me, this is what I look like
Visualizing #geospatial data in #DuckDB 🦆with #leafmap 🍀 and #lonboard 🗺️🌎 Video: youtu.be/r3A_OLT-JBM Notebook: geog-414.gishub.org/book/duckdb/08… Playlist: youtube.com/playlist?list=… #dataviz #geopython
New Post: Introduction to DuckDB buff.ly/3VTzjRh
Folks, tons of goodies even in a bugfix release! - DuckDB Wasm ❤️ @pyodide for in-browser Python/DuckDB fun! - Attach directly to DuckDB files on S3 - Read LZ4 parquet files - Deletes are more RAM efficient - Faster inserts from wide parquet files - Fixes for ODBC / Power BI
Folks, tons of goodies even in a bugfix release! - DuckDB Wasm ❤️ @pyodide for in-browser Python/DuckDB fun! - Attach directly to DuckDB files on S3 - Read LZ4 parquet files - Deletes are more RAM efficient - Faster inserts from wide parquet files - Fixes for ODBC / Power BI
We just released DuckDB v0.10.2, a bugfix release. See the installation page and the release notes for details: – duckdb.org/docs/installat… – github.com/duckdb/duckdb/…
We invite our community to submit talk proposals until April 29. We especially encourage members of underrepresented groups to share their DuckDB-related projects. Please use the form at forms.gle/RgFazaawkfx9YK…
Hi DuckDB community! We are hosting an informal pub session with @hfmuehleisen in Berlin on 2024-04-22 (Monday) starting at 8PM near U Oranienburger Tor. We only have 10 seats available – if you are interested in participating, please send an email with the subject “DuckDB…
Today, the new CSV Reject Tables for DuckDB got merged. github.com/duckdb/duckdb/… It hopefully will allow people to read the unreadable. All sorts of structural CSV errors are sorted to allow users to verify and correct them.
Did you know that DuckDB supports function chaining? This allows function calls to be rewritten in more a readable manner. See the Even Friendlier SQL with DuckDB blog post for details: duckdb.org/2023/08/23/eve…
This is not a drill! @duckdb DuckCon will immediately follow @posit_pbc conf in Seattle this August Two back to back conferences with some of the most genuine, non-gimmicky, open source data communities out there
This is not a drill! @duckdb DuckCon will immediately follow @posit_pbc conf in Seattle this August Two back to back conferences with some of the most genuine, non-gimmicky, open source data communities out there
Ever wondered how #duckdb can read CSV files so fast? Last Friday we had an excellent talk from @holanda_pe from @duckdblabs about efficient CSV parsing and all the complexities that come with it in #duckdb. Missed it? Check out the recording! 🎥youtu.be/YrqSp8m7fmk
Hi DuckDB community! We are hosting an informal pub session with @hfmuehleisen in Berlin on 2024-04-22 (Monday) starting at 8PM near U Oranienburger Tor. We only have 10 seats available – if you are interested in participating, please send an email with the subject “DuckDB…
A reminder: DuckDB has a tldr page. If you have @tldr_pages installed, you can get examples of the most common command-line arguments by running $ tldr duckdb
Erik Bernhardsson @bernhardsson
38K Followers 3K Following Building @modal_labs when I'm not posting bangers about data and software. Previously built the music rec sys at Spotify and ran the eng team at Better.Mim @mim_djo
9K Followers 3K Following #Fabric Enthusiast, Small Data And self service, #Microsoftemployee since Nov 2023 , but my tweets are my ownAlex Monahan @__AlexMonahan__
3K Followers 705 Following Forward Deployed Software Engineer at MotherDuck! Docs & blogs at DuckDB Labs! Views expressed are my own and not my employers'.Hamilton Ulmer @hamiltonulmer
3K Followers 642 Following 👁️📈👁️ @motherduck Prev. @rilldata, @mozillaHannes Mühleisen @hfmuehleisen
5K Followers 937 Following I like databases. Co-creator of @duckdb, Co-Founder and CEO @duckdblabs. Professor of Data Engineering @Radboud_UniSimon Willison @simonw
71K Followers 5K Following Creator @datasetteproj, co-creator Django. PSF board. @nichemuseums. Hangs out with @natbat + @cleopaws. He/Him. Mastodon: https://t.co/t0MrmnJW0KABC @Ubunta
3K Followers 3K Following Data & ML Infrastructure for Healthcare https://t.co/FwocCiCQAT Opinions are पड़ोसी' In 🇩🇪Berlin from 🇮🇳Kolkata/छत्तीसगढ़Taylor A Murphy @tayloramurphy
7K Followers 376 Following Founder & CEO @archdotdev | maintainer: @meltanodata | prev: Data @gitlab | Paid Data Actor/Influencer | Husband and Dad(x2)Tino Tereshko 🇺�.. @thetinot
6K Followers 3K Following Co-founder & Produck @ MotherDuck. https://t.co/GSnb7PUXl5 Ex PM @ BigQuery. Papa. Husband to @emilyvajda Ultra-competitive C class cyclistMotherDuck @motherduck
5K Followers 121 Following Making analytics fun, frictionless and ducking awesome with a serverless easy-to-use data analytics platform based on @DuckDB in collab with @duckdblabs.Josh Wills @josh_wills
18K Followers 2K Following Engineering at @datologyai; @duckdb enthusiast, ex-@slackhq子茄 @ant_sz
9K Followers 986 Following Software Engineer @ Tokyo. Database Enthusiast. Work for fun. {🏂,☕} #日本旅游 #吃吃喝喝 #读篇paperAlex P @ifesdjeen
12K Followers 1K Following Distributed and Storage Systems. Apache Cassandra Committer and PMC member. Author of Database Internals @therealdatabass. Discord: https://t.co/8LwhZom9eQKatie Bauer @imightbemary
11K Followers 831 Following Wrong but useful. Tweets about data work, careers and teamsGwen (Chen) Shapira @gwenshap
26K Followers 9K Following Co-founder of @niledatabase. Making SaaS global, elastic and chill. Find me at: https://t.co/uyuHg400cpRahul Jain @rahulj51
3K Followers 2K Following Principal Software Engineer at @justbobsledit. Formerly led Data and Engineering at @thebeatapp , @omioglobal , @thoughtworks .Andy Grove @andygrove_io
3K Followers 584 Following @ApacheArrow PMC Chair. Apache DataFusion PMC. Original creator of Apache DataFusion.Xuanwo @OnlyXuanwo
9K Followers 941 Following ASF Member. Apache #OpenDAL PMC Chair. VISION: Access data freely across services by any method.boi @rice_baron
5 Followers 73 FollowingBrett 🇺🇲 🌐�.. @ushtaritk421
393 Followers 4K Following Social sciences and tech enthusiast. Liberal. #upzonetherich . Speak 🇦🇱 & 🇩🇪. 🐘 [email protected] 🧵 ushtari_tk421.Ricardo Castro @imRicardoJS
12 Followers 302 Following Senior Full Stack Web Developer. +3 años de experienciaBalji Maurya @BaljiMaurya
8 Followers 188 Following Full Stack Developer | JavaScript | TypeScript | GoLangRichieQC @rquintco
72 Followers 2K Following Sinaloense en CDMX. Trying to understand how the brain learns at algorithmic levelValentinus Sofa @SofaValentinus
248 Followers 2K Following - Interested in distributed computing and cryptography - I love philosophy, science & technology, history, art, and literacy.Balagopal Kanattil @bkanattil
66 Followers 1K Following Software Engineer. Bachelor's degree in Physics. Otaku, Metalhead and ADHD.Evgeni Simonov @s0oft
2 Followers 17 FollowingWaypoint AI @waypointai
113 Followers 4K Following Automate bug triage & root cause analysis to solve bugs quickly & get back to building! -- Book an appointment: 📅https://t.co/lgRrvWE0gSJeronimo C. @jr_corcol
29 Followers 997 FollowingKristian Maglasang @krismaglasang
77 Followers 348 Following Funnelling data by day, pretend chef by night, Phineas and Ferb fan round the clock!Joey @jmhain
18 Followers 152 FollowingNetra Bhatt @netrabhatta
95 Followers 487 Following Software Engineer, Father of 2, adult chess improverDanilo Soto @DaniloJSoto
30 Followers 1K Followingcitezenb | citezenb.t.. @CitezenB
15K Followers 15K Following Passionate about @Tezos, a blockchain of cultural significance. #blockchain #nft https://t.co/c7t0jFOruQKen @kenhorn
323 Followers 897 Following Launching @CloudSinc1 - Data quality and actionable insights. Tech AMA. @[email protected]Kishore Ganesh @KishoreGanesh12
42 Followers 836 Following大仙 @BIAOXYZ
24 Followers 221 Following "Across the Great Wall, we can reach every corner in the world." 记录无法被记录的,尤其是国内🌶️🐔血汗工厂的恶行。——某没事就沸腾的公司让我看到了一场大型魔幻现实主义表演。Srinikhil Naravamakul.. @manchicoffee
314 Followers 2K Following Builds, breaks things for @AzureCosmosDB.ycai @ycai_cs
77 Followers 795 FollowingHung Pham @hhp_9x
90 Followers 397 Following MSc biostat. A #stan stan, #rstats, randomize when you canOmar Valdez @theDataFixer
0 Followers 14 Following #dataengineering #datainfra #datascience #bigdataMichael Wang 汪東�.. @EastSun5566
46 Followers 1K Following Currently, I am building https://t.co/D9TrZSe3Wa 🚀Hồ Đắc Đăng Ng.. @HcngNguyn3
9 Followers 146 FollowingAayush Shah @aayush_shah_88
193 Followers 2K FollowingJacob Somer @jacob_somer_
595 Followers 3K Following AI Enthusiast & Software Engineer 💻 Building intelligent systems that make a difference.Raz Stanislas @caudry_toujours
3 Followers 105 Following 2 chiens, 2 chats, 2 gosses, 1 vie bien remplie....kingxavier44 @kingxavier44
2 Followers 24 Followinganton @antonmks
2 Followers 13 Followingbestlong @bestlong
6 Followers 129 FollowingAriane H @Ariane_Hoff
32 Followers 128 Followingkazoomarc @datamoree
626 Followers 5K Following • random-digital-art-ish — FB: https://t.co/ZEI4oo3qwq — IG: https://t.co/Rh4056hSDdBrick @BrickInTh3Wall
2 Followers 262 FollowingSergio Fonseca @sergiofj
34 Followers 399 FollowingRohan Paul @rohanpaul_ai
13K Followers 1K Following ML Engineer (e/acc) 📌 https://t.co/x0IIWfnOt8 🚀 https://t.co/QEO4CKRl1b Open LLMs is Happiness 💡 Ex Deutsche & HSBC. DM for collaboration.Jonathan Reis @jreissup
108 Followers 2K Following Data Architect | Data Engineer | Data Infrastructure | AWS Solutions Architectbabumoshaye @_babu_moshaye
0 Followers 35 FollowingHannes Mühleisen @hfmuehleisen
5K Followers 937 Following I like databases. Co-creator of @duckdb, Co-Founder and CEO @duckdblabs. Professor of Data Engineering @Radboud_UniDuckDB Labs @duckdblabs
3K Followers 3 Following DuckDB Labs is a small artisanal data processing company that provides services around DuckDB directly from its creators.Mark Raasveldt @mraasveldt
801 Followers 66 Following"(DuckDB) It's my default choice when I got a CSV and gotta do some analyzing on it" - Andy
DuckDB was recently covered in @andy_pavlo's Advanced Database Systems course at CMU. The lecture covers DuckDB's history, internals, and integration with other systems. Slides: 15721.courses.cs.cmu.edu/spring2024/sli… Recording: youtube.com/watch?v=4iD4h4…
Thanks to our custom-built data sharding and the query engine (that uses parquets and DuckDB under the hood), the op costs for our 200TB data lake is around 5k/mo. Each worker node keeps just 1TB of data. With the new 100TB SSDs going mainstream, the capacity will go 100x🦑
I just published This Alternative to Pandas Processes Data 350 Times Faster link.medium.com/59UohoyBbJb
We invite our community to submit talk proposals until April 29. We especially encourage members of underrepresented groups to share their DuckDB-related projects. Please use the form at forms.gle/RgFazaawkfx9YK…
Save the date: DuckCon #5 will take place in Seattle on 2024-08-15. For details and the registration link, see duckdb.org/2024/08/15/duc…
Just updated Scrooge to DuckDB 0.10. Scrooge is a financial extension + eat-your-own-dog-food kind of thing where I get to try our extension-template, suffer from breaking changes and s3 releases. I must say the current extension template is pure bliss! github.com/pdet/Scrooge-M…
The ability to test data eng code with a local DuckDB is such a game changer.
Some other examples I can think of: $ pip install ziglang # you get a two language compilers (zig and c) $ pip install duckdb
A neat thing about pip and its ecosystem is that - if you know how to package for it - it's actually really good at installing the right binary for the current operating system and adding it to the user's path
duckplyr: dplyr Powered by DuckDB – A High-Level Overview buff.ly/4aHxAmt
Recently @ApacheArrow added two new columnar memory layouts: ListView and StringView. Now @duckdb supports them both! Awesome collaboration between @duckdblabs and @VoltronData
DuckDB now integrates with Arrow's recently added types: String and List Views. Inter-op is the future ;-) github.com/duckdb/duckdb/… github.com/duckdb/duckdb/…
Ibis in the browser? Try it out! (Warning: very experimental, doesn't work on iOS, and we'll be working on UX improvements going forward!): ibis-project.org/tutorials/brow…
DuckDB now integrates with Arrow's recently added types: String and List Views. Inter-op is the future ;-) github.com/duckdb/duckdb/… github.com/duckdb/duckdb/…
Trying out Data Analysis using Llama3 on @GroqInc and @duckdb. Anyone got good datasets to throw at this? Code: git.new/groq-data
Wanted to analyze a 22GB csv file at work. I am used to unix pipes with sed, cut, etc. Reached for @duckdb this time. So fast. Feels like playing around with a small text file. The repl is excellent. Could also (zstd) compress it to a 1.4GB parquet file with no performance loss.
@lostkobrakai @josevalim @livebookdev @duckdb Yeah, duckdb is a gem. I keep find good usecases for it all the time.
@__AlexMonahan__ @keithjkraus Definitely. Ibis in the browser is powered by DuckDB.
💡 @davidgasquez maintains a repo that reports all the awesome stuff around @duckdb so people get more productive 📢 Based on his work, you can also enjoy this knowledge on @huggingface hf.co/chat/assistant…