Interested in finding out more about data wrangling with DuckDB? Be sure to watch the keynote from posit::conf, where Hannes Mühleisen talks about "Data Wrangling [for Python or R] Like a Boss With DuckDB": https://www.youtube.com/watch?v=GELhdezYmP0
DuckDB
DuckDB is an analytical in-process SQL database management system. It is simple, feature-rich, fast, extensible, and comes with the permissive MIT open-source license. "DuckDB" and the DuckDB logo are registered trademarks of the DuckDB Foundation.
𝐍𝐞𝐰 𝐑𝐞𝐥𝐞𝐚𝐬𝐞: 𝐃𝐮𝐜𝐤𝐃𝐁 𝟏.𝟏.𝟐
We released DuckDB version 1.1.2, which is a bug fix release.
Curious about the change log? Here are the release notes: https://github.com/duckdb/duckdb/releases/tag/v1.1.2
Follow our documentation for instructions on installing or upgrading: https://duckdb.org/docs/installation
𝗙𝗮𝘀𝘁𝗲𝗿 𝘁𝗼𝗽 𝗡 𝗳𝗼𝗿 𝗮𝗴𝗴𝗿𝗲𝗴𝗮𝘁𝗲 𝗳𝘂𝗻𝗰𝘁𝗶𝗼𝗻𝘀
The end of the week brings us another blog post. Alex Monahan takes a deep dive into the top N capabilities in DuckDB. Checkout how you can simplify your queries and boost performance with 𝚖𝚒𝚗, 𝚖𝚊𝚡 aggregate functions and their advanced cousins 𝚖𝚒𝚗_𝚋𝚢 and 𝚖𝚊𝚡_𝚋𝚢: https://duckdb.org/2024/10/25/topn
Happy Friday, everyone!
Interested in DuckDB’s evolution from a research project to a mature database system?
Hannes Mühleisen, the co-creator of DuckDB, presented the journey of DuckDB during his keynote at @pyconde@fosstodon.org
We rolled out a fresh look for duckdb.org over the last few weeks. This includes a redesigned landing page, blog posts, media collection, and the Community Extensions repository. And dark mode is now supported on all sites! 🌚
𝗖𝗼𝗻𝗰𝘂𝗿𝗿𝗲𝗻𝗰𝘆 𝗰𝗼𝗻𝘁𝗿𝗼𝗹 𝗮𝗻𝗱 𝗹𝗼𝗴𝗴𝗶𝗻𝗴 𝗶𝗻 𝗗𝘂𝗰𝗸𝗗𝗕
Have you ever wondered what the .wal file is when working with DuckDB? Time to find out!
This week, the co-creators of DuckDB, Hannes Mühleisen and Mark Raasveldt, wrote a blog post about the Multi-Version Concurrency Control and Write-Ahead-Logging schemes designed to ensure transactional guarantees: https://duckdb.org/2024/10/30/analytics-optimized-concurrent-transactions
𝗨𝗽𝗱𝗮𝘁𝗲𝘀 𝗼𝗻 𝗩𝗦𝗦 𝗘𝘅𝘁𝗲𝗻𝘀𝗶𝗼𝗻
In this week’s blog post, Max Gabrielsson dives into the details of the new features and improvements in the Vector Similarity Search Extension: https://duckdb.org/2024/10/23/whats-new-in-the-vss-extension
He talks about:
- indexing speed improvements
- index accelerated top-k aggregates
- index accelerated lateral joins
- new distance functions
In light of CVE-2024-9264, we would like to remind everyone that passing untrusted user input to DuckDB needs special care. We have a documentation page on Securing DuckDB (https://duckdb.org/docs/operations_manual/securing_duckdb/overview), which explains the details, including advice for running DuckDB in embedded mode.
We finalized the schedule for the sixth edition of DuckCon!
We want to emphasize that DuckCon is a 𝐟𝐫𝐞𝐞 event, and registration is required to attend in person. If you can't join us in person, the event will be streamed through a public stream (no registration required to watch).
Check out all the details about #DuckCon on our website: https://lnkd.in/dCE2_k5m
𝗡𝗲𝘄 𝗿𝗲𝗹𝗲𝗮𝘀𝗲
We released DuckDB version 1.1.3, which is a bug fix release. You can find the change log here: https://github.com/duckdb/duckdb/releases/tag/v1.1.3
Follow our documentation for instructions on installing or upgrading: https://duckdb.org/docs/installation
📣 New post in the DuckDB tricks series
These tips can save you precious keystrokes and file scans, making both writing and running your queries faster.
New blog post by Hannes Mühleisen and Mark Raasveldt:
Runtime-Extensible SQL Parsers Using PEG
https://duckdb.org/2024/11/22/runtime-extensible-parsers
This post, a shortened version of a CIDR 2025 paper, discusses how parsers in DBMSs could be re-designed using Parser Expression Grammars for extensibility and improved error reporting.
If you're curious about DuckCon, here is a talk from our previous edition, which took place in Seattle: https://www.youtube.com/watch?v=pY3fDhZiPDk
Find more info about the upcoming as well as previous DuckCon events on our website: https://duckdb.org/2025/01/31/duckcon6.html
𝗡𝗲𝘄 𝗜𝘁𝗲𝗺 𝗶𝗻 𝘁𝗵𝗲 𝗦𝗵𝗼𝗽
As the chilly season approaches, we've got your back—literally!
Our DuckDB hoodies are now available in the shop: https://shop.duckdb.org/. Perfect for staying warm this season!
One of DuckDB's key use cases is data science applications, where it's often used in combination with (or in place of) data frame libraries. These libraries often preserve row order between operations, which is also supported by DuckDB. See which operations preserve order:
https://duckdb.org/docs/sql/dialect/order_preservation
3 more months until the sixth edition of DuckCon, taking place in Amsterdam! Check out our event: https://www.linkedin.com/events/duckcon-67257738718894034946/
𝗛𝟮𝗢.𝗮𝗶 𝗱𝗯-𝗯𝗲𝗻𝗰𝗵𝗺𝗮𝗿𝗸 𝘂𝗽𝗱𝗮𝘁𝗲𝗱
The 𝖧𝟤𝖮.𝖺𝗂 db-benchmark has been updated with new results: https://duckdblabs.github.io/db-benchmark/
You can find more details about the setup and the benchmark in our related blog posts: https://duckdb.org/2023/11/03/db-benchmark-update.html
𝐔𝐩𝐝𝐚𝐭𝐞𝐝 𝐛𝐞𝐧𝐜𝐡𝐦𝐚𝐫𝐤 𝐬𝐮𝐢𝐭𝐞
In this week’s blog post, Pedro Holanda takes a deep dive into DuckDB’s CSV performance with the well-known NYC Taxi Dataset: https://duckdb.org/2024/10/16/driving-csv-performance-benchmarking-duckdb-with-the-nyc-taxi-dataset
We recognise that benchmarking is challenging, so the blog post contains detailed steps to reproduce this new benchmark. Happy coding!
You can also find us on Bluesky. Stay up-to-date with DuckDB by following @𝚍𝚞𝚌𝚔𝚍𝚋.𝚘𝚛𝚐
𝗙𝗶𝗿𝘀𝘁 𝗗𝘂𝗰𝗸𝗗𝗕 𝗠𝗲𝗲𝘁𝘂𝗽 - 𝗦𝘂𝗺𝗺𝗮𝗿𝘆
Last week we hosted our first meetup, here in Amsterdam. In case you missed it, all the talks were recored and are now available on Youtube. You can find the links to the videos and the slides on our website: https://duckdb.org/2024/10/17/duckdb-amsterdam-meetup-1
Until we see you at the next meetup, make sure you register for the next DuckCon, which will take place in Amsterdam.