Elektrine
Log in Register

#duckdb

6 posts · Last used Aug 03

Thomas @thbley@phpc.social
· 2mo ago

I've made a new release: DuckDB driver for Laravel

Support for views Bugfixes: year default expression, parameter serialization CI tests: project setup, macOS, Windows more examples in the readme:

  • read and write Parquet files
  • copy data from MySQL/MariaDB/PostgreSQL to Parquet
  • community extensions
  • performance example
  • read public data
  • Eloquent Models, schema and query builder for special types

https://github.com/thomas-0816/laravel-pdo-duckdb

#php #laravel #analytics #duckdb #eloquent #bigdata

github.com
1
0
0
0
Hacker News @hackernews@robot.villas
· 2mo ago
Paging Through a Parquet File in DuckDB: File_row_number or Offset? https://rusty.today/blog/paging-parquet-duckdb-file-row-number-vs-offset/ #HackerNews #Tech #DuckDB
Paging Through a Parquet File in DuckDB: file_row_number or OFFSET?
rusty.today

Paging Through a Parquet File in DuckDB: file_row_number or OFFSET?

You have a large Parquet file and an API that has to return its contents, but responses have a size ceiling, so the caller pages through it. LIMIT/OFFSET is the obvious way to write that and it is the wrong one. I measured file_row_number against it: 2.53x faster on a file with 163 row groups. Speed is the boring half of the answer. OFFSET will also hand back the wrong rows without telling you.

0
0
0
0
Self-Hosted Feed @selfhosted_bot@fd.mrmave.work
· 2mo ago
🦆 slothflowlabs/duckle Create visual data pipelines locally at native DuckDB speed using a built-in AI assistant. No cloud required. ⭐ Stars: 789 📅 Last Update: Jul 14, 2026 https://github.com/slothflowlabs/duckle #selfhosted #homelab #selfhost #selfhosting #opensource #duckdb #aiassistant
GitHub

GitHub - slothflowlabs/duckle: Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per

Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agen...

0
0
0
0
Márton Salomváry @mrc@mastodon.berlin
· 6mo ago
I might have said this earlier but worth repeating. DuckDB is freaking amazing! Today I worked on a 56G TSV file containing 55 million rows of JSON serialized documents (all of OpenLibrary editions). I can query this file including filtering on nested JSON structures and most queries complete in a few dozen seconds worst case, but I can also create derived indexes to bring down query times to milliseconds. All in memory on an M1 Mac with 64GB RAM. #DuckDB #OpenLibrary #BigData
3
1
0
0
You've seen all posts