Hacker News new | past | comments | ask | show | jobs | submit

DuckDB Ducklake

https://github.com/duckdb/ducklake
Don't think it's widely known or understood, but Ducklake doesn't require duckdb: it's just a (good) data lake spec that works in duckdb.

There's a cool alternate rust/datafusion ecosystem initiative going on at https://github.com/datafusion-contrib/datafusion-ducklake, and think the Quack protocol opens up a lot of cool possibilities too.

If you need an idea for what do do with ducklake: recommend throwing all of your agent traces in it.

loading story #50013044
It's alright, it's pretty alpha software. On v1.5.4, catalog filtered counts are broken, afaik. I went to main/v2 to fix it, and then the SQL parser in duckdb v2 is 10x slower, which was another wrench in the gears. It's been a bit of a pain tbh
loading story #50012289
Motherduck is offering a free copy of O'reilly's "DuckLake: The Definitive Guide" book on their DuckLake web page

https://motherduck.com/product/ducklake/

But "Duckpond" was right there!
Is this basically a table format like Delta/Iceberg but with an SQL engine built in via DuckDB?
Why program greenfield in C++? I know "made with rust" is a meme but seriously, why not a memory safe language in 2026?
loading story #50012134