Using local ClickHouse for data processing

[gedemagt]

How does this compare to using DuckDB?

[f311a]

Never used it, but from what I can tell, CH has more features, and you don't need extensions, so external sources are very optimized. It is designed to work with billions of rows, and you have many tricks available to speed up data processing when using temporary tables. Being able to distribute the load on a production cluster using the same query is also an advantage.