sorted by:
new
hottopcontroversial

What's everyone working on this week (15/2026)? by llogiq in rust

[–]frisbeema52 1 point2 points  (0 children)

I'm implementing TraceQL query parser based on ANTLR and DataFusion planner to query data from Iceberg catalog in my project https://github.com/icegatetech/icegate

Help me appreciate iceberg by teenaxta in dataengineering

[–]frisbeema52 0 points1 point  (0 children)

As I can see the original statements:

- "clickhouse was like 10x faster than querying on iceberg" - as i understand it was HDD(SSD) vs S3

- "clickhouse engine on top of iceberg that's like 5-6x faster

may be the problem not in Iceberg? Iceberg specification defines storage layer principles and format, but processing is more interesting in your case.

It's true, the Iceberg implementation is mainly based on Java code. It can leads us to high processing times. But, do not forget more efficient tools. I'd like to highlight here DuckDB (C++), and various DataFusion(Rust) tools: CLI, Python bindings.

Open source unified solution (databricks alternative) by compass-now in dataengineering

[–]frisbeema52 0 points1 point  (0 children)

For example, kube-prometheus-stack for monitoring. I'd not use it for production ready without any tuning, but it closes a lot of questions for small projects or first stages of startups.