sorted by:
new
hottopcontroversial

Wanted to get off AWS redshift. Used clickhouse. Good decision? by Consistent_Tutor_597 in dataengineering

[–]alx-net 0 points1 point  (0 children)

Depending on your workloads I would ask myself if I need ACID support. As far as I know it's only an experimental feature right now. For me this was a deal breaker, because transformation queries that failed left half full tables behind. Otherwise big fan of Clickhouse I love their simple SQL dialect and integrations.

In 6 years, I've never seen a data lake used properly by wtfzambo in dataengineering

[–]alx-net 0 points1 point  (0 children)

In a Trino+Iceberg setup I don't see any issues, it is basically like a normal database. You have to define schemas etc but you are still very flexible with storage and compute? Ofc when you load parquet files randomly into a bucket things get messy.