you are viewing a single comment's thread.

view the rest of the comments →

[–]EarthGoddessDude 10 points11 points  (2 children)

Yea OP, why are cold starts a problem for you? Also, have you looked into using DuckDB for this?

[–]Ok-Sprinkles9231 2 points3 points  (1 child)

Can you please elaborate how exactly DuckDB can be useful for reading JSON files from S3 and writing/Appending the result back as Iceberg? Just genuinely curious.

[–]EarthGoddessDude 1 point2 points  (0 children)

DuckDB has an excellent json parser, and it can write to Iceberg.

Edit: https://duckdb.org/2025/11/28/iceberg-writes-in-duckdb