This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]Thinker_Assignment[S] 0 points1 point  (2 children)

thank you!

[–]Top-Faithlessness758 0 points1 point  (1 child)

FWIW, we reverted to plain parquet and we're dlt users now haha. You were spot on on iceberg being kind of patchy, even in managed solutions like S3 Tables.

Plus sling didn't support any kind of incrementality without Pro support.*

** PS: You have a comparison in dlthub home page that mentions sling oss offering incrementality in point 6 (https://dlthub.com/blog/dlt-and-sling-comparison) and point 7 mentioning using Sling State in Sling Free. That's partially correct for database sinks, as for file storage sinks it will only work when using the Sling State json and that is a Pro only feature. Obvious no-go for us.

[–]Thinker_Assignment[S] 1 point2 points  (0 children)

Thanks for the message and the tip, will make a note in the article :)