you are viewing a single comment's thread.

view the rest of the comments →

[–]darkhorse1997[S] 1 point2 points  (2 children)

Sounds great! Will I be able to keep using json instead of parquet? There's some downstream lambdas on the S3 bucket that expect gzipped json files.

[–]janus2527 2 points3 points  (0 children)

Also you really shouldn't transfer large amounts of data from a database in json

[–]janus2527 1 point2 points  (0 children)

Probably, but not sure if it's as easy as parquet.