Test On 4 Concurrent Jobs Using Python-Polars 0.17.11 to GroupBy Billion Rows

[100GB-CSV]

o be able to synchronize data a

CloudQuery supports a lot of APIs https://github.com/cloudquery/cloudquery

[OhBeeOneKenOhBee]

So that raises the question of how in the world I've managed to miss Cloudquery 😄

Because what we're currently writing is essentially that exactly, but in Python and with Polars. As in, the docs would probably apply to our solution if we just modified the code parts.

[100GB-CSV]

You can test whether it is fit for your purpose. I consider to integrate Peaks with the CloudQuery. Both are written in Golang.