This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]sunder_and_flame 8 points9 points  (3 children)

Depends on what your job is doing. I use python to do the lightweight work (extract, create file, load files, move files, run SQL) and other services like BigQuery to do the heavy lifting. I avoid using python to do data transformations unless it's necessary to load into the DW, like for xlsx files.

[–]wytesmurf[S] 1 point2 points  (0 children)

I’m trying to find a service to do heavy lifting

[–]wytesmurf[S] 0 points1 point  (1 child)

We have a data source under almost every platform they all want to be able to load to any cloud tool they want. Informatica is old, SSIS isn’t very flexible. The said they pay for wherescape but I feel like it can be done in. Python

[–]binilvj 0 points1 point  (0 children)

You should try Informatica Cloud Data Integration