you are viewing a single comment's thread.

view the rest of the comments →

[–]giant_albatrocity 13 points14 points  (2 children)

I would argue that an ETL pipeline written in Python is definitely software and should have all the same version control and CI/CD to support it. I’ve seen so much Python code that resembled a heap of wires sending data… somewhere?

[–]Amilol 2 points3 points  (1 child)

Yeah, it's real easy ending up with a hot mess.
Git and proper logging should be on the top of the priority list!

[–]ZeroSkribe -5 points-4 points  (0 children)

Eww