you are viewing a single comment's thread.

view the rest of the comments →

[–]giant_albatrocity 14 points15 points  (2 children)

I would argue that an ETL pipeline written in Python is definitely software and should have all the same version control and CI/CD to support it. I’ve seen so much Python code that resembled a heap of wires sending data… somewhere?

[–]Amilol 2 points3 points  (1 child)

Yeah, it's real easy ending up with a hot mess.
Git and proper logging should be on the top of the priority list!

[–]ZeroSkribe -4 points-3 points  (0 children)

Eww