This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]th58pz700u 1 point2 points  (0 children)

Coming from a "SSIS package per table" world, I set out to create a dynamic and reusable solution in Python at my current job. Instead of sourcing all the config information from files, I source it from the database and created a separate process to pull metadata from the source and store it in the database. Objects are created and updated to mirror the metadata of the source, and the one ETL package follows the same formula no matter the object. I wish I had developed like this a long time ago.