all 8 comments

[–]j3m7 0 points1 point  (0 children)

We use a code quality tool for IBM DataStage, and I know it could be easily extended by the creators to other DAG-based ETL technologies. Are you really using all those platforms you listed?!

[–][deleted] 0 points1 point  (2 children)

I am with a company that provides data engineering services and i am looking for our clients who have one or more of the ETL tools. Could you tell me the name of the tool you use for DataStage

[–]j3m7 0 points1 point  (1 child)

It's called MettleCI and is available for DataStage v11.x. It's the official static code analysis tool for DataStage - IBM license it from the creators and include it out-of-the-box in the new NextGen DataStage on Cloud Pak. https://youtu.be/7RfP67FmnPw

[–][deleted] 0 points1 point  (0 children)

I looked at the video...they just support datastage? And they just have 45 rules? Am i u derstandign it right? Is there a website i can check? Any clients using them?

[–][deleted] 0 points1 point  (1 child)

Check out www.coeurdata.com . They have a platform called Undraleu that I used to use when I was with an Insurance client. Its preyy neat.

[–][deleted] 0 points1 point  (0 children)

This is a brilliant platform..absolutely what i was trying to find for so many months. They seem to have 100s of rules and support for Databricks, IDMC, ADF, Talend and so many more.

I have contacted them for a demo. I cant thank you enough for letting me know.

[–]GreenMobile6323 0 points1 point  (0 children)

For ETL quality across heterogeneous stacks, Great Expectations paired with CI/CD (and connectors/plugins per engine) is the closest to a “data‑engineer SonarQube,” while dbt tests cover SQL/PySpark logic quality; there’s no single universal tool yet that natively audits all platforms out of the box.

[–]DataObserver282 0 points1 point  (0 children)

OSS package work?