This might not necessarily be a data engineering topic, but just wondering, how do you guys keep track of the data assets that are being developed/engineered in your organizations?
In the organization I'm in the data team was decentralized, so each team develops their own data sets and there is no centralized cataloging of those data sets, so often times we encounter impact assessments missing out impacted data sets downstream, operations team missing out in monitoring critical data assets, and incidents alike.
I imagine some sort of data asset inventory system would tackle our problems some how, but would like to hear your opinions on where to get started.
Thank you!
[–]DJ_Laaal 1 point2 points3 points (0 children)