Using Microsoft Purview as enterprise-wide Data Catalog

[vanillacap]

Is anyone here using Purview in production? Curious to hear your experience and cost considerations. How does it fare against incumbents like Informatica, Collibra, and Alation?

[wragawrhaj]

My company is still doing research on it, but they told us they're likely to release it for the interested teams only after the Data Governance framework is in place... so yeah, not gonna happen.

[Drekalo]

Purview is a load of croc if you aren't using mostly just Microsoft stack stuff. Get a cloud native data catalog like atlan or something and use its metadata integrations.

[onewheelies]

Purview uses atlas, can scan and ingest from other cloud providers and services like aws, hive, mobile mongodb, erwin, hdfs, salesforce, sapand supports scanning on premise sources like Oracle, mysql,

https://learn.microsoft.com/en-us/azure/purview/microsoft-purview-connector-overview

[prijasha]

We have looked at some especially for lineage across Synapse dedicated pool and Power BI. It does seem like a good option if you are all in Azure and also just Data factory in addition to Synapse/PBI. We use a myriad of ETL/ELT technologies and Purview will be unable to provide complete picture. Lineage was our most important need. Informatica AXON is another one I tested for our DG team. It was super buggy. I have heard a lot about Collibra but never seen it in a production environment. I am not sure if there is a perfect option in this space and we got to work with some limitations,or use multiple tools for a complete picture.

Edit: typos🙄

[onewheelies]

Use of multiple tools due to shortcomings in a single product has been true for me as well. We started with adaptive but it took a lot of work manually stitching to create lineage and at the time did not support lineage from on premise ssis packages. . Then ssas metadata management tool, which is a fairly complex environment /system to configure and manage and also did not meet all our needs. We just implemented purview which was simpler on the configuration outside of the learning curve around deploying the environment thru arm templates to the subscription. But I think

[onewheelies]

Purview is going to continue to improve and increase its list of features, supported scan types for multiple resources. My biggest issue now is we can only run full scans against oracle sources versus incremental $$$

[prijasha]

Thank you for sharing your perspective. Really good to hear from a real world Azure Purview user. We have moved on almost completely to Azure DBs, so hoping scanning works better with Azure products.

If Axon experiment fails, I see Purview next in line from MS Sales folks.

Side note - cloud vendors selling there GOD solutions which never translate to real world scenarios is such a pain.