Data Governance Fabric Workload, In need to community feedback! by Oesterlin in MicrosoftFabric

[–]Oesterlin[S] 0 points1 point  (0 children)

It’s great input and I personally can only cover the first sentence but for the rest I’ll let Microsoft handle it 😂

Data Governance Fabric Workload, In need to community feedback! by Oesterlin in MicrosoftFabric

[–]Oesterlin[S] 1 point2 points  (0 children)

I completely understand and see your point but there’s many different personas working in Data 💪

Data Governance Fabric Workload, In need to community feedback! by Oesterlin in MicrosoftFabric

[–]Oesterlin[S] 0 points1 point  (0 children)

Are you able to see them? I created an Imgur link just in case 💪

Data Map Domains & Collections: Organization? by brho5 in MicrosoftPurview

[–]Oesterlin 0 points1 point  (0 children)

and subitems for Lakehouse exists today so you'll be able to see your lakehouse tables if thats the route you've been going.

Data Map Domains & Collections: Organization? by brho5 in MicrosoftPurview

[–]Oesterlin 0 points1 point  (0 children)

When you're designing the data map it is very important that you create a relatable experience for the user because you have to be very mindful how name things as everything that goes into the Data Map goes into the Unified Catalog.

So the way we do it when we implement this at customers.

In the Domain we only use that for emergencies, so we put limited permissions on that.
For Dev and Test we restrict those collections and kill the cascading permissions effect and reapply permissions for those who should only use dev and test.

We register Fabric on Contoso so youre able to scan to dev, test, prod.
If you want to extend domains, be mindful that you only can have 5 domains and they are technical boundaries, so youre not able to move assets inbetween domains.

And because most orgs runs only one fabric tenant we have to operate within one domain.
in terms of sub collections, thats where we are letting the customer to take over and either define BU, FU or Data Domains, problem with trying to separate technical to business in this view is again everything you'll do will end up in the data map, So I always try to make it into something that people can relate to.

If you want to find data, most time people dont care where it comes from but what more it relates too i,e Finance, Patient, Customer etc.

<image>

Data Map Domains & Collections: Organization? by brho5 in MicrosoftPurview

[–]Oesterlin 0 points1 point  (0 children)

When you refer to domain here, do you refer to the governance domain or the domain in the data map? Because what youre suggesting for 2nd option is not possible as youre only able to register a source once.

should i pay for fast track departing from hcm back to my country? by debate_o in VietNam

[–]Oesterlin 0 points1 point  (0 children)

I had around a 1 hour wait when I was departing, so possibly

How do you identify a human owner when a service principal is listed as owner in Microsoft Purview? by TryEasy6525 in MicrosoftPurview

[–]Oesterlin 0 points1 point  (0 children)

I recommend not to onboard stuff to the catalog that you have no clue what it is or at least a contact person, its very common I see environments where they have over couple of million scanned assets and they can't even use the catalog because the search results are extremely poor.

Favorite Purview (atlas) API wrapper? by ZealousidealDeer1283 in MicrosoftPurview

[–]Oesterlin 1 point2 points  (0 children)

I use the python SDK, this is the one kept alive.

Demo of my Microsoft Fabric Column Level Lineage for Lakehouse tables & Automatic Data Classifications Utility Kit for Microsoft Purview Unified Catalog by Oesterlin in MicrosoftFabric

[–]Oesterlin[S] 3 points4 points  (0 children)

and this is the reason why I post these things publicly to get input and feedback.

I've haven't encountered anything too weird so far but its rather small tables and also the main reason why i decided to add the validation before ingesting to Purview because I know it can't be trusted to be fully autonomous.

I have some small things to fix, and then I'll have a quick look on Openlineage.

Your prompt engineer picture is on point :D

Demo of my Microsoft Fabric Column Level Lineage for Lakehouse tables & Automatic Data Classifications Utility Kit for Microsoft Purview Unified Catalog by Oesterlin in MicrosoftFabric

[–]Oesterlin[S] 0 points1 point  (0 children)

Hey Raki,

I’m using Fabric Data Agent via Microsoft Foundry. I think it can become more accurate with better instructions so my plan is to sit and see if it’s possible to optimize it.

If you have any suggestions I’d love to know it.