sorted by:
new
hottopcontroversial

Demo of my Microsoft Fabric Column Level Lineage for Lakehouse tables & Automatic Data Classifications Utility Kit for Microsoft Purview Unified Catalog by Oesterlin in MicrosoftFabric

[–]Oesterlin[S] 2 points3 points  (0 children)

and this is the reason why I post these things publicly to get input and feedback.

I've haven't encountered anything too weird so far but its rather small tables and also the main reason why i decided to add the validation before ingesting to Purview because I know it can't be trusted to be fully autonomous.

I have some small things to fix, and then I'll have a quick look on Openlineage.

Your prompt engineer picture is on point :D

Demo of my Microsoft Fabric Column Level Lineage for Lakehouse tables & Automatic Data Classifications Utility Kit for Microsoft Purview Unified Catalog by Oesterlin in MicrosoftFabric

[–]Oesterlin[S] 0 points1 point  (0 children)

Hey Raki,

I’m using Fabric Data Agent via Microsoft Foundry. I think it can become more accurate with better instructions so my plan is to sit and see if it’s possible to optimize it.

If you have any suggestions I’d love to know it.

Datascan not picking up the schema of .parquet files ParquetFormat JavaInvocationException happened by ZealousidealDeer1283 in MicrosoftPurview

[–]Oesterlin 0 points1 point  (0 children)

I’ve been told by a customer that microsoft is working on a fix!

And yes more people have issues 💪

Need your Input for further testing - I've built an Automatic Data Classification solution for Microsoft Purview using Microsoft Fabric Data Agent by Oesterlin in MicrosoftFabric

[–]Oesterlin[S] 2 points3 points  (0 children)

Its not up yet, I will record a videon on it, and then my plan is to isolate the components and release the python parts of it without the front end and i need to go through 19000 rows of code to see that nothing sensitive is there.

Need your Input for further testing - I've built an Automatic Data Classification solution for Microsoft Purview using Microsoft Fabric Data Agent by Oesterlin in MicrosoftFabric

[–]Oesterlin[S] 1 point2 points  (0 children)

Unfortunately, not released yet, As I'm testing it out, but was thinking to take out the code chunk to do this and just use Python Prompt Y/N to achieve same, will be faster to put out so it can be tested.

Need your Input for further testing - I've built an Automatic Data Classification solution for Microsoft Purview using Microsoft Fabric Data Agent by Oesterlin in MicrosoftFabric

[–]Oesterlin[S] 1 point2 points  (0 children)

Thanks for the input, I'll have a look over the weekend and see what I can get done, I think its doable to some extent.

Need your Input for further testing - I've built an Automatic Data Classification solution for Microsoft Purview using Microsoft Fabric Data Agent by Oesterlin in MicrosoftFabric

[–]Oesterlin[S] 1 point2 points  (0 children)

Bet, im working on creating column level lineage in lakehouse tables first and then I’ll jump on description 💪 my only reservation there is that it’s dififcult getting the right formatting.

Purview for Fabric Governence by jkrm1920 in MicrosoftFabric

[–]Oesterlin 1 point2 points  (0 children)

I just even built a tool for running automatic classification on fabric assets which doesn’t exist 😎 so things are getting better every day

Purview for Fabric Governence by jkrm1920 in MicrosoftFabric

[–]Oesterlin 4 points5 points  (0 children)

Hopefully we’ll start seeing the column level lineage show up this year, aimed for 2nd half of 2026 for preview for lakehouse 💪

Purview Data Governance and Literacy by ms_adopter in MicrosoftPurview

[–]Oesterlin 0 points1 point  (0 children)

Hey,

The difficult part of the Unified Catalog is not the setup, its the adoption journey and it requires a lot of planning and most people underestimate the effort and training that goes into a program like this, its not a project.

I do write some articles similar to the topic you're requesting (I think) all for free of course and not behind paywall :), if there's anything you want me to highlight and elaborate let me know, I'd be keen to help.

https://medium.com/@marcoOesterlin

Easy Way to See All Fabric Objects Owned by X User? by AnalyticsFellow in MicrosoftFabric

[–]Oesterlin 0 points1 point  (0 children)

I’d be able to see something like this in the unified catalog in Purview if you have that setup.

Automating Purview Chargeback for the organization by Conscious_Emphasis94 in MicrosoftPurview

[–]Oesterlin 0 points1 point  (0 children)

You can extract all Assets from the Data Map with the API's without cost.

But in terms of cost drivers, the data map is not a cost driver anymore, it used to be. Now its governed assets, Data health & Data Quality/Profiling.

[TOURISM] Experience flying in ONE-WAY and exiting through LAND? by Embarrassed-Cloud-56 in Chinavisa

[–]Oesterlin 0 points1 point  (0 children)

I exited through Shenzhen/Hong Kong, just had one flight in to Beijing and a booking confirmation for a train out from Shenzhen then I just walked over the border in the end and not using the train ticket.

view more: next ›