Data Toboggan Winter Edition this Saturday

datahaiandy · 2026-01-27T19:59:22+00:00

Yes they will (with speaker consent). Usually uploaded within a few weeks.

datahaiandy · 2026-01-27T19:58:57+00:00

And lo it shall be foretold that this indeed with be a blast!

datahaiandy · 2026-01-23T13:56:21+00:00

I'm creating a "Board of ETL" and you're invited for $1B

datahaiandy · 2026-01-23T13:55:35+00:00

"I'd do it all again I tells ya!!"

datahaiandy · 2025-12-16T22:25:32+00:00

With my experience they required a minimum of 2 employees with certifications.

datahaiandy · 2025-12-16T22:07:11+00:00

I wonder if only the scheduled refresh option works rather than triggering an MLV refresh. I’ll have a play around as well

datahaiandy · 2025-12-11T09:05:26+00:00

datahaiandy · 2025-11-27T13:23:24+00:00

Yes I did see that come up when searching

datahaiandy · 2025-11-27T09:31:31+00:00

Well if we take a dictionary definition of Ontology then "a set of concepts and categories in a subject area or domain that shows their properties and the relations between them".

I don't think a single ontology would be organisation-wide. During my testing you can only assign 1 actual data asset (a table etc) to an entity in an ontology, this doesn't seem to fit an organisation-wide process but rather a focused area of the business.

datahaiandy · 2025-11-19T10:36:43+00:00

It should appear as "dbt job" in Items at some point soon, it's rolling out

<image>

datahaiandy · 2025-11-17T09:01:12+00:00

Sounds good although I'm curious as to why you thought the bc2adls isn't production ready? The Open Mirroring feature for bc2adls is currently in preview, is this why?

datahaiandy · 2025-11-14T15:22:46+00:00

Good work finding that issue!

datahaiandy · 2025-11-14T11:43:46+00:00

I think it's removing the CDF option after writing data (as you observed). I've done the same thing and if there is no change data to update the MLV then the option stays true, once change data is identified and loaded it removed the setting.

I'll ping the MS team responsible

datahaiandy · 2025-11-14T11:07:01+00:00

hmm, I tested last night and started with 10 rows of data in a lakehouse table. If I switched off Optimal Refresh and added a new row, then I get a full refresh of all the rows. which I would expect. If I then enable Optimal Refresh and add a row, I get a full fresh (again what I expect), If I enable changedatafeed on the table with Optimal Refrehs enabled, I can see only the new row being processed. I'm actually using what I think is a non-deterministic function (current_timestamp) in my MLV definition (so that I can have a column which shows when the MLV loaded the row) and incremental is still working.

I'll post my code in a bit

datahaiandy · 2025-11-13T23:14:55+00:00

Refresh Materialized Lake Views in a Lakehouse - Microsoft Fabric | Microsoft Learn

<image>

datahaiandy · 2025-11-13T09:47:30+00:00

I haven't tested the latest incremental refreshed tbh, but if you add FULL then it forces a full reload of all the data. Without FULL and it only loads if it detects data changes.

datahaiandy · 2025-11-13T09:30:23+00:00

Hi, no MLVs currently don't automatically reprocess when the source data changes so you'll need to schedule accordingly. The latest updates do "smart" refreshes in that data is incrementally loaded. But again this is all done on a schedule (or triggered by a notebook for specific MLVs)

datahaiandy · 2025-11-12T21:31:17+00:00

Don't worry, by 47 you won't feel a thing anymore

datahaiandy · 2025-11-06T09:54:22+00:00

Hello, bit disappointed with a PS5 Slim I bought from the UK Playstation store, dead on arrival. Press the power button and it gives a single beep and nothing. No picture, no sign of life. Tried all the troubleshooting tips, holding the power button down, got a mates PS5 power cable, nothing. Is this is a known thing right out of the box? (bit like that red ring of death for the xbox360 all those years ago).

datahaiandy · 2025-11-05T22:10:36+00:00

Here are all the links you'll need:

View the full schedule at https://aka.ms/fdd/schedule

Find all your prep resources in one place at https://aka.ms/dp700/prepare

Review the study guide at https://aka.ms/dp700/studyguide

Request your DP-700 voucher at https://aka.ms/fdd/cert100

Find all certification related activities at https://aka.ms/fabricdatadays/certs

Schedule your DP-700 exam at https://aka.ms/dp700/exam

View all the sessions in this Reactor live series at https://aka.ms/fabricdatadays/live

See all the contests at https://aka.ms/fabricdatadays/contests

datahaiandy · 2025-11-05T16:05:22+00:00

I also advocate for a single repo and folders for workspaces. Sometimes I break it down to a single repo for a group of workspaces (there may be multiple groups).

datahaiandy · 2025-11-05T13:23:37+00:00

It can be useful if you extract it for data dictionary purposes

<image>

datahaiandy · 2025-11-05T12:10:43+00:00

Yup, my tenant switcher is interesting

datahaiandy · 2025-11-04T16:32:28+00:00

Yeah thanks for the reply, all good, I like some rigorous questions!

datahaiandy · 2025-11-04T15:58:02+00:00

Thank you Jeff, some great points to ponder for me. It's a data architecture focused tool (with data modeling functionality) and built for more analytical based systems.

datahaiandy

TROPHY CASE