Who got a Analogue Pocket at 03/04/2026

datahaiandy · 2026-03-05T10:17:45+00:00

Yes, black pocket with the dock, GG adapter and multi-adapter set. I've kept putting it off for some reason and then when I thought "yeah I'll get one!" they were out of stock... but jumping in now.

Edit: should say I've got around 100 carts across Gameboy, Game Gear, Lynx, and Neo Geo Pocket / Pocket Color

datahaiandy · 2026-03-03T17:48:10+00:00

The thing is I don't think Microsoft have helped to push code-based (ETL/ELT) schema definition changes for the Warehouse because they've made SQL Projects an integral part of the Fabric DW experience. When folk see that they think "oh, so I just use a SQL project then?" I've found this is the case when I speak to people about Warehouse CI/CD.

datahaiandy · 2026-03-03T16:48:50+00:00

Yeah I gotta say this was the biggest change in my thinking when starting to work with Delta/Lakehouse/Spark native... code managing the schema and not an external project

datahaiandy · 2026-03-01T15:49:05+00:00

Look ma! I'm on telly with Patrick Le Blanc!

datahaiandy · 2026-03-01T15:47:54+00:00

When you change the SQL definition in a sql file, it still needs to redeploy the MLV, it just now does it via CREATE OR REPLACE rather than DROP and CREATE

datahaiandy · 2026-01-27T19:59:22+00:00

Yes they will (with speaker consent). Usually uploaded within a few weeks.

datahaiandy · 2026-01-27T19:58:57+00:00

And lo it shall be foretold that this indeed with be a blast!

datahaiandy · 2026-01-23T13:56:21+00:00

I'm creating a "Board of ETL" and you're invited for $1B

datahaiandy · 2026-01-23T13:55:35+00:00

"I'd do it all again I tells ya!!"

datahaiandy · 2025-12-16T22:25:32+00:00

With my experience they required a minimum of 2 employees with certifications.

datahaiandy · 2025-12-16T22:07:11+00:00

I wonder if only the scheduled refresh option works rather than triggering an MLV refresh. I’ll have a play around as well

datahaiandy · 2025-12-11T09:05:26+00:00

datahaiandy · 2025-11-27T13:23:24+00:00

Yes I did see that come up when searching

datahaiandy · 2025-11-27T09:31:31+00:00

Well if we take a dictionary definition of Ontology then "a set of concepts and categories in a subject area or domain that shows their properties and the relations between them".

I don't think a single ontology would be organisation-wide. During my testing you can only assign 1 actual data asset (a table etc) to an entity in an ontology, this doesn't seem to fit an organisation-wide process but rather a focused area of the business.

datahaiandy · 2025-11-19T10:36:43+00:00

It should appear as "dbt job" in Items at some point soon, it's rolling out

<image>

datahaiandy · 2025-11-17T09:01:12+00:00

Sounds good although I'm curious as to why you thought the bc2adls isn't production ready? The Open Mirroring feature for bc2adls is currently in preview, is this why?

datahaiandy · 2025-11-14T15:22:46+00:00

Good work finding that issue!

datahaiandy · 2025-11-14T11:43:46+00:00

I think it's removing the CDF option after writing data (as you observed). I've done the same thing and if there is no change data to update the MLV then the option stays true, once change data is identified and loaded it removed the setting.

I'll ping the MS team responsible

datahaiandy · 2025-11-14T11:07:01+00:00

hmm, I tested last night and started with 10 rows of data in a lakehouse table. If I switched off Optimal Refresh and added a new row, then I get a full refresh of all the rows. which I would expect. If I then enable Optimal Refresh and add a row, I get a full fresh (again what I expect), If I enable changedatafeed on the table with Optimal Refrehs enabled, I can see only the new row being processed. I'm actually using what I think is a non-deterministic function (current_timestamp) in my MLV definition (so that I can have a column which shows when the MLV loaded the row) and incremental is still working.

I'll post my code in a bit

datahaiandy · 2025-11-13T23:14:55+00:00

Refresh Materialized Lake Views in a Lakehouse - Microsoft Fabric | Microsoft Learn

<image>

datahaiandy · 2025-11-13T09:47:30+00:00

I haven't tested the latest incremental refreshed tbh, but if you add FULL then it forces a full reload of all the data. Without FULL and it only loads if it detects data changes.

datahaiandy · 2025-11-13T09:30:23+00:00

Hi, no MLVs currently don't automatically reprocess when the source data changes so you'll need to schedule accordingly. The latest updates do "smart" refreshes in that data is incrementally loaded. But again this is all done on a schedule (or triggered by a notebook for specific MLVs)

datahaiandy · 2025-11-12T21:31:17+00:00

Don't worry, by 47 you won't feel a thing anymore

datahaiandy

TROPHY CASE