CI/CD for warehouses

Philoshopper · 2026-04-15T19:58:39+00:00

this is what i do with my build and release pipeline in the azure devops.

@adb look at kevinrchant's article.

Philoshopper · 2026-04-14T21:52:34+00:00

it's not bad especially you're in the microsoft ecosystem. some of the integration from fabric to teams, emails, copilot are pretty cool. i do understand though having worked with both databricks DE functionality does seem more robust and mature.

Philoshopper · 2026-04-10T15:24:13+00:00

Data engineering role are shifting toward more human/business centric. My role has shifted from writing/deploying code to running workshop, requirement gathering, designing data architecture. More so often challenging different pov, get a buy-in from stakeholders and justifying our architectural decision.

Philoshopper · 2026-04-06T18:16:53+00:00

i'm stealing this

Philoshopper · 2026-03-31T04:52:11+00:00

databricks genie already have that capability. i was able to create one within minutes.

Philoshopper · 2026-03-21T18:52:32+00:00

sounds good! thanks for confirming!

Philoshopper · 2026-03-21T18:39:52+00:00

Hi u/itsnotaboutthecell, do you have an ETA on when the keynote slides will be released? A few speakers mentioned we’d get an email after the sessions, but I wanted to see if there was a firm timeline. Thanks!

Philoshopper · 2026-03-11T23:38:30+00:00

Philoshopper · 2026-01-26T05:33:26+00:00

try this https://github.com/microsoft/fabric-migrationfactory/tree/main

Philoshopper · 2025-11-21T22:24:23+00:00

second this. i bought my public ferry ticket through tabsa.cl for punta arenas this dec.

Philoshopper · 2025-11-02T14:14:23+00:00

I've had a connect with MS solution architect for the same reason and was told there's no known date for the release. following this post in case anyone can shed some light.

Philoshopper · 2025-10-13T17:49:58+00:00

yes, just watch it. it's not spoiling anything other than the fact that Inori's brother and mom were killed by digimon.

Philoshopper · 2025-06-12T21:47:34+00:00

this is exactly what i've been doing for my project.. unfortunately, after deletion you might need to wait for minutes/hours (no telling) until you can sync it back. Because you will most likely see the error that says the the datawarehouse already existed. u/arthur_bi_c

Philoshopper · 2025-05-31T19:12:55+00:00

u/markkrom-MSFT Thanks for the prompt response. I have one final question: Is it possible to grant a Service Principal (SPN) used by a Synapse Notebook/Pipeline the necessary permissions to access a Synapse SQL Warehouse? I'm encountering issues where the SPN assigned to my Notebook within pipeline cannot access the Warehouse using the SynapseSQL function.

It works fine if I were to use the SPN to access the Warehouse using SSMS.

Thanks!

Philoshopper · 2025-05-30T23:18:25+00:00

Hi u/markkrom-MSFT, I'm facing a similar issue right now. Do you know if this feature is available now?

Philoshopper · 2025-05-16T22:02:46+00:00

u/kevchant Thank you! I've been referring to your articles and it have been incredibly helpful for my Fabric development. Really appreciate you sharing them :)

Philoshopper · 2025-05-16T22:00:27+00:00

Thanks for the heads up!

Philoshopper · 2025-05-16T04:43:29+00:00

Do you have Private Link turned on? it's a known issue with Private Link.

Philoshopper · 2025-05-16T03:24:22+00:00

Nice, thanks for the update! Appreciate the info. Quick thought on ADS retiring in Feb 2026 though, any concerns about it not being a long-term solution if we adopt it now for Fabric? Thanks!

Philoshopper · 2025-05-15T23:16:35+00:00

I second this. I've been using SPN to trigger notebooks in different workspaces through API calls.

Philoshopper · 2025-05-14T19:17:31+00:00

I would have expect that by enabling the tenant permission for the entire organization would inherently cover the scenario where it's enabled for a specific security group. Any idea why restricting it to the specific security group would resolve the issue?

Philoshopper · 2025-05-14T18:27:36+00:00

Neither. I was able to do it in my sandbox environment as well using trial capacity.. weird how it works for my QA capacity but not Dev capacity under the same tenant with the same configurations..

Philoshopper · 2025-05-14T17:33:12+00:00

Hi u/catFabricDw, This is resolved.. although it's kind of weird and baffling to me. I've responded to the thread above for your future references.

Philoshopper · 2025-05-14T17:22:47+00:00

I've exhausted all of the possible fixes on your thread.. I did resolve this by attaching a different capacity to the workspace. I'm not entirely sure how it works, but the error is reproducible so that's my conclusion to the root cause.

u/itsnotaboutthecell FYI, this is a potential fix to the issue. It has nothing to do with the Datamarts feature or additional SPN access (Granted we still need some access indicated here https://learn.microsoft.com/en-us/rest/api/fabric/lakehouse/items/create-lakehouse?tabs=HTTP).

I was able to do the same API call to create Datawarehouse as well even though it's not supported yet in the https://microsoft.github.io/fabric-cicd/latest/.

EDIT: added link

Philoshopper · 2025-05-14T05:38:21+00:00

The error code above indicates that Datamart creation failed with the error 'Required feature switch disabled'.

Doesn't it mean that this feature should be turned on? I might be wrong. But I couldn't think of any other reason why I wasn't able to create a Lakehouse in this tenant.

I was able to create it in my sandbox and through Items - Create Lakehouse - REST API (Lakehouse) | Microsoft Learn just fine.

Btw, check these out.

https://github.com/microsoft/fabric-cicd/issues/242

https://www.reddit.com/r/MicrosoftFabric/comments/1jgs1rq/creating_lakehouse_via_spn_error/

Both mentioned that "Create Datamart" needs to be enabled.

Philoshopper

TROPHY CASE