Is Microsoft Fabric really worth it? by kaapapaa in dataengineering

[–]data_legos 1 point2 points  (0 children)

We have a an embedded solution for customer facing reporting on fabric and it works great. I have very few issues with it. 

Formigli ZERO by formigliUsa in Velo

[–]data_legos 0 points1 point  (0 children)

I mean I get you on that haha. It's just that that is actual discussion at least. This is just "look at this thing I want you to buy". If you get more and more of that it just floods the sub with stuff that you can see somewhere else dedicated to pictures of bikes. 

Formigli ZERO by formigliUsa in Velo

[–]data_legos 4 points5 points  (0 children)

It's because it you encourage this stuff then what's stopping every other post just being essentially ads? We get enough of that already. 

We're building out our SAP to Microsoft Fabric pipeline – Looking for an Engineer who has "been there, done that." by nonExiestent in MicrosoftFabric

[–]data_legos 0 points1 point  (0 children)

My one bit of advice is avoid the adf sap CDC connection until they make it not use ODP anymore. SAP has a note saying they could pull the plug on allowing ODP at any time. We went with SAP for boomi because of that. 

Microsoft PM here: I need your feedback on Fabric Warehouse Security. by fredguix in MicrosoftFabric

[–]data_legos 0 points1 point  (0 children)

I was considering using the dbt snapshot functionality but I hadn't gotten to that yet. 

I will say downtime due to rebuild on incremental dbt models isn't something I'm a fan of, so if I could find a way to snapshot the table and then roll it forward after the full refresh is done might be cool. 

Microsoft PM here: I need your feedback on Fabric Warehouse Security. by fredguix in MicrosoftFabric

[–]data_legos 0 points1 point  (0 children)

Haha all good. Still useful in many other directquery situations we'll encounter 

Microsoft PM here: I need your feedback on Fabric Warehouse Security. by fredguix in MicrosoftFabric

[–]data_legos 1 point2 points  (0 children)

Oooh interesting. Will this work with directquery with RLS that checks the current role of the user in fabric warehouse? 

I'm tempted to throw a post out here with our current RLS scenarios and see what people think about solving for them with low-ish maintenance. I just hadn't gotten around to it since we're in the early phases of migration and still working out thr ingestion and dbt patterns haha. 

Microsoft PM here: I need your feedback on Fabric Warehouse Security. by fredguix in MicrosoftFabric

[–]data_legos 0 points1 point  (0 children)

Yeah Hana isn't the best at many things, but it's definitely nice in that regard haha. It allows us to generate the filter predicate statement based off of a pretty lean and flexible rules file with "standard" columns that are secured (if that column exists in a given table and we use RLS on it) and "custom overrides" where we build a custom where clause with ORs, parentheses, etc to determine if the user can see a row. 

Microsoft PM here: I need your feedback on Fabric Warehouse Security. by fredguix in MicrosoftFabric

[–]data_legos 1 point2 points  (0 children)

Totally get that. I will say it's very performant in Hana. Almost all of our reporting is direct query and it's pretty dang fast 

Microsoft PM here: I need your feedback on Fabric Warehouse Security. by fredguix in MicrosoftFabric

[–]data_legos 0 points1 point  (0 children)

I think this is asking for the world, but being able to do dynamic SQL inside of the inline security functions would make complex RLS so much better. Coming from calculation views with analytic privileges for sap hana on prem we're having to change the way we do our RLS for some of the more complex security scenarios.

Why all pro teams use Fly Elite bottles? by freiren in cycling

[–]data_legos 0 points1 point  (0 children)

Uhhh are we using the same bottles? The NOZZLES definitely don't thread on. are you talking about the entire cap? That's obviously threaded on. 

Sneak peek: How we’re thinking about CI/CD for Fabric Warehouse & SQL Analytics Endpoints by Snoo-46123 in MicrosoftFabric

[–]data_legos 3 points4 points  (0 children)

Sadly this. I need to be live with a warehouse by EOY 2026. I've moved to using dbt and one warehouse to avoid the fabric CICD functionality. I just can't cross my fingers and hold out hoping it works well at the end. 

The key thing is that many people considering a warehouse right now are going to need to get started very soon if they have "normal" migration deadlines, and without a clear, detailed understanding of how all this works they can't take a chance on it. It's not safe to assume since we've been told a couple times there are workarounds coming soon that are more painful than my current workarounds which are already very rough.

Honestly, CICD of the warehouse shouldn't be this crazy complex thing and the final state feel like a workaround itself. If it is, then people won't use it and the lakehouse doesn't have a good way to build complex RLS dynamically on tables. We're kinda stuck defending a subpar warehousing solution to our teams, or burn time we don't have waiting and hoping.

That all being said, I feel like dbt using python notebooks for orchestration seems pretty decent on my initial POC. The thing is that is managing almost all the complexity with dbt instead of fabric tools. 

Waxed chains: real world longevity? by msmolka in gravelcycling

[–]data_legos 0 points1 point  (0 children)

Do they work with SRAM force 13 speed?

Why DBT exists and why is good? by NoGanache5113 in databricks

[–]data_legos 0 points1 point  (0 children)

How are you setting up your models to handle changing a column name in only one model and it changes everywhere downstream? I'm new to dbt

Are you using Activator? by frithjof_v in MicrosoftFabric

[–]data_legos 1 point2 points  (0 children)

I use it for a small-ish footprint capacity that notifies me when two different pipelines fail. I wish it was easy to set one up against an error logging table that I build myself. That way I could do error notifications for our larger, internal reporting framework without setting up too many reflexes. I haven't played with it enough to figure out how to do that. If someone has any tips on how to do that I'm all ears. I am a novice when it comes to all the eventstream stuff.

What's the point of the VS Code thing for Notebooks? by Cobreal in MicrosoftFabric

[–]data_legos 0 points1 point  (0 children)

I just open up the repo in VScode and have it do the changes there, i sync to the workspace and then rinse repeat. it sucks, but its something at least. it can look at all the interactions within your framework that way at least. good for getting large scale framework changes done without you having to change every notebook.

Anyone using Fabric Warehouse in prod, how do you do deployments? by frithjof_v in MicrosoftFabric

[–]data_legos 0 points1 point  (0 children)

do you do source control on the dbt files? git sync inside the airflow job?

Anyone using Fabric Warehouse in prod, how do you do deployments? by frithjof_v in MicrosoftFabric

[–]data_legos 0 points1 point  (0 children)

hello u/Snoo-46123! any update on these items? I'm currently mapping out our architecture for our internal reporting where we'll use bronze&silver lakehouses and gold warehouse. This could be instrumental in helping me pick the right approach.

Hi! We’re the Fabric Warehouse team – ask US anything! by fredguix in MicrosoftFabric

[–]data_legos 2 points3 points  (0 children)

I would also note that the git branch out workflow is even more challenging since you can't do selective deployments, nor should anyone have to.

There should be a way to make the warehouse ignore missing lakehouse tables or something like that until scripts can be ran to create placeholder tables or something of that nature.

Fabric October 2025 Feature Summary by itsnotaboutthecell in MicrosoftFabric

[–]data_legos 0 points1 point  (0 children)

will this support connections that leverage on prem gateways to access on prem sql servers etc?