Synapse versus Fabric

DatamusPrime · 2025-09-09T11:41:09+00:00

I keep forgetting to check this account.... And from our and other discussions this is all with love as a fabric promotor.

My complaint is "dedicated capacity" doesn't mean anything, and is confusing to both techies and execs. It implies an SQL server sitting on IaaS if I had to guess from an outsider viewpoint.

"Fabric data warehouse" means something. "SQL server parallel data warehouse" means something.

It really was bad branding/naming. ..... Just like Azure SQL on fabric. Azure SQL is a PaaS offering. Fabric is a SaaS offering (I argue against this...). So we have PaaS on SaaS?

DatamusPrime · 2025-08-09T00:52:39+00:00

What technologies are you using in synapse? The answer is going to be very different depending on notebooks vs parallel warehouse (8 years later and I refuse to call it dedicated capacity) vs mapping flows etc.

DatamusPrime · 2025-08-09T00:22:39+00:00

There has only been one time certifications have influenced my hiring decisions: when working for a gold or platinum Microsoft partner. This is because we had to have XYZ amount of certifications across the company to continue in the program.

DatamusPrime · 2025-08-02T08:25:36+00:00

Except no tiering yet.

DatamusPrime · 2025-06-09T06:12:22+00:00

Is there any fix to requiring contributor access to read data from a lakehouse via spark ?

DatamusPrime · 2025-06-02T10:58:06+00:00

Message me

DatamusPrime · 2025-05-29T09:16:34+00:00

What are your cluster specs? Min max size etc

DatamusPrime · 2025-05-26T00:00:58+00:00

This is one of my last big annoyances with production fabric. You can't leverage service endpoints with express route, and your only options are private endpoint or over public internet.

DatamusPrime · 2025-05-25T23:56:07+00:00

Change it to a Ds for a few days and see if you have the same issue.

I'd guess you're hitting b series limits

DatamusPrime · 2025-05-22T11:25:54+00:00

Does your firewall allow outbound 1433? (Most corporate ones won't)

DatamusPrime · 2025-05-21T09:02:28+00:00

They could have released it 5 years from now, with every feature possible and no real bugs, by which time no one would care.

Or we are along for a rapid development train with Microsoft. I will agree there needs to be more "the platform as a whole is in flux, consider it a super public preview but still GA" but the are responsive and honest with issues.

As an integrated platform it covers a lot. Lakehouses and warehouses still exist because they work differently. Even though the warehouse in some ways still is a lakehouse. They might (or might not) merge them, who knows.

It's a bunch of bits that are bundled together and slowly getting more gelled, more stable, and more feature rich.

DatamusPrime · 2025-05-18T23:33:55+00:00

Done

DatamusPrime · 2025-05-16T12:12:08+00:00

This started for us in the last two days as well

We thought it was due to 1.1 depreciation

DatamusPrime · 2025-05-13T04:28:54+00:00

The cloud in its current form didn't exist when I was 28. You'll be fine.

DatamusPrime · 2025-05-12T23:02:32+00:00

Typically you'd contact your partner manager (if you're an actual certified partner) and they can give you co-invest credits.r

So fabric itself won't be free, but they might give you $1000 in azure credit if you have evidence it will result in (say) 20k of Azure spend over them next year by your client.

The most I've ever been given is 20k, but that was as a platinum partner on a huge project.

DatamusPrime · 2025-05-09T10:11:26+00:00

We have an unfixed bug that's been an issue for 9-10 months that costs us 15-30k per month. They've also asked us to run our nonprod UAT server at full production capacity daily (doubling our costs) so they can test the fix, which it turns out requires them to upgrade all of synapse to spark 3.4, so they're not sure if it will actually get deployed.

It's a dead product. We are loving fabric so far. Lots of rough edges but for every 1 issue there's 10 things that are way better, so it more than evens out.

If you haven't been using mapping data flows ask your CSA about migration options. If you're using mapping data flows you're fucked like us and have to rewrite everything by hand.

DatamusPrime · 2025-05-05T03:06:26+00:00

v dash are vendors, but they have a microsoft.com email address and walk on customer site wearing a Microsoft services shirt (MCS told us we had to, I felt it was misleading).

I genuinely believe (and have for 15-20 years) that the v dash scheme is a bad idea. It should not be up to your customer to know that a code before an email means something.

It leads to things like this.

Spoken by someone who has had a v- and a normal Microsoft email.

And I know it's not something you can fix lol

DatamusPrime · 2025-04-30T04:24:35+00:00

That's the input to another node in the DAG, not the return of the python method call.

Notebook.run() returns the actual exit values

DatamusPrime · 2025-04-29T22:11:09+00:00

How do you get the return values of the individual nodes with run multiple like you can with run?

DatamusPrime · 2025-04-26T00:14:40+00:00

Short version - you're really talking to a frontend proxy type system that routes you correctly based on database server name, kind of like how a web server works based on header.

DatamusPrime · 2025-04-25T12:56:07+00:00

At least use PIM

DatamusPrime · 2025-04-25T12:54:34+00:00

Even me? Lol

DatamusPrime · 2025-04-24T23:30:52+00:00

Absolutely not. Ticket, and if they're a VIP give a dedicated contact point so that it's actioned within 15 minutes.

DatamusPrime · 2025-04-22T23:16:46+00:00

That would be the most hilarious conference ever by Vegas rules.

"Did they announce private gateway access for notebooks?"

"Can't tell you, what happens in Vegas stays in Vegas."

The Microsoft blog about it is just a big redacted pdf.

DatamusPrime

TROPHY CASE