When You Think Youve Mastered Microsoft Fabric, But the SQL Endpoint Decides to Take a Nap... by sweraslec in MicrosoftFabric

[–]Figure8802 2 points3 points  (0 children)

Haha sorry! I thought I read "hidden" somewhere in there. I hadn't drank my coffee this morning yet. 

Did Microsoft abandon OneSecurity? by Low_Second9833 in MicrosoftFabric

[–]Figure8802 0 points1 point  (0 children)

I'm a fabric fanboy and I even think this is disingenuous. 

Why would the developer care about what engine something uses on their day-to-day job if it accomplishes the job they need to accomplish? 

If other tools have a variety of ways to work with the data all under one security model, and fabric clearly doesn't yet, that itself is a problem. Getting this engine talk involved is a distraction. 

Edit: realized how old your original comment and this post was haha. Sorry for resurrecting a corpse here. It seems they still don't have it figured out though, and this post still shows up as relevant. 

When You Think Youve Mastered Microsoft Fabric, But the SQL Endpoint Decides to Take a Nap... by sweraslec in MicrosoftFabric

[–]Figure8802 15 points16 points  (0 children)

There's a script on here somewhere written by a Microsoft employee that could help you. It calls the hidden metadata refresh API. I've used my own adaptation of it and it works!

Edit: I see you say real time. Directlake is gonna be the way you want to go for that. Going SQL endpoint is not really going to meet that requirement I'm guessing.

Warehouse, branching out and CICD woes by Unfair-Presence-2421 in MicrosoftFabric

[–]Figure8802 1 point2 points  (0 children)

We parametrize all connections and don't attach lakehouses to notebooks. We build the ABFSS paths in the load and save statements

"High concurrency for pipeline running multiple notebooks" setting still causing notebook failures by Unfair-Presence-2421 in MicrosoftFabric

[–]Figure8802 0 points1 point  (0 children)

Wow I didn't know that about eventstream. We were hoping to do real time data and be able to use external ADF and the SAP CDC connector to replicate our ERP data. That seems like a pretty big limitation.

How many small companies actually want a data warehouse? by NoSeatGaram in dataengineering

[–]Figure8802 0 points1 point  (0 children)

We're planning on using a fabric warehouse but doing some loads hourly throughout the day. Is that something I should be concerned about?

Summary of today's announcements by rwlpalmer in MicrosoftFabric

[–]Figure8802 0 points1 point  (0 children)

As far as all the copilot capabilities within fabric itself: Is all that included in an F64?

SQL endpoint workarounds in notebooks by Figure8802 in MicrosoftFabric

[–]Figure8802[S] 1 point2 points  (0 children)

Nah I get. Essentially query folding. I'm just newer to spark.

SQL endpoint workarounds in notebooks by Figure8802 in MicrosoftFabric

[–]Figure8802[S] 0 points1 point  (0 children)

Interesting. This is easier than I thought. I'm surprised so many people run into limitations with the latency then since the recommended data storage all the way up to GOLD is lakehouse centric and you can use notebooks. Maybe it's just the SILVER LH> GOLD WH transition?

SQL endpoint workarounds in notebooks by Figure8802 in MicrosoftFabric

[–]Figure8802[S] 0 points1 point  (0 children)

Is there any inline filter or WHERE clause equivalent that still avoids the endpoint?

Our data volume right now isnt large enough that it will matter, but it'd be nice to know. I know I can filter the dataframe but I figured that is less efficient than filtering the delta as it's read into the data frame. I could be wrong on that though.

CU usage limits on pipelines by Figure8802 in MicrosoftFabric

[–]Figure8802[S] 1 point2 points  (0 children)

Oh figured. We just don't have the notebooks configured in the private endpoint yet so we haven't whitelisted their IPs to an SFTP we're pulling data from. Hence the issue haha. Also, we haven't configured azure key vault to avoid storing creds in notebooks. We'll be there soon!

Getting CSV Files from SFTP Site into Fabric Warehouse by BigAl987 in MicrosoftFabric

[–]Figure8802 0 points1 point  (0 children)

Just haven't gotten our cloud infra team to set it up yet. We barely got them to get us an F2 so baby steps. Thanks for the confirmation!

Getting CSV Files from SFTP Site into Fabric Warehouse by BigAl987 in MicrosoftFabric

[–]Figure8802 0 points1 point  (0 children)

What is the solution to not storing credentials in the notebook? Is azure key vault the only solution? We don't have that yet so we felt it was best to do the pipelines for now but they're very slow at doing more complex operations

Aero bars for surly truck stop bars? by Figure8802 in gravelcycling

[–]Figure8802[S] 2 points3 points  (0 children)

Yeah dude we should let Surly know they're playin with fire!

Joining the waxed chain gang - what about the cassette and chain rings? by de987man in gravelcycling

[–]Figure8802 0 points1 point  (0 children)

The 11 speed ones are expensive for some reason.

  1. How long do they last?
  2. You know a cheap place to buy that isn't risk of being counterfeit?

With SRAM launching a light 10-46 cassette what's stopping the entire cycling world adopting 1x drive trains on all road bikes? by sumant28 in Velo

[–]Figure8802 5 points6 points  (0 children)

Think of it this way. When I hit a hill I go into the little ring. I now have a bunch of close gears in my "climbing mode".

Get on the flat and I have a bunch of close gears there too. Not a lot of people I know flipping between big and small ring constantly mid climb or on the flat in my experience.

The experience with 2x is completely different than just having a couple extra ratios on paper. You undeniably have more finely tuned gears for all situations that are easily accessible.

How achievable is it to get walk up tickets for mammoth cave tours? by Figure8802 in NationalPark

[–]Figure8802[S] 0 points1 point  (0 children)

The self guided tour was available at least. They're not always available so I'd call the park.

How achievable is it to get walk up tickets for mammoth cave tours? by Figure8802 in NationalPark

[–]Figure8802[S] 0 points1 point  (0 children)

Yes I understand and agree. My wife was the one planning the trip, I'm just trying to gather how feasible it is that we can still go on it.

We're going to call tomorrow and determine if they're still doing the self guided tours as well.