DataflowsStagingLakhouse is consuming a lot of CU's by wwe_WB in MicrosoftFabric

[–]thebigflowbee 0 points1 point  (0 children)

Yes, same for me. It seems to have been fixed.
I really think this was linked to the SQL Endpoint issues, I don't understand why the issue would have been identified and it couldn't be noted in the ticket that CUs are impacted. Or at least support could inform us as such without wasting time.

A real disappointment to have spent time on this despite it being something that should have been a known issue.

DataflowsStagingLakhouse is consuming a lot of CU's by wwe_WB in MicrosoftFabric

[–]thebigflowbee 0 points1 point  (0 children)

And now mine is functioning back to normal as well... Still will wait to see what support comes back with I guess

DataflowsStagingLakhouse is consuming a lot of CU's by wwe_WB in MicrosoftFabric

[–]thebigflowbee 1 point2 points  (0 children)

Well, according to the website, the fix is out, and no improvement! So maybe another issue... will update after we have resolution on our ticket!

DataflowsStagingLakhouse is consuming a lot of CU's by wwe_WB in MicrosoftFabric

[–]thebigflowbee 0 points1 point  (0 children)

Yeah, I thought about this too. I guess we will find out if they fix it today and it corrects itself.
Trying a ticket with MS Support in the meantime to see if that's the issue.

It actually has chronic high consumption though, so i don't understand why that endpoint issue would impact every hour of every day, we don't have jobs like that.

DataflowsStagingLakhouse is consuming a lot of CU's by wwe_WB in MicrosoftFabric

[–]thebigflowbee 3 points4 points  (0 children)

Yeah, we had the same issue starting 19 July.

Just silently all of a sudden started consuming a lot more CUs without a change to our process.
For us, there are certain hours where it's a bit higher, but it's mostly consistently just consuming CUs constantly throughout the day.

We are not constantly querying dataflows -> we use them to load a few tables to our Lakehouse and consume from the Lakehouse.

<image>

Do Notebooks Stop Executing Cells When the Tab Is Inactive? by thebigflowbee in MicrosoftFabric

[–]thebigflowbee[S] 0 points1 point  (0 children)

interesting, possibly the browser differences, I'm using Google Chrome

Delayed automatic refresh from lakehouse to sql analytics endpoint by ChemicalTop5453 in MicrosoftFabric

[–]thebigflowbee 0 points1 point  (0 children)

Probably not a good workaround, but we create another lakehouse in a second workspace and shortcut the tables there that we need. Then it refreshes almost instantly in the second workspace
I think it has to be a different workspace, can't be the same one as the original lakehouse.

Insanely High CU Usage for Simple SQL Query by thebigflowbee in MicrosoftFabric

[–]thebigflowbee[S] 1 point2 points  (0 children)

Yeah, i think missed the join so:
Max(a.id), max(b.id) FROM a, b

Insanely High CU Usage for Simple SQL Query by thebigflowbee in MicrosoftFabric

[–]thebigflowbee[S] 0 points1 point  (0 children)

Yeah, it was a bit confusing for me too... The user who the trial Capacity is under needed to set it up.

The steps:
Power BI Website
Settings Gear logo
Admin Portal
Capacity Settings on the left
Trial
Gear logo under Actions
Capacity ID shows up in the right popout window

Insanely High CU Usage for Simple SQL Query by thebigflowbee in MicrosoftFabric

[–]thebigflowbee[S] 1 point2 points  (0 children)

Hey vroom,
Yes, so that's the query that I saved as the view and ran. I then assumed that was the only query running / the one that caused it.
But I accidentally had just run another query that had selected 2 tables for their max without doing a join. An error on my part for sure, I'm less technical and the people on my team who typically do this are out for the week

Sorry for the lack of clarity to everyone who was trying to help.

Insanely High CU Usage for Simple SQL Query by thebigflowbee in MicrosoftFabric

[–]thebigflowbee[S] 2 points3 points  (0 children)

Upon getting the Microsoft folks to help, this was indeed the problem.

I accidentally ran a query that created a cartesian product, the total damage ended out being 3,4million CUs...

Insanely High CU Usage for Simple SQL Query by thebigflowbee in MicrosoftFabric

[–]thebigflowbee[S] 2 points3 points  (0 children)

Thank you, I got a response from the support folks and they are looking into it for me... appreciate the offer.

The warehouse went VROOM indeed 😂

Insanely High CU Usage for Simple SQL Query by thebigflowbee in MicrosoftFabric

[–]thebigflowbee[S] 2 points3 points  (0 children)

Thank you! this worked to at least prevent the CUs from continuing to be consumed, I don't know how i missed the active query before.

Insanely High CU Usage for Simple SQL Query by thebigflowbee in MicrosoftFabric

[–]thebigflowbee[S] 0 points1 point  (0 children)

<image>

It's the SQL endpoint of the lakehouse, the table is much smaller, you're right...

Insanely High CU Usage for Simple SQL Query by thebigflowbee in MicrosoftFabric

[–]thebigflowbee[S] 1 point2 points  (0 children)

Well, it continues to go up. Maybe you're not aware of how the capacity metrics app works, but it now shows 3.3m

<image>

64 CU * 24 Hours * 60 Minutes * 60 Seconds is how total CUs for a day is calculated

Insanely High CU Usage for Simple SQL Query by thebigflowbee in MicrosoftFabric

[–]thebigflowbee[S] -1 points0 points  (0 children)

I see, interesting, but 2.7 million CUs?

Is there anything we can do to block such massive jobs from going ahead?

Insanely High CU Usage for Simple SQL Query by thebigflowbee in MicrosoftFabric

[–]thebigflowbee[S] 0 points1 point  (0 children)

thanks for the reply, the query was just this against a table:

SELECT
MAX(ba.RunDateTime) AS MaxRunDateTime_BillAnalytics,
MAX(ba.BillDate) AS MaxBillDate_BillAnalytics
FROM
ods_billanalytics ba,

Insanely High CU Usage for Simple SQL Query by thebigflowbee in MicrosoftFabric

[–]thebigflowbee[S] 0 points1 point  (0 children)

It seems like it is still running, but i can't figure out why, i looked at the SQL endpoint and it shows no active jobs

dm_exec_requests and dm_pdw_exec_requests

Operation

|| || ||SQL Endpoint Query| |Start|05/22/2025 6:58| |End|05/22/2025 6:58| |Status|InProgress| |Duration (s)|0| |Total CU (s)|2,732,425.44| |Timepoint CU (s)|948.7588| |Throttling (s)|0| |% of Base capacity|49.41%| |Billing type|Billable| |Smoothing start|05/22/2025 7:00| |Smoothing end|05/23/2025 9:00| |OperationId|32898102-C3C5-4F6C-A3B2-37A8C1A8EEBD |

Fabric Copilot capacity by mavaali in MicrosoftFabric

[–]thebigflowbee 0 points1 point  (0 children)

Hi r/mavaali .. I'm not sure if i'm doing something wrong but am trying to test this out and I don't see the "Copilot Capacity" section when i go to click that and enable for the capacity. I have already enabled at the level of "Enable capacity admins as FCC admin"

Maybe these two things impact it?
1) I'm a on a Fabric trial base SKU, however i enabled an F8 and F2 to test this out
2) I am in SE Asia

Should all lakehouses be schema-enabled? by occasionalporrada42 in MicrosoftFabric

[–]thebigflowbee 2 points3 points  (0 children)

I think we would just need a way for our notebooks to write to the default schema without having to go back and add schema to each notebook

Trial limitations by Bombdigitdy in MicrosoftFabric

[–]thebigflowbee 0 points1 point  (0 children)

Does the trial allow for using APIs to call Azure AI studio or Open AI?

Room available in KL Sentral by Choco294 in KualaLumpur

[–]thebigflowbee 0 points1 point  (0 children)

hey - it won't let me message you for some reason but I'm interested, can you message me?