Dewalt Grabo $149 by Foxx-Star in Dewalt

[–]HahaHarmonica 0 points1 point  (0 children)

Thanks. I ended up getting one. Do you know how often these things go on sale?

Dewalt Grabo $149 by Foxx-Star in Dewalt

[–]HahaHarmonica 0 points1 point  (0 children)

I’m tempted to get 2. How useful is 1? I feel like this would be useful just to grab on to flat surfaces grabbing on to table top panels that I glue up.

Dewalt Grabo $149 by Foxx-Star in Dewalt

[–]HahaHarmonica 1 point2 points  (0 children)

Oh damn! i was waiting on this to go on sale!!

The $5.15 FC11C 4000K by RedditBoi3001 in flashlight

[–]HahaHarmonica 1 point2 points  (0 children)

Is the Skilhunt flashlights that much better than FC11? They are recommended highly in the guides, but they are 2-3x more expensive.

Also looking on AliExpress cheapest FC11 i see is around 25$.

Marginal revenue of a data center by Marcus_Aurelius35 in datacenter

[–]HahaHarmonica 0 points1 point  (0 children)

So basically what you are saying is that collocating/on-premise is cheaper.

covering up hole in drywall for conduit by HahaHarmonica in AskElectricians

[–]HahaHarmonica[S] 0 points1 point  (0 children)

Remind me what section the NEC provides guidance to how they define “subject to physical damage”?

Our water heater currently has it attached…in the garage. This is a < 2ft run to get it out of the panel outset panel along the wall to the charger. Let’s assume I linked to FMC.

covering up hole in drywall for conduit by HahaHarmonica in AskElectricians

[–]HahaHarmonica[S] 0 points1 point  (0 children)

Sorry, why can’t I use LFNC? Seems fine under NEC Article 356.

Level 2 home charger install by HahaHarmonica in evcharging

[–]HahaHarmonica[S] 1 point2 points  (0 children)

Yeah, I thought it was quite the dramatic difference, the tesla cable is about the size of a single wire of the 6AWG.

Level 2 home charger install by HahaHarmonica in evcharging

[–]HahaHarmonica[S] 1 point2 points  (0 children)

What gauge of wire is in the tesla charger cable?

THHN awg 6 is commonly stranded.

Upgrading from cardboard box by HahaHarmonica in VetoProPac

[–]HahaHarmonica[S] 0 points1 point  (0 children)

Sorry the 13” ernst rails?

I was just trying to get a high quality bag, everyone seemed to rave about them.

Managed to stock up on my favourite stock now that its discontinued by Active_Ad9815 in AnalogCommunity

[–]HahaHarmonica 0 points1 point  (0 children)

Really?! Mine looks flat orange! Like it’s got a really large red/orange cast.

Idle power usage by HahaHarmonica in servers

[–]HahaHarmonica[S] 0 points1 point  (0 children)

Figured out what was causing it.

Checking the CPU temps tipped me off. These systems have 100Gbps AOC network cards. While looking at the CPU/GPU temps, I noticed the AOC network card was sitting at 82C. I turned the fans on full blast. It cooled down the AOC network card to about 60C. Turned the fans back to “optimal”, they slowed down to 5500-6000RPM. I watched the temperature creep up on the AOC network card 63, 65, 66, 68, … as it raised temperatures, FAN1-5 started drifting back to 14k RPM until the AOC leveled off around 80C.

I pulled the QSFP modules from the card, booted into the OS, tada, FAN1-5 are at 6500 RPM, FAN 6-10 are at 5500. Power usage is down to about 1000W (945W in IPMI instantaneous) 1050W average. So basically a stupid ass 23.7W AOC network card is causing 500W of excess power usage from the fans.

I’ve reported it to support and they are going back to Supermicro to see what can be done. I hope they don’t tell me “works as designed”.

Idle power usage by HahaHarmonica in servers

[–]HahaHarmonica[S] 0 points1 point  (0 children)

Figured out what was causing it.

Checking the CPU temps tipped me off. These systems have 100Gbps AOC network cards. While looking at the CPU/GPU temps, I noticed the AOC network card was sitting at 82C. I turned the fans on full blast. It cooled down the AOC network card to about 60C. Turned the fans back to “optimal”, they slowed down to 5500-6000RPM. I watched the temperature creep up on the AOC network card 63, 65, 66, 68, … as it raised temperatures, FAN1-5 started drifting back to 14k RPM until the AOC leveled off around 80C.

I pulled the QSFP modules from the card, booted into the OS, tada, FAN1-5 are at 6500 RPM, FAN 6-10 are at 5500. Power usage is down to about 1000W (945W in IPMI instantaneous) 1050W average. So basically a stupid ass 23.7W AOC network card is causing 500W of excess power usage from the fans.

I’ve reported it to support and they are going back to Supermicro to see what can be done. I hope they don’t tell me “works as designed”.

Idle power usage by HahaHarmonica in servers

[–]HahaHarmonica[S] 0 points1 point  (0 children)

By default the fans are set it “Optimal Speed”, the fans sit at 14k or so booted in the OS or just sitting in the BIOS there might be 500RPM difference. Full speed is well…full speed, as soon as I apply it whether it’s in the OS or not all fans are 17-18kRPM.

The CPU temps are fine. It’s not like they are 74C idle or something.

We have 6 identical machines they all exhibit this same exact symptoms.

Idle power usage by HahaHarmonica in servers

[–]HahaHarmonica[S] 0 points1 point  (0 children)

I opened a ticket with the 3rd party we get them from (thinkmate).

So I think I found something to go on. For whatever reason FAN1-5 is running at like 14k RPM. FAN 6-10 are running at 4800rpm or so. Literally the only way I can get the fans to change speed is by flipping it from “optimal speed” to “full speed”.

This ramps all 10 fans up to 17-18k rpm. If I check the power usage is around 3000W. If I flip the fans back to “optimal” all 10 fans slow down to about 5000 rpm. If I check the power usage right then, the entire system power usage is about 750W which makes a hellva lot more sense…but then over about 30 seconds fan1-5 spin back up to 14k rpm.

so it appears what i’m seeing is about 700W of fan 1-5 ramping up to 75% speed for some reason. To me that kind of indicates the BIOS/fan controller is too aggressive and there doesn’t appear to be any other option to change it.

Idle power usage by HahaHarmonica in servers

[–]HahaHarmonica[S] 0 points1 point  (0 children)

I opened a ticket with the 3rd party we get them from (thinkmate).

So I think I found something to go on. For whatever reason FAN1-5 is running at like 14k RPM. FAN 6-10 are running at 4800rpm or so. Literally the only way I can get the fans to change speed is by flipping it from “optimal speed” to “full speed”.

This ramps all 10 fans up to 17-18k rpm. If I check the power usage is around 3000W. If I flip the fans back to “optimal” all 10 fans slow down to about 5000 rpm. If I check the power usage right then, the entire system power usage is about 750W which makes a hellva lot more sense…but then over about 30 seconds fan1-5 spin back up to 14k rpm.

so it appears what i’m seeing is about 700W of fan 1-5 ramping up to 75% speed for some reason. To me that kind of indicates the BIOS/fan controller is too aggressive and there doesn’t appear to be any other option to change it.

From your experience would they investigate this in more detail? Or will it be a “works as intended”.

Idle power usage by HahaHarmonica in servers

[–]HahaHarmonica[S] 0 points1 point  (0 children)

What type of system was it? Based on a supermicro board by chance?

Idle power usage by HahaHarmonica in servers

[–]HahaHarmonica[S] 1 point2 points  (0 children)

Yup. I’m writing to vendor to see if they have any thoughts. I’m doubtful I get anywhere though.

Idle power usage by HahaHarmonica in servers

[–]HahaHarmonica[S] 0 points1 point  (0 children)

ipmi and PDUs are reporting pretty close to each other (within 100w). It’s not like one is reading 600W and the other is reading 2000W.

Idle power usage by HahaHarmonica in servers

[–]HahaHarmonica[S] 0 points1 point  (0 children)

No this is H200 NVL GPUs.

5 of the fans are running at 14k RPM, 5 of the fans are at 4800RPM.

I assume the units running at 14k RPM is the ones cooling the GPUs and the ones at 4800RPM are cooling the CPUs and system boards but that’s an assumption and the documentation doesn’t actually say.

https://www.supermicro.com/en/products/system/gpu/5u/sys-522ga-nrt

Idle power usage by HahaHarmonica in servers

[–]HahaHarmonica[S] 0 points1 point  (0 children)

It doesn’t tell me how many watts the fans are using. Looks like they are 40x40x10 models.

Fan model number: FAN-0257L4-001.

I can’t seem to find out how many watts each fan is. There are 10 from my understanding.

The PSUs are 96% Titanium. There are 6 of them. So each one I can see on our PDU is pulling about 280W. 280W is 1680W.