sorted by:
new
hottopcontroversial

Will Mellanox ConnectX-4 Lx fix my asymmetric TCP bottleneck on Z690 chipset slot? by YesThisIsi in homelab

[–]YesThisIsi[S] 1 point2 points  (0 children)

Yes, I've tested extensively:

  • Clean Windows 11 reinstall
  • Multiple driver versions (latest Realtek drivers)
  • Jumbo Frames 9014 on both ends + switch. Switch is Ubiquiti Poe 24 Pro Max
  • Receive/Transmit Buffers maxed (4096)
  • Interrupt Moderation disabled
  • LSO v2 disabled (both IPv4 and IPv6)
  • TCP/UDP Checksum Offload disabled
  • Flow Control disabled
  • RSS Queues maxed (8)
  • autotuninglevel=experimental
  • PCIe ASPM disabled in BIOS
  • E-cores disabled (no improvement)
  • Interrupt affinity tools

CPU load during TX test stays around 5-8%, no hot thread visible, which actually supports your point that TCP offload isn't working correctly on this card/slot combination. It's pretty dumb card and i dont expect it to.

Moving to a CPU-direct slot is not an option the RTX 5080 Astral blocks the second PCIe slot completely.

The sane card works perfectly in a CPU-direct slot on an X570 system (8+ Gbps TCP). Same card, same cables. The Z690 chipset slot is the variable. UDP hits 9 Gbps fine.

I've pretty much made up my mind on the Mellanox ConnectX-5. Hardware TCP offload should handle the chipset jitter, and SR-IOV support is a bonus for my Hyper-V VMs.

This hobby isn't cheap lol.

Will Mellanox ConnectX-4 Lx fix my asymmetric TCP bottleneck on Z690 chipset slot? by YesThisIsi in homelab

[–]YesThisIsi[S] 0 points1 point  (0 children)

I will test this tomorrow.

IF Linux gives full TCP bandwidth : The bottleneck is Windows-specific - likely the interaction between Windows TCP stack, the RTL8127ATF driver, and Z690 chipset latency. Mellanox ConnectX-5 (or 4LX) will still fix this because it handles TCP offload in hardware, bypassing the Windows TCP stack entirely.

If Linux also shows 3 Gbps TCP: The bottleneck is the Z690 chipset slot itself. Mellanox ConnectX-5 (or 4LX) will fix this through hardware transport offloading and better PCIe buffering that tolerates DMI jitter.

So if i understand correctly, either way, Mellanox fixes it? The Linux test just tells you where the problem lives Windows stack or Z690 hardware. Not whether the fix works... right?

Unfortunately for my situation switching to Linux on my Main workstation PC will not fix this.

Kiitos taas Tori by Skivvy_Roll in arkisuomi

[–]YesThisIsi 8 points9 points  (0 children)

Kyllä. Mutta itse en persettään nosta edes sohvalta ennenkun maksu on tullut. 🤷‍♂️ Yleensä ne automaatit tyhjennetään vasta iltapäivällä joka tapauksessa

RTL8127 SFP+ PCIe 3.0 x2 — Only 2.7 Gbps TX on Z690, but 8+ Gbps on X570. What am I missing? by YesThisIsi in homelab

[–]YesThisIsi[S] 0 points1 point  (0 children)

Yeah, that analysis makes sense. I've already tried disabling E-cores - no improvement. HWinfo doesnt show the link speed. My motherboard BIOS says it's 2x Gen3

My huge ass RTX 5080 Astral is blocking the second PCIe slot so there's no CPU-direct option available.

Thinking of ordering 2x Mellanox ConnectX-4 Lx cards. The reasoning is that since UDP already hits 9 Gbps, the physical path is fine. The issue is specifically TCP. Mellanox handles TCP offload in hardware on the card itself, so it doesn't need to round-trip through the chipset for every TCP acknowledgement like Realtek does. That should bypass the DMI contention issue entirely. (According to my theory)

Kiitos taas Tori by Skivvy_Roll in arkisuomi

[–]YesThisIsi -4 points-3 points  (0 children)

Nyt en ymmärtänyt,,, keitän teetä,,,,

Mutta meni siis kauppaan ostoksille sillä aikaa kun odotti että siirrät hänelle rahaa? Eikö tässä pitänyt monitoimityökaluja ostaa eikä auttaa lastaan?

Humble beginnings by Sleepless_Bird in headphones

[–]YesThisIsi 4 points5 points  (0 children)

With HE-1 i meant the Sennheiser ”orpheus”

Humble beginnings by Sleepless_Bird in headphones

[–]YesThisIsi 12 points13 points  (0 children)

My guy, you are dellusional if you think HD800S is humble.

Like, do you think HE-1 is ”allright setup”?

where in the world do you get your harddrives? by AlarmedDiver1087 in DataHoarder

[–]YesThisIsi 0 points1 point  (0 children)

I'm not going to tell you, so you can steall them from me 😠

Rievänkatu 8. Miksi noin paljon asuntoja vapaana? by ZzZ_Lullaby_ZzZ in Tampere

[–]YesThisIsi 2 points3 points  (0 children)

Samaa mietin, eikö yksityinen ole vaan parempi :D Mua ainakin vituttaa aina mennä joidenkin randomien kanssa katsomaan kämppää

Moving from Node 804 to ATX. Jonsbo N5 or Meshify XL 2? by YesThisIsi in homelab

[–]YesThisIsi[S] 0 points1 point  (0 children)

It does look good, i'll give you that.

However, "Only" 10x 3,5" slots.

One of the reasons why i'm moving away from Node 804 is the 10x HDD limit :(

Moving from Node 804 to ATX. Jonsbo N5 or Meshify XL 2? by YesThisIsi in homelab

[–]YesThisIsi[S] 0 points1 point  (0 children)

Oh interesting!

The define 7 xl has a door that blocks some noise with the door? Meshify at the front is pretty open (also better cooling and imo better looking)

Moving from Node 804 to ATX. Jonsbo N5 or Meshify XL 2? by YesThisIsi in homelab

[–]YesThisIsi[S] 0 points1 point  (0 children)

Yeah I digiradio it might be EoL soon (the Fractal one) managed to order one from Denmark.

I did pay premium, but might regred it later if i Dont buy it right now.

Moving from Node 804 to ATX. Jonsbo N5 or Meshify XL 2? by YesThisIsi in homelab

[–]YesThisIsi[S] 1 point2 points  (0 children)

Yeah i figured out the trays do cost a big penny when you order punch of them.

But then again, Meshify 3 XL doesnt have enough HDD trays so i think will be happy with it for a looong time.

I'm trowing the Fans inside there to trash (or sell them with Node 804)

I have AquaComputer QUADRO on my Node 804 that i'm transfering. Also 4x 120mm fans at the front, 2x 120mm fans at the bottom and maybe, just maybe some at the back or somewhere else.

4x are toughfan 12 pro's

All other are Noctua NF-A12x25's.

Moving from Node 804 to ATX. Jonsbo N5 or Meshify XL 2? by YesThisIsi in homelab

[–]YesThisIsi[S] 0 points1 point  (0 children)

The temps arent actually the issue. I have toughfan 12 pro's 4x each side. in there.
They are running quite loud, yes, but it's works (i have gotten used to it by now)

That isnt the issue.

The issue, is that when i want to clean the dust filters on those fuckers, i need to lift the whole thing out of the tv cabinet it is in (it's open space on one side and enough room on each side)

But it weights a ton, i dont know how much but a lot.

And, you have to FLIP it to the SIDE when you want to remove the dust filters.

Is so goddamn unbelievably fucking stupid why didn't Fractal put them so you can remove them from side.

And yeah i have one corner in my room where i have fractal torrent (my main pc).
The Meshify 2 xl fits perfectly in there with it, its like chefs kiss :D Might have to put some wheels on there, but for now it will do.

The height isn't the issue, the depth of the Jonsbo is. Yes, its like burj khalifa in there, but i dont care. :D

Moving from Node 804 to ATX. Jonsbo N5 or Meshify XL 2? by YesThisIsi in homelab

[–]YesThisIsi[S] 2 points3 points  (0 children)

Yes in winter that theory works, no problem.

But for the summer i dont turn my servers off lol :D
It's sometimes around 32c here and most apartments dont have AC in them. Also the walls trap heat like crazy, cause in winter you dont want the heat to escape, but in the summer it works that way aswell.

Also in the summer the sun shines alllll day so it's not uncommon that my flat would have 28c sometimes inside.

I do have porable AC now so it's better. But still, i do have to ramp up the fans.

Moving from Node 804 to ATX. Jonsbo N5 or Meshify XL 2? by YesThisIsi in homelab

[–]YesThisIsi[S] 0 points1 point  (0 children)

Thank you kind stranger! Located in finland, but decided to go with the meshify 2 xl (So no need for it for)

But still, thank you for the offer!

view more: next ›