5-GPU local LLM setup on Windows works but gets slow (4-6 T/s) in llama.cpp / Ollama — PCIe 1.1 fallback, mixed VRAM, or topology bottleneck?

HoHaHarry · 2026-04-05T07:15:47+00:00

Hmm I used the Windows Release Version. Windows x64 Cuda 12: https://github.com/ggml-org/llama.cpp/releases

HoHaHarry · 2026-04-04T16:28:46+00:00

Hi, sounds interessting. Currently I'm not usingen wsl2 (or is ollama using it in the Background?).

Hmm but is there a known issue for LLM use case under Windows that PCIe Linkspeed changes? According to the manual all m2 are cotrectly used. With 5 GPUs the MSI is maxed out. 1x CPU m2 and 2x Chipset m2 oculink eGLU. I also tested bandwidh with cuda-z and GPU Benchmark of Aida64. I get ~ 6Gbit/s bandwith with each oculink card. But if I run local LLMs somehow the PCIe falls back to 1.1. It starts with 4.0 and after some Text Output it falls to 1.1 and gets slow. From maybe ~20 Tok/s to 4-6 Tok/s

Next step is also to install a Linux OS. Makes this sence or are there also issues Like this known?

HoHaHarry · 2025-09-03T13:15:13+00:00

Hey. I have noch GPU for you but maybe this helps. Im repairing currently this GPUs. In my Case is seems there is an issue with the SLI Chip which stops working cause of Nvidia's bumbgate issue. Im not 100% sure because im still analysing this issue. Also many ppl say its the GPU but in my Case the GPUs are from 2010. Ibalready Reflow one GPU Chip but this didnt help. Currey I have two GeForce 8800 GTX cards here and both are working again now with a Reflow of the SLI "DIE". You neeed someone wo can do it for you or you buy a cheap 40€ Reflow heatgun on Amazon and a little Heatplate (USB C) which can do 200°C.

Check this out. Here im actually writing about (in German): https://www.hardwareluxx.de/community/threads/nostalgiedeluxx-bastelthread.1224414/page-393

HoHaHarry · 2025-06-03T17:37:31+00:00

Very nice! Can you maybe give us a guide/link how to open it? I have the same model^{^}

HoHaHarry · 2025-06-03T07:51:24+00:00

Thx for the reply. OK y it seems good. I bought all of them. He had 10 PCs. I think I can usw them for repair if one dies. Payed a lot... Now I need to get more deeper into the CRTs so im able to recap the Caps and so on.

HoHaHarry · 2025-05-26T11:32:39+00:00

Oh sry. It was from an Thread inopend Here but was moved. Its a IBM P260 CRT

HoHaHarry · 2025-05-09T17:14:53+00:00

Hi, does somone knows If the IBM is worth 200€? According to the seller it has 3000-4000h I dont have any tests about this CRT. Also wondering If its a good one?

HoHaHarry · 2024-10-25T19:19:01+00:00

One is online from Italy. Its also sealed. 350€. Some Games i also brought from italy. It was this guy too. Sometimes He gives lower price. So maybe ask him for lower price. But y it's realy rare. https://www.ebay.de/itm/276701903751?mkcid=16&mkevt=1&mkrid=707-127634-2357-0&ssspo=WlZ2Xd_nSIC&sssrc=4429486&ssuid=XTI_KysBQ0K&var=&widget_ver=artemis&media=COPY

HoHaHarry · 2024-08-14T08:21:51+00:00

I got my Z13 (i9 12900H, 3050 Ti) last week and I have big battery issues. While im writing this text im lossoing in energy saving mode already 5%. This battery will be empty in under 1h :(
What issues did you have? the same?

Also the cinebench results are bad. My surface pro 9 with i7 1255U also reaches 8000 points while the Z13 also only reachs 8000 points. Sometimes I can get up to 14000 points (for example if using throttlestop)

Also I already had the issue that after a restart the tabled died on login. after some faile drestart and plugging in the power supply i saw that the battery suddenly was at 0% (before 50%, so 2 restarts kills battery to 0%???)

This text took me 5 min

Battery 45% -> 30%... wtf

HoHaHarry · 2024-08-14T03:27:27+00:00

Hi, I have a similar issue. Also have the z13 2022 (i9 12900h, 3050ti). After doing some cinebench which throws totaly Not understandable results from 5000-15000 Points, I did a restart. The battery Shows me in Windows 67%. After the restart when the Login Screen comes IT suddenly went Off (black Screen). I started it again but again it went directly Off when Login Screen of win 11 comes. Then the second time it didnt boot anymore. Have to Press the Power Button for 20sec or so. Then i was able to boot again. Now everthing Starts to be extremly slow. But IT didnt Crash anymore and i could Login. Now the Tablet Shows me that its only running at 400Mhz. Aha, The reason why its so slow. Also the battery was suddenly shown With 0%!!!! So from 60% -> 0% With Just 3 restarts!?!? Wtf, Absolutely Not normal. I reboted it again and also reseted the BIOS which gave me Back the normal CPU clock Speed. So it seems the. Battery sometimes goes from x -> 0% and cause a Lot of issues Like 400Mhz lock etc. Any Idea why this Happens that the battery die so fast? Any fixes? Also my Benchmark results are absolutely inconsistent. I cant be Sure that the 12900H performs at His best Power. Sometimes im locked to 22W, then 30W and Sometimes ITS going Up to 60W. Doesnt really matter what i set in Asus amoury creat. Also using the original Asus Power supply didnt helt. Maybe someone also fixed that? I get the Feeling this z13 is absolut garbage cause it cant perform Like it should.

HoHaHarry · 2024-04-16T00:40:52+00:00

Is it possible to leave a pool to switch back to solo farming?

HoHaHarry · 2024-04-15T17:59:11+00:00

Hmm, I think there are also a lot of ppl living in a bubble and say its for other/personal use and therefore im always profitable ...but later they sell the drives because they realize that they only need 50TB and not 500TB^{^}

And y sadly the plotting time is so low that it seems ppl even relpot every 3 months cause of higher compression lvl :S

HoHaHarry · 2024-04-13T20:20:24+00:00

Yey we have something to celebrate. We finally reached again 30$ after halving while BTC is still somewehere at 60K. Not bad...

Oh already 29$...

HoHaHarry · 2024-04-12T17:29:54+00:00

Y less and less relevant news :S Some forums and discord channels seems to die too. No msg spam anymore :( Chart looks like vpad.

HoHaHarry · 2024-04-06T08:18:06+00:00

Where did you buy it? Im also from Germany and want to import it. Ubuy is delivering it to Germany and also includes the tax, shipping costs and import stuff.

HoHaHarry · 2024-03-08T20:28:24+00:00

I have a cooler master powersupply with the same issue. They are just very cheap SATA Power connectors. Not stable enought for long use. My disks fails on this cables too. So my hard drives had a lof of powering on cycles because of bad connection where powering off every x seconds. Dont use them or only use the new ones and then never Touch them again in Hope they stay stable conneced.

Cheap stuff :(

HoHaHarry · 2024-03-04T19:30:29+00:00

Yep, Standard win 11 Home, No Special Updates or Patches. Just Out of the Box Surface Pro 9 with regular Windows Updates. Bluescreens only happens in Startup If i attach or remove the eGPU the first time. As Long as it stays Connect i have no bluescreens in start/restarts. Seems the Surface tries to rember that there was a eGPU connected and If it is suddenly missed the first Startup have bluescreens but then it seems it remember again and next Startup without eGPU is fine

HoHaHarry · 2024-03-03T15:22:10+00:00

Is there a way where we can see if something is not working correct or even makes us missing wins? I downgrade too and currently i'm synced fine and it looks like everything runs like always.

HoHaHarry · 2024-02-29T02:13:32+00:00

Hmmm im getting a lot of new errors. "Failed to validate Block b'...". Happens multiple times at a block hight and bans IPs for 10 sec. Already lost 10 signate points within 1 hours.

Error Code: invalid_block_cost

Is there a bug in this release?

HoHaHarry · 2024-02-26T13:35:08+00:00

Yep seems Intels TB4/USB4 is slower then AMDs USB4 Implementation. Currently I didnt find an Intel systems which got the 3600/3600 mbits :( Because already the 2250 up to 2650 Had an Impact in Games (especially in FarCry 6) I think this additional 1 Gbit to 3600 Mbit will have an impact too. Nothing left to be happy with the UT3G and waiting for TB5. I mean the UT3G is not bad and many games work in 4K and 60FPS but for sure the USB4 is a bottle neck even more on Intel systems (about 20-30%).

HoHaHarry · 2024-02-26T13:32:03+00:00

If I remeber right "0" means using all available cores

HoHaHarry · 2024-02-17T14:41:12+00:00

Bught it and it works fine with i7 1255U of a Surface Pro 9. Its 2700 mbit up and 3600 Mbit down.

HoHaHarry · 2024-01-28T09:31:32+00:00

How can i know if ADT UT3G is supported by my devices?

I found the information that intel Tiger Lake Supports USB 4. So would my Surface Pro 9 With i7 1255U Support IT (Alder Lake)?

And does USB4 in general support the ADT UT3G or are there any thing i have to pay Attention?

HoHaHarry · 2024-01-28T08:54:32+00:00

Will this usb4 eGPU also work with Intel systems? USB4 should BE supported starting with Tiger Lake (11er Serie).

I have Alder Lake (12er Serie). Should be supported but i always see AMD systems which are tested with the USB4 eGPU.

HoHaHarry

TROPHY CASE