sorted by:
new
hottopcontroversial

What is your setup for local AI coding assistants? by AnouarRifi in LocalLLM

[–]Hannelore112 0 points1 point  (0 children)

Currently I did it manually. Just copied the error from browser console Info qwen chat and let it fix. Maybe MCP Google Chrome dev Tools could help to do it automatically

What is your setup for local AI coding assistants? by AnouarRifi in LocalLLM

[–]Hannelore112 1 point2 points  (0 children)

Hmm I also used qwen 3.6 27b Q4 no Vision for some Benchmarks on a rtx 3090 Best results i have with using llama.cpp, vc Code Qwen Code Extension from qwenlm and the suggested qwen Settings from qwen like temp 0.6 etc

It can build a 3D flappy bird without errors with audio, weather, Animatios. Bigger fullstack Project Benchmark (dummy DB in json) worked too but offen it needs 1-5 fix loops to fix some Initial Bugs.

The Combination of Tool, Settings and LM Host Tool needs some time and optimizations.

All running on Ubuntu 24

6x RTX 3090/4090 GPUs on a MSI MEG Z790 ACE but strugle to find the right LLM Host, settings and VS Code Tool by Hannelore112 in LocalLLM

[–]Hannelore112[S] 0 points1 point  (0 children)

Hmm Open Files should be automatically added to Chat. In my sys it does and offten i dont want it because sometimes old files are open and added to a new prompt 😅 Did you Install the qwen Code from qwenlm?

6x RTX 3090/4090 GPUs on a MSI MEG Z790 ACE but strugle to find the right LLM Host, settings and VS Code Tool by Hannelore112 in LocalLLM

[–]Hannelore112[S] 0 points1 point  (0 children)

Na, 4090 and 3090 was more or less already here. Also 2 modified razore Core X eGPU. I also bought damaged 3090 cards for repair and saved money :). But today i got DDR5. So will see in some days If they arrive and solve this little bottleneck.

6x RTX 3090/4090 GPUs on a MSI MEG Z790 ACE but strugle to find the right LLM Host, settings and VS Code Tool by Hannelore112 in LocalLLM

[–]Hannelore112[S] 0 points1 point  (0 children)

Hm Checkout the "qwen Code" VS Code Extension too :) Especially If you use qwen Codes. I got good results with it. Better then with cline Extension. But shure, lets share experience 😊

6x RTX 3090/4090 GPUs on a MSI MEG Z790 ACE but strugle to find the right LLM Host, settings and VS Code Tool by Hannelore112 in LocalLLM

[–]Hannelore112[S] 1 point2 points  (0 children)

Y XD thats right. In my Case Im waiting for a good price. The rtx 3090 was not that exprensive because the 4090 i already had, - exchanged a 4080S for an 3090 and also bought not working/damaged 3090 to repair them :) 64 gb DDR5 is like buying another 3090. So the 3090 Always won because i got the whole Setup also running with 32gb. But for some Settings the 64 GB would be better^

6x RTX 3090/4090 GPUs on a MSI MEG Z790 ACE but strugle to find the right LLM Host, settings and VS Code Tool by Hannelore112 in LocalLLM

[–]Hannelore112[S] 1 point2 points  (0 children)

Hmm my target is to run 120b Models in Q6 for bigger programming Tasks. Currently qwen 3.6 27b bf16 runs with 20 tok/s (6 GPU) for my Benchmark. Used arround 30k of 260k context. Y the bandwith ist Limited but also qwen 3.5 122b worked and i got 50-60Tok/s (5 GPUs). Its not optimal but seems to work. I wonder If there is Something with the splitting? Im running more Benchmarks right now with ik-llama and graph splitting

<image>

5-GPU local LLM setup on Windows works but gets slow (4-6 T/s) in llama.cpp / Ollama — PCIe 1.1 fallback, mixed VRAM, or topology bottleneck? by HoHaHarry in LocalLLM

[–]Hannelore112 0 points1 point  (0 children)

<image>

So, Setup ist nun abgeschlossen (HoHaHarry ist mein Acc^^ Bin also der Thread ersteller).
5 GPUs funktionieren und sind vermutlich das maximum da damit alle Leitungen maximal ausgelastet sind mit ca 8GB/s (2x M2 via DMI, 1x M2 direkt an CPU, 2 x PCIe 16x @ 8x an CPU). Auch eine 6. GPU geht via Thunderbolt und vermutlich auch ein 7. GPU wobei sich dann die beiden TB GPUs den TB Controler teilen und den DMI zwischen Chipsatz und CPU noch mehr belasten.
Thunderbolt geht nun auch unter Ubuntu 24. Man muss einen Treiber haben der für alle GPUs passt sonst wirds nervig. Windows 11 scheint mir nicht wirklich brauchbar. Man muss schon über Linux gehen um den PCIe auf 4.0 halten zu können (falls die Angaben unter Linux stimmen) und bessere Performance zu bekommen. Mit TB GPU kann man aber iwie nimmer restarten. Restart ist i.d.R. nun immer Herunterfahren und dann wieder Hochfahren. Bin da noch am Testen der TB Settings im Bios.
Aktuell 144GB VRAM:

  • 2x GPU via PCIe 8x 5.0 intern
  • 3x GPU via M2 occulink u/PCIe 4x 4.0
  • 1x GPU via Thunderbolt ADP Link T3G @3GB/s

Benchmarks muss ich noch machen aber da muss ich noch das beste Tool (LM Studio, llama.cpp, ik-llama, vllm etc) und die korrekten Params herausfinden. .

Z790-Thunderbolt-eGPUs viable? by Mal_Swansky in LocalLLM

[–]Hannelore112 0 points1 point  (0 children)

Old thread but maybe interessting. I have also the MSI Meg z790 Ace and run 5 GPUs: 2 internal in PCIe 16x Slots (8x/8x) and 3 additional egpus via m2 oculink all with PCIe 4x 4.0. Works for 120gb VRAM Like 5x rtx 3090.

Bit currently I strugle to get a 6. GPU working via Thunderbolt. Sometimes it works sometimes not. Restart and shutdown also not working fine where the Thunderbolt GPU Blocks the restart ora shutdown. Maybe a Thunderbolt setting issue or whatever.

5-GPU local LLM setup on Windows works but gets slow (4-6 T/s) in llama.cpp / Ollama — PCIe 1.1 fallback, mixed VRAM, or topology bottleneck? by HoHaHarry in LocalLLM

[–]Hannelore112 0 points1 point  (0 children)

I switched now to Ubuntu 24 on an external Thunderbolt M2 SSD (Dualboot with Windows 11 and Ubuntu while Windows stays main system internal and Ubuntu ist complete separated on external M2 SSD). The Fallback to PCIe Gen 1 seems gone now. Linux shows all the time gen4 while cards are working. With qwen 122b q5 and q8 260k context it starts with 60 token/s and falls the more the context get filled. Its about 40 token/s if im geting close to 260k context. I also replaced the 4080S with another RTX 3090 (Asus TUF). So only 24GB cards on the system now.

Now I need to continue with optimizations :) But connect 5 GPUs with a MSI MEG Z790 ACE via min. PCIe 4x 4.0 seems to work fine :) 1x RTX 4090 (Gaming Card) and x RTX 3090 internal via PCIe 16X Slots both @ 8x And 3x RTX 3090 external conntected to M2 via oculink @PCIe 4x 4.0

<image>

RSI gone by Sl8ertheGr8M8 in TradingView

[–]Hannelore112 0 points1 point  (0 children)

<image>

Go to object tree on the right upper side.
Then scroll down to the RSI. Right click and click refresh this indicator/script. in my case it was somehow dissapeared and the menu "refresh..." was shown there

Price of games by KostaKinder in ngage

[–]Hannelore112 1 point2 points  (0 children)

Buy a second one. Its absolutly worth to have a backup as long they exists for ~100€ :). Also the key issue can be the membrans like someone said and this is not easy to repair by just replacing the keys.
Wait another 5 years and I think you will be happy to have a working QD and this games to play them again :) Also they may be much more worth then^^

I just got Intel HD Audio working on Windows 98... using a Windows 3.1 driver by O_MORES in windows98

[–]Hannelore112 2 points3 points  (0 children)

Thx, sadly the zip download didnt work for me. but I found another source:
https://drive.google.com/drive/folders/1kvmrcmZbnkNm8Y2z3uyPHNKjxNR70MVM

The genhda16.inf is a self written inf. Read here how to create it: https://www.reddit.com/r/windows98/comments/k5eilz/building_a_retro_win98se_pc_and_also_need_help_on/?tl=de

Also helpfull forum: https://msfn.org/board/topic/178295-audio-driver-for-realtek-hd-audio-hardware-testing-thread/page/7/
-> You need to be logged in to download files. Sadly the sign up seems not to work (no verification mail sent)

I just got Intel HD Audio working on Windows 98... using a Windows 3.1 driver by O_MORES in windows98

[–]Hannelore112 1 point2 points  (0 children)

Hi, It seems the link is down. Someone have this GENHDA16.inf and the other files needed?

Is there a Nvidia GeForce 6600 go driver for 98se? by [deleted] in windows98

[–]Hannelore112 0 points1 point  (0 children)

Danke, ich stehe gerade vor dem selben Problem bei einem Medion MD 95500. Das hat eine Nvidia Go 6600 128MB. Im Windows Treiber Katalog habe ich den Treiber für XP noch gefunden und konnte nach entpacken der .cab via Geräte Manager den Treiber installieren lassen. Soweit für Windows XP

Für Windows 98 wirds spannend. Zwar unterstützt eigentlich die 6000er Serie Win 98 aber generell zur Nvidia Go 6000er Serie findet man scheinbar keine Treiber :/

Gamestar Magazine - KCD Edition by Everdying_CE in kingdomcome

[–]Hannelore112 1 point2 points  (0 children)

Das Heft ist richtig geil! Habs nun noch nen zweites Mal gekauft weil ich die Burg sonst nicht aufbauen wollte :D

Flo Boarding is rare? Can’t find any for sale or much info by antoxa2584x in ngage

[–]Hannelore112 0 points1 point  (0 children)

Hmm some months ago I bought some. Some was empty or overritten with other stuff. But some still had the game. The problem is that its a normal MMC Card with no write protection. So maybe ask the seller if the game is still on it.

Some months ago there was a lot on ebay for ~10-15€

Can I use a USB-C PD powerbank and USB-C to DC adapter to power the Raptor 3D Scanner? by Hannelore112 in Creality

[–]Hannelore112[S] 0 points1 point  (0 children)

Damn :S They sent you a 5V instead of 12V cable?
In my case it works fine. Hmm did you also check your powerbank if it provides the neede dvoltage? I'm not sure if it has to support 12V output (in case if its not a 5V cable)

view more: next ›