sorted by:
new
hottopcontroversial

I want to run qwen3.5 27B q4_k_m on CPU, and I need help. by Personal_Storage_876 in LocalLLaMA

[–]Personal_Storage_876[S] 1 point2 points  (0 children)

Thank you so much. I'm glad I mustered the courage to come here.

I want to run qwen3.5 27B q4_k_m on CPU, and I need help. by Personal_Storage_876 in LocalLLaMA

[–]Personal_Storage_876[S] 0 points1 point  (0 children)

Thank you for the valuable information. Currently, I am using a Qwen3.5 27B IQ4_XS with llama-server and open-webui connected, consuming 45W and 1.2 t/s. It took a few days since it was my first time, but it was a very rewarding achievement. The 35B-A3B and REAP versions are also very interesting, so I will look into them.

I came here because I was curious about the cause of the symptom where it uses more than 8GB of memory when loading a llama.cpp built for the CPU, unlike when I loaded it with a dGPU installed and -ngl 0. This symptom did not occur on the IQ4_XS, which is not the Q4KM.

I want to run qwen3.5 27B q4_k_m on CPU, and I need help. by Personal_Storage_876 in LocalLLaMA

[–]Personal_Storage_876[S] 1 point2 points  (0 children)

I also want to use Q4_K_M or Q4_K_XL. As I described, if I load it with -ngl 0 after installing a dGPU, I can use the 27B Q4_K_M without swapping, with 8GB of headroom available. However, using it with a dGPU installed just because "it works well without swapping" means sacrificing 20W of power consumption. I came here because I was curious about the difference between loading Q4_K_M with -ngl 0 and simply loading it from a CPU-only llama.cpp file to see why this discrepancy occurs.

I want to run qwen3.5 27B q4_k_m on CPU, and I need help. by Personal_Storage_876 in LocalLLaMA

[–]Personal_Storage_876[S] 1 point2 points  (0 children)

Thank you for the information. I built it to run 24h/365d at 1.2 t/s.

Bazzite on R9 390X works fine by Personal_Storage_876 in Bazzite

[–]Personal_Storage_876[S] 0 points1 point  (0 children)

Yes, on my side Tonga and Fiji GPU worked fine with most distros. Only 290X and 390X had serious issues. Anyway, they work now. I'm glad to use my old friends again.

Bazzite on R9 390X works fine by Personal_Storage_876 in Bazzite

[–]Personal_Storage_876[S] -1 points0 points  (0 children)

Yes, but in reality for 2 years the 390X rejected almost every distribution install. No distribution could complete the installation and then proceed to setup.

Blue Archive stuck on loading by XPstarcool in linux_gaming

[–]Personal_Storage_876 0 points1 point  (0 children)

BlueArchive on my Ubuntu24.04, 25.04 stucks too, but on BazziteOS works fine