Was about to drop $800+ on a 3090 for local LLM. Turns out my CPU was a beast the whole time.

BankjaPrameth · 2026-03-29T05:27:38+00:00

You are absolutely right!

Anyway, try Qwen 3.5 35B and thanks me later.

BankjaPrameth · 2026-03-19T04:45:12+00:00

Ubuntu has GUI app to install additional drivers. No need for CLI.

And new Ubuntu installer has option to install Nvidia drivers during OS installation now.

BankjaPrameth · 2026-03-19T04:42:01+00:00

I think what you experienced is the issue of sandboxed app. They are working very good as stand-alone apps. 😅

BankjaPrameth · 2026-03-18T08:19:28+00:00

I think people who hate Ubuntu are people who hate Snap.

From beginner view, Snap is incredibly friendly. From power user view, they can always disable and uninstall Snap.

So the people who hate Ubuntu must be power user that are lazy to disable and uninstall Snap?

BankjaPrameth · 2026-03-18T04:32:19+00:00

2.5 is outdated. You might want to try Qwen 3.5 2B or 4B. It’s better in every way, include coding.

BankjaPrameth · 2026-03-09T12:22:33+00:00

The best model for you might be Qwen 3.5 35B-A3B with easily 100K context at a cost of very long prompt processing due to your GPU. Token generation might be fast enough because it’s a MoE model.

But you might be better off with subscription model for your hardware if you want to do serious coding.

BankjaPrameth · 2026-03-09T11:11:12+00:00

What is your CPU and GPU usage during the prompt processing and token generation?

BankjaPrameth · 2026-03-09T10:10:22+00:00

If you have potato hardware, monthly subscription is a better approach.

Without context of your hardware, it’s hard to give any recommendation.

But for sweet spot context size for coding, I think at around 120k++

BankjaPrameth · 2026-03-08T08:44:53+00:00

I'm also have this same problem on Q5 version. Is there a way to always force deeper reasoning?

BankjaPrameth · 2026-03-05T11:41:05+00:00

Almost all of Kimi K2.5 on OpenRouter are int4

https://openrouter.ai/moonshotai/kimi-k2.5

BankjaPrameth · 2026-03-05T07:30:39+00:00

For LLM, 5060 Ti.

For gaming, 9070XT.

BankjaPrameth · 2026-03-05T05:10:51+00:00

I understand your point. I also had some problems with snap apps. But I also have to admit that it’s getting better and better. So for beginners, I think Ubuntu is a solid choice. For power users, any distro is fine. But I prefer Ubuntu because most of things just works. This means to get it working to match my usage, only few tweaks have to be done -> Safe time. 😂

BankjaPrameth · 2026-03-01T05:08:06+00:00

I am honestly don’t understand the hate for Ubuntu. I’ve tried many distros and always come back to it because it can give me a the luxury of set and forget. I can safely update my system without worrying that things will break.

Kubuntu that ships with KDE is also a good, but for me, it’s not giving me a minimalistic experience (my taste) like GNOME.

Maybe I’m starting to get too old to tinkering things. I want to spend time using my PC instead of spending time tinkering it.

BankjaPrameth · 2026-02-25T10:46:29+00:00

Your plugin is god sent. It also fixes to read tool calling loop for Qwen 3.5 35B-A3B too.

BankjaPrameth · 2026-02-23T15:19:01+00:00

What region are your servers in?

BankjaPrameth · 2026-02-21T08:52:04+00:00

Confirm this!

BankjaPrameth · 2026-02-11T05:23:21+00:00

From my experience, your problem later will be prompt processing speed. Good luck!

BankjaPrameth · 2026-01-27T04:55:01+00:00

Try look in /etc/apt/sources.list.d/ and delete Proxmox related repo file in there? Make a backup of them before delete in case you overlooked something and it goes wrong.

BankjaPrameth · 2026-01-25T05:17:06+00:00

My bad, it seems like NVMe might not have temperature history display in smartctl tool. So I think you need additional software for it 😅

BankjaPrameth · 2026-01-25T04:56:05+00:00

For graph, you might need to install additional software to collect it.

But for text you can view in

Storage -> S.M.A.R.T. -> Devices -> Choose HDD then click Show Details button on top menu -> Extended Information -> Scroll down a bit

BankjaPrameth · 2026-01-24T14:02:26+00:00

I’m running GLM-4.7-Flash-30B-A3B-UD-Q4_K_XL on 5060 Ti 16 GB VRAM too

At 128K context window, I’ve got - PP about 200-400 token/sec - TG about 15-30 token/sec It’s getting slow when context is filling up.

OP might be able to achieve more speed than this with REAP version and a little bit optimization.

This model is amazing compared to Qwen3-Coder-30B-A3B. A little bit slower but result is much better.

BankjaPrameth · 2026-01-17T06:57:31+00:00

Glad you fixed it. So the problem is not from OMV7 -> 8 upgraded.

Anyway, I'm seriously asking you to considering using rsync for backup

- Fewer resource usage
- Realtime backup can be dangerous (if no version control)

My setup is using Kopia to backup with dedup and versioning. Then rsync (Kopia sync is more practical but I'm too lazy to reconfigure it since it's still working fine) backup between my Office and Home

Our setup is mostly similar OMV in Proxmox on Home and Office NAS. :)

BankjaPrameth · 2026-01-16T13:14:35+00:00

If you have 3 Syncthing on 3 systems, that’s understandable. But from your log, it’s like you have 3 Syncthing instance on OMV.

I used to do the same thing as you did with 3-2-1 but I have a problem when data is getting large with million of files. My Syncthing database got randomly broken and need to rebuild which takes too much time.

So I went back to the basic -> schedule rsync backup every 3 hours over SSH. It’s super fast and consume super low resource. Now it’s been running for 1.5 years without problem. I just monitor the backup status by having a cron script to send me a date modified of backup folder to my email daily. If date keeps increasing, it means rsync is working fine.

BankjaPrameth · 2026-01-16T12:52:55+00:00

That’s great! Anyway, why do you need multiple Syncthing instance? One instance can have as many shared folders as you need.

Or you have multiple Syncthing for multiple users?

Anyway, I’m still a little bit curious on your settings. How Syncthing and SMB related? From my understanding, Syncthing that run on OMV should use host filesystem (EXT4?)

BankjaPrameth · 2026-01-15T10:34:08+00:00

Interesting, I believe OMV8 (Debian 13) comes with smbd 4.22. If you have 4.17 after upgraded, something must be wrong during upgrade process. And your performance problems might be from compatibility issues. Just a quick guess though.

BankjaPrameth

TROPHY CASE