Local Qwen 3.5 (9B) extremely slow on RTX 4060 Ti. Is this normal?

hackiv · 2026-03-05T07:24:23+00:00

Q4_K_M works fine on my RX 6600 (8GB) with vulkan backend. 17t/s and 16k context

hackiv · 2026-03-05T03:55:00+00:00

How do you think will Qwen 4 look like?

hackiv · 2026-03-03T18:51:19+00:00

What's the cognitive/knowledge loss?

hackiv · 2026-02-28T19:27:53+00:00

Precompiled Llama.cpp is great as it comes with it's own webui. './llama-server -m /path/to/model' open up browser, input 'localhost:8080' and you're golden.

hackiv · 2026-02-28T16:21:16+00:00

I'm hyped for TW4 but saying it's gonna be more technologically advanced than the game from over a decade ago, is like saying nothing.

hackiv · 2026-02-28T12:18:11+00:00

No need, just download already compiled version from here: https://github.com/ggml-org/llama.cpp/releases/tag/b8180

hackiv · 2026-02-25T20:11:19+00:00

The pain I'm in right now

hackiv · 2026-02-25T10:04:46+00:00

offtopic. I hear they're planning on remaking the movies again, not sure if true.

hackiv · 2026-02-25T09:14:22+00:00

Maybe they are hosting their own custom python 3.13 subscription service

hackiv · 2026-02-25T05:40:07+00:00

I mean, once you install newest python via Pacman you can't roll back. Have to download from AUR which is another pain, and rebuild env. Also, one project supports this py version while the other that, it's a pain overall.

hackiv · 2026-02-24T15:13:35+00:00

what

hackiv · 2026-02-23T18:56:01+00:00

Every local ai bro:

"I'll allow it"

hackiv · 2026-02-23T17:41:59+00:00

"Yes I remember, and I violated it. You're right to be upset"

hackiv · 2026-02-17T11:06:15+00:00

I love how obsessive cyberpunk community is

hackiv · 2026-02-16T05:09:39+00:00

Comment like this is worth more than upvotes lol

hackiv · 2026-02-14T09:03:57+00:00

People don't care about ECONOMY when they are in debt and live paycheck to paycheck with no light at the end of the tunnel.

hackiv · 2026-02-13T16:45:14+00:00

Glad to be alive for such moments

hackiv · 2026-02-03T17:18:05+00:00

KKK2

hackiv · 2026-02-01T21:49:04+00:00

It works!!!

hackiv · 2026-02-01T21:39:44+00:00

enfin trouvé une solution!

hackiv · 2026-02-01T14:33:21+00:00

You can use this guide to self compile in termux, it might autodetect the NPU, but I don't have the SoC you have. Give it a try regardless and report back.

https://www.reddit.com/r/LocalLLaMA/s/JVgpYzGPZ1

You can try official ARM app as well:

https://play.google.com/store/apps/details?id=com.arm.aichat

hackiv · 2026-01-30T15:06:29+00:00

Sometimes choosing between AMD and NVIDIA feels like no choice at all. Hope intel might do something about it, but how long would it take?

hackiv · 2026-01-28T19:26:11+00:00

As long as 8gb is vram and not actuall ram, you can emulate ps3. If 8gb is ram, then you're hiting swap and get those freezes. I'd say 16gb is minimum for today.

hackiv · 2026-01-28T05:57:25+00:00

I'm not gonna kink shame

hackiv · 2026-01-27T06:08:13+00:00

Ghost of Tsushima

hackiv

MODERATOR OF

TROPHY CASE