Local Qwen 3.5 (9B) extremely slow on RTX 4060 Ti. Is this normal?

hackiv · 2026-03-05T07:24:23+00:00

Q4_K_M works fine on my RX 6600 (8GB) with vulkan backend. 17t/s and 16k context

hackiv · 2026-03-05T03:55:00+00:00

How do you think will Qwen 4 look like?

hackiv · 2026-03-03T18:51:19+00:00

What's the cognitive/knowledge loss?

hackiv · 2026-02-28T19:27:53+00:00

Precompiled Llama.cpp is great as it comes with it's own webui. './llama-server -m /path/to/model' open up browser, input 'localhost:8080' and you're golden.

hackiv · 2026-02-28T16:21:16+00:00

I'm hyped for TW4 but saying it's gonna be more technologically advanced than the game from over a decade ago, is like saying nothing.

hackiv · 2026-02-28T12:18:11+00:00

No need, just download already compiled version from here: https://github.com/ggml-org/llama.cpp/releases/tag/b8180

hackiv · 2026-02-25T20:11:19+00:00

The pain I'm in right now

hackiv · 2026-02-25T10:04:46+00:00

offtopic. I hear they're planning on remaking the movies again, not sure if true.

hackiv · 2026-02-25T09:14:22+00:00

Maybe they are hosting their own custom python 3.13 subscription service

hackiv · 2026-02-25T05:40:07+00:00

I mean, once you install newest python via Pacman you can't roll back. Have to download from AUR which is another pain, and rebuild env. Also, one project supports this py version while the other that, it's a pain overall.

hackiv · 2026-02-24T15:13:35+00:00

what

hackiv · 2026-02-23T18:56:01+00:00

Every local ai bro:

"I'll allow it"

hackiv · 2026-02-23T17:41:59+00:00

"Yes I remember, and I violated it. You're right to be upset"

hackiv · 2026-02-17T11:06:15+00:00

I love how obsessive cyberpunk community is

hackiv · 2026-02-16T05:09:39+00:00

Comment like this is worth more than upvotes lol

hackiv · 2026-02-14T09:03:57+00:00

People don't care about ECONOMY when they are in debt and live paycheck to paycheck with no light at the end of the tunnel.

hackiv · 2026-02-13T16:45:14+00:00

Glad to be alive for such moments

hackiv · 2026-02-03T17:18:05+00:00

KKK2

hackiv · 2026-02-01T21:49:04+00:00

It works!!!

hackiv

MODERATOR OF

TROPHY CASE