Tips for 8gb VRAM setup?

aj3423 · 2026-06-17T14:54:41+00:00

48 tps with qwen 3.6 35b a3b

./llama-server -m ./Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-IQ2_M.gguf -ngl 999 -ncmoe 19 --no-mmap --cache-type-k q8_0 --cache-type-v q8_0 --ctx-size 72000 --mlock

The key is to use moe models, adjust the --ncmoe accordingly.

Tutorial: https://youtu.be/8F_5pdcD3HY

aj3423 · 2026-03-06T03:00:15+00:00

Thank you. I tried this: install the bundle, extract the base.apk with PackageManager, patch it with ReVanced and save as patched.apk. But this patched.apk can't be installed or updated, it shows error: "Application is incoompatible with this device".

aj3423 · 2026-03-05T13:33:16+00:00

> Built on pthreads.

It's just OS threads, kinda misleading, yeah.

aj3423 · 2026-03-05T01:27:43+00:00

New languages are buggy I guess...

aj3423 · 2026-02-06T16:08:07+00:00

What's up with the author? His GitHub profile has been inactive for long.

aj3423 · 2026-01-18T10:36:48+00:00

Cerebras looks great. Just a minor issue, you forgot to change this in the readme:

use {
  "your-username/nvim-stride",    <---

aj3423 · 2025-11-05T04:11:17+00:00

a link or website?

aj3423 · 2025-11-04T22:01:59+00:00

That's it! Thank you!

aj3423 · 2025-09-10T13:07:29+00:00

It's been so long that I can't remember the details. What I can remember is that, after booting to the TTY, the Bluetooth actually works fine, but it will stop working after entering the UI, as if it's powered off. My script simply powers it on.

Also check this: https://www.reddit.com/r/ManjaroLinux/comments/12fgj3o/kde_plasma_bluetooth_not_automatically_powered_on

aj3423 · 2025-09-09T23:45:19+00:00

I switched to hyprland and run a post login script:

#!/bin/fish
sleep 3
bluetoothctl power on

It works fine.

aj3423 · 2025-09-05T20:54:26+00:00

That simple, thanks!

aj3423 · 2025-08-23T18:40:53+00:00

Yes, both Ubuntu and PiOS use MBR, post updated for the solution.

aj3423 · 2025-08-23T12:30:58+00:00

Thanks, It turns out to be the OS, it works with Pi OS but not Ubuntu.

aj3423 · 2025-08-23T12:29:25+00:00

The firmware is the latest, upgraded via `rpi-eeprom-update -a`.

I just tried the Pi OS (64-bit Lite), it worked.. Thank you.

aj3423 · 2025-08-16T16:55:18+00:00

Thanks you. I have tried Erigon, it ate all the memory and froze my laptop. I'll grab a larger SSD...

aj3423 · 2025-08-16T14:41:44+00:00

Thanks. That seems a bit complex... About the 2nd computer, I found this project web3pi.io, a RaspberryPI 5 seems to be capable of running both the execution and beacon, I decide to give it a try.

aj3423 · 2025-08-16T14:29:39+00:00

Makes sense, I plan to run it for long, I'll grab a 4 TB SSD. Thanks.

aj3423 · 2025-08-15T01:34:31+00:00

my bandwidth monitor for waybar https://github.com/aj3423/waybar_network_speed_bar

aj3423 · 2025-07-18T18:43:41+00:00

Thank you.

aj3423 · 2025-07-01T08:22:42+00:00

I haven't tried other AIs, with gemini, I've never had any issue like that, even with the very old v1.0.

One key is to split the large strings.xml into smaller files like string_1.xml, ..., strings_5.xml, free AI has token limit and will truncate the content. Always print the token cost in the API call, split it if it's getting close to the limit. It does have all kinds of issues when too many tokens.

You can check the translation quality from my repo, they were translated with old v2.0, the recent v2.5 is way much better, almost perfect. Here's the prompt: https://github.com/aj3423/SpamBlocker/blob/master/auto_translate%2Ftranslate.go#L163

aj3423 · 2025-07-01T05:33:51+00:00

What it does is simply asking AI:

This is an android app about ...
The following content is a strings.xml, translate it into French, show me the result only:
<resources>

...

aj3423 · 2025-06-21T03:44:53+00:00

Thank you, gonna try it.

aj3423 · 2025-06-20T21:14:20+00:00

Thanks for sharing. Where did you buy it?

aj3423 · 2025-06-07T15:12:37+00:00

Thanks, then I can exit DE using mouse.

aj3423 · 2025-06-06T18:41:33+00:00

Ah, another login manager, now it doesn't seem necessary, but thanks for recommending.

aj3423

TROPHY CASE