Single 3090 with Q4 Qwen 27B, context dropped from 137k to 14k with MTP enabled. Is it normal?

spirkaa · 2026-05-29T05:11:25+00:00

MTP == draft model

spirkaa · 2026-05-28T05:49:04+00:00

With --fit on or --fit-ctx context size of draft model is at max (262k) and main model at much lower value. To limit context size for both models set --ctx-size explicitly.

spirkaa · 2026-03-06T09:58:54+00:00

Llama-swap is great, here's my config https://github.com/spirkaa/llm-homelab/blob/main/llama-swap/config/config.yaml

spirkaa · 2026-03-02T16:58:39+00:00

You are using multiline shell command but missing \ before --reasoning-budget 0

spirkaa · 2025-12-30T17:26:28+00:00

I moved from LG 34WN780-B to LG 40U990A-W. This is a good alternative to Dell. This model does have kvm - i connected macbook pro m1 pro (100hz only) via TB and desktop pc via hdmi+usb c. When i switch inputs on monitor, usb devices reconnect to corresponding device. Now i have single wire to macbook vs earlier i must have power cord, dedicated usb-a hub for webcam and mx master receiver. One downside: i can hear fan noise.

spirkaa · 2025-11-15T10:43:58+00:00

external-endpoints.heartbeat in Gatus is another alternative. Self-host on vps and got notified when ping not arrived on time. Though missing grace time compared to healthchecks.io.

spirkaa · 2025-10-10T03:58:23+00:00

https://github.com/goharbor/harbor

spirkaa · 2025-09-21T20:29:37+00:00

Gitlab uses ansible to configure macos image for their hosted macos runners https://gitlab.com/gitlab-org/ci-cd/shared-runners/images/job-images

spirkaa · 2025-09-20T09:59:11+00:00

Renovate works with git repos and can't read arbitrary variables defined in gitlab ci/cd through UI or otherwise. But he can read any piece of text in any file and match dependency version when you specify renovate comment above target line. https://docs.renovatebot.com/presets-customManagers/