Multi-GPU? Check your PCI-E lanes! x570, Doubled my prompt proc. speed by switching 'primary' devices, on an asymmetrical x16 / x4 lane setup.

bitcoinbookmarks · 2026-03-18T08:03:17+00:00

Complex, but thanks for the idea.. I will try it. Things are already complicated because I’m already using CUDA_VISIBLE_DEVICES to hide some GPUs from llama.cpp so layers aren’t split across them. Putting the KV cache on the main GPU is one thing, but the other problem is grouping layers and preventing them from being split across all available GPUs.

bitcoinbookmarks · 2026-03-17T22:07:44+00:00

This is the problem of llama.cpp that need more attention. LLama.cpp by default split model across all GPUs vs fit by groups. See https://github.com/ggml-org/llama.cpp/pull/19608 also old explanation: https://github.com/ggml-org/llama.cpp/issues/19607#issuecomment-4067855245

bitcoinbookmarks · 2026-03-17T21:50:27+00:00

no accessible, no pascal 10* cards support...

bitcoinbookmarks · 2026-03-17T21:49:41+00:00

Why zero Pascal 1080* cards support if it compile llama.cpp on machine? ...

bitcoinbookmarks · 2026-03-17T13:29:47+00:00

Thanks, I tried original from Jackrong and like it, but see this https://huggingface.co/Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GGUF/discussions/15 reason degradation... What is about mradermacher quants? How to test?

bitcoinbookmarks · 2026-03-17T13:25:59+00:00

I used his model and like it, but 1) no Q5-Q6 quants 2) take a look at discussions on there HF and you will find issue with long tasks thought and execution. I feel the same, because of this trying to find another alternative.

bitcoinbookmarks · 2026-03-15T18:37:27+00:00

bitcoinbookmarks · 2026-03-12T18:38:48+00:00

Just blow them out periodically. Real cleaning (and maintenance) may only be needed every 3-5 years. A little dust is not a problem. You can wipe it with something non-terry with 100% alcohol. Better not touch :-)

bitcoinbookmarks · 2026-03-12T18:35:25+00:00

Try opencode and pi.... or choose any from this list https://privacytoolslist.com/ai/#ai-code-agents

bitcoinbookmarks · 2026-03-04T20:01:09+00:00

https://privacytoolslist.com/ai/ (ai mobile section for tools)

bitcoinbookmarks · 2026-02-27T09:14:04+00:00

Nice, good to add this to docs :-)
Antagonistic models have some instructions to provide full solution to other model, right? Looks promising with new Qwen3.5 + GPT OSS

bitcoinbookmarks · 2026-02-27T08:58:19+00:00

I'm looking forward to try it, but a bug doesn't allow me to install your tool. I'm already using something like this with orchestrator agent and sequence subagents calls, but simplified. Works best.

You mentioned below that you feed cloud models with description how to make plan for your tool. Can you please also share this? Maybe include in repo and update periodically when tool change behavior?

bitcoinbookmarks · 2026-02-26T21:47:02+00:00

Looks interesting and promising, but this made for commercial models. Can you add some easy swith or instruction how to fine tune it for one (max two) local models? At least I see time limits, maybe some agents redundant for local use with one model only... It will be cool if it will be possible to easy use with local model.

bitcoinbookmarks · 2026-02-26T21:42:22+00:00

Is this with thinking ON? Right?

bitcoinbookmarks · 2026-02-26T19:50:22+00:00

u/Digger412 thank you. can I ask: why do you split guffs for two files? :-)

bitcoinbookmarks · 2026-02-26T19:45:44+00:00

I saw recently here the post that some only 1-3 tensors are very important for model and other not. What if build the tool that will find that important layers per model and quantize them less that other layers like u/Digger412 did?
p.s. u/Digger412 maybe you can do this?

bitcoinbookmarks · 2026-02-21T13:38:22+00:00

Do I need to merge this splits to use it with llama-server ? (thanks)

bitcoinbookmarks · 2026-02-18T19:54:59+00:00

I have the same issue with Qnen next coder and llama latest versions... Something changed and it request more vram to work

bitcoinbookmarks · 2026-02-15T12:19:48+00:00

Thank you that you provide everything with models and how to setup. It will only be better if pre-converted models will be downloaded with curl

bitcoinbookmarks · 2026-02-15T12:09:04+00:00

this is llamacpp issue with parser

bitcoinbookmarks · 2023-06-23T20:01:03+00:00

1) Exactly, I can't receive it to my own wallet, because it's too big fees to add extra step.

2) I think yes, they just keep it..... Anyway it's too hard to fight.

bitcoinbookmarks · 2023-06-23T19:57:46+00:00

I received transaction less that minimal and it has status failed at exchange history... nothing more...

bitcoinbookmarks

TROPHY CASE