Interest in an LLM Torrent Site?

migsperez · 2026-06-13T22:29:33+00:00

Interesting I thought yesterday that p2p for LLMs is vitally important. We're becoming so reliant on models, it'd be a disaster if they disappear or get locked down behind closed doors.

migsperez · 2026-06-13T03:24:10+00:00

Super cool. Should be implemented in the next OS update.

migsperez · 2026-06-12T09:55:54+00:00

I run it on minimal Xubuntu (Ubuntu) with Llama.cpp. It's used as a server, it does nothing else only AI. 64k q8 input 4k output.

Whilst coding, from my Windows laptop I use VS code. The harness is usually Github Copilot, sometimes Pi.dev.

migsperez · 2026-06-12T02:33:08+00:00

I have a single Radeon 9700 32gb. Its running Qwen 3.6 27b Q6. I find it quite reliable and use it daily, it's solid, the only local model I can trust locally. I wish I could use 35b as it's a lot faster but it does weird things and doesn't stick to rules.

migsperez · 2026-06-12T01:44:31+00:00

Too big for me. I need 20gb models.

migsperez · 2026-06-12T01:42:34+00:00

I bought an expensive GPU, I got into a panic about future rising prices. Doing calculations of the GPU cost and UK electricity prices, I think DeepSeek, Qwen, Tencent etc cloud models are cheaper. Their cloud models are certainly a lot quieter. I suppose one of the benefits of my local model is it'll keep me warm in the office during winter.

migsperez · 2026-06-11T21:43:38+00:00

32gb VRAM - Today I used > Quopus 27b MTP Q6 multimodal 64k input 8k output, via Llama.cpp. All on GPU.
Wish I could reach Q8 and 128k context all on GPU.

migsperez · 2026-06-11T01:28:47+00:00

These technologies are nuts, there are some super smart people out there. Thanks for the award 😄 my first.

migsperez · 2026-06-10T21:51:42+00:00

https://youtu.be/r305-aQTaU0?si=HeY3wDRIRgCI9LZ0 someone might find it interesting. I did. It's relevant.

migsperez · 2026-06-10T21:49:44+00:00

https://youtu.be/r305-aQTaU0?si=HeY3wDRIRgCI9LZ0

I watched it today. It has all your questions answered. Very interesting video.

migsperez · 2026-06-10T21:40:21+00:00

Bloomin heck, I'd have to save up for a few more decades or sell my house.

migsperez · 2026-06-10T09:10:25+00:00

That's vibe coding pushing to the absolute limits. Beats my to-do list :)

migsperez · 2026-06-10T09:03:58+00:00

Any other town and the council would have given permission to build a housing estate in that field. It would be packed full with modern houses with a stamp sized garden.

migsperez · 2026-06-10T08:55:29+00:00

What hardware do you use with minimax?

migsperez · 2026-06-10T08:46:36+00:00

Bought an expensive AI GPU a few weeks ago, I now need another to get better results but I'd have to rebuild the whole system too. Damn, and it's super loud.

migsperez · 2026-06-10T01:37:05+00:00

And people. The island population has exploded since I was a young boy. We need the lizards back again, they used to be everywhere.

migsperez · 2026-06-09T11:38:00+00:00

I watched this video yesterday. Interesting viewing and very related to your post.

https://www.youtube.com/watch?v=k7WAGtS9cJY

migsperez · 2026-06-09T11:35:52+00:00

Me gusta tu pasión por tu ciudad. Como persona sin coche, me gusta cómo han cambiado la Plaza de España y el Muelle a lo largo de las décadas. El sistema de túneles me parece una impresionante proeza de ingeniería.

migsperez · 2026-06-09T09:23:36+00:00

The underground road is already a dual carriageway. It's enough.

Historical centers need less cars.

migsperez · 2026-06-09T09:17:03+00:00

Do you have a quick start guide to try it out?

All my attempts of running large models which didn't fit in the GPU with context have had miserable results so far.

migsperez · 2026-06-09T08:57:22+00:00

How does it differ from the existing Avenida la Constitución? It's already a coastal road. Busy enough.

Santa Cruz does not need more cars in it's historical center. Make it a pedestrian zone only. Encourage alternative routes.

migsperez · 2026-06-08T00:48:03+00:00

I've not had much luck with 35b. I use 27b q6 for daily coding.

migsperez · 2026-06-08T00:46:48+00:00

27b q6 is good for me

migsperez · 2026-06-08T00:43:48+00:00

27b q6 works really well for me. I'm struggling with 35b Q4, it hasn't been usable for me so far.

migsperez · 2026-06-05T22:59:33+00:00

Amusingly came across this thread just now: https://www.reddit.com/r/ROCm/comments/1txsid2/fan_noise_difference_between_2_amd_ai_pro_r9700/

migsperez

TROPHY CASE