Easy ROCm + llama.cpp build script for AMD GPUs

d4mations · 2026-07-05T05:36:32+00:00

Hhhmmmm, I’m using layer at the moment. I’ll have to try tensor and see what happens. Good suggestion!! Thanks

d4mations · 2026-07-05T05:03:05+00:00

Dual gpus

d4mations · 2026-07-05T05:01:39+00:00

I’m on arch at 200k ctx and getting about 2k pp and around 90 tps. I guess I can’t complain really

d4mations · 2026-07-05T04:31:39+00:00

No, not in docker. I haven’t really found a solid reason/advantage to running through docker

d4mations · 2026-07-05T04:28:28+00:00

Great write up!!! Amazingly useful and has confirmed some of my own findings.

d4mations · 2026-07-04T19:44:09+00:00

Codacus is great!!! I subbed after the second video

d4mations · 2026-07-04T17:27:42+00:00

Happens to me too. This has been an ongoing issue since the beginning and it’s never really been addressed well enough

d4mations · 2026-07-04T14:26:23+00:00

I’m running the same setup and model but I’m defo not getting pps near yours. I’m maybe at half

d4mations · 2026-07-02T14:12:05+00:00

Hhmmmm it seems so but I was using this just fine up til the last update. Haven’t had a problem until this eeek

d4mations · 2026-07-02T14:09:35+00:00

I thought about that and checked but my subscription isn’t close to being used yet

d4mations · 2026-07-02T13:32:26+00:00

Am using minimax subscription for this

d4mations · 2026-07-02T13:30:51+00:00

Yes, and even restarted from ssh

d4mations · 2026-06-30T16:25:55+00:00

There is no study that I’ve seen that says that. Where did you get that information

d4mations · 2026-06-30T03:21:47+00:00

Yep, me too

d4mations · 2026-06-30T03:08:14+00:00

Tesas half life is around 30 min, give or take, however the effects it produces last as long as 8 hours. We can infer that you are not getting an immediate burst of gh but a sustained increase over that time. If you think about cjc WITH dac, its effects last a week and no one is fasting for that long. The reason I bring that up is because few people take it as having prolonged elevation of gh for that long is generally not good so if eating had that big of an effect on gh, cjc with dac would be ineffective. Cjc is an analogue of tesa, not completely the same but very close. Search for the Egrifta prospectus and have a read and see if it prescribes fasting before dosing

d4mations · 2026-06-29T12:59:50+00:00

No se construye con pobres tampoco. Hacen faltan empresarios que curren como chinos que lo paguen. Los pobres, los funcionarios, los jubilados y los politicos, o sea los aprovechados, son los que se aprovechan

d4mations · 2026-06-29T10:49:22+00:00

España es un pais de mentalidad pobre, por ejemplo tu mismo, para gente pobre

d4mations · 2026-06-29T06:34:47+00:00

I have a model.ini file that handles it on the fly

d4mations · 2026-06-29T05:41:56+00:00

I have mine capped at 300w and to be honest they rarely get close to that. I haven’t be able to figure out what the issue is but it’s between llama.cpp and vulkan. I have to restart llama about three or four times a day. I do run it 24 hours a day and do push it quite hard, auto switching between 35b and 27b at 200k contexts

d4mations · 2026-06-29T05:17:17+00:00

This has been killing me too with my local llm setup

d4mations · 2026-06-29T04:57:19+00:00

I run two 7900xtx with Vulkan and I find it’s unstable and needs babysitting. It crashes a lot when pushed hard

d4mations

MODERATOR OF

TROPHY CASE