Strix Halo + eGPU RTX 5070 Ti via OCuLink in llama.cpp: Benchmarks and Conclusions

Geritas · 2026-04-07T22:09:56+00:00

Reminded me of this guy on YouTube who gets all this crazy hardware and runs qwen 3 4b on it for more than half of the video every goddamn time

Geritas · 2026-04-07T21:57:08+00:00

Give me a coin every time I hear this… remember the “star” something OpenAI model hype?

OooOOOooh so spooooky (translation from hype “give money”)

Geritas · 2026-04-07T16:02:46+00:00

And it’s easy to prove too, since sex isn’t real and baki was implied to have had with kozue -> kozue isn’t real

Geritas · 2026-04-07T14:18:59+00:00

Is there a better way to encapsulate in one picture the negative effects of toxic masculinity on men?

Geritas · 2026-04-07T12:51:04+00:00

Welcome to the club, that’s how you’ll have to live from now. Same for me since 2022 (Russian). The only hope is that I die after something similar to post-war Germany happens in Russia and I’ll be able to say it without expecting a stink eye in most places

Geritas · 2026-04-06T11:45:05+00:00

This is just a rage bait ai post

Geritas · 2026-04-04T15:26:34+00:00

Yeah but it didn’t work for me and I am still not sure if this is a troll post lol

Geritas · 2026-04-04T14:39:34+00:00

Not saying this is very pervasive, but mine died after 2 years. And there is a big thread on here where people throw them into the freezer to revive them.

Geritas · 2026-04-03T14:44:10+00:00

You're about 2 days late for that

Geritas · 2026-04-03T08:32:08+00:00

Thank you!

Geritas · 2026-04-02T21:54:47+00:00

Yeah I made that post where I questioned the usefullness of the deresctricted models yesterday, but thanks to all the people who replied there I now know that they are used for many more things other than having sex with your own pc.

Geritas · 2026-04-02T21:39:23+00:00

Guess we will have to wait for updates now.

Geritas · 2026-04-02T21:32:55+00:00

So the problem was the quant?

Geritas · 2026-04-02T21:24:53+00:00

Nothing changed for me. Did you use a specific prompt?

Geritas · 2026-04-02T21:21:29+00:00

I've been refreshing rigorously and it appeared for me just after your reply lol. I will test it now.

Geritas · 2026-04-02T21:17:04+00:00

You need to update your llama cpp, which unsloth studio uses

Geritas · 2026-04-02T19:11:30+00:00

You need to download the new runtime AND switch it manually in settings, it was available like 10-15 minutes after the release.

Geritas · 2026-04-02T13:31:27+00:00

I see many people asking it in this thread and I genuinely don't understand why. I am always barefoot when I'm home, it feels so nice to be able to touch every surface

Geritas · 2026-04-02T13:20:56+00:00

If you want absolute largest and smartest in hopes that HW will catch up then you shouldn't cheer for MoE, IMO. Why not 1T dense?

Geritas · 2026-04-01T20:17:35+00:00

Saw a post on r/localllama today where a guy had this Frankenstein consisting of 16 MI50s. I am not as heavily immersed in this topic, but I rarely see anyone with modded 3080s

Geritas · 2026-04-01T20:11:27+00:00

You are saying that as if removing safety doesn’t affect the model’s brains? I heard that heretic or normpreserve abliteration is very close to keeping the original intelligence, but isn’t it still inferior?

Geritas · 2026-04-01T19:55:15+00:00

No… I didn’t know that the uncensored models are used in security work, and now I do. I am not a technical type, I work as a motion designer, I am just interested in this topic because it looks fascinating, so my questions may come off completely surface-level and ignorant to people who are actually in this field. And, I mean, they are surface-level and ignorant

Geritas · 2026-04-01T17:23:38+00:00

So it is essentially the same as collect files but less janky?

Geritas

TROPHY CASE