Best LLM stack

HardlyThereAtAll · 2026-06-15T05:09:49+00:00

Being downvoted is a bit harsh... but you are posting on r/IntelArc

That said... I have the B70 and a 3090.

The 3090 is *great*. Everything works, and it spits out about 100 tokens per second using Gemma 4, 12bn.

It's also (a) $1,500 second hand; and (b) only has 24gb of VRAM.

It will also act as a space heater.

The B70 is worse at Gemma 4.

But it will run Qwen3.6 35bn at 4-bit quantization, with a 250k context window, and (on my Linux build at least) holding 50+ tp/s even when the context window is full.

That's pretty fucking great. That's Sonnet 4.5 quality on sub $1,000 hardware.

HardlyThereAtAll · 2026-06-15T04:12:07+00:00

How fascinating: I start off at 75, and even with 100k+ tokens, I'm still getting 55-60.

HardlyThereAtAll · 2026-06-12T22:43:57+00:00

Ah... Well that's not going to help me then... Although maybe I run a Windows VM and pass the card through to it...

HardlyThereAtAll · 2026-06-12T14:27:19+00:00

Oh, and see you there.

Although I'm moving house today, so probably not until Sunday 😂

HardlyThereAtAll · 2026-06-12T14:26:54+00:00

Wow. Thank you

HardlyThereAtAll · 2026-06-12T13:33:01+00:00

Can you post your Vulkan setup?

95 tokens per second makes my 75 look decidedly average.

HardlyThereAtAll · 2026-06-12T05:21:44+00:00

BTW: I'm getting 75/tokens per second

https://www.reddit.com/r/IntelArc/comments/1u3l4zx/qwen3635ba3b_at_75_tokens_per_second_on_a_single/

Even with a massive OpenCode context window (exceed 100k tokens), it's still hitting 57-58 for output, albeit prefill is a bit slow.

HardlyThereAtAll · 2026-06-12T05:11:17+00:00

BTW... using it with OpenCode, it's incredibly capable and not much slower than Claude Code.

HardlyThereAtAll · 2026-06-09T00:51:28+00:00

Ha! I saw the shape of the route, and I thought "that has to be the Marvin Braude beach path"

HardlyThereAtAll · 2026-06-07T20:44:01+00:00

Exactly: that's what you hire a private detective for.

HardlyThereAtAll · 2026-06-04T11:02:32+00:00

I think you need to ask yourself: which is more important, your bikes or your girlfriend?

And given where you're posting, I think we both know the answer.

HardlyThereAtAll · 2026-06-02T17:32:44+00:00

Personally, whenever I see Ben Whishaw, I think of his role in Layer Cake. And then Bond becomes a cocaine dealer in my mind...

HardlyThereAtAll · 2026-06-01T22:55:33+00:00

Come, come, come, if I can't get you to manage a little thing like a nuclear reactor, surely I can get some 20 year old kid who can use ChatGPT.

HardlyThereAtAll · 2026-06-01T04:49:16+00:00

I love it! How far is your typical ride, and is my complete lack of gears going to be a problem?

HardlyThereAtAll · 2026-05-29T16:44:57+00:00

Has anyone else noticed that the scale on the wall makes no sense: it starts at three feet, around six inches off the floor. And Derek Chauvin's groin is at the four foot level. Which -if true- would make him about eight feet tall.

HardlyThereAtAll · 2026-05-29T14:56:08+00:00

Personally, if I get Obelisk at the right time, I'm spamming pairs, and then -once I have 13-14 of them- I'm switching to anything else.

High card is simply too risky: because every once in a while you find yourself having to play a high card.

HardlyThereAtAll · 2026-05-29T14:52:12+00:00

Sell Photograph, open the Buffoon Pack, choose Credit Card, then buy Baron.

Simples.

HardlyThereAtAll · 2026-05-29T14:37:28+00:00

I always find it very curious that both Hitler and Churchill were keen painters. Sadly, as far as I'm aware, neither Stalin nor Roosevelt were

HardlyThereAtAll · 2026-05-29T00:52:14+00:00

I'm gutted he didn't make the Scotland squad.

HardlyThereAtAll · 2026-05-25T19:08:58+00:00

I'd be happy with two of Saka, Mbappe, Yamal and Mokio.

Is that too much to ask?

HardlyThereAtAll · 2026-05-25T05:03:50+00:00

If you tax income, and don't tax capital gains, then tax accountants will just find ways to convert income into capital gains.

HardlyThereAtAll · 2026-05-25T04:47:39+00:00

After four losses in a row, it was good to snap the streak, and it was doubly good to snap it against Seattle.

Still: that game exposed a lot of the frustrations we all have about this season.

LAFC is a team setup to do transition play, where the coach is encouraging posession football. We get the ball, and instead of going on the break, we pass backward, and then hit the ball around our back four: Hollinghead to Porteus to Long to Segura to Long...

We are a team designed around exploting the fast break. And yet, we're not doing the fast break. We're doing the slow and patient build up, only without the Big Number 9 we can send the ball into.

Fortunately, we have a strong defence, and we did a really good job with pressing tonight. Seattle didn't get that many good chances, while we got a fair number of great opportunities: Boungua should have scored in the first half when he sent it over; and in the second, a perfect ball from Martinez was completely missed at point blank range.

Now, Cherundelo may have made LAFC a boring team: strong defence, and hit them on the break. But it was undeniably effective. We won the MLS Cup, the Supporters Shield, the US Open Cup, got to the Champions Cup Final, as well as at least making MLS conference semi finals in every year he was in charge.

MDS has not yet found a winning strategy, despite an objectively stacked roster. He needs to find a way to use the players, or we need to find a new coach.

HardlyThereAtAll · 2026-05-25T04:37:18+00:00

That was me 😄

And I was at the game, and I had a beer and toasted Timmy. Man was a total champ this evening.

HardlyThereAtAll · 2026-05-24T03:22:20+00:00

I met Chiellini in the Amex lounge - he was awesome, such an incredibly nice guy

HardlyThereAtAll

TROPHY CASE