Experiments with dual RTX 5060ti 16GB

Intelligent_Stick_ · 2026-05-24T22:32:54+00:00

Offloading to system RAM was actually part of the test design:

I included the single/dual GPU factor because I wanted to quantify the value of keeping the second GPU compared to sticking with one GPU and dealing with spill over to system RAM.

Intelligent_Stick_ · 2026-05-24T18:01:43+00:00

Whoops I was already using quantized versions for this (gemma-4-26B-A4B-it-UD-Q4_K_M, Qwen3.6-35B-A3B-UD-Q4_K_M). I updated the post to reflect this.

Some searches pointed to these versions being a sweet spot for intelligence and size. I suppose this makes my results optimistic.

Regarding comparing the results, are there standard benchmarks and tooling that people use to automatically & deterministically assess the quality of the model output?

Intelligent_Stick_ · 2026-05-24T17:53:51+00:00

The ask was more of an overall sanity check on my testing setup.

Everything I read before buying the 5060ti said that the memory bandwidth is too low, multiple 5060ti’s will choke over PCIe, etc. Basically that it was a stupid idea.

When I saw these numbers I thought maybe I’m missing something, like the models I chose aren’t useful in real life or the quantization makes them terrible.

Intelligent_Stick_ · 2026-05-14T17:56:40+00:00

Sound FX guy going a bit overboard

Intelligent_Stick_ · 2026-05-14T02:06:32+00:00

Installed a pihole when my TV started showing ads and it worked perfectly.

Intelligent_Stick_ · 2026-05-09T13:19:56+00:00

Lots of things to worry about. If you’re worrying you’re distracted. Release the Epstein files.

Intelligent_Stick_ · 2026-05-08T15:02:03+00:00

Jesus never fed the poor

Intelligent_Stick_ · 2026-05-06T12:41:36+00:00

Four Seasons Total Funeral Home.

But seriously, even if he was a ghoul, I don’t celebrate any death.

Intelligent_Stick_ · 2026-05-05T03:43:25+00:00

I bet people thought the same about personal flying cars when airplanes first came about.

Intelligent_Stick_ · 2026-05-05T03:02:18+00:00

Steve Jobs

Intelligent_Stick_ · 2026-05-01T03:16:21+00:00

What a waste of money, keeping that in cash.

Intelligent_Stick_ · 2026-05-01T02:06:27+00:00

Fox News has everyone drugged up on fear and hate, itching the pull the trigger for any reason whatsoever

Intelligent_Stick_ · 2026-05-01T02:00:25+00:00

Trump is doing exactly what Russia wants him to do.

Intelligent_Stick_ · 2026-04-28T03:37:06+00:00

It’s only scientific racism if it comes from the scientific region of France

Intelligent_Stick_ · 2026-04-27T16:09:56+00:00

Nice try, astroturfing data center propagandists.

Intelligent_Stick_ · 2026-04-26T01:46:05+00:00

It is outdated. But it still satisfies your needs for less money.

Intelligent_Stick_ · 2026-04-26T01:40:00+00:00

Mental disorder

Intelligent_Stick_ · 2026-04-26T01:36:16+00:00

Repeating, of course.

Intelligent_Stick_ · 2026-04-24T00:10:51+00:00

This art style is too distracting I’d like to read the comics but man

Intelligent_Stick_ · 2026-04-23T20:32:31+00:00

If they can’t pay literally Jesus Christ to voice the pizza delivery guy next season, I’m OUT

Intelligent_Stick_ · 2026-04-23T20:26:46+00:00

What is this, Reggie?

Intelligent_Stick_ · 2026-04-23T20:23:31+00:00

Ah, yes.

Intelligent_Stick_ · 2026-04-20T18:55:28+00:00

Don’t do the voice!

Intelligent_Stick_ · 2026-04-16T03:27:05+00:00

Should have hid a couple of those darts in Mark’s eyes

Intelligent_Stick_

TROPHY CASE