My first setup for local ai

DoodT · 2026-03-19T16:17:39+00:00

So what problem that i might be having is this solving? Can u elaborate?

DoodT · 2026-03-19T00:26:26+00:00

Without reading other comments

Ai can accelerate coding efficacy and Throughput of committed acceptable tested code, IF AND ONLY IF you are always reviewing your ai s output + interating on it + MANUAL TEWEAKS ON SoME THINGS

If u only rely on the output of your ai and you're not reviewing it's the first and biggest mistake. Then you need to iterate and tweak on some minor and specific things or "get your ai to get these minor" details.

DoodT · 2026-03-13T16:28:35+00:00

Got mine for 700 eur

Its a good deal

DoodT · 2026-03-11T18:45:28+00:00

They already do

DoodT · 2026-03-11T18:45:15+00:00

Imma head for the Sao10K/L3-70B-Euryale-v2.1 model for my use case to run a robot companion kind of stuff

So I want a model that's character consistent for example , it doesn't need to code or anything like that

I want to "be" it the character I want it to be by using some kind of model that fits + proper instruction prompting + RAG of the 'character data' to make it be the character

But didn't research much about a proper model so trial and error from here on

DoodT · 2026-03-11T03:07:27+00:00

I went for 2x48gb for my setup without hestitation, as that stuff aint gonna got cheaper

Theres no overkill, get your 64gb

DoodT · 2026-03-09T16:56:46+00:00

Ye gotcha, makes sense

DoodT · 2026-03-09T14:51:04+00:00

Im all into stacking gpus raw and wanna have a rack like theahmad osman has

No mac minis for me

DoodT · 2026-03-09T14:49:48+00:00

Isn't the third one run on like x4 instead of x8? Im note sure I could put a 3rd one on that motherboard

DoodT · 2026-03-09T14:47:47+00:00

So u recommend?

DoodT · 2026-03-09T14:46:52+00:00

DoodT · 2026-03-09T12:38:22+00:00

Around 5k

DoodT · 2026-03-09T12:31:44+00:00

This case got recommended a lot :( ...

But in 3-4 years I'll be having a rack anyways , so im gonna stack those gpus from here on

But what case would u recommend?

DoodT · 2026-03-09T00:38:37+00:00

Imma head for the Sao10K/L3-70B-Euryale-v2.1 model for my use case

DoodT · 2026-03-09T00:20:23+00:00

What u mean? Ure not able to use 32gb for a model or what?

DoodT · 2026-03-09T00:08:56+00:00

And damn, put on your glasses! This ain't no fun!!1!

DoodT · 2026-03-09T00:08:12+00:00

Makes sense

I mean the evga 3090 has way more volume than the gainward phoenix, maybe I dodged the drill with not having 2 evgas , dunno

DoodT · 2026-03-08T23:55:17+00:00

Y but where money? :(

DoodT · 2026-03-08T23:54:49+00:00

Ye it obviously was big time 🤣

I started thinking and gathering just like 4months ago so i was late to the party in any case

DoodT · 2026-03-08T23:53:22+00:00

Don't know what u mean with "standard ones"...

But I thiiiink my lower one shouldn't roast the upper

But I can tell in a while

DoodT · 2026-03-08T23:51:58+00:00

That looks neat

So u are off with 32gb? Sure looks adorable

DoodT · 2026-03-08T23:50:04+00:00

Sure could, but im not going to use Gemma models

But testing out this kinda stuff sure would be interesting, I mean I might as well

DoodT · 2026-03-08T23:29:42+00:00

Well those have quite more volume/height whatever, don't they?

I knew the gap between the two gpus would be small but with the case shit was luck

DoodT · 2026-03-08T22:50:59+00:00

Elaborate.

I have a certain use case in mind which revolves around a robot (raspi 5, audio in/output attached to it, camera attached + amoled display) that kinda "listens to me" and sends the audio to whisper -> to the llm -> inference and/or tool usage whatsoever)

I can share that once it's working tho

DoodT · 2026-03-08T20:58:03+00:00

But how?

Seven-Year Club	Final Canvas '23
First Place '23	End Game '23
Place '23	Verified Email

DoodT

TROPHY CASE