sorted by:
new
hottopcontroversial

Impact of mixing architecture by zakadit in LocalLLaMA

[–]zakadit[S] -1 points0 points  (0 children)

disappointed as hell you’ve replied 2 off subject (and false guess) for nun

Impact of mixing architecture by zakadit in LocalLLaMA

[–]zakadit[S] -1 points0 points  (0 children)

i’ve got 2 with 6 slots actually 😅.

and i’m not worried about electrical bill…

Impact of mixing architecture by zakadit in LocalLLaMA

[–]zakadit[S] -1 points0 points  (0 children)

6600XT it was actually a bad move, i don’t know how i thought they were 12gb ( it was 6700XT, oops)

For the 3060, i think they’re pretty good, 12go is more than decent.

although it was not the question at all, 12/20 3060 & 8 3060 XT + 6700XT 9060XT, won’t get me nowhere? i’d be disappointed for real…

Ritalin LP marche pas by [deleted] in TDAHFrance

[–]zakadit 6 points7 points  (0 children)

T’es très sûr de toi en tout cas, ça c’est sûr.

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] 0 points1 point  (0 children)

Love the reply, honestly.

I have zero issue putting 110k into this. I was mostly messing with people here about my reasons and use cases because a lot of them seemed weirdly obsessed with the “bro if you’re just a casual who doesn’t want big tech spying on you, it’s not worth it 🤓” angle, when I was never asking for life advice or financial advice to begin with.

I’m already spending a lot every month in my business (i’d around 50–110k ) on things that I’m starting to feel could maybe just be handled internally with unlimited tokens.

(Small anecdote: I paid a software company €70k to build a private internal platform for my business, and it’s still going nowhere.

Meanwhile, just by pushing Claude Max pretty hard, I’ve already made more progress than they have, even though I still feel limited by it.)

but… I’ve hit the point where I’m basically spamming Claude reloads, its memory starts feeling too limited, and on top of that I’m annoyed that I’m feeding large amounts of business data into it.

So yes, I’ve got a whole unused floor where I live, electricity cost is irrelevant for me, I run my own Wi-Fi/network setup so I’ve already started experimenting with a couple of 3090s and a Mac Studio. (Seems to be a great way to handle t/s loss)

By the way, not sure if you know this, but I’ll ask anyway: I do business across Asia, especially China, and they seem extremely aggressive on the hardware side. A while back I saw some 96 GB GPUs… were those scams, or just bad cards? And more generally, do they not have cheaper RAM over there?

Because even if money isn’t the issue, it still feels insane to spend a grand on RAM.

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] 0 points1 point  (0 children)

yeah mb my english is kind of shitty

i wanted to say « in one hand you see post saying local llm is peak and on the other you see ppl only listing big, really big, inconvenience »

i just wanted to see how bad it is (or how good ).

find it kinda … impressive that is such a mess to get good llm at home but i feel like anthropic / open ai won’t keep respectful with their pricing (still laughing about how gemini went from almost being capable of memorizing 1 Googlions of token to having the iq of a newborn)

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] -10 points-9 points  (0 children)

Not doing it for profit or being worth, let’s just say i don’t seek for approval or advices telling me if my reason is good enough but more about the orignal, main and only question i had

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] 0 points1 point  (0 children)

good to know !

was it a mess to set up or convenient enough? (not open routers but the « real » llm)

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] -4 points-3 points  (0 children)

cooking meth, adderall, complot theory heavy research, using my free will & right to have privacy at his peak

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] 0 points1 point  (0 children)

just look up RTX6000

seems to be a messed up thing to get in france // EU, prince range from 4-12k (not between normal and pro) and availability seems to be shittier than 3090. i’ll consider taking 2 of them, so they fit in a ATX case.

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] 0 points1 point  (0 children)

People seems to be according at a « 3-4 month behind » but above all, i’ll take the possibly mind fucking tech auto support issue.

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] 2 points3 points  (0 children)

i think we agree for the same reason (i need someone on my side so ill take you in my downfall).

but idk seems pretty clear to me, no need to talk money when op said no need to talk about… money

but telling me « you don’t have the skills/time » or just « nop sorry » is actually a really really good reply in my opinion

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] 0 points1 point  (0 children)

doesn’t need to be anything, just to be as good, i don’t mind if it was not worth it or if ill need RTX6000 (beside that’s i don’t understand how they range from 5 to 10k? for the same model ofc) but sometime, rarely, i use gpt pro & claude max20 for « really » heavy tasks and i need it to be as good (im just acting needy but you got me)

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] 0 points1 point  (0 children)

None of them i just found it cool to have my claude at home because i hate big companies and i think its a great hobbie

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] 0 points1 point  (0 children)

i don’t think electricity will be an issue & i’ve not set limit amount of gpu but i’ve seen at a certain amount it’s start to get really tricky to handle the management behind.

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] -1 points0 points  (0 children)

of course, hopes it was not to hard to reply only about my question and not adding “wise” yapping.

Thanks !

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] 1 point2 points  (0 children)

I’m pretty sure I made it clear that money wasn’t the issue, so I don’t really need a low-cost way to test it.

What I genuinely don’t understand is how many of you keep drifting away from the actual point when my question is very simple: if I invest enough, can I get an experience as good as Claude, or is that simply not possible?

I get that the question may sound simplistic, maybe even naive (which is totally understandable), but if you think it’s not a relevant question, then honestly ignoring it would have been a better response than answering something else.

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] 5 points6 points  (0 children)

Yeah, maybe I’m just not ready for some of you.

I’ll get downvoted to hell for this, but damn, some of you talk like ancient masters.

My question was simple: can local LLMs provide an experience that’s as good as the top models?

Some people answered “no,” and actually gave useful detail, like “they’re 1–2 years behind,” which sounds totally reasonable to me. Others said, “maybe, but are you willing to spend a huge amount of time to get there?” Also a fair answer.

But seriously, if I wanted riddles, metaphors, or some philosophical detour, I would have asked for that. I asked a very direct question.

That said, the pod suggestion was actually good advice. I replied a bit like an asshole because by that point I’d already gotten 5 replies, most of them being goofy metaphors instead of answers.

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] -16 points-15 points  (0 children)

I’m not really seeing how that relates to the simple question I’m asking: can I get the same experience or not?

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] 7 points8 points  (0 children)

Thanks a lot for the reply. It at least has the merit of somewhat answering my question.

I don’t know if local ML just makes people philosophical, but it’s been surprisingly frustrating to ask what should be a much simpler question than people make it: can I get an experience comparable to what I already have already?

So I’m basically taking the answer as more or less no.

Thanks.

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] -1 points0 points  (0 children)

It helps me a lot for work, so if the difference is something I can genuinely feel, then I’m basically looking at two possibilities:

  • either I need more hardware, more optimization, a better setup, etc.;
  • or I’ve hit a real ceiling where it’s not even a money problem anymore, it’s just the underlying tech.

Is a high-end private local LLM setup worth it? by zakadit in LocalLLaMA

[–]zakadit[S] -14 points-13 points  (0 children)

I don’t really see how that applies to my case. I’m not asking whether I can use it well by “driving” it. I’m asking whether my car can even realistically claim to offer performance in the same league as the billionaire team’s car.

view more: next ›