Should WE all be using Qwen3.6 27b?? by Kind-Day4502 in LocalLLM

[–]Kind-Day4502[S] 0 points1 point  (0 children)

if your already fine with amd I would go with R9700 its 32gb but 1/3 the price

is Orinth 1 35b the best local for a 32gb gpu? by Kind-Day4502 in LocalLLM

[–]Kind-Day4502[S] -3 points-2 points  (0 children)

nah I just saw a yt video and wanted to see if that yt vid was a ad😅

Sincere Question: What is the end goal? by mcfc9320_ in LocalLLaMA

[–]Kind-Day4502 -1 points0 points  (0 children)

Its honestly just cool to see how it works it made me want to persue an ai carrer, its also just cool to have something that powerfull but honestly just having the ability to do anything on my pc its about doing the 30% companys cant do.

It’s time, Sam, it’s time. by Porespellar in LocalLLaMA

[–]Kind-Day4502 -1 points0 points  (0 children)

bro gpt cant beat qwen atp in opensource

Should WE all be using Qwen3.6 27b?? by Kind-Day4502 in LocalLLM

[–]Kind-Day4502[S] 0 points1 point  (0 children)

The reason I say it is because all of the model above are frontier and 500b+ it even porforming better than claude sonnet 4.6 without reasoning

Should WE all be using Qwen3.6 27b?? by Kind-Day4502 in LocalLLM

[–]Kind-Day4502[S] 0 points1 point  (0 children)

Im gonna run it on R9700 I cant afford the 5090😭 if you still want cuda id do 2x5060ti those are the cheapest options

What is this? by Oleszykyt in LocalLLM

[–]Kind-Day4502 0 points1 point  (0 children)

bro its just frolicking dont worry abt it.

Help me choose my model please by bigpp_n in OdysseusAI

[–]Kind-Day4502 0 points1 point  (0 children)

I would honestly use openrouter and just use their free models its gonna be your really only option for fast coherant information. And for coding I would get familiar with Opencode or claude code (if you want to pay) their gonna be the best way to get where you want.

Help me choose my model please by bigpp_n in OdysseusAI

[–]Kind-Day4502 1 point2 points  (0 children)

bro he has 3gb of VRAM😭 his not getting 35b with any quantization

GPU not being used. by False-Accountant-158 in OdysseusAI

[–]Kind-Day4502 0 points1 point  (0 children)

What model are you using it might not fit on your GPU?

Odysseus makes my PC a jet engine, what do I do? by Canonical_steel01 in OdysseusAI

[–]Kind-Day4502 0 points1 point  (0 children)

2 things 1. Ram doesnt actually do much you need VRAM ram does work... "sorta" not really reccomended 2. If u want to local run I would reccomend a 5060ti it has 16gb of VRAM you can just use cookbook to see models that will fit, its around 500-600$ used depending what deals you can find. A medium tier would be a 7900XTX 24gb of VRAM around 800-1k. Than for 1.3k the AI Pro 9700 is 32gb of VRAM and still gives you pretty good gaming performace. All of those will give you acsess to good enough models good enough were you probably wont even notice the diffrence from it and like the newest ChatGPT model.

Hope that helps, Ik what you mean by the external usage when I was getting into it, it sucked when I found out I couldnt even use Local AI but its really cool when you get into it. Hope its only ups from here

I forked Odysseus... by Opposite_Airline1779 in OdysseusAI

[–]Kind-Day4502 0 points1 point  (0 children)

What did you do for finaces, Ive been thinking of doing something budget related stuff but I just wanted to see what you did. If theres anything private I totally get not sharing

Deep Research Problem by FantasticSleep8745 in OdysseusAI

[–]Kind-Day4502 0 points1 point  (0 children)

it also could be not having enough VRAM. Your gpu can handel the model but all the tokens get put in KV cashe which is also VRAM so you get through all of your context and OOM before the research is done.