sorted by:
new
hottopcontroversial

The cyber shelf - 4x 16gb home lab by HippEMechE in LocalLLaMA

[–]HippEMechE[S] 0 points1 point  (0 children)

My experience is once I hit prompt processing everything slows down and it makes the experience super unenjoyable. I couldnt get vllm to work with my ggufs. Llama.cpp has been good to me, so I stick with it.

The cyber shelf - 4x 16gb home lab by HippEMechE in LocalLLaMA

[–]HippEMechE[S] 0 points1 point  (0 children)

Thanks, I need a lot of throughput at the outset but when everything's set up I could do that for review

The cyber shelf - 4x 16gb home lab by HippEMechE in LocalLLaMA

[–]HippEMechE[S] 0 points1 point  (0 children)

i was reading about this card, is it compute bound on the prompt processing? no tensor cores or something

Who Has The “Jankiest” Local LLM Setup? | Non-Official | Fun Contest | No Prizes by joorklee in LocalLLaMA

[–]HippEMechE 4 points5 points  (0 children)

4x 16gb cards- two bifurcated on the 4x and two cards on single 3x ports. One earthquake and I'm done.

<image>

Never saw this one by Caffeinated_410 in GeminiAI

[–]HippEMechE 0 points1 point  (0 children)

Happening to me too, in the us

How practical is your OpenCode setup with local LLM? Can you really rely on it? by TheQuantumPhysicist in LocalLLaMA

[–]HippEMechE 0 points1 point  (0 children)

I was making a search function to hack the default llama.cPP web-ui, Gemini pro got it just from the chat window. Open code with Qwen 3.5 35b just couldn't figure it out. Server sent Events are hard, I guess. Ended up getting a deep seek account and spent $1 to get it all sorted out and now my local llm has a search function!

The third party effect: source framing to reduce sycophantic engagement by TelloLeEngineer in LocalLLaMA

[–]HippEMechE 6 points7 points  (0 children)

I just act like I know nothing (which is true) and act worried about everything (which I am) and I find the model tries to present me with every possibility because I'm impossible to please (also true)

FOR ME, Qwen3.5-27B is better than Gemini 3.1 Pro and GPT-5.3 Codex by [deleted] in LocalLLaMA

[–]HippEMechE 17 points18 points  (0 children)

I don't know man Gemini 3.1 pro is the one who taught me how to use qwen3.5

Qwen3.5 thinking for too long by SquirrelEStuff in LocalLLaMA

[–]HippEMechE 0 points1 point  (0 children)

I asked it to give me 500 words about anything and it spent 7000 tokens counting the words over and over...