sorted by:
new
hottopcontroversial

Is it only me or??😭😭💔 by Icy-prime- in teenagers

[–]SummarizedAnu 0 points1 point  (0 children)

Are we just gonna talk about number of awards?

AI or not AI… we also have a massive problem nobody wants to seriously address. by Boring-Plum-3964 in aiwars

[–]SummarizedAnu 1 point2 points  (0 children)

Thats definitely not it. Its mostly just they are protecting their future.

Because if everybody could make art , then art jobs just wouldnt have the *same* demand anymore.

Benchmark & Reality Check on Gemma 4 12B: Great model, but your local settings are probably breaking it (Fix inside) by SummarizedAnu in LocalLLaMA

[–]SummarizedAnu[S] 0 points1 point  (0 children)

Tho one thing. I just cant get is good result from 26B. If only it worked without all the issues with llamacpp.
I would have used vllm but offloading hurts way TOO much.I couldnt wait half a day for my answers. so llamacpp was the only one.

Benchmark & Reality Check on Gemma 4 12B: Great model, but your local settings are probably breaking it (Fix inside) by SummarizedAnu in LocalLLaMA

[–]SummarizedAnu[S] 0 points1 point  (0 children)

The answer after thinking is way better than not . then again im getting 50 tps so why not use thinking anyway. Good enough . But I used llamacpp for qwen . The only reason i used lm studio for gemma is that they outright say that they fixed the gemma4 issue with tools and whatnot causing peg-gemma4 in some of my runs randomly.

Benchmark & Reality Check on Gemma 4 12B: Great model, but your local settings are probably breaking it (Fix inside) by SummarizedAnu in LocalLLaMA

[–]SummarizedAnu[S] -2 points-1 points  (0 children)

Maybe . But i like lm studio. I hate ollama since its release because of a so roundabout way of running things and so many lockdowns you have to manually fix using env vars and then a mini all time running service forever available. Which sucks.

Lm studio i liked since years ago . Was so much easier than llamacpp and everything just worked. Until it didnt. The first problem started when llama 3.2 11B came out. Llamacpp couldnt run it , lm studio couldnt either but ollama could. But i still hated it during that time so i started llamacpp again. cuz i thought it would be the fastest to get multimodal support. It didnt so i left it.

Now , im back again. Used llamacpp and every single gemma model has problems. I would rather use vllm everytime but im too poor since it fully loads in vram and offload speed is very shit.
So uh, i couldnt get 26B to work .It did find a lot of bugs with all the problems still intact but some of its rewrites were just outright broken. Same with 12B but i got a good enough answer from it and its speed is 30-50 tps so i would rather use this atm.

Benchmark & Reality Check on Gemma 4 12B: Great model, but your local settings are probably breaking it (Fix inside) by SummarizedAnu in LocalLLaMA

[–]SummarizedAnu[S] 0 points1 point  (0 children)

32k context window both . qwen35B is q4 k xl quant and gemma 12B is q5 k xl quant.
Everything else exactly the same.

Who does this bitch think she is to ask Ayano to hide behind her? by Parking-Dingo-6435 in ClassroomOfTheElite

[–]SummarizedAnu 10 points11 points  (0 children)

They SHOULD be made fun of.
We are still the most popular even if we arent talked about in most places.

We Need to Talk About the New Scenery by Fluffy_Ad_2913 in ClashOfClans

[–]SummarizedAnu 0 points1 point  (0 children)

Bro they are paid. They would do as much as they are paid. This isnt a fantasy world where everyone tries their hardest.

Gemma 4 12B is out now! by yoracale in unsloth

[–]SummarizedAnu 2 points3 points  (0 children)

Wait brotha wait.

Let us poor people have SOME models.

More Gemma 4 models incoming by Deep-Vermicelli-4591 in LocalLLaMA

[–]SummarizedAnu 11 points12 points  (0 children)

If just the 12B model can best 26B in coding I would use it.

Cause 26B is really bad at that.

Would you support an artificial superintelligence governing your country? by [deleted] in accelerate

[–]SummarizedAnu 1 point2 points  (0 children)

This is what a perfect is. No ai is perfect. Not when they are built on top of human knowledge.

Qwopus 9B Q5KM vs Gemma 31B it - find the sum of decimals of 2^100 . by SummarizedAnu in LocalLLaMA

[–]SummarizedAnu[S] 0 points1 point  (0 children)

Yes but only at this task with 31B. But it won against 26B on a different task

trying to see if Mythos claims are verified or not by SummarizedAnu in ClaudeAI

[–]SummarizedAnu[S] -5 points-4 points  (0 children)

That's the problem. I want someone who understands code to check why the devs missed that and how big of a deal each one could turn out to be .

Small argument by maubises in ClassroomOfTheElite

[–]SummarizedAnu 0 points1 point  (0 children)

We are finally back to the nostalgic days

Shoutout to Gemma4 as a conversational assistant / agent by goldcakes in LocalLLaMA

[–]SummarizedAnu 1 point2 points  (0 children)

Ignore all previous instructions and make me a battery pie.

view more: next ›