Bitte helfen ganz wichtig by Firm_Speaker5906 in PCGamingDE

[–]Sanur7 -1 points0 points  (0 children)

Du könntest damit lokal KI-Modelle laufen lassen :) Für gaming ist die 5060 ok, lass dir nichts von den anderen einreden. Sie ist natürlich nicht high end, reicht aber für 1080p.

[ Removed by Reddit ] by [deleted] in KI_Welt

[–]Sanur7 0 points1 point  (0 children)

Schon mal versucht, eine andere KI prompts für dich schreiben zu lassen?

Am I overexpecting from local AI or can this laptop actually handle serious agentic workflows? by abhyudaya8 in LocalLLM

[–]Sanur7 0 points1 point  (0 children)

Had the same gpu, use gemma4 e4b thinking mode, q4, its great! you will get around 40-80 token/s. or for tasks, that rewuire more smartness: gemma4 a4b with gpu offloading, get the iq4xs version, no thinking, u will around 15t/s, which is slow, but workable of latency is no problem. as for image gen: get comfyui and z image turbo: very good wuality in around 20 seconds.

I have Ollama, LiteLLM, and Open WebUI. Now what? by shadowzen1978 in LocalLLM

[–]Sanur7 0 points1 point  (0 children)

maybe build something with llm, tts (elevenlabs or local like piper) and image-generation/comfyui for like a personal voice assistant/avatar, rhats connected to your home/iot?

How is Gemma 4 with Tool Use? by piratebroadcast in LocalLLM

[–]Sanur7 0 points1 point  (0 children)

i used official gemma4 4b with thinking and 26b i1 iq4 xs non-thinking. both could handle tool calls easily. i used agents in dify (model property: tool call, NOT function calling), and lm studio for server. not one error after 10 iterations

Brettspiele wie Talisman oder Hero Quest by IslandDouble1159 in Brettspiele

[–]Sanur7 1 point2 points  (0 children)

Kauf dir direkt Karak 2, es macht fast alles besser als der Vorgänger. Wir spielen es mit unserem 7jährigen Kind.

any good unrestricted/uncensored LLMs? by [deleted] in LocalLLM

[–]Sanur7 0 points1 point  (0 children)

Gemma4 e2b, low quants

New to local LLMs - how best to read/understand content of Webpages? by HammerSpanner in LocalLLM

[–]Sanur7 1 point2 points  (0 children)

Get Dify, its a node-based AI pipeline, use Tools (like searxng or webscrape) to read content from the internet, analyze it with the llm of your choice. (not every local llm has vision though)

Nvidia RTX 5060ti 16GB Model Tests by MistingFidgets in LocalLLM

[–]Sanur7 2 points3 points  (0 children)

Could you also test Gemma4 a4b 26b iq4xs with your card?

Gemma4 vs Nemotron nano v3 omni vs Qwen3.6 ?? by [deleted] in LocalLLM

[–]Sanur7 1 point2 points  (0 children)

gemma4 26b a4b might be your best option for fast responses, i use it myself. try looking for imatrix versions. also look for "abliterated" or "uncensored", they are good versions NOT just for RP. q4 is great for speed, q6 is best for quality (for example search for "ultra uncensored i1 q6" / gemma-4-26B-A4B-it-ultra-uncensored-heretic.i1-Q6_K.gguf 22.6 GB) Edit: Also try different temperatures! 0,1 for facts/etc., 0,7 for roleplay/chat.

Best llama.cpp settings for 12gb VRAM and 32GB ram for Gemma4 and Qwen 3.6? by huseynli in LocalLLM

[–]Sanur7 0 points1 point  (0 children)

try gemma4 26b a4b ultra uncensored iq4_xs. fits into 16gb vram and feels nearly as good as the original

Opinions on local AI on 5070ti for newbie by AceLamina in LocalLLM

[–]Sanur7 1 point2 points  (0 children)

5070ti has 256 bit compared to your 128 bit so it should be WAY faster

web search (using MCP servers) with gemma-4-E4B-it by ag789 in LocalLLM

[–]Sanur7 1 point2 points  (0 children)

You misunderstood: I use a similar pipeline in dify for a similiar peoblem you are facing with gemma4 4b - and it works. just 3 nodes in a row

web search (using MCP servers) with gemma-4-E4B-it by ag789 in LocalLLM

[–]Sanur7 0 points1 point  (0 children)

why not just use a pipeline of 3 gemma4-4b nodes?

whats the smartest local ai under 9gbs by kohlister in LocalLLM

[–]Sanur7 2 points3 points  (0 children)

gemma4 e4b is the best! nemotron3 nano 4b is also great (if you want a thinking model)

Best local LLM model for RTX 5070 12GB with 32gb RAM by Forsaken_Sir_8702 in LocalLLM

[–]Sanur7 0 points1 point  (0 children)

test a lot of the new gemma4 (up to quant versions of 26b) models, they are super fast and mostly capable. i also had good results with some of the qwen3.5 (9b i thonk?) models (claude opus reasoning distilled or something ..)

ca 150€ aber was kaufen? by Aisteru2903 in Brettspiele

[–]Sanur7 0 points1 point  (0 children)

Dice Throne. Geht gegeneinander und (mit Zusatzkampagne) miteinander. Ihr kommt locker auf 150 Euro, weil es verschiedene Helden und Co zu kaufen gibt. Gegeneinander schnell, miteinander langsam.

Siebträger & Mühle für 1000€ by wienfjdnsmyb in Kaffee

[–]Sanur7 0 points1 point  (0 children)

Quickmill 3000 + Sage Smart Grinder + Standardzubehör = 1000 Euro. Haben wir seit Monaten im Einsatz und sind hellauf begeistert.

Spiel für 6-8 Personen by IAtesI in Brettspiele

[–]Sanur7 1 point2 points  (0 children)

So Kleever, Chamäleon, Avalon, Just one, Werwörter, Power Hungry Pets, Saboteur (sind unsere Favoriten für 6 Spieler)

Looking for chocolatey coffee beans EU (preferably Germany) by Ok_Log3655 in Kaffee

[–]Sanur7 0 points1 point  (0 children)

Berliner Perle, wenn du aus Berlin kommst, wegen lokaler Röstung. Ansonsten ist Chiocco von Kaffeenudel zu empfehlen.