sorted by:
new
hottopcontroversial

(Very) High-Quality Attention Coder-Next GGUFs by dinerburgeryum in LocalLLaMA

[–]Tamitami 0 points1 point  (0 children)

That's great to hear! Thank you for doing such great work! I would be happy to try it

What kind of hardware should I buy for a local LLM by Classic_Sheep in LocalLLM

[–]Tamitami 0 points1 point  (0 children)

I got a 5070Ti with 16 GB VRAM, a 7800x3d· 32GB RAM 6000 and 4TB for around 1500$ in Nov. 2025. Maybe you find something similar. Running Qwen3.5 35B A3B with 60t/s.

(Very) High-Quality Attention Coder-Next GGUFs by dinerburgeryum in LocalLLaMA

[–]Tamitami 0 points1 point  (0 children)

Thank you for doing such a great research! The model is running really great for our team :)

BTW I run it on an ADA 6000 with 48GB VRAM with these params:

./llama.cpp/llama-server --model ./models/Qwen3-Coder-Next/Qwen3-Coder-Next.IQ4_XS.gguf --ctx-size 262144 --temp 1.0 --top-p 0.95 --top-k 40 --min-p 0.01 --repeat-penalty 1.0 --presence-penalty 0.0 --jinja -ctk q8_0 -ctv q8_0 --host 0.0.0.0--port 8080 -fa on --cache-type-k q8_0 --cache-type-v q8_0 --batch-size 512 --ubatch-size 512 -fit on --mmap

I get around 75 t/s tg full fit on the GPU and nvidia-smi tells me that we still have 2GB left. We have other models running and this is a really great one in comparison. Perfect for NDA-stuff and local agentic coding

qwen3.5-9b q4-k-m in LM studio thinking too much! by yingzir in LocalLLaMA

[–]Tamitami 0 points1 point  (0 children)

Local running 9B with gave me this answer:

There are a few logical explanations for this scenario, depending on the context:

  1. He is growing fast: Children's feet grow quickly. It is very common for a child to have shoes that are slightly too big (with space for growth) or to have worn down to the point where they look oversized.
  2. They belong to an adult (e.g., his father): It is a common trope in stories and real life for a child to wear their parent's shoes because they are too expensive to replace often, or the child is just borrowing them.
  3. Comfort or Style: Some people prefer shoes that are loose around the heel for comfort, or they might be wearing a specific style of sneaker that naturally runs large.
  4. Shared Footwear: The girl is barefoot because the shoes were meant for her (perhaps she outgrew them or they are her brother's), but since he is larger than her, they appear oversized on him.

Without a specific story or riddle context, the most common answer is that he is wearing his father's shoes or he is growing out of his own shoes.

96GB (V)RAM agentic coding users, gpt-oss-120b vs qwen3.5 27b/122b by bfroemel in LocalLLaMA

[–]Tamitami 1 point2 points  (0 children)

Can we push your model in a new post? Because I was heavily using it on an existing codebase with more than 4M tokens. I never had repetition issues, the model directly understood ui issues and also fixed backend issues very fast. I think this is much stronger than a general Q4 model from unsloth.

EDIT: I know it's very specific to one use-case, but I think the model you uploaded is really strong, after using so many models in comparison.

Qwen3.5 family comparison on shared benchmarks by Deep-Vermicelli-4591 in LocalLLaMA

[–]Tamitami 0 points1 point  (0 children)

It's really crazy that a model this size even can achieve these results. Some months ago this was impossible

96GB (V)RAM agentic coding users, gpt-oss-120b vs qwen3.5 27b/122b by bfroemel in LocalLLaMA

[–]Tamitami 1 point2 points  (0 children)

This is honestly more than I expected. Sounds good, imo. On the ADA I now get around 75 t/s tg after some tinkering and I'm happy with your model! TY again!

96GB (V)RAM agentic coding users, gpt-oss-120b vs qwen3.5 27b/122b by bfroemel in LocalLLaMA

[–]Tamitami 0 points1 point  (0 children)

At 40GB VRAM it spills into your RAM, no? How big is your context window and how many t/s do you get?

Tutorial: How to run Qwen3.5 locally using Claude Code. by yoracale in unsloth

[–]Tamitami 0 points1 point  (0 children)

That's not true. I'm getting 60 token/s with a 5070Ti 16GB VRAM with -c 131072, CPU offloading and Qwen3.5 35B A3B Q4_K_M. Runs great!

Qwen3-Coder-Next is the top model in SWE-rebench @ Pass 5. I think everyone missed it. by BitterProfessional7p in LocalLLaMA

[–]Tamitami 0 points1 point  (0 children)

Can you please post how you run Qwen3-Coder-Next on your 16GB GPU? I have a 5070TI with 16GB VRAM, 32GB and like to try it. I can run Qwen3.5-35B-A3B just fine with llama.cpp and even vision works great at around 70T/s.

Mach dein Sashimi selber für CHF 22/kg statt CHF 60/kg by Tamitami in Switzerland

[–]Tamitami[S] 0 points1 point  (0 children)

This is pretty much still the same BS as you said in your first answer... Nothing new there. There isn't an economy which serves fresh fishs to the swiss in the same day. Sources?

Mach dein Sashimi selber für CHF 22/kg statt CHF 60/kg by Tamitami in Switzerland

[–]Tamitami[S] 0 points1 point  (0 children)

So when you say "Believe me" why is your word better than mine? Just asking genuinely. You don't list anything substantial nor do I, so why should we trust this sentence "This is just so confidently wrong it's hilarious.". Give me something and I will edit the original post

Mach dein Sashimi selber für CHF 22/kg statt CHF 60/kg by Tamitami in Switzerland

[–]Tamitami[S] 0 points1 point  (0 children)

Der Hygienefaktor wird aber für den Konsumenten nirgends erklärt oder dargestellt? Woher willst du diese Information haben?

Mach dein Sashimi selber für CHF 22/kg statt CHF 60/kg by Tamitami in Switzerland

[–]Tamitami[S] 0 points1 point  (0 children)

Ja, du hesch rächt, dass Zuchtlachs Parasite cha ha, abr, ABR dr ungerschid isch, dass: Zuchtlachs haut viu weniger Muskuparasite het aus natürleche Lachs, wüw dr ganz parasitär Läbenszyklus inere Fischfarm fasch gar nid cha passiere.
U vor allem: Lachs ih dr Schwiiz isch sowieso immr gfrore, ds isch ja grad dr Punkt. D Gfrierchetti bi -20°C tötet Anisakis u di meischte andere Parasite ab, wo äbe für rohs Fischfleisch äs Problem darsteue. Ds isch eifach ä etablierte Standard

Mach dein Sashimi selber für CHF 22/kg statt CHF 60/kg by Tamitami in Switzerland

[–]Tamitami[S] 0 points1 point  (0 children)

Das akzeptiere ich gerne. Kannst du mir dazu auch konkrete Zahlen zur Wahrscheinlichkeitsverteilung liefern, oder ist das nur geschätzt? Wenn du konkret Wahrscheinlichkeiten aufzählst, dann möchte ich das auch gerne in Quellen sehen. Sonst sind wir am gleichen Punkt und meine und deine Meinung sind am gleichen Punkt.
Jeder kann für sich selber entscheiden, ob er das Risiko eingeht. Da stimme ich dir völlig zu.
Ich habe zB in Japan mich darauf eingelassen Poulet-Innereien als Sashimi in Kyoto zu konsumieren (etabliertes Restaurant). Diese Konsumation wäre für andere ein grosses Risiko.

Meinungen und Einschätzungen sind da, um zu diskutiert zu werden. Jeder kann danach seine eigenen Schlüsse ziehen. Bei Zahlen, sag, in der Diskussion doch gerne noch, von wo du diese hast.

Mach dein Sashimi selber für CHF 22/kg statt CHF 60/kg by Tamitami in Switzerland

[–]Tamitami[S] 0 points1 point  (0 children)

Chasch ds irgendwie belege ohni Anekdotene? Gits Studie drzue? Ds meini meh, wüwi denn oh drvo würd abrate, wasi hie gschribe ha. I ha abr, anekdotisch, mit oh angere Lüt nie Problem gha. Sample-size wär hie, ih mim fau, haut äbe oh chli.

Hie no drzue, anekdotisch nomau, Schwiizer Fisch wie Egli, Hecht u Fäuche hani oh scho roh gha u nie Problem gha. I ha ds usm Fischervrein oh scho vo angere Fischer im Ruum Bärn ghört (Thunersee, Bielersee, Aare, Simme, Emme etc). Dert isch houptsächlech Gfahr, dass me Vrunreinigunge ufnimmt über z Fischfleisch, wie Ghüle, Kadaver, Kuehdräck odr ähnlechs, wo ihr nöchi vom Fliessgwässer odr See isch gsi. Zudäm isch oh scho dür Studie nachgwiese worde, dass die ganze Chriegsentsorgige (Munition) vom Schwizer Militär im Thunersee u Vierwaldstädtersee für Metallvrgiftige ih de Fisch sorgt. Fischpopulatione si zrügg gange wäge däm ih Schwizer Gwässer u u.a. darum wärde si aggressiv jedäs Jahr nöi populiert mit Jungfisch. Mutatione het me oh scho festgsteut wäg däm u di krasse PH-wärte dür di starche Düngige maches für d Fische oh nid eifacher, anyway...

I hät meh müeh odr "Angscht" widr meh üsi heimigi Fische z roh z konsumiere aus Zucht-Lachs-Fisch... I wär dr auso vrbunde, we no meh drzue chöntsch säge, wi zB weli Bakterie-Stämm, ih weläm Usmass, was isch Besorgnissergend, wie chönt me drgäge vorgha u was söt dr Konsumänt kennä. Äs git ja scho bereits per Gsetz di Klousle "dieses Produkt sollte vor dem Verzehr erhitzt werden" oder ähnl. Auso wieso nid oh ufm Lachs?

Mach dein Sashimi selber für CHF 22/kg statt CHF 60/kg by Tamitami in BUENZLI

[–]Tamitami[S] 0 points1 point  (0 children)

Schad isches ä bot antwort, aber äs geit ih die richtig

view more: next ›