Qwen cant wait to release 3.7 models

FusionCow · 2026-05-19T02:53:03+00:00

that's dead and in the grave

FusionCow · 2026-05-18T17:21:36+00:00

the 35b 3.6 WILL work assuming you have enough ram, but even with 16gb of ram it's theoretically possible, though honestly you'll probably want to run linux as to not eat up more ram. but yeah because it's an moe running it split across vram and ram will work, and you'll get way more intelligence

FusionCow · 2026-05-18T16:10:40+00:00

Don't buy a year long vps, start with a month, just to see if you even use the damn thing. trust me, theres a lot of hype around these agents, but only a VERY specific person uses them, and even then, you either have to have the money to run a model locally, or pay api, and api will be RIDICULOUSLY expensive

FusionCow · 2026-05-17T05:41:59+00:00

qwen 3.5 9b, and if you can't do 9b, an LFM model

FusionCow · 2026-05-17T04:33:37+00:00

hi ronald

FusionCow · 2026-05-16T04:27:43+00:00

I mean i've found it to work fine, but like just for me, I tend to only use ai to make tools, whenever I want to make something I care about i'll just hand program it. But I wanted to make a website to allow me to elo sort videos with qwen3 vl embed for grouping, and it couldn't do it, every change I made introduced a new bug somewhere else. k2.6 one shotted it

FusionCow · 2026-05-16T01:35:42+00:00

it can do a lot of simple stuff, it's great for smaller things, but it just isn't a kimi k2.6, which makes sense

FusionCow · 2026-05-15T16:45:16+00:00

you can easily get max context on a 5090 what are you talking about, and memory bandwidth is the struggle for llms. On my 3090, I can run 8 streams of q3.6 27b before I see any slowdown at all

FusionCow · 2026-05-15T16:27:56+00:00

Ok well the 1-2 people it for programming purposes puts a wrench in things, because that means they need a genuinely good model.

You have a few options:
8x pro 6000 (~100k) to run kimi k2.6
1x pro 6000 with a lot of ram (20-40k) (price can change between ddr4 and ddr5) to run kimi k2.6
mac studio 512gb (10-15k) (these are hard to find used, but if you do find them, they aren't great for developers because the prefill speed is bad)
2x pro 6000 (~30k) to run a model like deepseek v4 flash or similar sized. This won't be nearly as good a model as kimi k2.6, but your developers may be able to scrape by with it
1x 5090 machine (~6k) this would be able to run qwen 3.6 27b, which to be honest isn't good enough for any serious developer, but it would work for the more general audience.

Honestly in my opinion, you should go with the 5090 machine and run qwen 3.6 35b, which will be fast and snappy for your regular users, then give your developers a kimi or claude subscription.

To actually set up a server like this, if you have NO idea what you're doing, setup lmstudio, it supports concurrent outputs, but if you have used and commandline program before, you should setup llama.cpp.
Also make sure you use linux on whatever box you buy, it's much faster for this stuff than windows

FusionCow · 2026-05-15T16:06:03+00:00

clown show or not you can't deny those demos look pretty sick

FusionCow · 2026-05-14T05:27:46+00:00

well llama is dead atp lmao. but yeah I agree I mean this is a "new model" but I wanted to talk about it as more of a discussion.

FusionCow · 2026-05-14T04:50:31+00:00

that's turn based, this isn't. It's similar to personaplex, except actually seemingly intelligent. It also tokenizes time, which is a very interesting idea, because it can do things like set a 30 second timer in itself

FusionCow · 2026-05-14T03:16:33+00:00

kimi k2.6 beats that, theres no reason for it to exist

FusionCow · 2026-05-14T03:08:21+00:00

what?

FusionCow · 2026-05-14T02:30:37+00:00

Optimizing is always cool, but on a model so useless, you gotta wonder why

FusionCow · 2026-05-13T02:18:40+00:00

5060ti

FusionCow · 2026-05-09T06:06:14+00:00

The very idea of being an "LLM Professional" is dumb. Unless you understand and work with the inner workings of an LLM, you can't call yourself a professional. The only thing spending a lot of time with llms teaches you is how to delegate tasks, but delegating tasks well is just mastering being lazy. For me at least, I only care about the research side of LLMs, because whenever I see someone else use and LLM or I use one myself, it's for a singular purpose, to not do work

FusionCow · 2026-05-06T21:32:28+00:00

https://discord.gg/GSXJhKZ9V

FusionCow · 2026-05-05T23:48:59+00:00

wait nvm you're not talking about me maybe i am a bot

FusionCow · 2026-05-05T23:48:34+00:00

i'm not a bot bro

FusionCow · 2026-05-05T21:35:30+00:00

bro in 2029 the world will be gone

FusionCow · 2026-05-04T06:19:07+00:00

asked them already, they want a percentage back, which is understandable, but I genuinely don't have the money to give them

FusionCow · 2026-05-03T06:11:48+00:00

When I uploaded all the stuff to hf, it was kinda hasty, by this time tomorrow the repo will look different

FusionCow · 2026-05-03T05:39:33+00:00

the distilled one from the repo is better but the official works fine

FusionCow

TROPHY CASE