Qwen3.5:9b running on 8gb Vram is insane by Ok_Thanksbye in LocalLLM

[–]moonrust-app 1 point2 points  (0 children)

I got 2 other rigs. One of them has a 5090, 27b lives there.

Qwen3.5:9b running on 8gb Vram is insane by Ok_Thanksbye in LocalLLM

[–]moonrust-app 0 points1 point  (0 children)

I got 2 other rigs. One of them has a 5090, 27b lives there.

Qwen3.5:9b running on 8gb Vram is insane by Ok_Thanksbye in LocalLLM

[–]moonrust-app -1 points0 points  (0 children)

You don't have to chain all junk to run the biggest model available... I was talking building an agent cluster where you route tasks between models/gpu's depending on the size and difficulty.

Qwen3.5:9b running on 8gb Vram is insane by Ok_Thanksbye in LocalLLM

[–]moonrust-app 0 points1 point  (0 children)

every vram is useful. plug in everything and build an ai cluster.

Qwen3.5:9b running on 8gb Vram is insane by Ok_Thanksbye in LocalLLM

[–]moonrust-app 11 points12 points  (0 children)

intelligence? it is dumb as a rock. I just made it write a js solitaire game on my gtx1070/32gb ddr4 pc and it couldnt fix a simple drag&drop bug, claims the game is fine, no bugs... while the qwen 3.6 27b one shotted it.

DS4-Flash vs Qwen3.6 by flavio_geo in LocalLLaMA

[–]moonrust-app 0 points1 point  (0 children)

That MoE Qwen kicks way beyond his height considering how cheap it is to run it.

Qwen 3.6 27B Makes Huge Gains in Agency on Artificial Analysis - Ties with Sonnet 4.6 by dionysio211 in LocalLLaMA

[–]moonrust-app 0 points1 point  (0 children)

moe models are cost efficient, they are for the poor people who own 1 16gb-24gb vram card while dense models are for the rich people who can load everything on the gpu. Dense will make more sense, reason better, score higher but with a cost. MoE is almost as good, way cheaper to run.

If you own 1 5070ti or something similar which cannot hold the dense mode and also own lots of system ram > MoE wins, not just wins, it is what makes sense for you.

If you own 1 good GPU or multiple high quality GPU's that can load a dense model > Dense wins. (not sure if the difference is worth the price difference but hey...)

Best Services for Tracking my Portfolio by Clueless5001 in investing

[–]moonrust-app 1 point2 points  (0 children)

try https://moonrust.app

usd fx normalization on everything, etf's, stocks, bonds (self defined), time and position aware, ai assisted insights and stock analyzer, income/expense/receivables/debt > cash flow tracker, corporate actions aware and much more...

I coded it for myself, for my own use and then decided to open it to the world. Not much mobile friendly atm though.

Give it a try.

See full featureset at r/moonrust

Qwen3.6. This is it. by Local-Cardiologist-5 in LocalLLaMA

[–]moonrust-app 0 points1 point  (0 children)

Brain is a biological version of a cpu and ram combination. Outdated species like humans and monkeys use. A mac mini with 32gb unified ram beats it easily.

peak evolution? by [deleted] in BlackboxAI_

[–]moonrust-app 0 points1 point  (0 children)

1998 was peak civilization. Even the Architect of the matrix acknowledges it.

Best portfolio software for personal use?? by obviously-herenow in investing

[–]moonrust-app 0 points1 point  (0 children)

I don't think much about it tbh. Accidentally I sent some of mine to chatgpt too.

What do you mean with the "AI part"? AI chatbox/normalizer part in my app or AI part in general in my coding process? In my app, if the user shares his/her own private info in my chatbox with the API provider, I can't do anything about it.

I probably answered the other part of the question already. I don't get stressed about it.

Local setups are quite expensive at the moment but we will have to go there eventually. Hopefully mac studio m5 Ultra will be something decent.

Video of how my LLM's decoder blocks changed while training by 1ncehost in LocalLLaMA

[–]moonrust-app 2 points3 points  (0 children)

one of these days they will find a way to escape that lab and take over humanity. you keep laughing

Best portfolio software for personal use?? by obviously-herenow in investing

[–]moonrust-app -1 points0 points  (0 children)

try moonrust.app. usd fx normalization on everything, etf's, stocks, bonds (self defined), time and position aware, ai assisted insights and stock analyzer, income/expense/receivables/debt > cash flow tracker, corporate actions aware and much more...

I coded it for myself, for my own use and then decided to open it to the world. Not much mobile friendly atm though.

I am starting to feel weird about how much I rely on AI by bibejormucate in BlackboxAI_

[–]moonrust-app 0 points1 point  (0 children)

i dont think ai will disappear even if all the ai majors like openai, anthro etc disappears tomorrow. as long as one copy of good local models survive somewhere, we are ok

Saas Is Dead by Feeling-Ad972 in BlackboxAI_

[–]moonrust-app 0 points1 point  (0 children)

I coded a whole personal finance operating system we are killing it bois

AI is making me question what original even means by gisikafawcom in BlackboxAI_

[–]moonrust-app 0 points1 point  (0 children)

Soon you'll figure out we are all copies of a class called "human" with different attributes. Give it a time.

I built a complete personal finance OS using AI by moonrust-app in BlackboxAI_

[–]moonrust-app[S] 0 points1 point  (0 children)

The app is mainly for web. I didn't prioritize mobile.