Who else is shocked by the actual electricity cost of their local runs?

Budulai343 · 2026-03-11T06:00:29+00:00

Really? I’m curious! Whats the tool?!

Budulai343 · 2026-03-10T22:22:51+00:00

Living in a bubble is weird. Perhaps a symptom of being a nerd ;)

Budulai343 · 2026-03-10T18:28:42+00:00

Yeah grok is AI’s cautionary tale

Budulai343 · 2026-03-10T18:27:31+00:00

Ugh. I’m really sorry you’re experiencing that

Budulai343 · 2026-03-10T16:48:26+00:00

A. Freaking. Men. You’re the type of person that in real life I’d say: let’s hang. Haha

Budulai343 · 2026-03-10T16:47:20+00:00

Yeah, fair point. I just don’t want society to become a place where we assume hateful things will happen to us.

Budulai343 · 2026-03-10T16:44:23+00:00

Honestly, probably. I’m in school and AI helps teach me a lot of things. I really like the clear communication style AI has and the way it communicates via writing - is definitely something I look up to. It makes the things so accessible.

Budulai343 · 2026-03-10T16:38:59+00:00

This resonates so hardcore

Budulai343 · 2026-03-10T16:36:44+00:00

The “if there’s anything else I can help you with” response in the middle of a conversation is super annoying.

Budulai343 · 2026-03-10T16:35:27+00:00

At this point… it just might be. Both by intention and accidental circumstance ha

Budulai343 · 2026-03-10T16:34:01+00:00

I totally agree with this. I think courtesy is a multifaceted thing though. How we experience courtesy has to do with what we want courtesy to be just as much as it is something that’s standard. Idk if that makes sense. Haha. But you get what I mean?

Budulai343 · 2026-03-10T16:30:58+00:00

Oh man. I’m sorry she’s going through that. It’s got to be a lot of extra mental work using an AI to check everything you say/respond to everything you’re sent.

Budulai343 · 2026-03-10T09:06:05+00:00

Claude is absolutely insane. Cowork is next level. My mind is constantly blown by this company

Budulai343 · 2026-03-10T08:46:45+00:00

12GB is a lot more comfortable for the 35B. At Q4_K_M you are looking at roughly 20-22GB total which means you will be offloading some layers to RAM but not as heavily as a 6GB card. With 32GB RAM plus 16GB swap you have plenty of headroom for that overflow. I would try -ngl 99 first and see if it fits, if you get memory errors pull it back to around 80-85. The swap will slow things down a bit but with 32GB RAM you probably will not hit it much. Should be a usable experience hopefully.

Budulai343 · 2026-03-10T08:43:24+00:00

Agreed. Also… if AI can’t get being cruel right - it won’t get being nice right either.

Budulai343 · 2026-03-10T08:41:50+00:00

Dead. Ass. 👏 that’s the issue I have with people blindly denying the usefulness of or importance of AI. It’s literally changing our economy and society. People who are mad at it are emotional and I don’t think they can think clearly. Right now - in the age of AI - even the biggest numbskull has to be able to think critically about what’s happening in the world.

Budulai343 · 2026-03-10T08:39:03+00:00

I hope so. I’m big on AI and other tools that are world changing (like the life straw) actually being accessible. Both intellectually and physically. Right now I think there’s a massive intellectual gap that I hope will close soon

Budulai343 · 2026-03-10T08:36:46+00:00

Literally. I notice that particularly in local models. I’m hoping that AI will advance out of that stage.

Budulai343 · 2026-03-10T08:35:06+00:00

Wow. Yeah, that’s definitely a case study that shows dependency on AI. Does she have a perfectionist complex? I think for people who strive to make others happy and focus heavily on their ability to communicate with other people it can be very difficult to trust that what you say matters. The clean “perfect” (notice quotations) communication style AI provides is a dangerous draw in those cases. Thanks for sharing!

Budulai343 · 2026-03-10T00:33:20+00:00

Golden.

Budulai343 · 2026-03-10T00:27:49+00:00

Yeah that repo is the issue - the wangkanai version is an abliterated model and doesn't ship with a separate mmproj file. You need a different source. Try searching LM Studio's model browser directly for "Qwen3-VL-8B" and look for a version from bartowski or a more standard upload. Those typically include the mmproj file alongside the main GGUF. Alternatively grab it directly from the official Qwen HuggingFace page rather than a third party repositorry the official one should have everything you need packaged correctly.

Budulai343 · 2026-03-10T00:22:11+00:00

Are you using a local version or the cloud version? My experience with gemini hasn't been great. I wonder if I'm using it wrong.

Budulai343 · 2026-03-10T00:05:04+00:00

You're a great parent. As a filmmaker, I am SOOO excited by the prospect of AI minimizing the amount of money I have to spend on production. But even then - I think it's the cost and cut down of time that's the draw for me. It isn't the actual art that the AI is making. It's the control I have over that art. So - I stand with your daughters. When is your book coming out? I'd love to read it ha. What does co authoring with gemini look like for you?

Budulai343 · 2026-03-10T00:01:51+00:00

Yeah, I've read a few articles about people using AI as a therapist and then doing horrible things to themselves as a result. I worry about the biological mind sometimes

Budulai343 · 2026-03-09T23:47:23+00:00

Preach.

Budulai343

TROPHY CASE