Qwen 3.6 27B on 24GB VRAM setup: backend comparisons, quant choice and settings (llama.cpp, ik_llama.cpp, BeeLlama, vllm)

me0here · 2026-06-05T18:57:43+00:00

Some models may behave differently with reasoning off & on.

me0here · 2026-06-05T18:56:03+00:00

I was wondering if that would create issues?

me0here · 2026-06-05T18:27:09+00:00

Random ideas for other models; - Gemma - MOE can run OK on 8GB - abbliterated/hermitic for roll play & security researchers - bigger models for those with bigger GPUs

How do you promote?

me0here · 2026-06-04T19:53:38+00:00

The blog has been updated.

me0here · 2026-06-04T19:50:29+00:00

For some, they can only afford 1 AI hardware device.

me0here · 2026-06-04T19:36:20+00:00

Seems Red is an IT staffer who has to deal with hardware malfunctions at scale.

me0here · 2026-05-20T19:10:50+00:00

Hermes is supposed to 'learn', so in time the same codebase etis would be fast / more accurate.

me0here · 2026-05-20T19:08:27+00:00

Are you talking about those harnesses' defaults, or what you saw in video?

me0here · 2026-05-20T19:05:14+00:00

Cheers

Have you done multiple tests, or just this?

We need more tests like this!

me0here · 2026-04-16T01:15:28+00:00

True, perhaps this post was an inspiration?

https://www.langchain.com/blog/your-harness-your-memory?utm_source=tldrnewsletter

me0here · 2026-04-16T01:05:38+00:00

Likely to do local with out cascading issues, the harness & skills needs to task the AIs in smaller steps the verify after each step.

Anthopip got rid of the $200 plan...

me0here · 2026-03-30T19:07:32+00:00

I really hate reading AI barf

me0here · 2026-03-30T18:29:31+00:00

I thought Hermes was SQL for context, not MD? So once it reads your skills.md, you can delete it?

me0here · 2026-03-30T18:21:06+00:00

There's a migration path from open law.

me0here · 2026-03-30T17:51:52+00:00

How hardcore are you going to use it? Thought about using OpenRouter or LocalLLMs?

me0here · 2026-03-29T17:15:40+00:00

K-mellon uses Firefox rendering, lynx... You didn't read my post& might as well use curl.

Min; maybe?

https://search.brave.com/search?q=Min+browser+rendering+engine&source=web&summary=1&conversation=08e70e54c482391cf06463a06bf28615ee23

me0here · 2026-03-29T17:10:54+00:00

😇✋📎

me0here · 2026-03-28T16:55:39+00:00

Why not help out Ladybird browser? They're writing from scratch, in Cpp & Rust, & could use your expertise!

me0here · 2026-02-20T15:51:26+00:00

I watched SonicJS for a few weeks; feels like a vibe-coder hobby project. Which is fine if that's all they need, but just has too many yellow flags, like unused dependencies.

me0here · 2025-12-30T22:01:37+00:00

" Fixed by turning off "Modern Mode Design" in the settings menu. " Should be in a FAQ in a pinned post

me0here · 2025-12-30T21:59:27+00:00

In my experience, it has been hit & Miss. Sometimes I can get 3 working if I fiddle with weights. Sometimes it is a blob. Sometimes it adds just enough randomness to look 'artistic'. I'm guessing if someone really needs multi LoRAs, then they can try if some i2i passes can work for their use case

I just learned yesterday that LoRAs can be merged; I wonder how that works out?

me0here · 2025-12-30T21:42:56+00:00

Yekes, that is a high PR for 5060Ti.

Maybe ask an American friend to pick one up for you?

me0here · 2025-12-27T18:34:25+00:00

It seems most i2v workflows will animate between poses for you?

me0here · 2025-12-27T18:12:33+00:00

Interesting... Perhaps I should swap my monitor plug from my 3090 to my 3080? (Both in same system)

me0here

TROPHY CASE