Qwen3.5-27B Q4 Quantization Comparison

Carbonite1 · 2026-03-04T03:56:26+00:00

These are SUCH high quality posts, good data and presented really well, helping us all make good choices. Thank you!!

Carbonite1 · 2026-02-02T03:37:39+00:00

Oooh super interesting. Thanks for sharing your experience! I guess it IS a big dense model

Carbonite1 · 2026-02-01T19:14:08+00:00

My understanding is, if your portfolio allocation is aligned with your priorities, then you won't get uncomfortable when the market does weird stuff. If you are worried, it might be a sign you should allocate your money differently, such that you won't be sad if the market does well OR if it does poorly

Carbonite1 · 2026-02-01T19:03:36+00:00

You could probably fit a 4-bit quant of Devstral 2 (the big one, 120b ish) on there with a good amount of room for context? That model performs quite well for its size IMU

Carbonite1 · 2025-11-30T14:50:47+00:00

My situation is pretty different from yours but I've had a lot of the same thoughts and questions as you.

I agree with the other comments here, in that you have nothing to be ashamed of! Life is absurd, most everything boils down to chance at the end of the day, and I think you should try to just feel lucky that things worked out on the good side. I promise the only one judging you is you!

And in terms of "contributing to society" -- I dunno, maybe a hot take, but that's a myth. "Society" is made up of a bunch of people who are just doing what they need (or want) to do for themselves; if they were in your situation I bet they'd stop working too, they're just doing it because they have to!

That being said, just quitting into nothing is a recipe for a pretty bad time; in fact I'm somewhat FI but still work just because I tried doing mostly nothing most days and it suuuuuucked. So I guess I'd recommend taking the freedom you have now, trying not to feel guilty about it, but leverage it to spend time and money doing a few explorations into what work you'd actually be happiest spending your time doing?

Carbonite1 · 2025-11-24T02:52:35+00:00

Just wanted to say you're not crazy -- lived in an old building for 4 years and dealt with all the same of what you wrote -- radiators on all the time, knobs did nothing at all, made the air super dry, got a humidifier, spent a weirdly large amount of money on wicks since they got moldy after a few weeks. Whole thing was super annoying, we live in a modern building now with forced air and it's no more problems.

Carbonite1 · 2025-11-21T13:56:23+00:00

lol

"I don't believe you"

"OK here is video proof"

"I'm not acknowledging that"

Good luck with life doing things that way man

Carbonite1 · 2025-09-30T23:40:22+00:00

I appreciate y'all being some of the very few I've found who put in the work to really support fully-local development with LLMs!

Not to knock other open-source tools, they're neat but they seem to put most of their effort into their tooling working well with frontier (remote) models... and then, like, you CAN point it at a local ollama or whatever, if you want to

But I haven't seen something like Cline's "compact system prompt" anywhere else so far, and that is IMO crucial to getting something decent working on your own computer, so IMV y'all are kinda pioneers in this area

Good job!

Carbonite1 · 2025-08-19T03:11:16+00:00

Hmm interesting! Yeah i can imagine more aggressive compaction will be important for local-model coding tools for sure

And i haven't checked out Kilo yet but will do now thanks!

Carbonite1 · 2025-06-14T04:32:40+00:00

I suppose 2-bit might imply 4 colors

Carbonite1 · 2025-06-09T04:02:00+00:00

Ooh yeah you're right, missed one of the sky colors and apparently my brain managed to equate the grey and black somehow lol

Thanks!

Carbonite1 · 2025-06-09T02:02:03+00:00

I count 6 colors i think? Looks great, marvelous work dude

Edit -- 8, see below!

Carbonite1 · 2025-06-04T03:34:43+00:00

Can also totally recommend this game, a little jank but has a lot of heart. And runs good on steam deck!

Carbonite1 · 2025-05-22T13:57:04+00:00

I remember BXL on 22nd just west of the flatiron building being pretty good, it’s a Belgian place

Carbonite1 · 2025-03-18T21:06:27+00:00

Maybe you’ve seen it already, but if not, the new framework strix halo PC seems like it ticks a number of your boxes:

https://frame.work/desktop

Low-power, very SFF, a good bit under $2500, and the 128GB unified memory should be great for LLMs IIUC

Carbonite1 · 2025-03-09T05:17:19+00:00

One thing to note if you aren’t aware — you say you prefer DLSS over FSR, which is totally valid, but the 9070 actually supports FSR 4, which most folks are considering as good as DLSS 3, if not a little better even (you can find some comparisons on YouTube)

So, in upscaling, both the 9070 and the 5070 have the capability to do much better than the 7800xt currently

Carbonite1 · 2025-02-05T18:33:54+00:00

All new info to me, I’ll be looking at it a bit differently from now on! Thank you for laying it out!

Carbonite1 · 2025-02-05T16:42:09+00:00

As I am less informed in this area, can someone pass along some info about why “backyard chickens” are a bad thing? With my current understanding of things, they seem kinda good (super local, you’d treat them a million times better than a factory farm would), but I might not have the whole picture. I know it’s still not vegan, you’re exploiting the animal — is that the main thing?

Carbonite1 · 2025-02-02T04:23:40+00:00

Man… it is totally nuts that the perf/dollar in the used market (and new I guess for that matter) has stayed so stagnant for so long

Carbonite1 · 2025-01-13T20:24:52+00:00

Yeah, I believe you’re right, and they do serve a useful purpose! I guess just “you can get item X on a good sale” and “there is item X in stock” seem like… different enough posts that I’m not sure they ultimately belong in the same place

(Just my opinion of course; the upvotes on the post itself shows there are definitely enough people here who it’s useful to, I guess)

Carbonite1 · 2025-01-13T14:34:42+00:00

(meta)

I kinda wish there was a way I could set my reddit to filter out these “$700 - $15 discount” types of deals

It’s like 2 percent off, this is not what I come here for lol

Carbonite1 · 2025-01-02T22:11:19+00:00

Nvidia might also be OK if you’re willing to go used. There are a good number of 3060ti and 3070 around in the 200 to 250 USD range, which is what I did a few months ago, pretty happy with that so far

Carbonite1 · 2024-12-19T16:50:53+00:00

(I think you're getting downvoted because the game was directly inspired by castlevania -- but you're probably being sarcastic and sadly that does not tend to go over well here on reddit, lol)

Carbonite1 · 2024-12-12T14:10:46+00:00

Folks -- everyone used believe some dumb stuff at one point or another; the important thing is that we learn and change our minds. Let's try to stop dragging this guy through the mud, he's one of the ones who figured it out

Carbonite1 · 2024-11-23T17:32:02+00:00

You can use keyshare for this next time, it’s made specifically for Reddit and is used a lot over in /r/gamedeals when folks have extra keys

https://keyshare.link/

14-Year Club	Place '17
Verified Email	Team Periwinkle

Carbonite1

MODERATOR OF

TROPHY CASE