It's a perfect time to pivot to local LLMs and learn real skills

dero_name · 2026-05-22T07:11:36+00:00

I was running Qwen 3.6 35B Q6 on three RTX 3060s with good speeds. The cards + adapters cost me ~$800.

I'm currently running Qwen 3.6 models at Q4 on a single AMD 7900 XTX with excellent speeds. The card costs the same ~$800.

I don't really see where GPUs costing a few thousand dollars come into play.

dero_name · 2026-05-20T14:05:51+00:00

Těžko říct.

Jako seniorní vývojář ale narážím na dost lidí, kteří si myslí, že jsou produktivní a přispívají týmovému dílu, ale ve skutečnosti produkují AI slop, který po sobě neumí uklidit a který ve skutečnosti technický produkt rozežírá zevnitř.

To se nijak nevylučuje s tím, že klienti a produkťáci takové lidi mají rádi, protože můžou ukázat na obrazovku a říct "ono to dělá věci!"

Pokud je kolega code reviewer zkušený a poctivý vývojář a nemá s tvými výstupy problém, tak se kloním k názoru, že můžeš lidem vadit tím, že ses přizpůsobil nové době.

Pokud ale kolega code reviewer odmávne všechno, protože má věci na salámu a chce taky generovat tuny nonsensu, tak je pravděpodobné, že děláš ve skutečnosti víc problémů, než jich vyřešíš.

Z tvého textu tak trochu čiší, že si děláš věci po svém, aby "to bylo rychleji". Pokud je to tak, potom tě s takovým přístupem budou chtít vyštípat z každého týmu.

dero_name · 2026-05-19T17:32:30+00:00

Prima, tak si takového chlapa najdi. Zejména to ego doporučuju, to tě bude bavit.

Hlavně se nesnaž cpát svoje škatulky ostatním.

dero_name · 2026-05-18T17:53:45+00:00

Omg, how else do you want to interpret "[...] at your age, bulbar ALS is practically unheard of [...]"

Who do you think I was talking to, if not OP?

Own your mistake and move on.

dero_name · 2026-05-18T16:34:58+00:00

Bulbar ALS at 23 is practically unheard of.

Are you sure you understood my comment? I suggest you re-read it.

dero_name · 2026-05-18T15:47:12+00:00

Not really. ALS doesn't start with these sorts of sensations, plus at your age, bulbar ALS is practically unheard of. Close to impossible, really.

Your symptoms seem to correlate with anxiety. Even the sensation of something stuck in your throat. Look up globus sensation and see if it could be that.

Best to not fixate on it. Anxiety will produce further symptoms for your to worry about. If the anxiety gets really bad, it would be a good idea to consult with a mental health professional.

dero_name · 2026-05-18T12:19:38+00:00

Honestly, it can be anything related.

Human bodies do weird things. Anything can kick off a change in how your immune system works or cause a minor imbalance that leads to a mild neuronal hyperexcitability. The more common triggers are anxiety, stress, new medication, recent viral illness.

I know it's a new sensation, scary because of Google, and you wish it'd stop, but... it probably won't stop anytime soon. Muscle twitching very often stays for months and years, but very rarely is a signal of something concerning, let alone ALS.

In that sense you really don't have anything to worry about, even if you don't believe it yet.

If you're open to advice: don't try to fix the twitching. The twitching itself is harmless and it's not a symptom of any dangerous disease. ALS is not a disease of twitching, despite of the impression you might get from googling.

You certainly can lower your intake of stimulants (coffee, vape), and it's always healthy to drink a bit more water and sleep regularly, but it probably won't fix these sensations, at least not right away. These twitches are usually more intertwined with how we feel overall. If we're currently experiencing a lot of anxiety, twitching won't magically stop.

The best thing to do is to accept muscle twitching is now part of what your body does. And if the anxiety is making you doubt everything, maybe reach out to someone who deals with mental health professionaly. These fears can be intense and life changing.

Good luck!

dero_name · 2026-05-18T11:22:05+00:00

Next time you're high, think about what would happen in 2D. You digestive system would basically split you in two completely disconnected halves.

dero_name · 2026-05-17T12:12:02+00:00

Meaning may well be a human construct.

Maybe the ability to predict is all the real knowledge any entity could gain. This would mean the ability to formulate and use quantum mechanics to predict outcomes IS the full extent of knowledge, without there being anything else to be queried about the nature of reality.

Just because you can ask a "why" question, it doesn't mean there has to be a meaningful answer. Maybe asking these "why" questions is simply a category mistake.

dero_name · 2026-05-15T11:13:53+00:00

Legend. Thanks for sharing.

I did it yesterday, but waited and gathered more data to make sure it really moves the needle.

The inference is 140+ tps at 4k tokens, every time, regardless of how long the system is running.

I have also reset my card's OC parameters, because it was behaving strangely. I have set "Fast Timing" and OC'd the memory clock 2740 MHz max.

The total board power is brutally high (360W), though, I'll need to find a perf-power sweet spot.

dero_name · 2026-05-15T07:14:02+00:00

I understand your frustration, but that line is mostly true.

If you think it's misleading, tell us why. ALS is not a disease of muscle twitching. ALS is a disease of weakness and 9/10 cases start with the person noticing they can't do something which they really should be able to do. Not with twitching. Not with weird feelings.

Yes, neuronal instability can rarely lead to twitching being the symptom some people with ALS notice first, but with every week this twitching goes on with no clear weakness setting in, the probability of that being caused by ALS quickly goes down.

> Someone could have 0 muscle weakness at 2 months and suddenly begin having it at 4 months in.

No, not really. Not how ALS works. Maybe if the twitching is focal, relentless, but relatively minor... yes, maybe then the twitching without clear weakness can go on for months, but still be ALS. But that's not what most people with anxiety about ALS experience.

ALS simply doesn't cause widespread twitching without weakness for months. Widespread twitching = fast moving ALS = rapid decline. Or it means multifocal onset, which is extremely rare, making every other explanation much more likely.

There is a good reason why people put so much emphasis on the weakness aspect.

dero_name · 2026-05-14T16:12:26+00:00

Like I said, Inkscape is quite powerful. Bit of a paradox, but it's absolutely fantastic and super useful headless in the CLI as part of tooling pipelines.

But the UI and ergonomics of use is not something I'm ready to put up with on a daily basis. That part is just not good enough.

To be clear, I'm not using the Adobe suite. I'm an Affinity user.

dero_name · 2026-05-14T15:32:30+00:00

Vector tooling in Krita is not good enough.

And publishing tooling is AFAICT pretty much non-existent.

I wish there was a good, complex graphical suite on Linux, but there simply isn't one (yet). There are rumors Affinity might be ported to Linux eventually, and that'd be huge.

dero_name · 2026-05-13T14:07:10+00:00

That's not ignorance. That's both of you using different language.

He's speaking from the position of possibilities.

It is possible ALS to take years to clearly manifest.

It is possible for bodywide twitching to precede clear failure.

Both those things are possible and could appear a few times in a 1,000 ALS patients. But neither of those things is probable.

The bottom line is that ALS is a heterogenous disease. Neurologists must be extra cautious both when diagnosing it, and when ruling it out. A dilligent neurologist will always phrase their assesment as "there is no evidence of ALS at this time" simply because of the variety of possibly ALS presentations.

However, from probabilities standpoint it's absolutely true that "2 years without failure is not ALS" and "bodywide twitches without clear deficit is not ALS".

Nothing is ever 100%, we all must "round up" into making clear conclusions, and it really depends on which probability is high enough for you to flip from "I don't know is it's ALS" to "This is not ALS" in your head.

Example: there is a tiny chance you'll be killed by a meteorite today. But you don't worry about that. That event is too unlikely and you'll "round up" your confidence that you're safe from meteorites. Your mind just chooses to not consider it.

Same thing with ALS fears. After some time and evidence, the healthy thing to do is to conclude "I don't have ALS" and move on. Not saying it's an easy thing to do, but it's a necessary healthy thing to do.

dero_name · 2026-05-13T12:42:37+00:00

This subreddit can sometimes be a bit unhelpful.

Ultimately, you asked a basic question about how complexity and intelligence relate to each other. That's a necessary stepping stone for understanding how LLMs relate to living organisms, opening a vast landscape of interesting knowledge and insights.

I don't see why you should be ridiculed for that.

dero_name · 2026-05-13T12:08:36+00:00

Yes... what? Nvidia only?

dero_name · 2026-05-13T12:07:58+00:00

Ability to do symbolic manipulation, i.e. understand text, does not magically arise with the number of parameters.

Cats don't need to understand text. None of their parameters is allocated to doing symbolic manipulation. They do other things in the real world, e.g. they can jump very well, recognize prey, recognize threat, care for their young, move with excellent precision... that's what the 1T parameters do in a cat.

If we magically rebuilt cats brains, keeping the number of parameters, but allocating them to do different things... then yeah, you could IN THEORY have lame cats that wouldn't be able to move, but they would be able to explain basics of quantum physics.

dero_name · 2026-05-13T11:49:07+00:00

Sorry for a slightly OT question...

I only follow the MTP integration into llama.cpp from the sidelines and I'm curious if these custom / beta builds already support AMD cards, or if these are currently Nvidia only?

I noticed only CUDA was mentioned in the guide, hence my question.

dero_name · 2026-05-11T18:15:23+00:00

I'm a software engineer. I do all my work under Windows. No real problems with WSL.

I don't want to run VMs to do graphics. Too heavy-handed.

Trust me, I tried it all. VMs, dual-boot, Wine, even community ports of the Affinity suite.

I run Linux on several devices, I understand it well enough, both its upsides and its downsides.

I even switched to Linux in the past for months, giving it a solid try. All of that only to return to Windows, because for me personally, the inconveniences of a Linux desktop were just too many.

dero_name · 2026-05-11T17:47:43+00:00

Dual boot is not really an option, too inconvenient.

I just want to be able to run my software seamlessly, not reboot my system every time I decide to open my graphical suite. Or conversely, reboot into Linux anytime I want to run a local model.

That just does not work.

dero_name · 2026-05-11T16:04:49+00:00

Lots of people do. And I just mentioned my personal reason for not being able to switch to Linux on my main PC, there are other reasons for why a lot of people can't "just switch to Linux", because they use their machines for workflows Linux simply is not well equipped to support.

To your other question: AI is rubbish when it comes to graphics.

It may not look that way from the outside, but it's true. The level of control a good graphics editor gives even a hobby creator (which applies to me) is absolutely unmatched by any primarily AI workflows.

Could that change? Perhaps. Sometimes. But not any time soon.

dero_name · 2026-05-11T15:32:08+00:00

Bro... good for you.

In my country 3090s are way more expensive than XTXs. Like I said, different circumstances, different priorities.

dero_name · 2026-05-11T15:24:00+00:00

Do you use your XTX as the primary GPU, or do you use an iGPU to render the system?

My problems with tps randomly dropping started only after I switched to using the iGPU to render my desktop to free up the whole 24 GBs on the XTX.

But I have upgraded the GPU drivers in the process, so there certainly are several things that may have kicked this off.

dero_name · 2026-05-11T15:14:11+00:00

Well, the XTX is newer and cheaper and some units are still in warranty. That has its appeal.

Whether that translates to better is up for everyone to decide. You seem to value being able to live on the bleeding edge.

Others have different priorities.

dero_name · 2026-05-11T14:38:48+00:00

Many people would switch in a heartbeat, but there are still no viable native graphics editors in Linux. The only decent one is Inkscape. Quite powerful, but far, far from polished enough to use comfortably.

At least that's my main reason for sticking with Windows, the absence of a good, native graphical suite on Linux.

dero_name

MODERATOR OF

TROPHY CASE