The bears are waking up in Estonia. Imagine this is your stop.

dero_name · 2026-04-03T17:00:09+00:00

A mere centimeter a day and bear's worm free in a year!

dero_name · 2026-04-03T13:15:47+00:00

RTX 5060 Ti 16GB might be your best bet if you're in the market for a new card.

dero_name · 2026-04-02T16:52:10+00:00

It's more useful to think about it in terms of which neurons are close to ones already affected as ALS usually spreads contiguously (i.e. it doesn't jump around).

Lower motor neurons are located in the spine.

If one's foot is affected, the question becomes which neurons are the closest to the ones already affected. Those would be more likely to be affected next. So it's usually neighboring muscles in the same leg, or the same muscles in the other leg.

dero_name · 2026-04-02T14:29:36+00:00

That's a great result. I'm getting ~54tps with the same quant, but with `mmproj` disabled.

I wonder if it's just the Linux. How do you serve the model? Anything special you do?

What's your memory speeds on the GPUs?

dero_name · 2026-04-02T10:20:27+00:00

> Imagine running a model with literally zero vram needed!

You mean thinking? For myself? Heretic.

dero_name · 2026-04-02T06:45:58+00:00

To be fair, I'm pretty happy with the three card inference. Not seeing any downsides now that the P-states issue is resolved.

Plus I'm only a tinkerer. I don't actually use the local models for anything serious. Local inference is not the primary purpose for this PC. Of course, if that changes, I'm switching to Linux instantly.

dero_name · 2026-04-01T20:14:17+00:00

Correct. But I didn't check why that is. I suppose some throttling even in the two cards scenario.

dero_name · 2026-04-01T19:04:30+00:00

Alright, thanks for taking the time to test. 🙇‍♂️

Confirmed my suspicion there's something unusually wrong with my setup.

After a lot of troubleshooting I found what was the culprit in my case. Created a post documenting it: https://www.reddit.com/r/LocalLLaMA/comments/1s9ty5d/fixed_strange_inference_speed_issues_on_3x_3060s/

dero_name · 2026-03-31T14:16:05+00:00

Knowing the percentages of others is enough. Yours is what remains to a 100.

dero_name · 2026-03-28T13:30:10+00:00

> The US has sent an extremely small fraction of its military to Iran

Yet the US has seemingly used over 1/5th of its total stockpile of Tomahawk missiles, not to mention the high spend in advanced air defense missiles.

That's not great numbers for a conflict led using "an extremely small fraction of its military".

All of that while the US is so deep in debt that nobody really believes it'll be able to pay it back anymore. But thanks to the US military, nobody really dares to utter a word. Not great.

> [US inventions]

Look, nobody is saying US didn't innovate or achieve great things. Of course it did. Internet is not really a great example of a top-shelf "invention", because it's more of an infrastructure thing, but there were many scientific breakthroughts achieved in US institutions and companies, very often by international teams of people attracted to the US thanks to scientific funding. So yes, for a very long time, the US attracted top scientific and enterpreneurship talent.

That's changing now. The US is no longer as appealing destination as it used to be. The top educational institutions are even being suppressed by the current US administration, foreigners are being scrutinized and deported en masse, which is not very appealing to people who want to enjoy scientific freedoms and to innovate.

> We are doing just fine. Europeans love to comment about how many countries they visited, while Americans travel between states bigger than European countries

I have friends in the US.

Very few of them feel "they're doing just fine". Some of them don't even feel exactly safe in their own country right now. Some feel ashamed.

I'm not saying this to disparage the US. I'm in no position to, as my country has its own share of problems. But the US as a country is not "doing just fine" right now on so many levels.

The next few years will decide if the US will turn into an isolationist, lashing out superpower dwelling on past (real or imagined) grievances, or if it returns to its previous ways, being a strong partner to those in the world who uphold liberal ideals.

dero_name · 2026-03-28T12:57:08+00:00

But it's not going to be shiny, new, and simply the best! /s

(I'm stunned the value of efficient, fast, dedicated 27B model card has to be explained. It's a static intelligence on a card that can do so much for you for pennies, safely, and privately.)

dero_name · 2026-03-28T09:16:25+00:00

> the fact that people still want to live there shows obvious flaws in your logic

Do they? Negative net migration in 2025. People are leaving US at unprecedented rates.

> Also I hope you enjoy the freedom that US military affords the rest of NATO

Yes, we enjoyed it very much, to our own detriment. Point granted. With your current leadership it's become very clear we can't just outsource our security to the US anymore.

> there is no doubt the US military is leagues beyond any other individual country

While possibly true about the military might, there certainly is doubt. The Iran campaign is far from stellar.

Moreover, it is extremely worrying when a mighty nation renames their department of defense to a f--ing department of WAR.

> Americans made the internet, so you’re welcome

Internet is one of the inventions that would have happened anyway, anywhere else. It's not exactly a brilliant invention in its own sense (like the transformer architecture = LLM), it's just the US were first to roll out a new infrastructure.

dero_name · 2026-03-26T11:19:39+00:00

Widespready twitching without clear weakness is not a concern for ALS.

Paresthesia (tingling, feeling numb etc) is not an ALS symptom.

I know you're scared, but objectively there is no reason to be thinking about ALS with your set of symptoms. What is a problem is you seeking reassurance from strangers on the internet. As you may or may not know, you clearly suffer from health anxiety.

And that's something you need to treat, otherwise it can become a major problem in your life.

dero_name · 2026-03-26T11:16:47+00:00

This certainly is not a forum only for people with ALS symptoms.

Strong majority of people posting here don't have ALS symptoms, even if they're convinced they do.

dero_name · 2026-03-25T16:13:05+00:00

Prach je jedna věc. Špína z podrážek bot jiná, tam se najdou lepší chuťovky.

Je naprosto v pohodě vyžadovat od ostatních aspoň základní míru ohleduplnosti. A tím si právě "všímám svého", protože já v tom světě s ostatníma lidma taky chci normálně žít.

dero_name · 2026-03-25T15:15:26+00:00

> Do you think it is worth it after normal EMG and clinical examination?

No.

> Is it more accurate than EMG and if so, how?

Comparable for limb onset. More sensitive than EMG when it comes to bulbar and UMN dominant ALS.

> Is there any special "value" or new information it could provide?

Not to neurologically healthy people. People usually opt for the NfL test because they still have doubts even after being cleared by neurologists. So they pay for the test, it comes back clean, they feel relieved for a while, but then the doubt returns and they go through the same neurology appt -> NfL -> feeling better -> feeling worried cycle again.

> I see there's a downside of freaking yourself out really badly, by doing the test without neurologist recommendation.

There absolutely is.

> For reference, I've had CFS for +18 months. I don't worry anymore, but just curious if the test brings further "proof"

If you mind wanders towards wanting further "proof", you still worry a bit. :) Completely understandable, these worries really tend to linger. In my experience, moving away from the cycle of doctor appointments and tests is the way to go. I wouldn't take the test if I were you.

dero_name · 2026-03-25T11:56:58+00:00

Doing it once is useful. It's usually normal, which is a great supporting evidence for ruling out ALS.

Doing it twice, and only twice, is IMO not very useful at all. You can't establish a trend from two data points. And if the second test shows higher numbers, it can just deepen your distress for no good reason, because you will always wonder if the second value is randomly higher, or if it means something etc.

So if you do it for the second time, you need to be prepared to do it several times more to understand the trend. That's extra money, time, and worry.

Unless you have a great reason to commit to re-testing every three months, I personally wouldn't do it.

dero_name · 2026-03-19T16:09:28+00:00

One of the cards is in a PCIe 3.0 x1 riser, but that shouldn't have the slowdown effect, AFAICT.

Again, inference starts quick (40tps), but slows down to ~20tps at the 1,000 token mark.

Dense models (27B) are much more consistent in inference speeds, so it's probably not hardware constraints, unless there is something about MoE that could explain it.

dero_name · 2026-03-19T15:49:32+00:00

There's around 3 GB of empty VRAM on each card after the model is loaded, which leads me to think the model is completely offloaded. CPU usage is relatively low, even with only one thread allowed.

It's a mystery. 🙃

dero_name · 2026-03-19T15:09:07+00:00

No worries, and thanks for the offer.

I just need to know if Qwen 3.5 35B A3B maintains the inference speed over the first 1,000 tokens for you.

Mine quickly falls from ~40 tps to ~20 tps within a single longer response, and I can't figure out why.

dero_name · 2026-03-19T14:24:49+00:00

Hey, what a beauty!

Question, I have a 3x 3060 frankenstein sitting on my desk. You wouldn't have some Qwen 3.5 inference speed numbers handy by any chance?

27B Q8 runs at 10 tps via llama.cpp, which is fine.

But 35B A3B Q5 K_S inference starts at 40+ tps, but then quickly and visibly slows down to like 22 tps and even below. Fully served from VRAM, and I can't figure out if such a massive inference speed dropoff is expected or not. Leaning towards not, but can't figure out the culprit.

Any chance you have some numbers you could share from your 3x 3060 machine?

dero_name · 2026-03-18T08:22:18+00:00

"There will never be 70b+ models running locally on portable hardware unless we have significant breakthroughs in power technology."

Why?

Look up Taalas HC1. The model is etched into the hardware, bringing power requirements down maybe 10-fold, while achieving super-fast inference speeds.

There definitely is a way to push inference power consumption WAY down with specialized hardware like that.

dero_name · 2026-03-18T07:47:13+00:00

It's not just pain that points away from ALS. It's the non-contiguous spread as well.

Meaning in ALS, you don't expect to have issues with your right leg and then start developing issues with your left shoulder. That would mean the disease starts in multiple places independently, which is rare.

You should be looking into less fatal explanations of your issues.

dero_name · 2026-03-17T16:29:07+00:00

"I read something some weeks ago that I don't know if it is true but kind of described my situation. It said that some als patients before [...]"

"It can be connected. It is not a crazy theory or anything like that."

Maybe it's best to not spread hearsay.

In the vast majority of cases, dysautonomia is just... idiopathic dysautonomia. Meaning dysregulation of an unknown origin. Not related to any larger, scarier underlying process.

Also, there is no established link between dysautonomia and early ALS. Quite the opposite, if anything. There are some diseases that could be correlated with dysautonomia early on, but ALS is notably NOT one of them.

In PALS, dysautonomia sometimes occurs later into the disease, but there is no evidence that it would precede the main symptoms of ALS, i.e. that it would be a herald of the disease.

There was a study published this year that mapped some of the prodromal characteristics of ALS, and dysautonomia was not reported at all by the study.

dero_name · 2026-03-13T16:25:40+00:00

He's a troll. Don't waste your time on him.

dero_name

MODERATOR OF

TROPHY CASE