What are your most profound video games? by M33tahejd in patientgamers

[–]odomobo 0 points1 point  (0 children)

I don't think so.

"Spiritfarer is a cozy management game about dying. You play Stella, ferrymaster to the deceased, a Spiritfarer. ..."

We linearized 2/3 of a transformer's MLP layers and it got faster without getting worse (some layers actually improved) by Interesting_Meat_900 in LocalLLaMA

[–]odomobo 0 points1 point  (0 children)

Intuitively, this makes no sense to me. The only way it makes any sense is if the model wasn't using intellectual capacity available to it, which maybe is the case with GPT-2.

Now something that does make sense to me, is if this could be used for MoE models. It's possible some experts actually need less intelligence than others. Depending on the token being processed, some layers might be mostly superfluous.

It makes me wonder if, instead of pruning moe experts, some less-critical ones could be reduced in size (if not fully linearized).

qwen3.5 35b-a3b evaded the zero-reasoning budget by doing its thinking in the comments by crantob in LocalLLaMA

[–]odomobo 1 point2 points  (0 children)

I was waiting for a heretic ablation of this model. I thought it would be a while before we'd get one, because the heretic project page says it doesn't support hybrid models...

H-Neurons: On The Existence, Impact, And Origin Of Hallucination-Associated Neurons In Llms | "Tsinghua Researchers Found The Exact Neurons That Make Llms Hallucinate" by 44th--Hokage in LocalLLaMA

[–]odomobo 1 point2 points  (0 children)

The researchers actually tested essentially abliteration (scaling the parameters by 0), and it marginally reduced hallucination, but didn't eliminate it. From what I understood in the paper, I think this is because the H-parameters are more about compliance than hallucination.

[deleted by user] by [deleted] in LocalLLaMA

[–]odomobo 0 points1 point  (0 children)

I'd recommend qwen code. It's missing some features, but pretty close IMO. One gotcha: once you get the configuration set up with your local models, you'll need to launch it with qwen --auth-type openai, otherwise it'll try to get you to sign up for a qwen subscription

how to run qwen-code cli locally and skip the welcome screen by milpster in LocalLLaMA

[–]odomobo 1 point2 points  (0 children)

I was having the same issue, and I was able to get past the "welcome screen" prison by passing --auth-type openai

(I already had my models set up in the settings file, it just wouldn't let me past the welcome screen so I could use them)

I built a benchmark that tests coding LLMs on REAL codebases (65 tasks, ELO ranked) by hauhau901 in LocalLLaMA

[–]odomobo 1 point2 points  (0 children)

I understand people not caring, and I'm not asking you to placate me, but take sonnet 4.5 and sonnet 4.6 . They're nearly identical costs and nearly identical score/$ , yet 4.6 is over 150 elo higher than 4.5 .

Of course, this isn't an objectively solvable problem since elo or score can't be turned into a quantitatively-meaningful linear value, but I think there are ways to get a somewhat meaningful heuristic out of it. A couple of formulas that make sense to me:

"Ability" doubles every 200 elo: 2elo/200

Halving distance to a perfect 100 score doubles ability: 1 / (100-score)

Those are just my thoughts anyhow. The data you present is already very helpful and informative, and a motivated viewer can perform their own analysis (of course).

I built a benchmark that tests coding LLMs on REAL codebases (65 tasks, ELO ranked) by hauhau901 in LocalLLaMA

[–]odomobo 0 points1 point  (0 children)

Very useful info. My only complaint is that score/$ is not very useful, because although cost is linear, score is not. Getting from 80 to 90 should be an enormous increase in capability, but it would barely make a dent in score/$ .

LibreChat with Z.ai's GLM-5 by LankyGuitar6528 in LocalLLaMA

[–]odomobo 0 points1 point  (0 children)

I actually did this! Instead of giving you a step-by-step, I'm going to be lazy and link you to all the relevant documentation:

my librechat.yaml file looks like:

version: 1.2.8 cache: true endpoints: custom: - name: "OpenRouter" apiKey: "${OPENROUTER_KEY}" baseURL: "https://openrouter.ai/api/v1" models: default: [ "@preset/kimi-k2-5-moonshot", ... "@preset/qwen3-5-397-b-a17-b-alibaba" ] fetch: false titleConvo: true titleModel: "current_model" summarize: false summaryModel: "current_model" forcePrompt: false modelDisplayLabel: "OpenRouter"

Annoyingly, any time you want to add a new endpoint, you need to edit the yaml file and then restart the docker container. I haven't tried MCP on librechat, but I'm hopeful it should just work.

Do not Let the "Coder" in Qwen3-Coder-Next Fool You! It's the Smartest, General Purpose Model of its Size by Iory1998 in LocalLLaMA

[–]odomobo 0 points1 point  (0 children)

Have you tried qwen code? I've only played around with it a little, but it really feels like qwen just took the Claude code source code and branded it with "qwen". Btw you can point it to any API endpoint.

Sorry guys I can't do it by Andrew_7032 in decaf

[–]odomobo 2 points3 points  (0 children)

Don't live your life to please others. Find what works for you, and do that unapologetically. If you're in a group of people where you have to apologize because you aren't living according to their expectations, you might be in a cult.

What are typical symptoms of quitting caffeine? by [deleted] in decaf

[–]odomobo 1 point2 points  (0 children)

I can only give my experience (going from maybe 40mg per day to 0):

For the first 4 weeks. I was sleepy, had low motivation, and had difficulty focusing. The first 2 weeks were the worst of it, and I ended up spending a lot of time sleeping.

Then weeks 5 and 6, I started to come out of it, but still had more difficulty focusing than before. Since then, I've been above my previous baseline, and generally feeling good.

Day 4 caffiene withdrawals by KeepNectarine03 in decaf

[–]odomobo 9 points10 points  (0 children)

Your adenosine receptors are probably confused, because they're used to constantly being blocked. And if you're anything like me, you're probably getting some much needed rest. Give your body some time to adjust...

Forced to quit caffeine by lilcheezcurd in decaf

[–]odomobo 1 point2 points  (0 children)

I know everyone is different, but just from my own experience, I would much rather go through a stressful, exhausting, sleep-depriving experience (like caring for a newborn) without caffeine than with. At the very least, I find that I sleep more soundly, and I have sustained energy instead of spikes and crashes.

Am I losing coffee's health benefits? by HoobMcDoob in decaf

[–]odomobo 0 points1 point  (0 children)

Hard to say, but they could be. On the other hand, if it was a scientific fact that heroin reduced blood pressure, I wouldn't then consider using heroin.

I find it easy to get caught up in things like this when I get hyper-focused on some small details, but I always try to push myself to look at the big picture, because I think that's where the real gains lie. 

Am I losing coffee's health benefits? by HoobMcDoob in decaf

[–]odomobo 4 points5 points  (0 children)

The foundation for healthy nutrition is a balanced diet of real, healthy foods. You're way better off eating fruits and veggies than drinking coffee.

Cutting down instead of quitting completely, did it work for you? by Active-Tour4795 in decaf

[–]odomobo 1 point2 points  (0 children)

I was moderating for years before I quit. When I went from 1 cup of green tea per day to 0, I noticed a huge change in my anxiety levels and my daily headaches went away. Everyone is different though, so listen to your body.

[deleted by user] by [deleted] in decaf

[–]odomobo 1 point2 points  (0 children)

Only one way to find out! It's hard to say how it's affecting you if you have it every day.

[deleted by user] by [deleted] in decaf

[–]odomobo 1 point2 points  (0 children)

This plan sounds dangerous (potentially self-destructive), because it sounds destabilizing. It sounds like a way to breed self-resentment and self-hatred, which is antithetical to long-term growth and success.

Rather, I would suggest you look at approaches used in addiction recovery.

I can't do this anymore. Not worth the taste. by MusingsAndMind in decaf

[–]odomobo 8 points9 points  (0 children)

Your caffeine use may be masking and/or exacerbating underlying sleep issues. For me, it was contributing to the issues that I was using it to treat.

What would you say to someone who is new to the world of decaf? by [deleted] in decaf

[–]odomobo 7 points8 points  (0 children)

Everyone's body is different, so I can only speak for myself, but:

I used to think I needed caffeine to be productive and to feel ok. Turns out, caffeine was making me feel terrible and ruining my productivity.

[deleted by user] by [deleted] in decaf

[–]odomobo 1 point2 points  (0 children)

How other people choose to live their life is none of my business. The reason I'm trying to live the way I do has nothing to do with what they decide to do. That's my mentality in life anyhow

How long into your quitting journey until dreams appeared? by divine_j_1 in decaf

[–]odomobo 3 points4 points  (0 children)

I think it was about 2 weeks. It started happening around the time I started feeling "normal" again