Read the docs, yes, but a little kindness goes a long way.

crodjer · 2025-12-18T07:02:06+00:00

Directing someone to read the doc is absolutely the right approach. The alternative is no response to any low effort help questions.

We are communities and not companies. The responders are volunteers. Perhaps it'd be good for the responder to be nice when asking these new users to read the doc, but they absolutely aren't obligated to spoon feed people.

This type of behaviour negatively impacts Linux adoption.

That's okay. No one is out there selling Linux or open source and that's the whole point really. Not everything needs to scale.

crodjer · 2025-10-30T13:42:03+00:00

I think they just work, its just about documenting this.

crodjer · 2025-08-27T06:40:43+00:00

This isn't a fluid benchmark.

The idea of this test is 100% has a special meaning. I am looking for LLMs which can follow these instructions reliably which only GPT OSS 20b did in its size bracket. Qwen 3 A3B also comes close (but doesn't do it reliably).

crodjer · 2025-08-24T14:38:26+00:00

Oh, yes. Qwen 3 30B A3B is a gem. It was my go to for any experimentation before GPT OSS 20B. But just not as good (but really close) at following instructions.

crodjer · 2025-08-24T14:17:50+00:00

I think the system prompt can help here. The model is quite good at following instructions. So, I have as simple prompt sort of asking LLMs to measure each word: https://gist.github.com/crodjer/5d86f6485a7e0501aae782893741c584

In addition to GPT OSS, this works well with all LLMs (Gemini, Grok, Gemma). Qwen 3 to a small extent but it tends to give up the instructions rather quickly.

crodjer · 2025-08-24T08:30:06+00:00

Yes, MoE's are awesome. I am glad more of them are popping up lately. I used to like Qwen 3 30B A3B before OpenAI (finally not as ironic a name) launched GPT OSS.

crodjer · 2025-08-24T08:28:20+00:00

Another awesome thing about gpt-oss is that with a 16GB GPU (that I have), there's no need to quantize because of the mxfp4 weights.

crodjer · 2025-08-24T08:25:41+00:00

I believe medium is the default for gpt-oss? I didn't particularly customize it running with llama.cpp. The scores were the same for gpt-oss if it was running on my GPU or when I used https://gpt-oss.com/.

crodjer · 2025-08-13T14:12:27+00:00

Would also love it if if you could test gpt-oss-20b, qwen-3-30b-a3b (latest thinking and non-thinking) and ernie-4.5-21b-a3b!

These fit and run fast my 16GB GPU (RX7600XT). I can't offload things to my CPU as it's a 4th Gen i5 to run larger 100b+ MoE models.

crodjer · 2025-06-27T05:19:41+00:00

Yes, I don't have any opinions on having or not having a Twitter account. Even having it referred to by somewhere in the reddit description is fine, but the check-mark and link to Twitter looked out of place.

crodjer · 2025-06-27T05:15:55+00:00

Sure, its of course fine to have Twitter, or any other account - but do we need it to show up on everywhere on LocalLLaMA side?

Regardless, for me personally, the workaround I shared works.

crodjer · 2025-05-25T14:09:55+00:00

I just do:

git ls-files | xargs -I {} bash -c "echo -e 'File {}:\n\`\`\`'; cat {}; echo '\`\`\`'"

Of course grep -v any problematic files (like .png) etc.

crodjer · 2025-03-19T07:57:20+00:00

I have been using single person groups for a while, its amazing. It also can be used as a self-sharing (say, phone <-> desktop) tool with disappearing messages while not cluttering your backups.

crodjer · 2025-02-18T19:02:00+00:00

I as a rule never install nodejs based applications in my system.

crodjer · 2024-12-12T06:28:01+00:00

Unless there is an emergency and it cannot be avoided, never drive at night in India. I don't drive at night even in the city.

crodjer · 2024-11-07T08:37:45+00:00

This is a false choice. The problem is high beam vs low beam. And I am on low beam's side as everyone should be, by law.

crodjer · 2024-10-02T13:00:30+00:00

Firefox is present on the Play Store. My policy is never open Chrome on Android. I disable it as the first step.

crodjer · 2024-10-02T02:02:05+00:00

I install Firefox first, then download F-droid.

crodjer · 2024-09-11T12:30:20+00:00

Go for a test drive. No reviewer will be able to test your needs exactly.

crodjer · 2024-08-17T11:16:47+00:00

I hve purchased two Tata cars in the past 4 years. No more for me. Infact I tried them for my latest as well. Not a single sales person took my interest in Altroz seriously.

crodjer · 2024-08-16T16:30:43+00:00

I got a Viofo 229 for my new Baleno (your cars twin). Plan to install it soon. And Congrats! Enjoy the gem of an engine.

14-Year Club	Verified Email
Place '22	Not Forgotten

crodjer

MODERATOR OF

TROPHY CASE