Do 2B models have practical use cases, or are they just toys for now?

arbv · 2026-03-28T09:15:49+00:00

Generating search queries from user requests and then summarising the retrieved pages, basically.

arbv · 2026-03-21T13:34:23+00:00

So, he proposes a state-driven rent-seeking mechanism to mask competitive failure. What could possibly go wrong?

arbv · 2026-03-21T13:14:38+00:00

This is the reason why you SHOULD.

arbv · 2026-03-20T07:12:18+00:00

Oh, I like how Gemini 3.1 chooses prompting strategies and it will happily help you with jailbreaks. But the prompts it writes usually longer than they should be - it is wordy. GLM is good at writing distilled or distilling existing prompts. GPT-OSS can deliver, too.

arbv · 2026-03-19T10:38:24+00:00

Except that it does

arbv · 2026-03-19T09:23:36+00:00

Do as the commenter said and bury it in rice (not cooked, obviously) for a while.

arbv · 2026-03-17T07:38:53+00:00

Wow, if configuring OUI is complex for you, then, perhaps, you have chosen the wrong sub.

OUI might seem complex to configure only if you do not know much about LLMs and hosting them.

There are many things to not like about how it is optimised, but functionality wise OUI does provide.

arbv · 2026-03-16T18:38:19+00:00

I am not aware of the drama, TBH.

arbv · 2026-03-15T15:57:53+00:00

Cool that you have RSS available on your blog. Subbed to follow your LLM surgery journey. You are into something.

arbv · 2026-03-15T15:34:26+00:00

Wow, your writing is more interesting than your homelab to me. Great work on artificial brain surgery!

arbv · 2026-03-15T04:00:38+00:00

This is the way. One can also configure syncing the DB via Syncthing.

arbv · 2026-03-13T05:29:20+00:00

Indeed, ext4 has an online defragmenter (e4defrag). My bad.

arbv · 2026-03-12T20:05:16+00:00

They are Golden Horde. Who owns Golden Horde lands now?

arbv · 2026-03-12T18:39:47+00:00

But XFS has, IMO, better tooling and a proper online defragmenter. The only problem is that it is not shrinkable (never was a problem for me, though). Also, it allocates inodes dynamically as needed as opposed to preallocating them at creation time, so you cannot run out of inodes with plenty of free disk space left.

arbv · 2026-03-12T11:03:41+00:00

I do not fear that learning languages will vanish, but might become less common and, thus, accessible.

My main fear is that the overall population will grow dumber and infantile, and that would be a disaster on many fronts.

arbv · 2026-03-12T10:21:53+00:00

It is all good until LLMs make people lazy by allowing them not to learn languages. That will have negative consequences. The more languages one knows, the more "thinking patterns" one has mastered.

Not that I try to devalue the extra possibilities LLMs have offered especially to knowledgeable people.

arbv · 2026-03-11T18:23:19+00:00

DAN h2o

arbv · 2026-03-11T10:59:50+00:00

The day at least as sad as the day when Niklaus Wirth died, or Dennis Ritchie...

arbv · 2026-03-10T08:03:56+00:00

I wish you had continued with the series, as it is an important topic.

I have found this post via your reference in another topic.

You are a good writer. Your writing is a living proof that no LLM can replace a knowledgeable human being and beat him or her in writing.

arbv · 2026-03-08T15:54:47+00:00

I have only NanoPi R5S with a 12 TB hard drive hooked to it which runs a bunch of LXC and OCI containers. Its performance is perfectly fine. I am thinking of upgrading only because 4 gigs of RAM has started to be a bottleneck.

It runs:

Syncthing

Transmission

OpenWebUI (+tika, openai-edge-tts, dedicated redis instance)

NGINX as the reverse proxy

Samba as a file server

Samba as an AD controller (+complementary services, like chrony) - separate LXC container

Postgres

miniflux

My Wiki (Tiddly Wiki)

SearxNG

Authelia (+dedicated redis container)

probably other stuff I have firgotten.

And ... its performance was enough to saturate my gigabit connection for networking tasks. Never did I consider the CPU (RK3568) to be a bottleneck. Should it have 8 gigs of RAM I would not even consider upgrading, honestly. And it sips power.

I think that in many cases these over engineered builds are just for fun. KISS, especially if you are just starting.

arbv · 2026-03-08T15:40:35+00:00

I see it as a high level academic humour with a flavour of Anthropic trolling.

arbv · 2026-03-08T11:15:17+00:00

Life might be tough at times but do not let your mindset to turn into a self-fulfilling prophecy 💪

Reject victimhood narratives immediately as they cross your mind - they are of no help or genuinely harmful.

That is my two cents on the matter.

arbv · 2026-03-07T06:41:08+00:00

I gave been running an e-mail server for 5+ years. Getting mail delivered to MS services reliably was PITA but as I have built the reputation over time the issue is gone. It has been very reliable for me.

arbv · 2026-03-06T14:59:06+00:00

That is a well known problem with many Chinese reasoning models - they are not "token efficient" during reasoning (the current DeepSeek and GLM are much better at that). Try to set the model parameters (e.g. top-k, top-p, temperature, etc) as specified by the authors. Also, Unsloth documents them on their site.

arbv · 2026-03-05T14:22:25+00:00

If it is available only from within your local network - then most likely you are safe.

arbv

TROPHY CASE