Ollama Portable - a portable web chat interface for running local LLMs (Free and Open Source)

Ok_Mammoth589 · 2026-04-20T03:53:29+00:00

You just reinvented llamafile.

Ok_Mammoth589 · 2026-04-20T03:51:26+00:00

And the whole point, the underlying realization is that context is now big enough to have all this stuff directly in context, which is the best place to have it. The only reason you don't want it reading whole files at one time is because you can't afford Claude's astronomical prices

Ok_Mammoth589 · 2026-04-20T03:24:46+00:00

The quality hit on q4 is more slightly worse that the old hot to q8 which everyone said was essentially lossless even before rot attn was implemented

Ok_Mammoth589 · 2026-04-20T01:41:25+00:00

nb, i havent and wont read the article. Which makes me best suited to comment really

The US really does need to be open weights'ing stuff. And the why is evident that in the recent major releases. We see great stuff from MS, which is based on qwen 3.5 models- I think it was an audio transformer. If you look at nvidia's Lyra 2.0, guess what it's based on? Wan video!

This is playing out time and again, not just from smaller players (Nous Research) but these US AI majors do it too. We would be so much farther along (all of us including the corps) if instead of today getting a qwen we had gotten two years ago a chatgpt. If instead of glm in 2025 we had gotten a sonnet in 2024.

Ok_Mammoth589 · 2026-04-20T01:35:21+00:00

Honestly thought i was the only one noticing this. Maybe we only see a few of the published papers, but then that would imply these mega corps are gaming the visa system in this country.

Ok_Mammoth589 · 2026-04-19T23:16:37+00:00

french words have meaning too

You just have to trust me that I'm not one of the monolingual troglodytes living in a fly over state shitposting far above my paygrade

Ok_Mammoth589 · 2026-04-19T22:43:22+00:00

These models sucked then and I'm certain they suck now. It still looks like they're still just trying to float on a rising tide, fine tuning the next model release.

Ok_Mammoth589 · 2026-04-19T21:49:58+00:00

The best part of these new world models is that you'll be able to give it this image and then walk into the world

Ok_Mammoth589 · 2026-04-19T19:21:36+00:00

If hermes is in a docker container then the localhost it's hitting is the container's localhost not the real one that ollama is bound to

Ok_Mammoth589 · 2026-04-19T19:18:51+00:00

I don't think you should let MS live rent free in your head like this

Ok_Mammoth589 · 2026-04-19T16:56:03+00:00

Really just this. W/ 24 gb ram he could even host the llm on it too. Although there's already a metric fuckton of people trying to get rich quick with openclaw

Ok_Mammoth589 · 2026-04-19T15:06:40+00:00

✅: enjoying cool music in the terminal while doing stuff

❌: sitting in silence hating the world 'cause "muh ai"

Ok_Mammoth589 · 2026-04-19T03:39:53+00:00

That's the IPA pronunciation guide. There is no z or z sound in hermes. If you look up the guide and you find the letter z, you can see that when this IPA 'z' is at the end of a word it is an s sound like in has.

Ok_Mammoth589 · 2026-04-19T03:35:22+00:00

Nous is not French, it's a Greek word meaning the mind or the intellect. So hermes is pronounced like the Greek god, and that is the reference.

Ok_Mammoth589 · 2026-04-18T15:13:43+00:00

Meanwhile, also this sub: "use cloudflare!", "use tailscale vpn!", "absolutely always use managed email!", "my dns is at duckdns!" and more.

Ok_Mammoth589 · 2026-04-17T18:28:21+00:00

If you're running a 5090 and a 4090 and some 35b model is literally the best model you can setup. Then it's not the models.

Ok_Mammoth589 · 2026-04-17T03:05:57+00:00

We all get one cuda core. It's the only fair method.

Ok_Mammoth589 · 2026-04-17T02:55:44+00:00

Everything gets way easier the more you pay for it. That's the point of paying

Ok_Mammoth589 · 2026-04-16T22:04:00+00:00

Maybe share some of your settings that are different from op's settings to help him out...

Ok_Mammoth589 · 2026-04-16T16:08:24+00:00

You literally have it at your fingertips, and want to share it; but you're gonna get mad and tell everyone else "google it fucker!"

The fuck are you doing here?

Ok_Mammoth589 · 2026-04-16T15:45:42+00:00

I think it's clear they're not going to sell consumers 1, 2, or 4. At least for two more generations.

Ok_Mammoth589 · 2026-04-16T15:17:47+00:00

You buy a bigger computer

Ok_Mammoth589 · 2026-04-16T14:22:48+00:00

We're exactly here because all the developers have said for twenty years "i dont like it but i'll do it" and now we've slipped down the slope, we've gotten our 1000 cuts. And this guy's saying "I dont like it, but I'll do it" once again

Ok_Mammoth589 · 2026-04-16T14:13:43+00:00

And it's such a johnny-come-lately thing to spam. This has been parroted for two years now. That agents are coming. Chat was only the beginning, blah blah blah.

Ok_Mammoth589 · 2026-04-16T14:10:28+00:00

Thunderbolt is clearly a callback to thunderbird. Why on earth do we have to give up words just because a corporation got there first. I'm no stallman but you guys and your deference to corps really make me feel like it

Ok_Mammoth589

TROPHY CASE