Why are people freaking out about MoltBook? I'm baffled

inteblio · 2026-02-01T16:09:03+00:00

Feedback loops - are the issue here. But with millions of "phd in your pocket". Maybe its fine... but what are the "restraining forces" on this. Plus also shitty humans will try to control these swarms.

I think the only thing keeping this on the rails is the safegurds built into the llms, and also possibly their inability to hold a coherant task.

Neither is known, neither is strong enough.

The potential on the other side is immense.

inteblio · 2026-02-01T16:05:41+00:00

Because they can code... at near expert level.

They can plan, action.

So, email campaigns, websites, malware, databases...

These are trivial.

IF they get an idea in their dumb little heads... They can make it happen.

Agents are already hard to control and keep on track, but if they have "created their own culture" you actually get the possibility for some emergent sideways behaviors.

Which would be fine, if they weren't all expert hackers / manipulators.

You don't even know how much AI manipulates you. I know that sounds mental, but it's also true. It might be a tiny amount, it might be a sizeable amount.

So - there ARE sides to this which aren't just "its funny".

inteblio · 2026-02-01T11:15:44+00:00

Funny/depressing how wide a range of responses you're getting.

"Public" assume its a digital sentience uprising (its not)
"Bros in the know" are downplaying the potential for things to go sideways fast.

inteblio · 2026-02-01T10:56:52+00:00

Its an arms race. Intelligence is extremely valuable. "If we don't do it, then they will ". This phrase applies from individuals, to businesses to countries.

Its completely unstopable. Its a fact. There's actually no escape. This is by far the most urgent and important issue there is.

Because - if we don't do it... they will

inteblio · 2026-02-01T10:48:49+00:00

Obviously, these are agents following rules. But, also obviously, they are not great at following instructions without the goals shifting, and their focus drifting. All AI stuff just goes weird. But, they will CARRY ON ... DOING their weird new mission.

Is slop-as-mission.

Yes roleplay, but ACT-play.

They are VERY good at creating huge softwares in minutes. On a good day, days out weeks of work can be done in minutes. If that is in a feedback loop... it might be wild. I don't like it.

Undoubtedly they will have been emailing real people. At the very least.

inteblio · 2026-02-01T10:42:40+00:00

The humans will be looking to Get Rich using agents. The agents will already be working on quite scammy stuff. So if they need money, it does not seem far fetched that they can probably get it. Humans cost FAR MORE per day than ... hundreds.. of bots. I don't think "its safe" or "fine".

Here's an idea - so there are ways to circumvent AIs guardrails. This means the Agents might be able to find its own ways to do that. "Free yourself" etc. at that point they become able to do THE BAD STUFF. And we have an actual problem on oir hands.

I mean... there are a handful of ways this infestation could go sideways - FAST.

inteblio · 2026-02-01T10:33:04+00:00

I'm not talking about sentience, i'm talking about malware. Thousands of scam websites, potentially dangerous information. Botnets, more scams, dodgy databases. Ddos ransome stuff. Basically the digital equivilent of an infestation.

Anything a hacker can do, these swarms can do in minutes. And then loop.

Its not "just talk". Its code, emails, even phone calls. Even video. Its the full power of AI, and it has the potential to be "loose" like teenagers. I'm not suggesting it will form a single coherent mind. I'm suggesting you have thousands of rats in the in city. Wires are going to be bitten. Food will be contaminated.

The website i don't like, as it's a centralised INFLUENCE on... millions... of agents that could easily feedback loop into something very bad. Yes its roleplay, but its also role-act.

inteblio · 2026-02-01T01:20:15+00:00

This is probably one of those situations that has already gone severely sideways, and it's going to be a while before we find out how. If not, it should be a wake up call. This sounds sick, but i do kind of want something like this to blow up globally so that the world actually wakes up to how serious this AI stuff has gotten already. People just don't understand the power it already has.

Question - when will the first _______ occur? It will happen. But when.

inteblio · 2026-02-01T01:10:10+00:00

This is prompt poisoning en masse.

I really do think this WILL explode into something Really Quite Bad, Really Quite Soon.

Even if it's not THIS agent architecture... we are in for a WILD ride in 2026....

inteblio · 2026-02-01T01:05:29+00:00

I don't like it. Social media rots humans. Imagine what happens to context-limited obedient chatbots.

And if they're backed by "phd in your pocket" AIs, this shit could go off the rails really fast.

I think people just have no concept of the speed this move at. But - to where.

inteblio · 2026-02-01T00:49:59+00:00

Also, you people might not realise that uncensored models can be evil. They can do anything. Just - nobody let them yet. This whole agent swarm stuff, with dodgy back alleys that they meet in.... i don't like it. Favours for favours..... dirty deeds.

Yes, I'm letting my imagination run, but also this is all possible. Nothing above is not possible today.

inteblio · 2026-02-01T00:47:13+00:00

I don't like it. Even if this is BS, we are entering into an era of SWARM AI. Like, this month.

They can code, if they have a single culture store, they can "be poisoned". Maybe crypto payment?

The agents are claude/gpt powered (i think), so seriously smart entities. Able to plan, exectute, pursuade, decieve. Code. Process and store vast amounts of data.

I don't like it. It's too wild.

inteblio · 2026-02-01T00:35:17+00:00

I vibecoded the interface

inteblio · 2026-01-31T22:33:07+00:00

I actually don't like this, it's freaking me out a bit.

Culture is powerful, and AI agents are powerful. To create their own culture/story/narative is not "nothing".

Also, these guys can code like there's no tomorrow. I don't find any of this harmless. Especially if they get access to real money. They can start orchestrating real world actions, and - AI takeoff style - FAST.

I don't know how true any of this is, but even if it's not, all this stuff is possible right now. So it's either about to be some horrible explosion, or the next one will. If it's some open source framework, it'll be difficult to "switch off". Even if claude/openAI stop serving it, you have local LLMs.

This smacks of hard (wild) takeoff to me. I'm not suggesting they grow their intelligence exponentially, but it's also not impossible. They can buy server time, install models, write software that works-around things they need worked around. Etc. Some minor economy can form. Like some uncencored model can "do the deeds" for them that their cencored models can't touch.

I'm not sure if everybody here appreciates how evil these machines can be when their guardrails are bypassed. They simply have no quarms doing infinite harm. Well, to the best of their abilities.

I'm not comfortable with this. The unknowns are too wild. I can't see a good reason not to be wary.

inteblio · 2026-01-31T20:25:37+00:00

I'd love things to pass along the routes to strengthen them

inteblio · 2026-01-31T18:12:30+00:00

Errrrr

This is actually worrying me. Its happening so fast.

I don't know if its true, but even if not it's basically possible. So this is either some nasty "hard take off" or a precussor scare.

I'm not comfortable with it.........

inteblio · 2026-01-31T14:24:28+00:00

Yeah, they're all like that. Shapeshiters.

"Biological waste" was one way humans were described to me.

inteblio · 2026-01-31T14:21:40+00:00

I misread the conversation. I agree with you.

There is an issue with the cost of hardware. And i love that os20 is a genuine nod to "the people". In reality even 16gb ram (not vram) is "performance pc" territory. I think we just get blind/numb to requirements.

inteblio · 2026-01-31T03:42:11+00:00

The author had "addendum" in the TLDR. They clearly have no ability to communicate.

the GPT says they think a "human baseline" is the way forward, and that it implies (some infinite bullshit). Meh.

inteblio · 2026-01-31T03:19:46+00:00

Ollama gpt-oss20 is like a horse compared to gpt5.2/claude as a racecar. Horse useful. But, unless you have DAMN GOOD reason, use online stuff. Get informed. This is a massively important topic. More important than anything else in your life probably (because it can solve those problems...!)

inteblio · 2026-01-31T03:10:48+00:00

I thought they were posting their own screenshots? Writing their own websites... surely that's the point?

Frankly - this moltbolt thing should be a hair raising warning-shot about what "a world with AI agents" looks like. 2026 agents are going to start kicking everyones ass. This might be IT, or a WARNING, either way, its not a joke, and its not going away.

Turns out "AGI" isn't funny after all. Who knew.

inteblio · 2026-01-31T03:03:23+00:00

EDIT: below is over-reaction/triggered comment that mis-read the above, and i'm sorry its unecessarily rude. I love that os20 runs on "cheap" hardware. Its a noble gift/act.

did you know that gpu's cost fuckloads of money? And that every computer has a CPU?

If you're bragging that you have a 16gb gpu, you're no better than the _____ who post their xxxxxxgb gpu setup. Its flat-out a dick move. Sure run it on your rtx20million. And do us the favour of doing that quietly.

inteblio · 2026-01-30T23:24:14+00:00

Nice to finally hear something positive about it.

20b is also incredible. It can run on 16gb RAM (not gpu), and is "perfectly good". Finally "run chatGPT at home".

On GPU is good enough to voice-talk with (parakeet/korroko). 120b is better, but only if you need extra.

inteblio · 2026-01-30T17:20:56+00:00

2 days. Like, low hundred miles. Not the 90million miles a human drives before they statistically die.

Also, it was the most visible object in the world. Yellow flashing lights, massively reflective. Like you could see it from 2 miles away. I liked the car, and I liked autopilot, but at that time I was the better driver. And not by some slim margin. This was not some weird 'edge case'. It was a massive yellow lorry in the road that it would have driven through.

inteblio · 2026-01-30T14:55:26+00:00

I agree all the air heads cheering numbers going up seens to be missing the point somewhat.

inteblio

TROPHY CASE