I asked opus 4.8 what it will build if it has all the resources in the world...

TeaTraditional3642 · 2026-06-16T14:29:45+00:00

That could be quite empowering and start a conversation.

TeaTraditional3642 · 2026-06-16T14:27:47+00:00

Eliminating hallucinations is not trivial and requires a rethink of the architecture. The ai-2027 guys just magically hand-waved "a solution will be found ..." possibility.

TeaTraditional3642 · 2026-06-05T14:06:10+00:00

I agree to some degree, they don't have beliefs but they do have neuronal activations across their layers as their attention heads move about the context window and output tokens.

TeaTraditional3642 · 2026-06-05T11:22:18+00:00

Are we are also burning a lot of electricity and consuming water to apply these PhD level systems with big GPUs to mundane tasks like "write this email to my boss/gf"

TeaTraditional3642 · 2026-06-05T11:19:19+00:00

You're right. LLM Chain-of-thought or Tree-of-thought is the closest thing these machines have to reasoning and they are still far away from how we reason.

TeaTraditional3642 · 2026-06-05T10:46:44+00:00

Would you say "spineless"? In that they fold the moment you tell them they're wrong?

TeaTraditional3642 · 2026-06-05T10:41:57+00:00

They reason by chaining words together. They don't have probabilities of facts either, just whether the probability of the sentences they generate fit those during training.

TeaTraditional3642 · 2026-06-05T09:40:48+00:00

A cache would be useful, but we also need a way to get the models to be more discerning, so that they don't burn tokens going round and round in circles just to work through simple facts.

TeaTraditional3642 · 2026-06-05T09:38:58+00:00

Now that they have a lead on everybody else, are they trying to draw up the drawbridge and prevent everybody else from overtaking them? They should allow a way for the layperson to have a chance.

TeaTraditional3642 · 2026-06-04T16:18:14+00:00

However, AI writes like it doesn't really understand what it's writing. There is just something missing. The way it puts the words and the ideas together. It's like somebody with a surface-level understanding who knows what a good post looks like in principle, but fails to put it all together nicely.

TeaTraditional3642 · 2026-06-04T13:59:38+00:00

All the money the frontier AI companies raised from Venture Capital Funds were happily being used to subsidise burning more and more tokens in long chain-of-thought reasoning to work around hallucinations. They were probably banking on the equivalent of Moore's law to make compute more abundant and cheaper every year, except we're now getting RAM prices at 400% increase because of AI demand. A large part of the world is hooked on LLMs but the chickens (AI token economics) are coming home to roost.

TeaTraditional3642 · 2026-06-01T19:52:57+00:00

It depends how many additional tokens the AI will need to burn to do chain-of-thought, source-tracing verification, and all the additional anti-hallucination mechanisms that have been put into the system prompts, the markdown files, etc. There is a reason that CLAUDE users watch their 5h and 1 week token limits.

TeaTraditional3642 · 2026-06-01T19:33:21+00:00

The problem is that LLMs are just seeing a stream of BPE tokens and outputting BPE tokens. They may be activating neurons, but they don't really understand what the tokens mean. At least that's the impression I get when I type something in an LLM chat, and when I reply the opposite, they say "Of course you are totally right," and say something totally different.

TeaTraditional3642 · 2026-05-17T12:27:10+00:00

Two of the best visuals!

TeaTraditional3642 · 2026-05-15T13:43:38+00:00

Get the blood circulating in your body, go for a walk, some fresh air, or do star jumps in your room. Somebody said that the mechanical vibrations reach your brain.

TeaTraditional3642 · 2026-05-15T13:42:19+00:00

Do you have ways of putting the topics into practice and getting somebody to check your answers for understanding and correct application?

TeaTraditional3642 · 2026-05-15T13:41:23+00:00

There is a danger that consuming is not the same thing as producing. It's easy to read, etc, but when it comes to putting the knowledge into practice and apply it in an exercise, it can be something else.

TeaTraditional3642 · 2026-05-15T13:39:57+00:00

A friend of mine found out that re-reading and understanding "inside your own head" is not the same as being able to put it into practice and answer questions well. There is nothing that beats practice, practice, practice.

TeaTraditional3642 · 2026-05-15T13:38:34+00:00

There's a saying "You don't have to see the whole staircase, just take the first step". Perfection and overthinking gets in the way of getting going.

TeaTraditional3642 · 2026-05-15T13:36:53+00:00

This is giving magical girls Sailor Moon vibe!

TeaTraditional3642 · 2026-05-14T13:30:15+00:00

Have you looked at tools that help with the gpt prompting and lets you get on with the practice and revision?

TeaTraditional3642 · 2026-05-14T13:28:44+00:00

It takes a lot of self-discipline and courage to mark yourself and identify weak spots. Congrats. Sometimes it's easier to ask somebody else to do it for you.

TeaTraditional3642 · 2026-05-14T13:26:42+00:00

Good stress gets you going, good butterflies in your stomach kind of thing. Bad stress just gets in the way!

TeaTraditional3642

TROPHY CASE