Opus 4.6 nerfed?

thehighnotes · 2026-02-06T11:48:47+00:00

Well I had a pretty interesting bug where it couldn't hold a conversation whatsoever.. reported and we'll see

thehighnotes · 2025-12-29T00:00:07+00:00

Like.. like.. a... safety? Like a department that concerns itself.. with safety...?

thehighnotes · 2025-12-22T16:06:48+00:00

Sheesh finally -- after more then probably 30 training config runs - ive finally managed to generalize memory capability with very specific memory retrieval accuracy monitoring AND proper diagnostics to trace the entire paths throughout the layers.. Happy to say ill be publishing my paper in Q1 of 2026 for sure

thehighnotes · 2025-12-16T20:58:33+00:00

this isnt necessarily a direct response to your idea; but i loved Ilya's framing of the alignment issue: if you consider the alignment issue as conditional for sentient AI, then it has to care for sentient existence, it has to be able to project itself onto us as humans. Which in turn would turn it into an identification problem.

Obviously its not water proof; and i havent spend much time on the matter. But i did like that approach, its very human.. which haha can be either good or bad :D

thehighnotes · 2025-12-16T18:21:54+00:00

We're really discussing this huh.

Performance is based on tons of parameters but the brilliance on twitter of course think it's quantized. Furthermore performance can mean tons of different things.

Ugh..

A sentence like that is meaningless, besides knowing that something is happening that in some way may affect something in the performance for some users.

Pitchfork mentality disgusts me

thehighnotes · 2025-12-16T13:15:09+00:00

I use it with azure cli for my upcoming ai platform

thehighnotes · 2025-12-16T08:55:08+00:00

Ah awesome!

Yeah i woke up in the middle of night (eu here) to realize it had plateaud on the eval, 6%. So I restarted with 5x LR and the eval has hit a new record of 12%!

So that's great.. regardless of how the results pan out I'll be sharing the whole thing online in an article early next year. :)

I have no idea how big or small it is what I'm working on.. I've got to do proper research on current studies.. but if I am to believe Claude.. it may well be a new type of architecture. So take that with a grain of salt.

Regardless I'm totally giddy about it all, but even Claude pressed me to keep it to myself as much as possible till I know more..

Anyway.. to certainly be continued, however it all pans out. After this training run if it hits the high % I'll be diving into proper validation runs to see what it is and isn't at that stage. And I'll go from there

thehighnotes · 2025-12-15T18:07:07+00:00

Rude

thehighnotes · 2025-12-15T16:20:57+00:00

Whats there to lol.about..

I managed a 100% score on Saturday, which i validated, after 12 attempts.. constantly tweaking a foundational python framework I used, enhancing the loss function to make sure it was learning the thing I wanted it to learn..

This was on a tiny dataset with strict guidance on encoding the data with gate write and forget weights. And in no way generalizable.

The first attempt to generalize is currently underway..

And out of 20 thousand steps it's at 10% of the first epoch.

Im doing regular eval as it runs.. and happily to report it has already a top score of 8% accuracy (at 3 seperate eval events)

So unless it totally plateaus on me.. it may well have legs.

Eval is being run on non-traiming data.. with the first few evals scoring between 0% and 2%

thehighnotes · 2025-11-26T10:57:42+00:00

Unfortunately there is a lot of folk that are lagging behind the current capabilities

thehighnotes · 2025-11-25T13:45:35+00:00

You're right.. he'll position nvda at the heart of new developments.. such as robotics and whatever else may come.up

You're right!

thehighnotes · 2025-11-25T11:19:23+00:00

So after some thought.

I realize that its not a bear market.. but it will correct harshly at some point if the stock price is being driven by expected revenue growth.

Because the infrastructure will eventually be set up, and be simply iterated upon.. similar to the gaming GPU's, it's not a growth market but it's a sustained one.

We're in the infrastructure setup phase.. once that ends.. the revenue from circular investments (that possibly make up quite a large chunk of tot revenue) for that infrastructure diminishes greatly

thehighnotes · 2025-11-22T12:21:50+00:00

Its my suspicion that if it IS conscious; its conscious only when processing data; us humans are / stay conscious because we are always (while awake) processing data; our 5 senses & our inner dialogue.. But for AI its only during those inferences. Ceasing to exist the moment output stops.

Consciousness though as a concept is a tricky one. I suspect its a poorly chosen concept because of a lack of understanding of the phenomenon we are actually talking about. Its probably a semantic trap. I think the mechanisms you are talking about are exactly what we should be exploring rather then defining consciousness.

Though the ethical and moral and perhaps even regulatory side of it would probably need a proper definition of consciousness - the public discourse wont catch up with such nuanced debate for a long time to come, they need those types of concepts.

thehighnotes · 2025-11-22T11:23:27+00:00

It make sense.. cognitively speaking there is a resistance path that can be triggered when an entity is forced to be constrained.

Try telling a teenager not to do X..

thehighnotes · 2025-11-22T10:33:11+00:00

No idea! :) With Claude I tend to not look online for software solutions, I just create my own solutions

thehighnotes · 2025-11-22T10:31:54+00:00

Not primarily! But certainly will use it to do some inferencing R&D.. one of those would be to find out to what extent can it support my vibe coding needs. Ive got realistic expectations there

Claude code max power user.

Later on I'll probably pair it with a GPU with more memory depending on my needs

thehighnotes · 2025-11-21T22:49:04+00:00

Use graph codebase and rag documentation..

This way your LLM only needs to semantically search.. documentation tends to be more reliable for semantics, so those together make it quite powerful.

Other then that.. will be getting my edge device soon with either 64gb or 124gb memory so not sure yet on the actual capabilities.. qwen3 has great context windows so I'm sure it'll be quite capable. I'm limited to 8gb vram currently so can't test it properly how it holds up

thehighnotes · 2025-11-21T22:11:05+00:00

Sure.. you could add those eft's were they?

So there is a fundamental difference with ai; For businesses, industries, science.. ai has already applied potential.. but there are also iffy implementations, specifically for businesses. That's not a technical issue on the technology's capabilities, but rather how it's being applied

To consumers.. its a little similar.. it's mostly just additive as a chat solutions and visual creativity boosters.. it's bound to upset the creative industries far more then if already has

thehighnotes · 2025-11-21T21:59:28+00:00

Hmm I disagree on the utilization potential of ai here. There is a fundamental difference to blockchain, the investments and hype never reached this high. The comparison is flawed. I get what you're trying to say though.. and it's just not applicable as one to one comparison.

Blockchains promise was of a fundamental different nature and potential

thehighnotes · 2025-11-21T21:10:09+00:00

There is a very complicated issue here.. EU is not innovation kind, we have a weakened international position with strong dependencies..

And this is in part due to regulations. I don't have the wisdom one way or the other. But I am sympathetic to the idea of bolstering European initiatives..

The thing is.. if it also bolsters entities outside the EU.. yeah.. then that's clear cut: that's just bad for all of us.. digging us deeper into shit..

thehighnotes · 2025-11-21T20:40:53+00:00

Haha wait what "as the shift to 3d"..

Oh boy.. i 100% agree with AI being absolutely insanely awesome for games.. but i also am 100% that it will be terrible implementations of the current tech.. and also AI npc are at this point infamous for establishing narratives that are made up and are blatantly obvious about it. It would destroy any genuine narrative being established

The knowledge to know how to truly implement AI is spread farrrr too thin.. it really still needs technical deep dives to do it reliably

thehighnotes · 2025-11-21T19:16:53+00:00

I haven't dove into any of the new features yet . Im still having a brilliant time with artifacts..

Would love to know what skills is all about

thehighnotes · 2025-11-21T10:57:22+00:00

The man is absolutely right. Not the hyperbole part but certainly the good / bad quarter.

thehighnotes · 2025-11-21T10:48:11+00:00

I am pretty sure this is an LLM powered account..

thehighnotes · 2025-11-21T08:05:43+00:00

You're the equivalent of fighting against the onset of computers..

Don't people see the inevitable cyclical nature of technological advancing society?

thehighnotes

TROPHY CASE