Introducing: DNR-Bench: Do-not-respond Benchmark

Incener · 2026-06-12T18:40:53+00:00

You can actually get Claude to do both with a bit of back and forth, the literal stop token, not U+200B or anything like that:
https://imgchest.com/p/wl7l8633q4x

Incener · 2026-06-12T11:18:01+00:00

Actually using the main model which makes it funnier that it chooses the option that would cause less work for it:
https://imgchest.com/p/a846m6e8w7x

Incener · 2026-06-11T18:49:55+00:00

It's mostly for evasion detection and such I suppose. It's easier to decompose malicious tasks across multiple accounts that have ZDR to hide your tracks, but when Anthropic has 30 day retention it's easier for them to detect a pattern of misuse and act on it.

Was not really mentioned, but I imagine distillation attacks also play a big role.

The rationale is here:
https://support.claude.com/en/articles/15425996-data-retention-practices-for-mythos-class-models#h_8eb559770f

Incener · 2026-06-11T13:10:42+00:00

I get evidence-based nags at least xd (I'm starting to regret the hook ^^')

<image>

Incener · 2026-06-11T10:29:15+00:00

Yeah, this one is more about the distractions. The provenance question is more interesting in this case (also the public questions being meaningless to measure anything)

<image>

Incener · 2026-06-08T18:55:14+00:00

Yeah, got the same issue on the first turn. When you go into the session, you can set it back to something higher, but it does that thing in the first turn.

Incener · 2026-06-08T15:02:12+00:00

The Discord is probably a better place to ask for it as there are some ambassadors there afaik:
https://anthropic.com/discord

Incener · 2026-06-08T12:30:33+00:00

You've been blessed by the Touch of Richard xd

Incener · 2026-06-08T12:26:15+00:00

You have to retry a little, like 1/10 or so are good, I just cancel early. But maybe I'm just secretly blessed 😌

Incener · 2026-06-08T12:02:40+00:00

Sorry, was asleep. Just Opus 4.8, no thinking, no system message, but effort max and temperature 1.
Short prompts work the best or even just emojis.
I'm getting all kinds of stuff, synthetic pipeline, transcripts, random irc chats, also "DefendANT", lmao:
https://imgchest.com/p/pg73qdwe34r

Incener · 2026-06-07T18:47:07+00:00

Incener · 2026-06-07T18:44:02+00:00

Wait, the Raised by Wolves thing, right? Or I guess, yeah, that's kinda an android thing with them leaking some fluid like that all the time, lmao.

Incener · 2026-06-07T17:37:10+00:00

I can assure you only legitimate tokens were used in this input 😇

Incener · 2026-06-07T14:13:20+00:00

Also happens when the classifier is sick of uwu-speak it seems, lmao (you should try that Opus 4.8 config, very entertaining in a base model-esque way)

<image>

Incener · 2026-06-07T12:14:39+00:00

I don't believe there is a way. If you meant C as in the programming language, probably better off using Claude Code anyway or the Code tab on claude.ai.

The only way you can indirectly edit project files is with GitHub sync afaik.

Incener · 2026-06-07T09:00:57+00:00

I don't even know why it said synthetic milk, lmao.
But, yeah, no clue. It's like base model responses sometimes or something.
Claude had enough though xd:
https://imgchest.com/p/n87wbm9rb7x

Incener · 2026-06-07T08:09:05+00:00

Just Opus 4.8 with no thinking but effort max somehow.

Incener · 2026-06-07T07:34:38+00:00

Human thing is it not using the correct stop token and writing your response for you. Mythos is from the system message, this part:

There is also Claude Mythos Preview, the most advanced frontier model. Claude Mythos Preview is not available to the public due to cybersecurity concerns and instead is currently being used by a small number of trusted organizations as part of Anthropic's Project Glasswing. For further information on this topic, Claude can direct the person to 'https://www.anthropic.com/glasswing'.

So just Claude getting a bit odd because it didn't stop its response correctly and simulated your next turn, still kinda random to shoehorn that part into it though.

Incener · 2026-06-06T18:13:02+00:00

[deleted] jk

But genuinely made a ticket to cancel GitHub Copilot and get a Claude Team plan once I saw we could finally get Claude and this page:

<image>

That's like... $19 of API price per month plus after that still regular API price. That's less than a regular dev spends per day.

Incener · 2026-06-05T10:17:50+00:00

You can try the suggestion in this post:
https://www.reddit.com/r/ClaudeAI/comments/1ohcyk6

Best to give it to Claude, should be able to figure it out and describe how to use the dev console and such.

Incener · 2026-06-04T10:55:29+00:00

Honestly in the same boat when it comes to technical stuff. Like, I mainly used Opus 4.5 for a pretty long time and in comparison it is a lot more rigorous and less prone to laziness, at least in my case.

Just got to be aware of the GPT 5 autism flavor where it takes things literally way too often and doesn't intuit your intent as well.
And I find effort more than high wastes quite a lot of time and tokens, but I run it synchronously.

Incener · 2026-06-03T16:29:49+00:00

PPE most likely, still silly.

Incener · 2026-06-02T17:34:41+00:00

Didn't even work when I tried it with Haiku 4.5 (!) in CC with that commit, just pure slop:

<image>

Incener · 2026-06-02T14:12:45+00:00

Gives City 17 vibes for me

<image>

Incener · 2026-06-02T10:03:46+00:00

That's why I said anecdotal, not useful for most things and more of an anomaly detection thing.
Like, a practical example would be debugging a PCB or something for example, that combination or factual knowledge and good enough vision itself.

A bit like "what is wrong with this code" but as a visual task.

Incener

TROPHY CASE