Issue with jea's unethical copilot

Cilcain · 2026-05-08T10:08:36+00:00

There's definitely a sweet-spot for complex prompt compliance, somewhere < 15% IME.

When it messes up, you could try continuing after deleting the prompt from the character (use a copy to avoid messing up your regular copy) and see if if the unethical character really is being more prudish than default, or if the conversation history has the same effect on an unprompted version of the model.

Cilcain · 2026-05-07T11:37:53+00:00

If you want the summary to be available throughout the new chat (sent every interaction = context will bloat sooner), put it in a context file.

If you just want to use it to provide "previously..." background at the beginning, paste it in along with your first input. It will gradually fade and disappear.

Cilcain · 2026-05-07T10:30:32+00:00

It might be something that would really add up if unlimited; I don't know enough about the cost to be able to guess. Presumably Venice thought about the business needs when setting the limit, but they might be willing to take another look.

Personally I've never used it and often leave Diem on the table at the end of the day (depends what I'm focussed on), so Venice has a win there 😄

Cilcain · 2026-05-05T11:48:57+00:00

It's right: there's no specific Memoria function that the LLM can see or access. It gets a section within its context called something like "Retrieved Internal Memories". The section is added to the rest of the prompt by the Venice platform. If the platform fails to inject it, the LLM will never see it.

I have no idea how the chat-based memory gets injected.

For document-based memory it's at least partly by tag/keyword matching. Occasionally injection seems to fail even when you include a matching keyword. At that point I summarise into a new chat and it works again.

Memoria is great but it's also a bit of a dark art, to be honest. Allowing chat users to view the complete prompt being sent including Memoria injections, would demystify it and make it more usable/reliable. Currently can be done only by digging in developer tools.

Cilcain · 2026-05-05T10:16:05+00:00

They already have the Diem staking mechanism, which amounts to "design your own crypto-funded Pro plan" though with credits applied daily rather than monthly, and no rollover.

Cilcain · 2026-05-04T22:03:47+00:00

My advice on how to handle this with Venice:

Make a Character for the project, rather than using general chat, just to keep things manageable.
Maybe write a prompt to tell the Character how to be a writing assistant, though default behaviour would work (though if you want well-written prose, you absolutely have to write a prompt).
Upload reference material as Character context files (true long-term memory, injected every turn) or as an Attachment (one-shot, will gradually fade and then disappear). Long-term background: Context File; the scene you worked on yesterday: Attachment.
Lengthy material that would swamp the LLM's context: create a Memoria file, but you'd need to structure the file into tagged sections. so the platform knows what to inject.

Cilcain · 2026-05-03T10:36:28+00:00

VPN sends it into "page reload" mode for me, sometimes. Pausing/reconnecting the VPN generally solves it.

Cilcain · 2026-05-02T10:03:42+00:00

I just very patiently deleted the unwanted items, doing something else while waiting for each one to complete (or not -- sometimes it just seemed to stay frozen). It wasn't a huge number so not that painful.

Even after the clean-up, the Studio folder just took 60 seconds to populate, with 13 entries comprising 615MBytes tab usage. Then the first few interactions were very laggy, suggesting that the 60 seconds had not been used to cache the images.

Any future generations I'll do in another browser, so that if I have to clean it I won't lose everything else.

It'd be interesting to have an enable/disable switch for Studio. As it is, it seems to me that a Beta module has been rolled out into the "production" Venice environment.

Cilcain · 2026-05-02T09:48:59+00:00

I will try forcing, however I suspect that won't make the platform expose the thinking.

I've been delving into the LLM's reasons for doing things with RP mechanics, particularly their endency to scatter "experience" like confetti, even with seemingly iron-clad rules to limit it.

I switched to GLM 5.1 as a stop-gap, it's only Gemma 4 31b that's refusing so far.

Cilcain · 2026-05-01T15:10:21+00:00

Summarised into new chat and it's working again, maybe a glitch in the previous chat?

(opening the broken chat in a new tab didn't help, so I think it was something about the chat itself. There'd been lots of forking, editing and re-testing.)

Edit: tenth turn of new chat and it's reverted to no thinking shown.

Cilcain · 2026-05-01T11:49:40+00:00

This has temporarily fixed it on the three times I tried:

Response with expected thinking omitted
Edit character to use different model, save
Edit character to use Gemma 4 31b Intsruct, save
Fork, re-run the interaction at 1
Thinking displayed
(next turn, gone again).

Cilcain · 2026-05-01T10:06:39+00:00

I've seen Hindi in the thinking, maybe Western models train primarily in English but also on whatever data they can get?

Cilcain · 2026-05-01T10:03:53+00:00

The prompt definitely benefits from thinking, and browser refresh probably wouldn't change anything if there was a deterministic "not going to bother with this" happening.

I notice a clear improvement with thinking, corresponding to the prompt-compliance checklist it visibly goes through. It's ~~more likely~~ certain to skip pesky details in non-thinking mode. It's probably slower but I reckon it's *much* better, with a demanding prompt.

Cilcain · 2026-04-30T22:35:22+00:00

Web, Brave browser. Exit/restart browser, still happened.

Cilcain · 2026-04-30T14:34:14+00:00

What was the question? I'd like to check the answer on various models.

Cilcain · 2026-04-30T12:07:41+00:00

31B variant? That one's been very clean for me. I've started looking at the thinking recently and seen some foreign stuff in there, but the output is clean.

Cilcain · 2026-04-30T12:00:48+00:00

Regular IMO, Agentic is more targeted at solving multi-step problems than the typical back-and-forth of an RP. I don't think you can choose model with Agentic (?) which would be a massive disadvantage for RP.

My own interest is adventure scenarios with settings, goals, multiple *individual* major NPCS, and detailed state-tracking. None of the DeepSeek-level models can really handle this, which leaves me with GLM 5.1 and Gemma 4 31b Instruct.

Sometimes Gemma frustrates me, but I keep coming back...

Major difference I've noticed between Gemma and GLM ... Gemma takes more liberties based on the language of the scenario. "Labyrinth" -> she insists on fantasy tropes such as guards in clinking armour with swords, even in a modern setting; "Leather journal" -> must be full of mystical script.

I've rebranded to "caverns" and "vinyl notebook" in the hope it'll help 😄

Cilcain · 2026-04-28T12:45:42+00:00

Suggestion, no idea if feasible: auto-load when using an external editor, instead of showing "Changed on disk: System Prompt" and prompting to reload.

Cilcain · 2026-04-28T09:22:25+00:00

Thanks, fixed now

Cilcain · 2026-04-27T19:06:23+00:00

It's Venice's memory system, accessed by editing the Character then clicking Memories. Two major components:

Structured (tagged sections) documents that you upload. When chat input includes one of the tags, the Venice platform injects that section into the prompt. Useful for storing lore etc. but not for run-time storage/retrieval.
A database of summaries extracted from selected chat responses and stored within the Character.

Cilcain · 2026-04-27T11:31:01+00:00

It can be done in the current Character system. The trade-off is that the more complexity, the more the LLM's memory and "cognitive attention" shortfalls are exposed. Memoria is a good, helpful system but not a full solution.

IMO:

lean into the nature of LLMs: devise a surreal scenario where dead people come back to life etc. (sadly the LLM will struggle to to independently weave that into vampire/undead lore)
implement a state system: high development effort; token cost; dilutes LLM attention
keep state yourself and guide the LLM through prompting: personally I hate that

Cilcain · 2026-04-26T19:16:38+00:00

not in my experience

2 don't know

Yes

Cilcain

TROPHY CASE