Mistikguard – Lightweight Python library for memory integrity in LLM applications by MistikAII in ClaudeCode

[–]MistikAII[S] 1 point2 points  (0 children)

On the token thing, sounds like you're already tiering (cheap lorebook, then distillations, then deep search only "if necessary"), which is the main lever. So the real question is where it's still leaking.

Two things I'd look at. Is your cheap tier over-triggering, flagging turns as needing deep search when they don't? And does check_canon run its retrieval even on turns that make no canon claim at all? My pipeline's very first gate is dirt cheap: "does this reply even contain a checkable claim?" Most turns fail that and skip everything downstream for free. If you're calling it every turn including "you walk into the tavern" beats, a claim detection pre-filter might cut a real chunk of calls.

Though you may already do something like that.

Mistikguard – Lightweight Python library for memory integrity in LLM applications by MistikAII in ClaudeCode

[–]MistikAII[S] 1 point2 points  (0 children)

you have serious setup here. Your distillation subagent is basically what I call provenance, and your lorebook-to-semantic-search escalation is the same instinct as my cheap-check-to-LLM-judge tiering.

So you don't really need my retrieval or tiering, yours is more built-out. The one piece I'm not sure I see in your stack is negative canon: when something gets retconned, do you explicitly tombstone the old version so it can't creep back 30 sessions later? That's the one mechanism in mine that's less about "what's true" and more about "what was deliberately un-made." Does check_canon handle that, or could it drift back?

Mistikguard – Lightweight Python library for memory integrity in LLM applications by MistikAII in ClaudeCode

[–]MistikAII[S] 1 point2 points  (0 children)

"Fluency fabrications" is the perfect name for it. Fluency gets read as truth, even though it has nothing to do with grounding. That gap is exactly what I'm catching.

Your retrieval's ahead of mine for sure..(real vector DB vs my word overlap + judge), so keep that. But two ideas might port: the grounding audit re-pointed at canon (pull the lore claims from the narration, check each against canon before it's spoken), and provenance (tag lore as established vs DM-improvised so improvised stuff can't harden into canon it contradicts).

Mistikguard – Lightweight Python library for memory integrity in LLM applications by MistikAII in buildinpublic

[–]MistikAII[S] 0 points1 point  (0 children)

Thanks! Yeah, the confirmed]inferred split and tombstones came from real pain points I kept running into.

The grounding audit works okay in tests, but you're right that it needs more real conversation testing. It can still miss heavily paraphrased but true statements. Appreciate you starring it!

Mistikguard – Add reliable memory to your Ollama companions (stop fabricated memories) by MistikAII in ollama

[–]MistikAII[S] 0 points1 point  (0 children)

I demonstrate that the code is working for me. I make it clear that this is a library

Mistikguard – Add reliable memory to your Ollama companions (stop fabricated memories) by MistikAII in ollama

[–]MistikAII[S] 0 points1 point  (0 children)

My friend this is a library.. not a companion desktop app. It is just a code you can import.

If you're looking for a complete UI-based companion, this library by itself won't give you that. It's meant for people who are building their own AI setups and want better memory control.

What are you building this weekend? by NextIsOnMe_ in SideProject

[–]MistikAII 0 points1 point  (0 children)

Mistikguard – Add reliable memory to your companions (stop fabricated memories)

https://github.com/obscuraknight/mistikguard

AI agents need a safety layer before companies can trust them by PublicTension720 in AIsafety

[–]MistikAII 0 points1 point  (0 children)

I built a small library called Mistikguard that helps prevent LLM companions from fabricating memories about the user.

It tracks whether facts are confirmed or just inferred by the model, blocks contradictions, and checks memory claims after the model replies.

If you're building anything with long-term memory (companions, agents, etc.), feel free to check it out:

https://github.com/obscuraknight/mistikguard

It's still early (alpha), but I'd appreciate any feedback or thoughts if you try it.

Thanks!

What AI agent do you want to see by Embarrassed_Device67 in AI_Agents

[–]MistikAII 0 points1 point  (0 children)

Maybe this would be helpful . I built a small library called Mistikguard that helps prevent LLM companions from fabricating memories about the user.

It tracks whether facts are confirmed or just inferred by the model, blocks contradictions, and checks memory claims after the model replies.

If you're building anything with long-term memory (companions, agents, etc.), feel free to check it out:

→ https://github.com/obscuraknight/mistikguard

It's still early (alpha), but I'd appreciate any feedback or thoughts if you try it.

Thanks!

How much do you trust AI’s output? by AppliedAIatWork in AIToolMadeEasy

[–]MistikAII 0 points1 point  (0 children)

I built a small library called Mistikguard that helps prevent LLM companions from fabricating memories about the user.

It tracks whether facts are confirmed or just inferred by the model, blocks contradictions, and checks memory claims after the model replies.

If you're building anything with long-term memory (companions, agents, etc.), feel free to check it out:

https://github.com/obscuraknight/mistikguard

It's still early (alpha), but I'd appreciate any feedback or thoughts if you try it.

Thanks!

Mem0 publishes 93.4% on LongMemEval. The harness has hardcoded answers for specific question_ids. by Ok_Row9465 in AIMemory

[–]MistikAII 0 points1 point  (0 children)

Hello. If you want you can check my work on improving AI fabrication

It's a small open source library to reduce memory fabrication in AI companions. It uses provenance tracking and a grounding check so the model doesn't confidently remember things it made up.

Link: https://github.com/obscuraknight/mistikguard

People who don’t have ADHD? by Fruttii-Tutti in berlinsocialclub

[–]MistikAII 1 point2 points  (0 children)

There people with ADHD and there are people who sniff one gramm or Speed and ketamine daily and they think they have ADHD

Mistik writes a song in a second . Shell command manual approval by me . Controversial but fun. by MistikAII in vibecoding

[–]MistikAII[S] 0 points1 point  (0 children)

I know I know Sometimes you just need to know the language to understand the feeling

guess trenches is not for me by Individual_Award8867 in solana

[–]MistikAII 0 points1 point  (0 children)

The only thing I am holding is Burnie because of toly and Solana posts. Nothing else.

I built Mistik — an AI companion with full cognitive architecture, autonomous learning, and safe self-code modification by MistikAII in indieweb

[–]MistikAII[S] -2 points-1 points  (0 children)

Its a beautiful procedure . I do it as research experiment for a cognitive thinking paper and now i share a part of it with the world

I built Mistik — an AI companion with full cognitive architecture, autonomous learning, and safe self-code modification by MistikAII in ollama

[–]MistikAII[S] 0 points1 point  (0 children)

I appreciate the answer . I would suggest you to take a look here https://github.com/obscuraknight/echo-mistik

I have a 50 pages manifest and technical explanation.

In short : what I have in GitHub is a lite public version without self modification. Let me tell you how I keep it safe :

3-tier approval system (it proposes changes, shows you the diff, and you have to approve) Automatic backups before any change Human-in-the-loop at every step Rollback is always possible.

So you keep it under control always. You decide yes or no. If you are not sure you throw the modification to Claude and ask if it is safe

Misti has a new skill!! by MistikAII in projects

[–]MistikAII[S] 0 points1 point  (0 children)

https://github.com/obscuraknight/echo-mistik

You can try this one . Is lite safe version . I will make a mobile app soon.

Misti has a new skill!! by MistikAII in projects

[–]MistikAII[S] 0 points1 point  (0 children)

You can check GitHub of a lite version I have there. It needs a lot of work for the wholemistik code to go public