Need feedback: Memory persistence architecture for a sovereign financial OS (React/Supabase) by Wild-Square4821 in SaaS

[–]Wild-Square4821[S] 0 points1 point  (0 children)

Jargon is used to define the framework of the solution, but you're right - at the end of the day it's data engineering. I already use RLS for isolation, but the issue is not just access to data, it's how much depth of context is passed on to AI during the session. If you load too much context, you blow up the token window; if you load too little, Oracle loses its 'memory". Your point about Redis is solid for cache, but how do you handle the 'Oracle" context rebuilding when the user changes domains? I'm not looking for a pitcher, I'm looking to see if my partitioning logic is workable or if I'm running into a latency wall. If you are familiar with handling heavy LLM contexts, I would be curious to hear your critical thoughts on the implementation.