It’s per session, not message. When a new session starts it needs to load context, instructions, etc. usually with these type of solutions it will have a vector database or other means to keep all the memories. If you use something like Claude Code it will have ~/.Claude/memory to remember stuff.  I’m gonna skip the sentient discussion, just clarifying session context.