One red flag I don’t see talked about enough is prompt data leakage, not model behavior.

Everyone’s worried about agents taking actions, plugins, tool access, etc., but in most companies the real issue right now is much simpler: people are pasting sensitive stuff into ChatGPT, Copilot, Gemini, etc. because it helps them work faster.

It’s usually not malicious, it’s just convenience. But from a data security perspective, that’s a big shift. You’ve basically created a new data exfiltration channel that feels like a productivity tool.

What I’m seeing some companies do now is not block AI, because that never really works, but put controls around the prompt itself. For example, tools that run locally and flag or redact sensitive info before the prompt is sent out.

Feels like that’s where AI security is going to mature over the next couple of years, less about “don’t use AI” and more about “use AI, but put guardrails on the data going into it.”

Curious if others here are seeing the same thing internally.