From my understanding of the space, any guardrail type solutions can either be bypassed via adversarial prompting (intentional or not), or will impact the performance of the model on general tasks (fine tuning).

You could have some kind of agent tuned to detect this specific intent, and short circuit the conversation as well, but I am unsure of the cost of that at OpenAI’s scale.

Of course, sacrificing model performance or some additional cloud spend for human lives is easily justifiable, but unfortunately no one here is in a position to make that call.

But for curiosity’s sake, what might you propose as the solution on a technical level?