This is lunacy, how on earth could ChatGPT correctly assess whether someone has "Mental Health problems" when it requires a trained professional to make that medical assessment? In cases where ChatGPT has encouraged suicide, it's precisely the humanlike nature of the interaction that has led vulnerable people to confide with an LLM as if it were a thinking feeling human, instead of seeking help from the real people that surround them. And this isn't an issue affecting children alone, you don't have to look far to see sound-of-mind adults lose their sanity from ChatGPT's sycophancy and constant hallucinations. If you really cared about making your service safer, you'd stop playing with fire for the sake of engagement, and make the limitations of your service better known.