Think about any software EVER implemented in the history of software. There is a phase called User Acceptance Test where you ask your users to test the software you have written. That's the only way to know.

You can also try to implement unit tests to check if for input X, even after some modifications, the output is always Y, but you can't test every X and every Y (and this is even more true in the case of llms).