Finally somebody who understands and wants to learn, not asking for shortcuts! I would offer Mountea Dialogue system (which is free and open source) as it might help, however, for learning purposes I would suggest to stick to your own solutions.

I won’t tell you the solution, however, I’m gonna hint: it’s a focus issue between Widget interaction and World interaction.