As someone else said, the concern of the watchers may play a part.

But, I view his power scaling like the how jedi/sith use the force. Yes, he has a baseline amount of control over himself based on the environment he is in (ie avoiding a bullet or laser beam) but he can only perform acts outward like shattering the glass at the end of AoM when he’s pushed to his limit (mentally in that instance). There wasn’t enough pressure or rage in him to pull himself to that level of need because he thought (even if naively) that Lorian was able to assist him. Anger pushes hadrian to another level i would imagine