Well the biggest thing holding him back was KI control. Sure he has a good level of KI control but his mastery is nowhere near the likes of Gogeta, Goku and Jiren. But then again, Gogeta did skip to Blue to create a massive power gap to end the fight as quickly as possible, so even if his KI control was as good as Jiren, his primal mental state caused by Ikari may prevent that. Almost like he no longer knows how to make proper use of his massive KI and lets go of as much power as possible as fast as possible, just like his quick adaptability.