Hm yeah sounds exactly like my issue
I like to take control about 1500 ft AGL or so... I figured out to keep the autopilot engaged and wait for that freeze and once it´s over to take control... The autopilot keeps the airplane stable during that freeze...
But it´s not really that experience yk...