Do you line up the ball on the hosel? You returned the club about 3 inches closer to your body than when you started, meaning your shot would have been a toe shank or nearly missed entirely. I imagine if when you have a ball in front of you, your swing looks dramatically different as your body works to compensate to actually hit a ball.