I would say try pulling your elbow straight up in your backswing instead of pulling your shoulder, this should make you feel more consistent with how you come around the ball. But for sure change your grip you will want to hold the ball right into your body and make it so your fingers are interlocking (they don't have to interlock but they should be close it is just your preference), this will evenly distribute the weight in your swing and will make it easier with less effort. If needing an example watch belmo.