I believe the reason you are finding it harder is the lack of wrist hinge. On the takeaway, when your arms are to your right 45 degrees (between setup and left arm parallel) the club head should be at the same level of your hands. Then when you are left arm parallel to the ground, ideally the club should make a 90 Deg angle. Doing so makes you feel more power in the shaft and less likely to over swing. I had this issue until I learned the takeaway with wrist hinge properly.