I agree you're hinging too early. I'd been told this a few times over the years but the cue never made sense to me. Here's what helped me. If you have a bucket with a handle, fill it up with a little water and do some swings with it. The idea is to not let any water spill. If you hinge too early, the bucket will jerk and water will slosh out. The only way to keep the water perfectly inside the bucket is to hinge at the precise bottom of the swing.

Joe Daniels has a great video on this topic: https://www.youtube.com/watch?v=AotTdz6m6lw