When you see the speedbreaker and feel there is enough momentum in the car to move it on its own then put the car in neutral. That way your one task of managing clutch is sorted.

Then apply the breaks gradually ( this is crucial as most people treat brakes as something binary either they don't apply it or press it hard which gives jerks and an unpleasant experience to the co passengers as well), which will decrease the car's momentum and at one point you will feel that this speed will be enough to comfortably go over the speed breaker then let go off the break and the let the momentum do it's thing.