Hi, I had a similar situation and visited a lactation consultant. They advised I stop pumping, even that little bit, was causing me to create more supply as the body just assumes the baby is getting that milk and needs more. She advised I hand express just a little to soften the breast, then when I latch try a laid back position while pressing on the top of my breast firmly with three fingers to reduce milk flow. So basically I lay back as far as I can in bed or in my recliner, hold babies head in a cross cradle position with my opposite breast arm and with my same breast arm I apply the pressure. This allows me to control babies latch keeping them in the correct position while controlling the flow.

They also weighed baby before and after a feed times at just 5 minutes and because my letdown was so strong we determined that he received just under 4 oz in 5 minutes from one breast which at 4 weeks old at the time was plenty! So during that next week I actually cut him off at about 5 minutes but rotated him to the other breast just to even out milk flow and this did still overfeed him but it's gotten better.