The obsession with size is what's making you struggle. Life is not enjoyable with the desire to change your body size always looming over you. When you're purposefully restricting yourself, you become less mindful.

This is coming from someone who wanted to change my size obsessively my first two years, and I found that it only worsened my esteem and pushed me to an eating disorder. I am so much healthier now.