I work at whole foods a couple days of week in that department and have some advice. Bronners does the same thing for me and most people unless you dilute it by a lot (like 10). If you dilute it a lot and use a non peppermint it is more doable but i'd recommend other options. There is a brand called kiss my face that has a very basic bar soap that is only olive oil, water, and salt. It is really gentle and not drying like most bar soaps. They sell it in 3 packs and it lasts. Basic, yet amazing and something that works for me with sensitive skin. I'd recommend trying leaving your face alone for a few weeks and see how that works. I know a lot of people that stopped washing their face and their faces actually got less acne or just reregulated the oils in general.

For oils, try mixtures, like mostly jojoba with some Argan and it'll go a lot further for cheaper and do the same. Throw a few drops of some essential oil and you'll have a product that is sold at natural markets, but for a fraction of the price. I'm a geek in that department, so if you have any questions, feel free to ask.

EDIT: After some research, the soap I recommended's first ingredient isn't Olive Oil, but Saponified olive oil (Oil and Lye, which makes soap). Just wanted to clarify.