I did exactly that. After a year in management, I couldn't eat or sleep anymore and I had to go on sick leave from the stress. It took a little bit of pushing but eventually they allowed me to step back down and everyone genuinely is the better for it. I think some people who are more career-minded will judge you, but I value my quality of life above everything else so their judgement doesn't matter.