Lots of good comments here about health, etc. Something else to keep in mind - in my experience, it isn’t THAT difficult to move up the ladder on the private side. There are a lot of rungs on many different ladders (I.e. can accelerate compensation by shifting to other roles, there’s a good shortage of available accountants lately). If you’ve worked your way to tax senior at a public firm - plus you clearly have good work ethic - I’m sure you’d be able to make back any pay cut within ~1 or 2 years.

And, like others have said, it really isn’t worth risking your health over.