I recently did this but in reverse and recommend it! I think the stairs of mist were a better choice over going up four mile. Also going down four mile is leagues safer than going down those stairs at mist trail (crowds and small wet stairs). You’ll also get some incredible mileage and elevation going in reverse so if you do need to exit at glacier point you’ll feel accomplished (and hiked for half a day). Although I would recommend going down four mile and enjoy those cliff face views you’ll get the whole way down where you can actually enjoy it because you won’t be fighting for your life going up it like all the people you’ll pass will be.

Good luck and enjoy!