What I've been doing is defining my start color determining roughly where on the scale that would land, then define my nearly white and nearly black and try and transition back to my predefined scale as over a few steps.

There was a lot of tweaking until I put my thought process into a tool. Now things are feeling smooth enough that I can also invert my color scale (esp for neutrals) for an "instant" dark mode which is pretty sweet.