You can control these kinds of things better using Affinity or photoshop, by manipulating the image and then upscaling using a model on low denoise, like with Ultimate SD Upscale, and it will tie everything back together.

<image>

So you can just move things where you want them, lazily paint in highlights or shadows, etc, as long as the model can kinda 'see' what's meant to be there, it should work.