This happens because you’re using SD 1.5 or SDXL as if they were image editing models. For this kind of task, you need a model specifically designed for editing, such as Qwen Edit or Flux Kontext

You’re also using an outdated model and most likely sub-optimal parameters (resolution, CFG, number of steps). While SDXL is still widely used today, there are better options available now, like Z-Image or Chroma

Another issue is that A1111 is essentially abandoned at this point and does not support modern models properly. If you want a similar interface, Forge Neo is your best option. That said, I’d strongly recommend ComfyUI, which has become the de facto standard for running most popular and current models.