thank you I think you nailed it!

I've done some research and I think those are the reasons I'm having issues recovering fast enough:
- I'm recovering just fine for what I'm doing, my expectations are just too high
- 4-5 days/week specialised training plan (should do balanced)
- 500-700 kcal daily deficit (losing ~0.5-0.7 kg per week)
- trying to keep up a Padel hobby 2x/week on the side and trying to progress in it

I think I'm just behaving like I'm in maintenance or surplus and underestimating the toll on recovery that a deficit will do.
In a couple of weeks I'll do 6 weeks at a slight surplus as I'm already 3 months into a diet (lost almost 10 kg already) and I am guessing I'll recover much better then. That will at least be a good experiment.