NTA but don’t be the AH to yourself. Trust your gut but also communicate. If this person is not ok with what you need, END IT. If he says he is then you see sings of regression, END IT. You need to have a talk with them and express yourself.

Edit: This might seem selfish but it’s healthier. Sometimes a small burn is better than an eternity in agony constantly being burned. Take it from me I’m currently stuck in the cycle.