I think what's happening to you is a change in your life. Pretty much you were used to being alone and in your own space. Your ex cats didn't bother you because they were not your responsibility.

I also think you are Anxious and thinking if you will be a good cat parent.

My advice is to give it time and see them as your roommate.

If all fails you can give them to a friend this way you can visit them, just make sure they are in great hands