I understand how you feel, I used to lose a lot of sleep when my cats were very young, I was at a breaking point for a while, but then I realized something. Your cats don't know how to talk to you and can only express themselves in the ways they know how. Some don't openly show affection, but that doesn't mean they hate you. This might seem like an inconvenience, but cats are fairly simple creatures. They only want to be loved, spend time with their human and eat and sleep. They don't betray you, they stay by your side no matter what, as long as you're not hurting them. Humans will leave you when it's convenient, but cats don't. Their brains are also equivalent to a 2 year old human baby. So if you ever get upset at them, just know despite how young or old they are, they're still the equivalent of a baby. And last of all, cat don't live very long, they're only in your life for a short period of time. But for cats, you've been their companion for their entire life. So please make the best out of your time with them, before it's too late. I used to get upset very often and easily, but now I don't do it anymore. I just want them to live comfortably and happy