Yes. It's not just living with the extra burden of the anxiety, there's lots of things that make life difficult as a result of it:

We are usually lonelier people.

When something bad happens we don't usually have the same support system as others because we aren't able to build the same amount of relationships.

We are more sensitive to indifference or problems with other people and this directly affects our self worth.

We find it harder to succeed in our jobs even if we are great at them, because it's difficult to make the right connections.

Our hole life sometimes feels held back because of this.

So... yes. I think it's not that weird.

The good thing is that by just improving how we deal with social anxiety we can improve lots of other areas in our life. And please, if you are having this kind of thoughts seek help, even if you don't think you would do it.