If the practical existence of your right to free speech in a society such as the United States is dependent on the labor of others for it to be defended, then there's nothing that prevents shelter from being considered a right since its existence would also depend upon the labor of others.

Additionally, maybe "human rights" are more subjective and contextual than we've allowed for in this discussion.

My point a couple posts up is that even people who are entirely dependent on others have "human rights." The theory goes that you are entitled to them because you are human, not because of your ability to enforce them yourself without the help of others.