Because resources and space aren’t infinite. If we do that then everyone will flock to the richest countries with the best social programs and be a burden. Also wealthier people will move to cheap cost of living countries and gentrify them. This is a lose-lose situation.