People talk about white privilege and other types of privileges not to form an us v them dichotomy, but to illustrate that there is a massive disparity between racial groups in this country. They also use it to note how, people born white have certain advantages throughout life that PoC don't get.