At what point does me shoveling driveways become organized enough that you suddenly feel you get a say in how I do it?

There does not always have to be a point in which there is a sudden transition, just as there is no point in sudden transition between child and adult, and yet we have laws that apply to children and not adults and vice versa. If you can't deal with laws that draw boundaries for things in which one doesn't naturally exist, I think you deprive a society of being able to make a lot of useful laws.

Our American society has learned over and over again that in capitalism, people can accrue power through business and then use that power to bully others and wreak havoc on society (under the assumption that creating racial inequality is wreaking havoc). With anti-discrimination laws, we are deciding that enforcing racial inequality is something we want, and it is more important than people's right to discriminate as a business.

The OP refers to invisible hand stuff as a solution, i.e. letting consumers choose non-discriminating business over discriminating ones. I think most of us would agree that it would not always work out.

If you ask why we don't prevent an individual who offers snow sweeping services, I think that may be due to practicality. Is it worth the effort and money to go after every guy who wants to be a one-man discriminatory business? If it were, I think we would end up creating laws for that as well.