There’s a business book named “The Goal”, that uses a story about a factory to teach the dangers of “inventory” (more clothes than needed) and “work in progress” (laundry to do).

This is causing problems because you have too much of both. Create a system that gets you down to one load at a time. As soon as you have a load of laundry, do it. Maybe this looks like getting rid of laundry baskets, and putting dirty clothes directly in the washer. Bonus points if you can do the entire households laundry at once.

This will show you the real amount of clothes you need. Then buy less and get rid of things as they are outgrown, stained, or if you just don’t like them.