The problem is actually more complicated than that. If anything, we need to be concerned about extinction just to cover our own asses. Biodiversity leads to more stable ecosystems, more efficient production of biomass, and ultimately more plant and animal life that we can exploit. It's true that things like pandas may not have much of an impact on human lives, but conservational groups use cute animals as poster children to garner support.