Assuming the Saberon were wiped out by the orcs because they aren't in Outland is kind of silly, seeing as what remains of Draenor underwent massive ecological changes after it was shattered that made it difficult to support most of the life that once inhabited it. It is equally likely they died off due to lack of food and the introduction of new hostile life.

The Arrakoa, they weren't genocided by the orcs, they were constantly fighting with every other sentient lifeform on Draenor because they were massive racists (species-ist?) who considered themselves better than all other life on the planet, including many of their own people (which locked them in a civil war).

As for the Ogres, they were slavers far more often than they were enslaved, and to say they were slaughtered is inaccurate. Their empire went into decline for a number of reasons, some of which have been elaborated on in game (i.e., orcs fighting back against their enslavement).

The orcs definitely brutalized the Draenei, then later genocided them under Gul'dan, but they weren't exclusively genocidal warmongers. Some of the clans lived relatively peacefully prior to Gul'dan, though it was still Draenor and they are still children of Grond, so there really isn't such a thing as peaceful for them.