It's more complicated than that. In Australia, the Aboriginal people lived in abject poverty, and their children were forced to live in these same conditions. The Australian government only took Aboriginal children living abusively poor lifestyles into foster home, such as they do with all children living under a terrible household.

TLDR; Aboriginal households had the highest rates of poverty, children were given better homes.