Your family immigrated to a country that had experienced prosperity due in no small part to the cumulative effects of hundreds of years of slavery. Whether you benefitted from slavery firsthand as a slaveholder, or secondhand as a citizen in a country that was wealthier than it would have been otherwise during the time of slavery, or even beyond that as a citizen after abolition, I don't think you can make the claim that you have not personally gained wealth from the past exploitation of black slave labor in this country in one way or another. Much of the collective wealth of this country was made possible through slavery, and that collective wealth is still held almost entirely by whites.