In the area of race relations, there is very little high ground for ANY American to occupy.
Most Americans are beneficiaries of the Aboriginal American genocide. Every house, factory, farm, bank, apartment building, sidewalk, store, freeway, oil well, mine, or mill is located on expropriated land. The wealth of America was extracted from and produced on the land of the displaced or exterminated American Indian.
Slavery was visited upon Africans, and slaves were worked primarily on plantations, but not exclusively, and not exclusively in future Confederate states. Southern states, southern planters, southern importers or exporters, southern manufacturers, southern slave markets -- just about the entire southern economy -- depended on capital under the control of New York banks (primarily). Northern firms conducted much of the trade in southern goods. Slaves and plantations were insured by northern companies. Much of the slave trade was conducted by companies in Connecticut or Rhode Island.
The wealth northern businesses accumulated from the south benefitted wealthy families, institutions, and northern states. Brown University in Providence, Rhode Island, for example, benefitted from the slave trade. Just one among numerous beneficiaries.
The northern business establishment that benefitted from slavery also benefitted from the civil war, and benefitted from reconstruction. When you control so much money, it is difficult to not benefit from just about anything.
Many family histories of Americans include branches of antebellum southerners, slave owners, slaves, army soldiers who fought against the American Indians in the genocidal wars, and so on and so forth. Immigrants who came here in the early 20th century? They were, in many cases, egregiously sexist and racist, to boot -- even if they themselves were oppressed people.
And white people? The bulk of white people shipped over to the colonies were white trash the English wanted to get rid of. For the most part, the early white trash remained below the mean level of accomplishment. They stayed working class. Waves of white riff raff came to the United States to find a better life than they could get in Norway, Italy, Germany, Ireland, Russia, the Balkan and Baltic states, etc. 99% of them did not become part of the rich 1%, or even the better off top 10%. They stayed working class. The American Ruling Class has never respected the white working class much more than it has respected any other part of the American demographic.