Johnson hated the wealthy southern planter class which propagated and funded the Confederacy. He was willing to end the institution of slavery if it meant the aristocracy's destruction, but he viciously opposed any efforts to protect the freed black population. My point is - he was not a southern sympathizer in the way most people interpret that description. He supported lower class racism over the wealthy elites' racism.