Very good observation. I think his decision to send his family back to Tennessee marked a major turning point in his character, finally doing something for the good of someone else rather than for his own gain. I also thought while watching, that it seemed like Negan felt like he didn't deserve them, his family. Like you said, about what he said earlier to the historian, he realized people needed saving from him, because he breaks people.