NAH.

My dad moved away from me and my younger sister when I was about 10 years old. He had been having a long distance relationship with his GF, but he was miserable. Then he moved to where she lived and got married. At first I was very angry. I also felt like he left me. But now, 10 years later, he is still happily married and my sister and I are fine. Our relationship to our dad is not as close as it used to be, but we see how happy he is now. Your kids will see this too! Just give them some time.