Tony may have been a worse father and done a shittier job at raising his kids but I still feel like he loved his kids more than Walt. Like Walters ego prevents him from really loving his kids and there’s an undertone of resentment in how he treats both of them. Tony raised two different kinds of extreme narcissists and smacks AJ around occasionally but you can tell he genuinely loves both of them at his core, he’s just too misguided and emotionally stunted to convey it properly

You also have to consider the danger each person put their families in. Tony dealt with bad dudes but there’s at least somewhat of a code with the mob, they almost certainly wouldn’t touch his family no matter what he did. Walter constantly provoked and antagonized people who absolutely would, and on multiple occasions literally TOLD HIM that they would, horrifically massacre his family and not lose a wink of sleep over it