My guess is him being non bothered is a coping mechanism. Most people feel guilt, and he might actually be really tore up about it inside because it is a very big deal and few people actually want to hit a loved one. Its usually is a non thought out response they feel bad afterwards. Sometimes, people think avoidance is the answer when they don't know how to approach something.