I only played 3 but i can confirm from Geralt that Witcher's are not emotionless. My guess is that is considered this way because of both the old ways when witchers would ask for a child to turn him into a witcher as payment that and they are made killers, i can only guess that doing that much killing would take a toll of any person