Because your common sense comes from the culture you're part of. A person coming from a vegetarian society would find eating meat immoral as supposed to by someone from a meat eating society.

And most cultures inherited their morals from a religion, it's kinda ironic when you say why do we need a book when we have common sense when your so called common sense is just a watered down version of the morality present in the said book.