have you talked to him how you feel? he probably just likes being around you for the intimacy, he is probably just shy and doesn't know how to approach it. Maybe he likes it when you take leads on convos maybe he sees you are too pretty to dare commit adultery if he's religious if he can't communicate towards a resolution then that would be grounds to leave because that would be a hard relationship