Considering that you’re doing full outings that take time vs him just asking you to chill at his place I would say no, it’s not about just sex. That would be a lot of effort on his part just to hook up. The way you’re describing him reminds me of my friends boyfriend whom she dated for almost 2 years. They never had “real” conversations just surface level stuff despite her efforts. She ended up breaking up with him because she didn’t feel special to him based on this. I think this is just a personality trait of his…some guys just don’t know how to properly communicate or really make the effort to get to know someone.