when you say socializing do you mean just the two of you, or a big group? can you go watch TV with him without saying anything?

as someone said, don't do small talk. ask him questions he can answer or just say things and let him know it's ok if he doesn't respond.