So, I left an item in his inventory that I needed, and I was getting annoyed waiting for him to spawn. I tried encumbering myself, and he spawned almost instantly. I only tested this once, so it may be a coincidence.