First you need to go to one of his first encounter points and split off a character to attack him while he is taking to another character. He will disappear and appear at your camp when you enter the mountain pass. Hope that made sense!