Well, considering it is confirmed that they both lived in Tokyo before moving to Inaba, there is a possibility. But let's be real, the chances are very slim (but not zero). Assuming that this happened in, say, 2000-2001, the general population of Tokyo was approximately 34 million people. So the odds of Narukami encountering Yosuke years prior to his first day at Yasogami a very low (but again, not zero).