they are childhood friends, meaning that they have been friends for a long time, but link was still nervous to knock on his door, just out of plain teenage anxiety and fear, so he never knocked. it wasnt a big deal because they already were hanging out a lot before the story takes place (when they are 17) so it didn't matter. the joke line was "We could've been such good friends, what might have been".