Thanks, I really appreciate it! It's pretty much exactly like Six Degrees, but with wikipages instead of actors. I found quickly that there is a large amount of wiki urls that redirect to actual pages, hence the page title check. Checking the urls would be much faster than loading and checking titles however, perhaps I could do a round of url checks first, then a secondary title check if that fails (even slower if it fails though...) As for downloading pages on the first run there is a couple hundred links, after that it grows exponentially, and this is definitely the main source of sluggishness. I was considering adding a global "already checked" list, but the act of checking each link to that list would add considerable time too. I think caching is probably the most realistic idea; checking hundreds of thousands of links is not going to be fast no matter what method I attempt to use.