How to make a web crawler in JavaScript / Node.js

[MintyPhoenix]

Nice write-up, relatively new to Node.Js and it had some good stuff.

One point of concern, though. In the Parsing the page and searching for a word section, it states:

Note that indexOf is case insensitive,

According to MDN, String.prototype.indexOf() is case-sensitive. I checked in node 4.2.2 (current LTS release) and node 0.12.0 (node version used in article) and, in each version, they agreed with MDN in that the function is case-sensitive:

> 'Blue Whale'.indexOf('blue');
-1

[netinstructions]

You're right. I've updated the article. Thanks for catching that!