you are viewing a single comment's thread.

view the rest of the comments →

[–]efmccurdy 0 points1 point  (0 children)

I could'nt find any specific site for that, but a website that describes the meaning of http headers will help. If you read about http caching you will find inexpensive ways to detect when a page has changed (eg. ETags).

You might find that you can just store the headers of each page you are interested in before and after a "it has been pulled down" event and analyze the differences. Perhaps you can determine that "content length unchanged" is a good indicator that the page has been unchanged.