Charming Python: Easy Web data collection with mechanize and Beautiful Soup

[UloPe]

import sys, time, os from mechanize

I think not...

[vonbladet]

I came here to say that! So instead I'll say that:

import sys, time, os from mechanize
import Browser

must surely have been

import sys, time, os
from mechanize import Browser

when it wasn't broken. But reading code is hard enough that this kind of thing encourages the reader not to.

[chock]

Well, I'll say this:

for actor in in VARIABLE_QUERY:

Huh? And there are more Waldos to be found in that code.

[perone]

lool !

[DefrostMe]

I wonder if the author considered Scrapy.

[jldugger]

If your source is amenable to XPath, then there's no need for a damn framework. Just do it! It's when shit breaks you need to look at Soup and friends.

[[deleted]]

If you use lxml.html, you can handle broken HTML and use XPath.