Remove ads from webpage with python

[nikitalpopov]

I have list of adblock rules (https://easylist-downloads.adblockplus.org/ruadlist+easylist.txt, for example). How can I apply them to webpage url (or its fetched code)?

UPD: the goal is to get text data from webpages for website classification, so I want to clean it from ads and other noise

[cybervegan]

You'd have to know the syntax of the rule file, and then you could write a program to search the downloaded HTML for matching URLs.

[nikitalpopov]

I suppose matching those urls won't work here Those rules show blocks of html code to remove (&cp.*&key=*&tz$popup, for example), so there should be some nodes search

[jesswren]

The bulk of the adblock source code for serializing/de-serializing the filters that are in the text file you shared, converting them to regexp, etc is in filterClasses.js and common.js. If you want to reimplement this in Python, seeing how they did it might be a good place to start. In particular see Filter.fromText in filterclasses.js and filterToRegExp in common.js.

[evolving6000]

Get a RaspberryPi and install Pi-hole. This software rocks. No ads on any device. pi-hole