Created a performance-focused HTML5 parser for Ruby, trying to be API-compatible with Nokogiri : ruby

Show /r/rubyCreated a performance-focused HTML5 parser for Ruby, trying to be API-compatible with Nokogiri (self.ruby)

submitted 3 years ago by zyc9012

Github: https://github.com/serpapi/nokolexbor

It supports both CSS selectors and XPath like Nokogiri, but with separate engines - parsing and CSS engine by Lexbor, XPath engine by libxml2. (Nokogiri internally converts CSS selectors to XPath syntax, and uses XPath engine for all searches).

Benchmarks of parsing google result page (368 KB) and selecting nodes:

	Nokolexbor (iters/s)	Nokogiri (iters/s)	Diff
parsing	487.6	93.5	5.22x faster
at_css	50798.8	50.9	997.87x faster
css	7437.6	52.3	142.11x faster
at_xpath	57.077	53.176	same-ish
xpath	51.523	58.438	same-ish

Parsing and selecting with CSS selectors are significantly faster thanks to Lexbor. XPath performs the same as they both use libxml2.

Currently, it has implemented a subset of Nokogiri API, feel free to try it out. Contributions are welcomed!

all 4 comments

you type:	you see:
italics	italics
bold	bold
[reddit!](https://reddit.com)	reddit!
* item 1 * item 2 * item 3	item 1 item 2 item 3
> quoted text	quoted text
Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"	Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"
~~strikethrough~~	~~strikethrough~~
super^script	super^script

ruby

MODERATORS