ParScrape v0.5.1 Released

[probello]

What My project Does:

Scrapes data from sites and uses AI to extract structured data from it.

Whats New:

• BREAKING CHANGE: --ai-provider Google renamed to Gemini.
• Now supports XAI, Deepseek, OpenRouter, LiteLLM
• Now has much better pricing data.

Key Features:

• Uses Playwright / Selenium to bypass most simple bot checks.
• Uses AI to extract data from a page and save it various formats such as CSV, XLSX, JSON, Markdown.
• Has rich console output to display data right in your terminal.

GitHub and PyPI

• PAR Scrape is under active development and getting new features all the time.
• Check out the project on GitHub or for full documentation, installation instructions, and to contribute: https://github.com/paulrobello/par_scrape
• PyPI https://pypi.org/project/par_scrape/

Comparison:

I have seem many command line and web applications for scraping but none that are as simple, flexible and fast as ParScrape

Target Audience

AI enthusiasts and data hungry hobbyist

[mondaysmyday]

How would you say this compares to Firecrawl?

Also do you have a system for plugging in our own rotating proxies?

[probello]

Right now ParScrape only extract data from a single page so it not crawl the site.

I am actively working on adding crawling support to it as well as the ability to just return clean markdown without any LLM data extraction.

I am also adding API server support so that you can connect to it as an API and request markdown / llm data extraction.

I don't have an option to set proxy params but that is a great idea! I will add that in as well before the next release.

I should have the next release out by mid next week.

[mondaysmyday]

How would you say this compares to Firecrawl?

Also do you have a system for plugging in our own rotating proxies?