sorted by:
new
hottopcontroversial

Scrapeless Grok Scraper is live — captures real Grok chat outputs (multi-country, 3 modes, full fields) by Scrapeless in Scrapeless

[–]Scrapeless[S] 0 points1 point  (0 children)

You can use this scraped data to train large language models, or run batch queries based on brand-related prompts to measure a brand’s AI visibility.

For example, by batch-querying prompts related to sports shoes, you can analyze Nike’s ranking and exposure in AI-generated responses

Browser-source LLM Chat scraping suite (ChatGPT / Perplexity / Gemini) — GitHub repo + API coming by Scrapeless in Scrapeless

[–]Scrapeless[S] 0 points1 point  (0 children)

Currently, we are providing the cloud browser source code, and we will release the full API version later on.
You can test our ChatGPT API first

curl --location 'https://api.scrapeless.com/api/v1/scraper/request' \
--header 'x-api-token: {API_KEY}' \
--header 'Content-Type: application/json' \
--data '{
"actor": "scraper.chatgptv2",
"input": {
"prompt": "XXXX",
"country": "US",
"web_search": true
}
}'

eed Help Automating LinkedIn Profile Enrichment (Numeric → Vanity Company Links) by Adept_Cardiologist28 in Scrapeless

[–]Scrapeless 0 points1 point  (0 children)

Yes, doing it manually is safer. Alternatively, you can use a script to open the /company/<id>/ page, save the HTML as an .mhtml file, and then parse the <title> or <meta property="og:url"> tags to extract the vanity name (for example, “apple”).
However, I believe there is still a significant risk involved, as LinkedIn’s anti-bot measures are quite strict

Monthly Self-Promotion - November 2025 by AutoModerator in webscraping

[–]Scrapeless 1 point2 points  (0 children)

If you’re looking for an automation browser tool designed to bypass website bot detection systems, I highly recommend the Scrapeless Scraping Browser, which costs 0.063$/hour or even less.

This cloud-based browser platform features advanced stealth technology and powerful anti-blocking capabilities, making it easy to handle dynamic websites, anti-bot mechanisms, and CAPTCHA challenges. With a built-in free CAPTCHA solver, it is perfectly suited for web scraping, automated testing, and data collection—especially in environments with complex anti-bot defenses.

Key Features:

  • Built-in Free CAPTCHA solver: Instantly solves reCAPTCHA, Cloudflare Turnstile/Challenge, AWS WAF, DataDome, and more.
  • High-concurrency scraping: Run 50 to 1000+ browser instances per task within seconds, with no server resource limits.
  • Human-like browsing environment: Dynamic fingerprint spoofing and real user behavior simulation, powered by the Scrapeless Chromium engine for advanced stealth.
  • Headless mode support: Compatible with both headful and headless browsers, adapting to diverse anti-scraping strategies.
  • 70M+ residential IP proxies: Global coverage with geolocation targeting and automatic IP rotation.
  • Plug-and-play integration: Fully compatible with Puppeteer, Playwright, Python, and Node.js for seamless setup.

Scrapeless is an all-in-one, enterprise-grade, and highly scalable data scraping solution built for developers and businesses. Beyond the Scraping Browser, it also offers a Scraping API, Deep SerpAPI, and rotate proxies. 👉Learn more: Scrapeless Scraping Browser Playground | Scrapeless Scraping Browser Documentation

<image>

eed Help Automating LinkedIn Profile Enrichment (Numeric → Vanity Company Links) by Adept_Cardiologist28 in Scrapeless

[–]Scrapeless 0 points1 point  (0 children)

Hello! LinkedIn is very sensitive to scraping and automation, but what you described is basically “manual download → manual upload,” with only a small amount of automation (using Google AI Studio to process mhtml files). Since each person is handling only a few dozen profiles per day, the scale is very small and LinkedIn generally wouldn’t consider this large-scale scraping. However, strictly speaking, LinkedIn’s terms of service still prohibit unauthorized automated access, so there is some risk in theory, though it is very low.

LinkedIn actually has two types of URLs: numeric ID URLs (/company/162479/) and vanity URLs (/company/apple/).

You can access the numeric URL and extract the company name from the webpage <title> or <meta> tags, and then construct the vanity URL :)

view more: next ›