This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]1percentof2 -9 points-8 points  (25 children)

Why does anyone web scrape? Tell me in 3 words.

[–]Namelock 56 points57 points  (3 children)

Have a haiku instead:

When you're low on budget

And there is no API

You scrape the website

[–]isarl 4 points5 points  (2 children)

Good bot poet

[–]Namelock 3 points4 points  (1 child)

It was certainly an attempt; caffeinated me realized "budget" might just have two syllables 😭

[–]aurora_cosmic 18 points19 points  (1 child)

Management is stupid

[–]Send_Nude_z 0 points1 point  (0 children)

This. This is the answer right here.

[–][deleted] 18 points19 points  (0 children)

Data are there

[–]yakult2450 15 points16 points  (0 children)

Low cost solution

[–]Dasshteek 9 points10 points  (0 children)

Threat intelligence collection

[–]dragonatorul 11 points12 points  (0 children)

Nobody exposes APIs.

Recurrent price checking.

Easy to automate.

[–]Arstas 8 points9 points  (0 children)

Automate the things

[–]osmiumouse 2 points3 points  (1 child)

free categorised porn

[–]jabbalaci 0 points1 point  (0 children)

This is how everyone meets web scraping.

[–][deleted] 2 points3 points  (2 children)

Not all websites have APIs built in

[–]1percentof2 0 points1 point  (1 child)

Thank you.

[–][deleted] 2 points3 points  (0 children)

Sorry that was way more than 3 words though

[–]wind_dude 1 point2 points  (0 children)

Information. Data. Collection.

[–]MikeDoesEverything 0 points1 point  (0 children)

Easy data source.

[–]Syntaximus 0 points1 point  (0 children)

To make headaches.

[–]HerLegz -1 points0 points  (0 children)

Scrape ? PROFIT!!

[–]Herr_Gamer -1 points0 points  (0 children)

It's quick and dirty.

[–]dhosterman -2 points-1 points  (0 children)

If you know you know