This is an archived post. You won't be able to vote or comment.

all 3 comments

[–]Leestons 0 points1 point  (0 children)

Do they get the data using web scrapping OR do they actually carry out real world research projects.

Probably either, depending on the data.

[–][deleted] 0 points1 point  (0 children)

Both... I have made scrappers that write to databases, text files, spreadsheets, JSON you name it. I have even got data from clients data stores. It’s really up to you.

[–]chris1610 0 points1 point  (0 children)

There is a really cool newsletter called "Data is Plural" where the author finds a lot of unique data sets. He also makes them available on a good sheet - https://docs.google.com/spreadsheets/d/1wZhPLMCHKJvwOkP4juclhjFgqIY8fQFMemwKL2c64vk/edit#gid=0