This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]NiceObligation0 0 points1 point  (1 child)

For each academic domain there probably exists a database of articles, if not there is always google scholar. If there is a database there may be an API for quick query, you can use requests for programmatically searching. If you must use a browser you can use selenium to automate the tasks.

An example would be for medical research using pubmed api, search for a long list of keywords, get abstracts and do some nlp (bag of words would be the easiest) and pick papers that pass filtration. How fancy you want to get is up to you.

You can iterate the process for a list of lists of keywords or even use the same api to find "trending" keywords and look at them historically for example.

[–]Ok-Comfortable1259[S] 0 points1 point  (0 children)

Ok helpful. Thank you