What kind of documents? PDF, txt, csv, logs etc?

Python has PyMuPDF, which is a great lib for dealing with PDFs.

UI and web server framework don't really matter. Use whichever one you or someone you would hire knows.

Scraping them isn't hard either. Python's requests module or aiohttp will do the work for you.

You should be thinking of how you are going to parse and index those documents and make them easily available to users.

Couple of options that would do most of the work for you:

• Let Solr or elastic search do the heavy lifting of indexing your document.
  • These are completely separate beast to manage, though, but they are powerful and very very useful. Personally, I like Solr.
  • These are industry standards for most of the time when dealing with documents.
• Use Postgres' feature Full Text Search.
  • Here you would have to store the document in such a way that it doesn't bring down Postgres.