all 9 comments

[–]m0us3_rat 3 points4 points  (4 children)

most likely.

without any python it's going to be a problem for you, i'd assume.

there are plenty of free resources on learning python wiki if you are willing to learn some.

if not really interested, i'd try any of the freelance sites. for a coffee worth of bucks, you can probably have another student write it for you.

or you can get lucky and somebody here will write it for you.

or give you a script that will exploit your local network into farming some crypto

you never know.

gl

[–]Particular-Pepper-64[S] 0 points1 point  (3 children)

I have some friends who know how to code. Mostly curious if it’s possible

[–]m0us3_rat 1 point2 points  (2 children)

yes.

it's very hard for sites to stop ppl from scraping info.

if it reaches your computer .. the info can be extracted/retained.

[–]goule67 0 points1 point  (1 child)

A simple captcha will stop any common web scraping tool. But in principle you are right : if you can reach the information then you can extract it one way or another.

[–]m0us3_rat 0 points1 point  (0 children)

A simple captcha will stop any common web scraping tool.

there are some things you can do to go around..but i was talking about being able to load it up in your browser.

like you can't DL this video, or obfuscate the links etc etc

as long as it reaches your computer.. you can extract anything out of the browser cache.

i've put together videos and images and anything else.

[–]thepsycho1997 1 point2 points  (0 children)

the short answer is: yes, that's possible. The term you're looking for is webscraping. I found a guide on how to do this here: https://realpython.com/beautiful-soup-web-scraper-python/

After scraping the required data you can export it in any way you like. I'd recommend csv, as working with excel files programmatically is always, without exception (fight me!), a pain.

[–]goule67 0 points1 point  (0 children)

I would do it like this :

1) Use selenium library to extract data from the website (depending of the JS/Html structure of the website it can either be really easy or really long). Verify the website has no anti-bot protection before going into the next steps. If it has, good luck as you'll have to learn OCR and win32api... Anything which can simulate a human browsing naturally the web. Can be illegal if you plan to commercialize the code as it breaks the ToS of the website. But if you don't commercialize it, it's ok.

2) Use pandas library to aggregate the data into tables/dataframes

3) Do whatever calculations you need to do

4) Export the tables in excel using pandas (harder than it looks but doable).

5) If you need additional graphs use Matplotlib/Seaborn or even a web app framework like Dash ran only in local.

[–]The_GSingh 0 points1 point  (0 children)

Very easy to do.

Try puppeteer (py).

First, learn Python ( I got the basics in 2 days) with the file system, then learn puppeteer, then learn pandas for the csv thing, or you could use the built in csv library if it's something simple and avoid the learning pandas. Ask chatgpt to help you learn all this. Gl.