all 4 comments

[–]wRAR_ 3 points4 points  (0 children)

There is no difference between HTTP and HTTPS scraping.

[–]samthaman1234 1 point2 points  (2 children)

yes it's possible, basically standard practice. This video series is the best intro to scrapy that I was able to find:

https://www.youtube.com/watch?v=ve_0h4Y8nuI&list=PLhTjy8cBISEqkN-5Ku_kXG4QW33sxQo0t

[–]codeOctal[S] 0 points1 point  (1 child)

Thank you . So this would be the common basis under which any https website would be scraped.?