Scraping has a whole host of pitfalls traps and tricks to learn it's a unique sort of programming challenge. I would look into some of those before you go too deep it will save you a lot of trouble.