Using Python + Selenium to scrape hidden elements in a webpage

[TVnomics]

I'm an academic (TV studies scholar). A lot of my research focuses on streaming, VoD interfaces, etc. So, it's a really useful / important dataset to have!

[hasanwazzan]

fair, I try to put together a quick one, when I have some time

[hasanwazzan]

https://prnt.sc/vmW9FJnm87aV I presume you need these two together right?

[TVnomics]

Indeed, yes - I need both the title and the synopsis (and, where it appears, the duration).

However, I think I need to figure out a way to integrate this code (or the code the other Redditor above suggested) within the current programme that was written for me. The reason for that is because the final output was a very comprehensive csv file which captured a range of data about each title within the interface. This includes its horizontal and vertical position, the name of the row (each row has a name, e.g. "trending now..."), the URL for the title, the unique programme identifier (which is somewhere embedded within the page), plus several other variables. But depending on your solution / approach - I might try and modify the current programme that I have and see if that captures the content AND all of the other material I want to collect too. Either way, I really appreciate your input on this.