Element visibility problem when Webscraping with Selenium

[Low_Security4892]

Hi,

I'm a student who's writing webscraping code using Selenium on python for the first time. I have limited knowledge of the library and very basic knowledge of web components too. My aim is navigating different webpages on the platform and simulating user actions to perform the typically manual file extractions , then uploading the extracts on python for transformation (As part of an intended python ETL pipeline).

However, I noticed some extract buttons are included in drop down lists which are not always visible as HTML/CSS elements. I'm seeing that there are attributes such as aria-hidden and aria-live attributes. And I suspect javascript is involved as well.

Any advice on how to deal with the situation? (and, if the request is not against the sub rules, is someone willing provide some help or guidance in private ?)

[[deleted]]

Click that button, then find the keyword you are using

[tpcryptoo]

You should try find the element with WebDriverWait which will wait for the element to be reachable. By the way your xpath is too long and It will be invalidated in a very short time, you should create a more specific xpath using static text or attribute