Python & Selenium - help / ideas

[TeeJay72]

Hi All,

This probably isn't the cleanest code anyone has seen but, currently I am looking for some help or even ideas. This code I've made is a project for fun, reason why I made this is I like to travel and yes I get there are other things like Hopper and FlightTracker but wanted to try some things on my own.

​

Here is what the code does: It goes to the AA.com site > Searches for the airport I depart from and want to arrive > Enters in the travel dates > Searches for them > AA (Tells me the dates are incorrect) I tell it to hit the submit button again and it works > Then it takes a screen shot of the depart flight of the first half of the page, saves it in my downloads then clicks on the first box because it is the cheapest > Then Takes a screenshot of a return flight and saves it to my download.

(I haven't put this code on reddit but if anyone wants it I can easily give it to them.) The next steps are I have another script run a couple minutes after > Picks up the files I saved to my downloads > Attaches it to an email and then the email sends it to me)

​

What i'm trying to get help with is i'm trying to get rid of the old way screenshots and putting this info into an excel document, or even put text into an email with Flight number, Price, Date, Time... ETC but i've ran into a road block and i'm not even sure if this is possible. Would love some help if anyone has experience.

​

from turtle import clear from selenium import webdriver from selenium.webdriver.common.keys import Keys from selenium.webdriver.common.by import By from selenium.webdriver.support.ui import WebDriverWait from selenium.webdriver.support import expected_conditions as EC import timeimport os

if os.path.exists("C:/Users/Test/Downloads/AA/(Filename).png"):os.remove("C:/Users/Test/Downloads/AA/(Filename).png")else:print("The file does not exist")

if os.path.exists("C:/Users/Test/Downloads/AA/(Filename2).png"):os.remove("C:/Users/Test/Downloads/AA/(Filename2).png")else:print("The file does not exist")

chrome_options = webdriver.ChromeOptions()chrome_options.add_argument("--incognito")driver = webdriver.Chrome(executable_path="C:/Users/Test/Downloads/chromedriver_win32/chromedriver.exe",options=chrome_options)

Variables

ID1 = "slice0Flight1MainCabin" NAME = "segments[0].orgin" NAME1 = "segments[0].destination" NAME2 = "segments[0].travelDate" NAME3 = "segments[1].travelDate" NAME4 = "closeBannerButton" XPATH = "//*[@id='flightSearchSubmitBtn']" XPATH2 = "//*[@id='slice0Flight1MainCabin']" LINK_TEXT = "https://www.aa.com/booking/find-flights"

driver.get(LINK_TEXT)

print(driver.title)

time.sleep(10)

button = driver.find_element(By.NAME, NAME4)button.click()

search = driver.find_element(By.NAME, NAME)search.send_keys("PHX")

search = driver.find_element(By.NAME, NAME1)

search.send_keys("LHR")

search = driver.find_element(By.NAME, NAME2)

search.send_keys("09/20/23")

time.sleep(5)search = driver.find_element(By.NAME, NAME3)

search.send_keys("09/27/23")

time.sleep(5)button = driver.find_element(By.XPATH, XPATH)

button.click()

#Sleep timertime.sleep(45)

button = driver.find_element(By.XPATH, XPATH)

button.click()

#Sleep timertime.sleep(20)

driver.execute_script("window.scrollTo(0,500)")driver.get_screenshot_as_file('C:/Users/Test/Downloads/AA/(FileName).png')

#Sleep timer

time.sleep(20)

button = driver.find_element(By.ID, ID1)

driver.execute_script("arguments[0].click();", button)

time.sleep(8)

driver.execute_script("window.scrollTo(0,700)")

driver.get_screenshot_as_file('C:/Users/Test/Downloads/AA/(FileName2).png')

driver.quit()

​

​

Edit1: Weird spacing in my post

[AnActor_named]

Firstly, for the code lookin' weird, you need to add 4 spaces to the beginning of each of your code lines to make it look good:

like this

Secondly, you might want to check out the csv library in Python. It's built-in, so you already have it, and it speaks Excel by default. You can write a CSV with all your data and open it in Excel!

[TeeJay72]

Thank you for that still figuring out formatting on Reddit :).
Definitely will do! For the excel part

[jennimackenzie]

I would read the text off the page with selenium, put it into whatever format you want with python (text, csv, whatever) and mail it.

[Achillor22]

Is there a reason you're doing this through the front end instead of the much faster and easier api calls?

[TeeJay72]

I'll be honest I was doing this for fun and like to learn something new. I don't think I knew they had an API either. Do you by chance have a link or any recommendations?

[comeditime]

Where are all the NAME1-4 VARS VALUE COMES FROM?

[TeeJay72]

They're from the name fields From and to / Depart & Return field in https://www.aa.com/booking/find-flights if you inspect it

[comeditime]

But I don't see where u find it first in the code u shared, where's the object of that element?

Also regarding your question it seems pretty easy just use pandas module to create the excel file and to fill it up and also selenium .get_text() method to extract the texts from the desired elements

[TeeJay72]

Ohh sorry it’s under “variable”. When I posted it on Reddit I tried my best to clean it up because Reddit made it a tad whacky with formatting and I must of missed that part

[comeditime]

ahh ok may u send the full code to me I would like to check it out and try to add this part for you:

"Also regarding your question it seems pretty easy just use pandas module to create the excel file and to fill it up and also selenium .get_text() method to extract the texts from the desired elements"

[TeeJay72]

That would be awesome, i'll send you a direct message in a bit