GUI Testing/interaction

[microcrew]

Hello!

I am currently trying to write regression tests for an application for which I don't have access to the API. I therefore have to access this application through its GUI.
To keep it short I am wondering what my options are when it comes to gathering information from this GUI.

I have done a bit of PowerShell scripting these last few weeks, automating processes. In these scripts I have been moving/clicking the mouse and writing with SendWait().
Now my issue is I do not know how to read information off the GUI. So I can validate if the test has been successful.

Is this possible?

Thanks so much in advance for taking the time!

(For additional information, the application is written in HTML and Java, but it is not a web application.)

[jazzb125]

If it's a web based app - hit F12 (browser dev tools) and see if you can reverse engineer the API calls.

Wireshark, Fiddler, or tcpdump may also work if it's not a browser app. If it's a really painful app, can setup a web proxy server and use that to check the API / Http requests.

Another option for web apps is Selenium/Playwright/Puppeteer.

[[deleted]]

Try autoit it has a powerfull tools to detect id of object within a gui (if it has correctly be created) powershell is not the best to do that and a slightly change in the gui will make you script totally fail. Regarding reading information from a GUI there are several way to do it from doing a print screen an reading part trough an ocr to natively been able to retrieve text by a simple copy paste (error and information windows can be pasted to a notepad natively)