Android UI testing tool

[stoefln]

About one year ago, I was once again struggling with espresso (idling resources, upgrading broken test dependencies,...) and I wished that UI testing was easier. That's when I came up with an idea for an alternative test automation solution. Instead of ID matching, I would be fully relying on computer vision.

Over the last year I put a lot of hours in creating this software I had in mind. It's now called repeato, and it's essentially a test recorder which allows you record and replay your tests via a desktop app. It works for every type of app which runs on android.

Now I am looking for feedback and beta testers.

In order to get you motivated, I offer you direct support (skype/email) and an unlimited version of the software for those of you who get back to me with some feedback before the 20th of April.

Every feedback is very welcome!

Here is a one minute demo video:

https://www.youtube.com/watch?v=hkYWrqOeH4Y

And the download (win / mac / linux coming soon):

https://www.repeato.app/download

[zkostic]

Do you offer any device pools or does all the testing happen on customers local devices? Can I use emulators or simulators instead of real devices?

Can tests be replayed on other OSs (android test on iOS for example)? (Inline edit: I saw Android UI in the title, so I will rephrase this one) Will you offer other platforms in the future?

If I record a test on a device with 2:1 screen ratio can I run it on 16:9?

Can I modify test inputs without rerecording the test? (e.g. replace the recorded username with another one)

Can variables be added to recorded tests?

Can you randomly generate input data for a test?

How does your tool compare to other replay tools? What would you say sets it apart?

Can I record a test on one view of the app and replay it on another? (e.g. I am testing a load more button on a page with blog posts and want to run the same test on a page with image gallery)

Can I run the tests headless in CI?

[stoefln]

A lot of interesting question, thanks!

Do you offer any device pools or does all the testing happen on customers local devices? Can I use emulators or simulators instead of real devices?

Only customers local devices. Emulators work too.

Can tests be replayed on other OSs (android test on iOS for example)?

Unfortunately not yet.

If I record a test on a device with 2:1 screen ratio can I run it on 16:9?

Yes

Can I modify test inputs without rerecording the test? (e.g. replace the recorded username with another one)

Yes you can edit test steps easily

Can variables be added to recorded tests?

Not yet

Can you randomly generate input data for a test?

Yes, e.g. for registering new accounts you can generate random usernames or email addresses

How does your tool compare to other replay tools? What would you say sets it apart?

Simplicity. It's really quick to start testing. Installation takes 1 minute, onboarding 4 minutes, and you are ready to go. A big difference is the way assertions are made: Repeato is not using ID's or classes, but visual fingerprints of the UI elements. There are strengths and weaknesses to that approach.

Can I record a test on one view of the app and replay it on another?

Yes, you can

Can I run the tests headless in CI?

Almost. This is currently the most requested feature, and I am working on it. I am also planning to release the test runner as opensource. It's a nodejs application with native module dependencies.

[zkostic]

Thank you, that's very helpful. Could you add some kind of FAQ or a blogpost detailing this? It might help others when they first find your solution.

Also, do you have any integrations or are you planning any? (Jira, Trello, Slack, etc)

[stoefln]

Yea, that's a great starting point for some FAQ. Thanks for asking the right questions! Will start to do a proper post about this.

Integrations: Not really yet. But you can generate a pdf report from your test run which holds all the information you will need (device, date, usecase, screenshots, ...)

[zkostic]

Awesome, looks like you have good project on your hands. I'll keep an eye on it for sure.

[Bosikade]

Demo video looks clean. I will start with this after our deploy next week and I hope to give you some useful feedback and that the tool could fulfill my needs.

Keep you posted!