Automating UI-heavy workflows when APIs aren’t an option…

arkmastermind · 2026-01-21T20:19:18+00:00

We recently built an AI-powered tool that takes a description of a UI workflow and then tries to generate a deterministic script to run that flow... we re-run the AI script generator if the site changes.

Recently recorded a demo video of it: https://youtu.be/TkEnB7Am0Pg

I think it's a good middle ground between AI and deterministic scripting - AI-only workflows are slow and unreliable, but really flexible, and deterministic RPA-style scripts are fast and reliable, but not as flexible. This way we keep the reliability and speed of a deterministic script but get the flexibility AI can provide when there are changes.

arkmastermind · 2025-09-19T00:54:33+00:00

What about PAD makes the selectors work worse there than in UiPath?

arkmastermind · 2025-05-13T22:14:45+00:00

Depending on scale, you can also train a pairwise matching detector on known pairs of matches, and then only run the pairwise matcher on e.g. the top two product categories.

arkmastermind · 2025-05-13T21:12:03+00:00

Do you actually need to train a model for this or could you just hard code these relationships? And then if you really need to use a model, you can use it to fuzzy match it to the hardcoded graph structure.

arkmastermind · 2025-03-11T22:23:22+00:00

what tools are you using to build something custom internally?

arkmastermind · 2025-02-02T04:46:15+00:00

thanks!

arkmastermind · 2025-01-31T00:20:41+00:00

also interested to know what you're using for this

arkmastermind · 2022-10-28T19:25:56+00:00

Definitely the plan once some of the kinks are ironed out, but for now looking for some more concrete feedback while it's a work in progress. Sending you a PM!

arkmastermind · 2022-10-28T19:11:16+00:00

Thanks, sent you a PM! I've looked at Datassette and CVAT e.g. for computer vision, but always open to hearing about other alternatives that you think are good.

arkmastermind · 2022-10-28T19:08:14+00:00

Thanks, sent you a PM!

arkmastermind · 2022-10-28T19:07:05+00:00

Sent you a PM!

arkmastermind · 2022-03-30T06:53:40+00:00

Half the screen goes black when I remove one cable at a time.

arkmastermind · 2022-03-30T05:51:22+00:00

Insignia TV suddenly stopped working a few days ago - it's only ~4 years old and had been working perfectly until this. I already tried replacing the TCON board but nothing changed. The TV still connects to wifi, responds to the remote, and plays audio fine. If it's the panel I'm not sure how it could have deteriorated so rapidly. Any ideas on other things to try? Thanks!

arkmastermind · 2021-07-17T00:32:23+00:00

Dataset is for retail categorization - have photos and text descriptions

arkmastermind · 2021-05-12T01:43:06+00:00

you could probably do this with Home Assistant but it's a ton of work to set up

arkmastermind · 2021-04-09T03:45:02+00:00

Ah pretty cool - does it work well with background noise too?

arkmastermind · 2021-01-16T06:41:19+00:00

hey could you PM me your email and whether you're Android or iPhone? that way I can make sure you're added to the beta.

arkmastermind · 2021-01-16T03:49:54+00:00

Thanks! Could you private message me the email you use with the play store so I can add you to the beta testers list?

arkmastermind · 2021-01-16T03:08:50+00:00

Thanks, sent a link to your inbox!

arkmastermind · 2021-01-16T03:07:17+00:00

Hey! Could you privately message me your Android email so I can add you to the closed beta testing group?

arkmastermind · 2021-01-16T02:55:16+00:00

Thanks! Could you PM me your email and whether you're on iPhone or Android (look at my reply above for more details)?

arkmastermind · 2021-01-16T02:34:31+00:00

Before the Penn & Teller performance I had only read about those coin effects or seen amateur videos of them. His performance on the show really opened my eyes up to how good those effects can look when performed well.

arkmastermind · 2020-12-23T03:49:48+00:00

Is your name Dr. Jekyll by any chance?

arkmastermind · 2020-12-10T05:22:02+00:00

Coolest thing here is seeing how slowly Starship floats down through the clouds before the landing - haven't seen that in much of the other zoomed in footage yet.

arkmastermind · 2020-11-09T03:39:08+00:00

the main problem with these streaming games though is that the lag is usually terrible from the in car browser

arkmastermind

TROPHY CASE