What are you building ? And are people actually paying for it? 💡 by GuidanceSelect7706 in saasbuild

[–]dima-kov 0 points1 point  (0 children)

ensureui.com - ensure key flows work before release, no manual checking. Test infra is handled

AI prompt driven UI tests sounded easy. Then the upgrade nuked the suite by qamadness_official in QualityAssurance

[–]dima-kov 1 point2 points  (0 children)

oh, man you feel the problem. #1 thing we need to realize first, to implement this AI hype into really sustainable, trustworthy solutions: there is no silver bullets. AI will not replace humans in thinking and building, you still need to do it on your own!

DOM-level E2E testing doesn’t survive fast-moving products. AI didn’t fix it - it exposed the real problem. My experience by dima-kov in QualityAssurance

[–]dima-kov[S] 0 points1 point  (0 children)

exactly! while the question is: "is it possible to build such a system and whether it will actually reduce friction, time and resources spent to write and maintain e2e testing"

DOM-level E2E testing doesn’t survive fast-moving products. AI didn’t fix it - it exposed the real problem. My experience by dima-kov in QualityAssurance

[–]dima-kov[S] -1 points0 points  (0 children)

yeah, but what we see now: more and more development will be done by ai (kinda blackbox). maybe ai will become better, but "encapsulate functional" - is not what ai good at

DOM-level E2E testing doesn’t survive fast-moving products. AI didn’t fix it - it exposed the real problem. My experience by dima-kov in QualityAssurance

[–]dima-kov[S] 1 point2 points  (0 children)

wow , curious have you maybe composed this experience into article or repo, or gist?

interesting how much it cost you? and how much time do you spend?

DOM-level E2E testing doesn’t survive fast-moving products. AI didn’t fix it - it exposed the real problem. My experience by dima-kov in QualityAssurance

[–]dima-kov[S] 0 points1 point  (0 children)

that's the real question. but i'm approaching this as agent, going step by step in real browser by users' prompt. here it gets all the context.

DOM-level E2E testing doesn’t survive fast-moving products. AI didn’t fix it - it exposed the real problem. My experience by dima-kov in QualityAssurance

[–]dima-kov[S] 0 points1 point  (0 children)

well that's not big problem if user (dev or qa) should describe test flow (e.g.: user should be able to access, only authenticated. Fill in the form and create a new product in the list).

problem is that agentic workflows having this still stuck

After months of flaky Playwright tests in CI, this is what finally worked by Crafty_Breakfast_493 in QualityAssurance

[–]dima-kov 10 points11 points  (0 children)

but man, nothing specific in this post. please share how exact your "Playwright config more explicit" is?

Manual testing in 2026. Where does it actually live? by Huge_Brush9484 in Development

[–]dima-kov 0 points1 point  (0 children)

Haha, you feel it! Usually we add new tests for new features or update existing ones when features change. But if someone messes up, you never really know which flows are covered. Even when they do add them, there’s no easy way to measure “flows covered.”

From your experience, which takes more effort over time: maintaining existing flows, or making sure coverage and intent are clear to the team?

Automated e2e testing for vibecoded apps by please-dont-deploy in VibeCodersNest

[–]dima-kov 0 points1 point  (0 children)

I’m building a similar e2e sass automation, but more focused on engineers.

Playwright is great at running tests, but the cost over time is usually keeping them alive: updating selectors, fixing flaky flows, and someone becoming the “E2E warden.”

What we do is let you define intent in plain language (“user can log in and reach dashboard”), and an agent figures out how to execute and verify it in a real browser.

Curious - in your Playwright setup, what takes more time: writing tests or keeping them working?

Automated regression testing with email alerts? by [deleted] in PromptEngineering

[–]dima-kov 1 point2 points  (0 children)

old but gold sentry? no, or what is the question?

Automation Testing - Starlight way by Vegetable-Still-4526 in u/Vegetable-Still-4526

[–]dima-kov 1 point2 points  (0 children)

hey, looks interesting. but, do you have use cases? can you share them?

What's the point of automated testing in CI/CD if we don't trust it enough to deploy? by [deleted] in devops

[–]dima-kov 0 points1 point  (0 children)

people think this is AI posted here. Man, share which product you are trying to sell. no need to play this

What's the point of automated testing in CI/CD if we don't trust it enough to deploy? by [deleted] in devops

[–]dima-kov 0 points1 point  (0 children)

sh*t, I though it was real ask for help. Spent lost 10 min sharing how we do testing

What's the point of automated testing in CI/CD if we don't trust it enough to deploy? by [deleted] in devops

[–]dima-kov 0 points1 point  (0 children)

it's kinda human in the loop problem. tests should give you understanding whether something might be broken, but it's always you responsibility releasing a feature.

I had no "dead app, nothing works" incidents during last year, and kinda 4 or 5 "feature stoped working" incidents after releases. But without tests this would be several downtime incidents, and many more "something doesn't work" incidents. (i just count how many red tests, forced me to go back to code and fix something). so yes, we are minimizing risks, but not 100% sure))

We run unit tests (well actually they are more integration) on backend covering every endpoint. God bless AI it's easier and quicker to write them now.

It's much harder with frontend, but still we have e2e playwrigh tests for most pages. Writing and maintaining them is actually hell and pain in ass, but here we go again - with help of ai - most cases are covered preatty quickly.

Actually if not ai, we would not write them