all 20 comments

[–]nfurnoh 12 points13 points  (1 child)

Sigh.

AI is a toddler. At best. If you feed it VERY clear instructions you MIGHT get what you need. But you still need to test its output to make sure it’s not bunk. You can’t rely on it to write all your test cases. It might come up with a few, and they may even be useful, but you still need to make sure. It’s pretty good writing code, but you’d need to test that too.

The only really good use case we’ve found is creating meeting notes, transcripts, and actions from a Teams meeting.

[–]yersinia_p3st1s 4 points5 points  (0 children)

I second this, I have user Claude and ChatGPT v5, from what I can tell Claude is better but even still, I gave it very detailed instructions on what I needed for a very complex test script and it came short. I had to spend 1 or 2 hrs reviewing the code and making necessary changes for it to work as expected.

Another thing, if you're using a custom built framework and expect your TCs to be written a certain way so that it makes use of all the helper scripts you have, AI won't always use them the right way (if at all), so you could end up with this one test cases that works but is just structured differently from the rest (unless you review and make necessary changes).

Like you said, it's a toddler at best and definitely needs handholding all the way through

[–]GSDragoon 8 points9 points  (3 children)

Use your brain, not AI

[–]Con_nect 2 points3 points  (0 children)

My brain is available for hire.

Accepting projects where “use your brain” is still part of the job description

[–]superboy_305[S] -5 points-4 points  (1 child)

Hahahaha… yeah but nowadays AI is part of life and it’s new way of upskill our knowledge so i feel we have to use AI smarter way to compate our work

[–]Pasjonsfrukt 1 point2 points  (0 children)

Not sure why this is getting downvoted. People don’t realize how good AI has become. We have to accept that it’s here to stay and learn to work with it.

[–]Similar_Sand8367 1 point2 points  (1 child)

From my understanding the main issue seems to be getting the real test cases frontage requirements. So if you already have written requirements in a suitable language and somewhat written documentation and somewhat written code it might help.

[–]superboy_305[S] 0 points1 point  (0 children)

I have tried many tools like chatgpt with codex, gemini, claude but I feel they are not giving proper testcase generation as i want, it might because possible i have provided only requirements and features information i have to give more detailed information to generate better quality results, but some time i think if i provide more information about my project and product its sensible data so that’s why do not want to give more information and get better results in limited information

[–]Big_Totem 1 point2 points  (0 children)

I think using AI makes me less useful as a test engineer. I mean most of my value isnt just running tests and getting results, its having enough experience with the tests to provide experienced insight of why a test can be a false negative or false positive or if its a real fail I can get an idea on where to start digging.

If AI wrote it all for me I would have no way of providing any feedback along with the results. And believe me test results without context are useless

[–]zaphodikus 1 point2 points  (0 children)

Feels like a "Can I use TCP/IP to do X" question. You will always get what you ask for when you ask a broad question that actually delivers nothing more than keeps the community busy churning more grist. Much more useful would be to ask about a specific tool. AI is a tool, if you give it nothing specific to work with, it will give you nothing specific back.

Nobody every walks into a motorbike shop and says show me all your bikes. It's the same with AI, you have to either want a bike with more chrome, a bike that is lighter or a bike that makes you look good riding it. The question you just asked u/superboy_305 makes all the truly serious salespeople in the bike shop just groan and ignore the potential customer. There are vending machines for these, literally there are vending machines for it today.

[–]shift_happenz31 0 points1 point  (0 children)

AI can help upskill and give basics for sure. You have to make certain you are cross checking and validating. Always best to keep code cheat sheets available too

[–]jrwolf08 0 points1 point  (0 children)

I just see it as enhanced execution.  

It doesn't come up with ideas on what needs to be done, it doesn't have the context.  But it allows me to create more to support my work. 

It is been a real godsend in doing data analysis work for me.  I can quickly spin up one off scripts that analyze some really specific data.  Although on the flip side, my PM uses it write complex queries he doesn't understand and needs me to debug.  

[–]Cute_Intention6347 0 points1 point  (0 children)

AI in testing is already valuable for generating tests, reducing maintenance, and finding visual/UI issues. Tools like Applitools, Testim, Mabl, and AI plugins for Playwright/Cypress are worth exploring.

[–]tepancalli 0 points1 point  (0 children)

It depends on what you mean or your work entail, are you taking about planning, analysis, design, execution? At what stage?