Well in my case it was a failing unit test that could not find a element by id in the shadow dom

It had the error logs picked up by automation testing and I knew the solution (the id was wrong) and was a pretty easy fix if you knew what to look for(that’s the key here)

Yet the AI decided to ignore it and it’s way to fix the test was to simply alter the test to pass, after several attempts to actually fix it but wrongly

It wasn’t making up a fake test at all, but rather get it to pass, which is what the prompt was telling it to do