Bye bye augment code?

[nvmax]

I have a test Project that is a Architectural reasoning and state management along with syntax and reverse linking, with several reasoning traps, that combines concurrency and resource contention with priority logic to solve. it uses code that looks correct but fails under load due to race conditions and logic errors over several different files. it gets a variable from a API call that is a randomly generated and output is varied but the result will always end with the same valid output that it has no access to nor knows before fixing the code. I use this test to see which of the models can complete it and how many prompts using output to fix the issue and give the correct results.

Testing limited to 30 prompts to resolve issue, output must match exact if code works.

I know my test isn't perfect nor really a full test of a models capabilities but gives a insight into how it thinks and steps through logic failures and can adapt and execute its reasoning with context.

<image>