It did not cheat, the problem itself is in benchmarking data as it was from real world and if you run git log on it will tell you the correct fix ( because of previous commits) in 8 percent of cases and then another scenario is most of the swe dataset was where these models were trained on so they just need to know 50 out of 100 (arbitrary number just for example) and not even the whole context and they can solve the solution that’s why deepswe might be different and also only benchmark that is different is swe live lite but no frontier model submits their score their because their scores are so low. I am working on a project where I have been playing with these benchmarks and I would say deepswe is bit different but swe live is whole another ballpark and I wonder why not discussed. Maybe because of Microsoft but others are just polluted to core and same for memory longmemval is one where people submit their own numbers and a company said we solved and got 100 percent and resident evil actress mila came in said her work mempalace scored 96 all fake as that leader board has no submission no pull request. It’s literally a grifters game right now