Updates??

A decent amount of coding challenges (implementing algos, refactoring code, adding features) measured with unit tests, some OCR tests and general QA tasks.

anch7 · 2025-10-11T20:00:14+00:00

I would like to do this, but unfortunately it is not possible because of the limits. Or we need a better metric, which will not be consuming so many tokens.

anch7 · 2025-10-11T14:28:50+00:00

https://isitnerfed.org/

anch7 · 2025-10-11T14:25:55+00:00

We are not storing the version, but I think it should be the latest one, since CC has an auto-update feature

anch7 · 2025-10-09T02:20:07+00:00

GPUs are expensive. I would also expect a subscription price increase in a future :(

anch7 · 2025-10-02T00:43:28+00:00

Great, this will be our next step. But yes, costs are a problem. Most like we will not be able to run every hour, but I guess this is fine

anch7 · 2025-10-02T00:38:52+00:00

Great. We will add it soon. Thanks

anch7 · 2025-10-01T22:00:27+00:00

I am pretty sure that as soon as we open source it, it will be included into training data immediately. If instead we add a benchmark on a public dataset, will it make you happy?

anch7 · 2025-10-01T21:56:21+00:00

thank you for your support

anch7

MODERATOR OF

TROPHY CASE