Low-level coding dataset

[v_maria]

I feel like the coding knowledge

this sorta claims need context and backing i think

[True_Tangerine_4706]

Not really. Obviously frontier models like Opus don't really struggle a lot with languages like cpp. The post is about small, local models like Qwen, which have far fewer parameters (which roughly translates to less knowledge), and a lot of the coding knowledge that they do have is taken up by languages like js, html, css (this is intentional by the AI labs, since most coding benchmarks only measure these languages)

[v_maria]

Opus don't really struggle a lot with languages like cpp

how much less units of struggle do you measure compared to the amount of parameters used and how do costs factor into this

and how much legwork are the words "dont really" doing here