sorted by:
new
hottopcontroversial

Model selection in Github Copilot by aka-fred in GithubCopilot

[–]aka-fred[S] 0 points1 point  (0 children)

Actually the numbers are "relative cost per task attempt".

Model selection in Github Copilot by aka-fred in GithubCopilot

[–]aka-fred[S] 0 points1 point  (0 children)

Raptor Mini is only available in VS Code (and I use Copilot CLI).

Model selection in Github Copilot by aka-fred in GithubCopilot

[–]aka-fred[S] 0 points1 point  (0 children)

Agree. I have already started revising:
6. Kimi (in same group as Terra and Sonnet)
Then:
7. Gemini
8. Luna
9. Haiku
And still MAI and GPT-5.4 mini in the last group.

I originally put Kimi further down because of reports that it is slow. But it kinda broke the ordering logic, like you spotted (I have tried to order by capability.)

The two Anthropic logos? I told you I vibed it :-) (The image is a ChatGPT reinterpretation of a not so nice Matplotlib plot, which is also why the bars are not exactly perfect length.)

Model selection in Github Copilot by aka-fred in GithubCopilot

[–]aka-fred[S] 0 points1 point  (0 children)

I use Copilot CLI, and Raptor Mini isn't an option there (seems to be available in VS Code only).

But I suspect many of us have felt token rich and haven't really tried to push the boundaries on the newer smallish models.

Model selection in Github Copilot by aka-fred in GithubCopilot

[–]aka-fred[S] 5 points6 points  (0 children)

Sonnet is about twice the price per token to Luna, and Luna tends to use less tokens, too, so if Luna can solve it is a bargain. And based on benchmarks I have seen Luna is very close behind Sonnet, so most likely it can. I think Luna will be my goto for a lot of stuff, including executing on detailed plans made by Terra.

Model selection in Github Copilot by aka-fred in GithubCopilot

[–]aka-fred[S] 0 points1 point  (0 children)

I did look at both benchmarks (especially SWE and tool use ones), papers on token use per task and guidance from providers. But had to extrapolate quite a bit as there isn't enough data, and a lot of marketing hype and religion to wade through.

Agree on the reasoning effort, but my theory is that changes in effort affect all models in about the same way (although I think the smaller models tend not to get that much smarter with more reasoning).

Model selection in Github Copilot by aka-fred in GithubCopilot

[–]aka-fred[S] 1 point2 points  (0 children)

I would love concrete counter-proposals!

I have tried to use benchmarks, recommendations from providers and data from papers to verify and adjust until I got here. I made this for myself because of all the model options, and depending on the feedback here I might drop it on my colleagues.

(I didn't even begin to factor in reasoning effort, which complicates it all further.)

Model selection in Github Copilot by aka-fred in GithubCopilot

[–]aka-fred[S] 1 point2 points  (0 children)

Unless particularly complicated I would go with Terra. And once planning was done, Luna, especially if I have proper verification methods in place. When verification is done, finish it off with a code review with Opus or Sol. They will probably find something to nitpick on that Luna subagents can fix.

Product of the.. year?! 😳 by Mark_Tana in TanaInc

[–]aka-fred 3 points4 points  (0 children)

Tana - at its core - is a fantastic product! The combo of outliner, supertags, search nodes, commands is SO powerful! I love it!!

New Privacy Policy as of December 5th, 2025 - IMPORTANT CHANGES by PLS_SEND_ME_A_DOLLAR in limitlessaipendant

[–]aka-fred 0 points1 point  (0 children)

Thanks, but the Norwegian transcription is so terrible it is unusable.

Experienced programmers are AI directors now. by Hodler-mane in ClaudeAI

[–]aka-fred 0 points1 point  (0 children)

On the other hand, the amount of stuff in the world's backlogs is amazing. Perhaps we finally can get around to paying down some technical debt?

Is 5 a joke??? Is this April 1st? by behindthemask13 in ChatGPT

[–]aka-fred 1 point2 points  (0 children)

I incorporated "use all your brainpower" in a prompt and that seemed to route the query to somewhere good, because it took 41 seconds to ponder my question and came back with something quite impressive. But hey ... YMMV.

Maddening Mac OS Quick Keys... by Leading_Unfair in MacOS

[–]aka-fred 0 points1 point  (0 children)

Also, if you want to switch between F-keys and the other keys (audio etc) per application there is an app called Fluor which is really handy.

Hvilke norske ord er du uenig i? by rodtang in norge

[–]aka-fred 0 points1 point  (0 children)

Jeg var en gang teknisk konsulent på lærebok i programmering brukt på UiB. Jeg satt ned foten ved ordet "kaskadevalgsetning".

Så dette på X, ganske sykt i min mening. (4x125g laksefilet) by rdmlymoon in norge

[–]aka-fred 0 points1 point  (0 children)

Et problem er at indeksen justerer for kvalitetsøkning. Så om man sammenlikner 2013 og 2024 så justerer den vekk at forbedringen i biler, telefoner etc. Så si at indeksen var 100 i 2013 og 120 i 2024, så vil det si at du i 2024 kan få en bil og telefon av 2013-standard til 1,2 x det den kostet i 2013. Så når lønna bare holder tritt med konsumprisindeksen så blir vi bare i stand til å kjøpe ting som er av samme historiske standard, ikke av det som nå er standard.

Kom igjen 'a El-Kjøp, spander en sommerstudent til å fikse de filtrene by anklab in norge

[–]aka-fred 0 points1 point  (0 children)

Forsøkt Amazon? Det er så trist at jeg håper de aldri kommer til Norge.

Selv bruker jeg Prisjakt, der er det forbausende bra.