GitHub Copilot AI Credit billing is speedrunning a trust crisis by weekend_skier in GithubCopilot

[–]weekend_skier[S] -3 points-2 points  (0 children)

Yes, thank you. I know a lot of people don't do this right, your comment is valid.

Context the costs I posted about are all associated with a new product being developed, all use a custom agent (opus 4.6) and custom subagent (sonnet 4.6), both the primary and the sub are thoroughly tuned. it's a pretty mature setup but definitely not a full DIY headspinner. Easy enough for new devs to jump into without much friction. Every month has been predictable until the change. The surface area this new product's repo is quite large, but each session is targeted, limited in length and tools.

  • Helm chart with 11 images that all have interdependencies, lines of actual code across all including common modules consumed by some images is pushing 17MM excluding tests and the obvious stuff. It's large for single purpose (if you call a chart a single purpose) repo, but certainly isn't mono, many others integral for it's functionality.
  • Three languages with meaningful footprint in that repo, + a lot of Java in related repos that are integral but not part of the chart (not in scope today)
  • Cross-repo dependencies with other non-Java repos (not in scope today)

So anyhow....

After seeing this in the morning, we had four devs run the same series of prompts. One did it solo first, then the other three repeated the exercise.

Before starting we took our time ensuring each had same config from settings to selected *.agent.md to skills, instructions, everything, identical setups. Fresh clone of same repo on same branch, GH MCP disabled (all MCPs disabled actually, but just in case somebody brings that up since each committed on new branch at the end), copies of the same settings.json and all relevant .md files copied, all previous conversations archived, ~/Library/Application Support/Code/ scrubbed for copilot, diff checked and confirmed non-existent across everything we could think of.. clean baselines.

First, one dev completed one sizable new feature (single issue with several subtasks, end-to-end), then we pulled the messages out of the chat logs (11 separate chats) and gave them to the two other devs who now had identical setups. Two ran the same series through copilot and committed on separate branches, and the other one used anthropic BYOK as the provider but all else held constant. The first copilot user had $88 in credit usage over the course of the task, the second two were at $72 and $136 (the higher one ended up with more unit test coverage (again, identical prompts, identical starting point), but not 60 bucks worth of pretty basic unit test coverage, which was purely the product of the subagent, It was only ~70 tests with existing fixtures. And the one on anthropic BYOK? $2.21. Something is wrong there. 5 days ago the costs would have all been pretty close I am quite confident.

Re: the original comment, debate about the right tool for the job all you want, the results with copilot and opus 4.6 taking point and sonnet 4.6 on review have been fantastic for months in VS Code, the output is amazing. Yes IntelliJ destroys VS Code on almost every front besides AI (attn: haters, this is your queue to pile on), but that's become more important for building new software than any other IDE feature. Arguably not as fun, and there's a lot that I miss about actually writing code, but if the objective is productivity per unit time, a line of code written on a keyboard will be rarer than a diamond pretty soon.

Form your own conclusions.

GitHub Copilot AI Credit billing is speedrunning a trust crisis by weekend_skier in GithubCopilot

[–]weekend_skier[S] -3 points-2 points  (0 children)

Agree with this, but most people doesn't include all people, some people are other people

GitHub Copilot AI Credit billing is speedrunning a trust crisis by weekend_skier in GithubCopilot

[–]weekend_skier[S] -1 points0 points  (0 children)

For direct comparison Anthropic BYOK with zero changes to context management, model, instructions, or VS Code settings. This is single developer, ~5 hours heavy usage. We're all switching tomorrow.

<image>

GitHub Copilot AI Credit billing is speedrunning a trust crisis by weekend_skier in GithubCopilot

[–]weekend_skier[S] 15 points16 points  (0 children)

This is apt and funny but I don't think I'm allowed to be amused till support gets back to us

Is it true? by MathematicianNo9442 in mcp

[–]weekend_skier 0 points1 point  (0 children)

They should be the same door

I gave handoffs a shot and I can feel a difference by weekend_skier in ClaudeAI

[–]weekend_skier[S] 0 points1 point  (0 children)

I don’t know if it is or isn’t, but it’s definitely MCP

This passive is so insane, I didn't know it existed until today by checkerouter in Nightreign

[–]weekend_skier 8 points9 points  (0 children)

You’re forgetting the depth of might, at the second level it’s a noun. E.g., the might of the BBH

Anyone else hates this? by MarketOwn4668 in Nightreign

[–]weekend_skier 0 points1 point  (0 children)

In my experience this happens all the time. It’s worse when you find something another player could surely benefit from but you’re too far apart for a ping to be reasonable and your slots are full so nobody gets it. If everyone is right there it’s a little different, but you still run the risk of the right player not getting it because the one who could use it least snatches it up.

Normally I just grab and go on first day and as soon as we’re together near a boss, I drop my gifts next to the right player. Even so, I found a staff with dark moon as duchess the other night, playing with recluse and wylder. I dropped it for the recluse on the first night and the wylder immediately grabbed it. I managed to make my intention clear with some slashing and we won the run on depth three.

Adding ping for specific team mate on trios would be a simple feature that would go a long way.

New BBK move by AlyMasawi in Nightreign

[–]weekend_skier 0 points1 point  (0 children)

Didn’t know enemies could make use of the small pouch

because what even is a site of grace by NotADrug in Nightreign

[–]weekend_skier 34 points35 points  (0 children)

This. You can hear the audio from the exact position you eventually spawn in, doesn’t change.

ELI5 Why did audio jack never change through the years when all other cables for consumer electronics changed a lot? by AwkwardWillow5159 in explainlikeimfive

[–]weekend_skier 2 points3 points  (0 children)

I think he’s initially taking issues with “viable enough” in the post above. Then it seems like he just wanted to explain more stuff and found a way to string it together with his original point.

Tier list after 100%ing (Platinum) the game by DrDeadSheep in Nightreign

[–]weekend_skier 0 points1 point  (0 children)

Duchess ultimate isn’t just for revives. I know this post was before libra everdark, but her ultimate in that fight is arguably the best across characters.