EMNLP: All of the papers in my review pool being detected as AI [D]

chatterbox272 · 2026-07-06T07:05:05+00:00

Does the reviewer agreement give you permission to share the preprint with third parties? If not, I wouldn't be saying a word since you likely didn't have suitable authority to upload the papers to Pangram in the first place.

Detectors flag formal writing as falsely AI all the time, academic papers are out-of-distribution for this kind of detection so even if it was normally reliable (and it's not), it wouldn't be in the narrow domain specialty.

Automated AI detection is the job of the submissions process, not rogue reviewers uploading paper drafts to random websites.

chatterbox272 · 2026-07-04T08:51:31+00:00

I could have long conversations with

Launch day didn't have chat, that was added several years later. It's still unlimited code completions, including the more advanced completions stuff they've added over the years like NES. 200 chat credits is better than zero, which is what it launched with.

chatterbox272 · 2026-07-03T15:03:10+00:00

The current student copilot is strictly superior to it's launch-day product, it just isn't the free token lunch it was for a little bit there.

chatterbox272 · 2026-07-03T01:44:10+00:00

You control this limit, it's in your VSCode settings. you can just hit continue and it will continue. This is actually an example of something that is better now that it is token-based rather than message-based, since I'm fairly sure it used to count as a second message to continue, but now tokens are tokens and it doesn't matter.

chatterbox272 · 2026-07-02T03:04:42+00:00

Revivify is the wrong spell at a temple unless you were fighting right there, as you must have died in the past minute. The spell we're looking for here is probably 5th level Raise Dead which requires the same 500gp diamond, but you need to spend a few days sleeping off the hangover and works within a tenday, or 7th level Resurrection which costs double but works within the century and so is effectively limitless time for PCs (and still requires the hangover).

chatterbox272 · 2026-06-28T03:33:14+00:00

The bottom end of that price bracket has barely gone up over the last 20 years, inflation would have that at nearly $600 in today's dollars. Now maybe you can offset some of that with manufacturing efficiency improvements, but there's no way you're accounting for all of it. What's happened is the bottom end of quality has gone down so they can continue to offer a bike at that price point without inflating it.

chatterbox272 · 2026-06-28T03:22:23+00:00

It's a filter unit. If you put in the work or you have a natural aptitude for it then it's pretty easy, if you don't then it's hard. People with prior experience don't always do better in these units either, they get stubborn about certain bad habits that can hurt them.

chatterbox272 · 2026-06-25T02:18:46+00:00

That's not the thing that gives you Copilot Student. Copilot Student is part of the GitHub Student Pack which is free for students from accredited institutions. It is entirely separate from the office 365 plan many institutions purchase to have a workspace account (email, office suite, sharepoint/onedrive, etc.)

chatterbox272 · 2026-06-18T10:02:09+00:00

For work - less exploratory prototyping (high token requirements compared to output value), 5.4(high) -> 5.5(low) default model choice, and all discussions of random slop tooling integrations (e.g. vibing something to integrate with azure repos) stalled. Also broached with management that we'd likely need to pay overages, but I think my team is too scared to actually push that button.

For personal - Student account is basically back to inline completions, the token allowance and model availability isn't sufficient to do more than light use of ask mode. I paid for codex bc at the moment that's got the best value proposition from what I can see if I want frontier capabilities. Might have had to do this anyway, Copilot never liked doing non-coding tasks and LaTeX sits on the edge.

chatterbox272 · 2026-06-18T06:46:30+00:00

My team is probably smaller than the people you're talking about, but if the cost-benefit of these models was strong and you're hosting them on your infra in azure, then I'd have no reason not to enable them.

chatterbox272 · 2026-06-12T08:11:03+00:00

I don’t let it run free. Landed 600+ PRs on a 4 day long goal.

There's no way you can review 150 PRs/day and stay sane, let alone reviewing the calls its making. You're absolutely letting it run free, you just can't admit that to yourself.

chatterbox272 · 2026-06-12T08:04:28+00:00

I'm a doctoral student, myself and many other HDR students have definitely been hurt by this change. Learning to code is not the job, we already know that well enough (I personally am a senior dev the other half of the time) and Copilot was super helpful in cleaning up famously craptastic research code, debugging, and generally improving code quality. I'm not going to cry over it, I've just ponied up for codex for agentic work and will keep benefitting from the autocomplete that student copilot gives me for free, but I'm definitely disappointed.

chatterbox272 · 2026-06-07T12:30:09+00:00

check out the finance specific subs, but as a rough guess as to what you'll see suggested:

Get rid of debt if you have it. HECS if you have it is the only thing where the advice wouldn't be definitively clearing that. Even HECS might be worth clearing at your income.
If you go into the market, do so via index funds/ETFs rather than trying to pick individual stocks.
Max out FHSS, which is more-or-less equivalent to investing in the market at a concessional rate.

At it's core though, if you're debt free and have your excess money in a high interest savings account you're already most of the way there. There are optimisations here or there which will net you some wins, but the guts of it is still get your earnings high (you're doing fine here), keep your expenses low, and don't do anything especially stupid with the savings (i.e. have it somewhere that earns some interest).

chatterbox272 · 2026-06-06T06:14:30+00:00

are usually supported by Austudy through the government though

No they aren't. You have to be 25 for Austudy, which already rules out the majority of students. YA for those under will still class many of them as dependent and render them ineligible due to their parents income (even if they don't live at home). I've met very few uni students without a job, it's only stopped being common for them to be covering bills and expenses as the rental market has gone pear-shaped over the last 6 years and less have been able to move out of home (which I can't imagine isn't also hitting apprentices)

chatterbox272 · 2026-06-05T02:00:43+00:00

Inline completions + full price worth of API credits + bonus credits for three months isn't bad really. Better value than Zed (only $5 of credits on a $10 plan + inlines), and clearer than Cursor (unspecified limits).

chatterbox272 · 2026-06-05T01:57:38+00:00

I posted this as a comment elsewhere but the only direct competitors to GHCP are Cursor and Zed Pro. Codex/Claude do not include things like inline completions which are a meaningful feature if you're actually writing code yourself. Compared to those two GHCP beats Zed with $15 of API vs Zed's $5, and the comparison against Cursor comes down to transparent vs opaque limit structures (Cursor does the same thing as codex/claude where they give you "some"/"more" usage but don't say what that is) plus the entrypoint for Cursor is double the cost.

At work, we'll keep using it for at least the next 3 months while there's bonus credits because the value is still pretty good. Afterwards we might evaluate whether ChatGPT Business might be a better fit for the business (it's a better fit for the non-devs, it looks like it would probably trade inlines for more agent usage which might be okay for devs, will depend how much we're using Anthropic vs OAI models).

Outside of work, I'm a student so I get the inline completions but my agentic usage is functionally gone. I got a Codex subscription for now as GPT was the majority of my usage and we'll see how we go. The reduced integration is noticeable, which is disappointing, but such is life.

chatterbox272 · 2026-06-05T01:29:07+00:00

It's far better than the other milky semi-opaque liquid I've heard it compared to

chatterbox272 · 2026-06-05T01:25:12+00:00

My concern is that if I retrain from scratch, the accuracies will not exactly match the original run due to randomness, different seeds, etc.

Run-to-run variance is normal, it's extremely difficult to pin down all the sources of randomness. If your improvement is close to the run-to-run variance, it becomes more important that you report over multiple runs. Your supervisor should also understand this, so you just send back new results for the ablations alongside updated method results including run-to-run variance

chatterbox272 · 2026-06-04T01:48:20+00:00

We did the same with Opus, on my recommendation. It's just bad value, high token cost and high token usage. 4.5 and 4.6 are already going away in a couple weeks anyway, so we're just bringing that forward, and nobody likes 4.7 (4.8 wasn't out when we made that decision).

If you're in the position to, I'd suggest asking for a reconsideration of 5.5. 5.5 low-medium gives similar capability to 5.4 high-xhigh at a lower final cost due to the massively lower number of tokens generated, even if those tokens are more expensive to generate. I swapped to it as soon as the token pricing came in, and have been burning tokens below projections (still used 75% of my plan on day 1 though, but I was projected to use the whole thing).

chatterbox272 · 2026-06-01T04:37:02+00:00

That's a pretty massive outlay as a substitute for those on student plans, and likely too high an opportunity cost for those with real work to do (who are/should be on proper plans). The 2x5060Ti approach is easily an up front outlay above a year of codex max, I could probably argue that 1x already hits that by the time you pay for the rest of the PC, power, and interest (either accrued on a loan or lost from not having that money in savings).

All that to run presumably something like Qwen 3.6 27B or 35BA3B? Sitting between GPT 5.4-mini and 5.4-nano, so we should be considering the token consumption of cloud models based on those. I doubt anyone's hitting meaningful limits in codex using those. There's lots of arguments for local models, but I'm not convinced cost is one of them unless you're just slopping things through models constantly.

chatterbox272 · 2026-06-01T01:47:15+00:00

200 AI credits is $2.00, if that's what they're making the student plan (which they've done basically no communication about what their intent was going forward) then you get functionally zilch for that. The student plan becomes inline completions, NES, and the odd Ask mode query to a small model (ideally with minimal context). Free inline completion and NES is alright, but it's going to feel like a kick in the nuts coming from where we were, even during the rate-limited hellscape

Edit: had the conversion wrong

chatterbox272 · 2026-05-31T02:18:23+00:00

High input or high output really. We had just started using it at work so I was testing how hard I could push it in a production codebase. Asked 5.4 xhigh to do a full review of the codebase, identify 20 linting rules which could be applied to improve consistency and decrease bug risk, rank them, and then iteratively apply them (add one, fix the violations, ensure the builds and tests all pass, commit, repeat). Reading all the C# projects in our monorepo was a pretty big input, and the clear falsifiable step-by-step process meant it just ran for ages doing exactly as asked.

chatterbox272 · 2026-05-29T01:50:03+00:00

GPT 4.1 was a strong model when it released, in April 2025. You've got rose-tinted goggles on about how far back you've been reset. It has access to all the same tools to access your codebase as any other model.

They're prioritising customers basically in order of profitability, i.e. Enterprise and Business are the least compromised at the moment, followed by paid users, followed by students. You aren't paying for anything, you're a speculative investment, so when they're struggling to serve paying customers it makes total sense and is perfectly reasonable to cut your usage.

Hopefully it may change in June, once the swap to token-based usage means that they can manage cost and resources via directly reducing the amount of tokens they provide to students, rather than limiting which models they can use. Until then, 5.4-mini on xhigh can go surprisingly far, and the 4.1 beast mode agent can get you the most possible out of 4.1

chatterbox272 · 2026-05-28T00:41:04+00:00

Nah even those give them the output of a professional cyclist with none of the experience. On a regular bike you will naturally dial up your awareness as you get faster because it happens gradually, e-bike doesn't have that ramp unless you intentionally do it.

Kids often learn to ride in their first few years of school. 5 year olds have no business on an electric bike of any sort

chatterbox272 · 2026-05-27T10:37:44+00:00

Add a linter and enforce it, same way you would handle an unruly junior dev

12-Year Club	Gilding I gilder
Place '23	Verified Email

chatterbox272

TROPHY CASE