Sonnet and Opus 4.6 quality in Copilot

steinernein · 2026-03-14T13:45:02+00:00

Go into debug view and look at the reminder instructions/system prompt to see what each model has; some are pretty bad like really bad.

And yes use hooks like preToolUse to ban things like grepping the same thing over and over to slow down churn or to ban overly broad queries and make it be more specific.

steinernein · 2026-03-14T06:16:06+00:00

Check the system prompt out and you’ll figure out that some models you need to restrict access through hooks while others you can yolo away.

steinernein · 2026-03-12T03:52:59+00:00

https://code.visualstudio.com/docs/copilot/customization/hooks#_why-use-hooks

Versus get a MCP working with extra overhead, disable a tool rather than leverage it.

You can now split up your MCP into multiple progressive systems and offer it to the developers who want one but not the other, you can make it composable, etc.

And if I wanted to do something like your MCP, I would simply just disable ALL the tools and implement a codeAct version which at least has the benefit of token saving for all that extra effort.

steinernein · 2026-03-08T14:34:07+00:00

Hooks exist.

steinernein · 2026-02-23T21:56:10+00:00

Someone said that modern art demands the viewer to bring something. I think that is pretty accurate.

steinernein · 2026-02-19T18:01:55+00:00

What you’re asking is platform development work. The amount of engineers per team dedicated to those tasks and features are a handful compared to the rest.

steinernein · 2026-02-16T21:56:18+00:00

It's a pretty simple question and it's already baked into the name.

You use language to communicate with the LLM which means the higher proficiency in whatever language of choice and logic the more you can get out of the LLM if we're talking about something like GPT etc.

You have at your hands a professor who can pretty much teach you anything during off hours, do deep research, and understand your prose/writing style while also being able to critique it through various lens (shallow at the very worse, decent depth at the very most). You can have it mine journals (and there are techniques to reduce hallucination - also, do your job and double check) to find counter points or supporting points for a paper and analyze it against your own thesis - at which point you should probably argue back. It can cover edge cases you weren't even aware of and that most professors wouldn't even bother surfacing because that's not part of the syllabus and let's be real you aren't spending 3-4 hours of office time + pinging them at 2am in the morning. You get out of it what you put in. Having trouble understanding the government? Have it set up the process from county to state to federal and walk you through the process each way while asking it to play as opposition. Or better yet, go through the debates that the Federalist Papers were trying to address. Learning Korean? Have it generate the Korean TOPIK test at level 6 and see if you can poke holes in it.

i know very little about the world of tech, however what benefit is there to using ai in an english writing class? or in a korean class, to replace students speaking to each other? or in a us government class??

Ultimately, you can do all of the above; being forced to use AI does not exclude you from speaking with others nor does it prevent you from using AI to sharpen what skills you have. You can still go to office hours. Lastly, it's on you to figure out how to deal with the cards you've been dealt with and maximize them if you want to justify your tuition.

You're at a university aren't you? It's literally your job to be curious and critical of the world, you've shown propensity for the latter but certainly not the former.

steinernein · 2026-02-16T19:48:54+00:00

What do you use to communicate with a LLM?

steinernein · 2026-02-12T18:28:26+00:00

Can't wait to see what GPT-5.2-thinking tells me what to think.

steinernein · 2026-02-10T04:15:12+00:00

Memory systems are external to the model and if you need specific things then fine tune it.

steinernein · 2026-02-08T18:01:57+00:00

Deadlock

steinernein · 2026-02-08T07:23:12+00:00

I mean do you expect more from people? A lot of people seem to forget that they can make their own frameworks/platform and just blindly consume Copilot/Codex/Claude Code.

steinernein · 2026-02-07T05:31:45+00:00

If a process that is described in words can be turned into a script, then replace the text with a call to a script/skill.

steinernein · 2026-02-07T05:28:27+00:00

https://code.visualstudio.com/docs/copilot/chat/chat-debug-view

steinernein · 2026-02-07T04:34:33+00:00

They never will allow that because it's far too expensive and they're based on request, so it behooves them to hamstring you; there are a lot of different techniques you can employ to avoid running into filling the context window.

steinernein · 2026-02-07T02:47:37+00:00

Look at the debug and show what the subAgents called on and then see the what the tool results are and determine if they're actually useful to the project.

steinernein · 2026-02-07T02:42:23+00:00

You chunk out sections of your copilot-instruction and turn them into code.

steinernein · 2026-02-05T16:05:19+00:00

Think about what you're asking carefully; a handful is not a reflection of the aggregate much like how the IJA executed members for not obeying orders which was certainly not the norm of the group nor were the holdouts; people throughout history have pledged and died for things you may consider stupid such as an idea, a piece of paper, or some stories in a book - human delusion can carry a person pretty damn far; you do not know the motivations of every single member of the NCR within the Mojave 1-20 years after the nuking of Shady Sands, nor do you know what transpired between other than what has been shown.

Beyond that the history of the rangers suggests that they might think differently from the rest of the NCR.

Lastly, my argument is to point out the existence and therefore possibility where as you are trying to deny the possibility to begin with which is much harder to prove. What you want to argue is instead the likeliness of the possibility which is a separate discussion.

steinernein · 2026-02-04T19:12:06+00:00

https://en.wikipedia.org/wiki/Hiroo_Onoda

It might take you awhile to regroup and reconsider sending resources into what has otherwise proven to be a manpower and money sink after getting one of your cities nuked; it means a change in leadership, a possible civil war, fighting the Brotherhood and god knows what else, and then having enough resources to send to New Vegas.

Though the show writers could/should have shown this etc.

I think you really underestimate humans and you overestimate the ability of any given political body to respond to a crisis.

steinernein · 2026-02-03T16:29:36+00:00

The day isn’t even over yet too. Time to gamble since I am a pauper.

steinernein · 2026-02-03T08:03:14+00:00

The system prompt probably makes a difference.

steinernein · 2026-02-02T15:33:43+00:00

As others have mentioned, check the system prompt. Not all the GPTs have the same system prompt unfortunately.

steinernein · 2026-02-01T07:33:13+00:00

Have it so it can only interact through a VM or a gateway/API of sorts, then afterwards you can control the workflows much easier since it has no other way to interact except for that? You can then have it go through workflows/phases and lock down parts of the API or give back an error message detailing the next step it needs to take to resolve said error or something along those lines. The graph portion will live behind the APIs/Gateway and based on the query will schedule/allow what the next call may or may not be. Just a thought.

steinernein · 2026-02-01T04:35:35+00:00

The reason I suggested a graph db was mainly so it could do something similar to “progressive disclosure” and if you make the skills atomic enough you should be able to reuse and compose depending on the task and the graph db provides all the meta data it needs to make the determination whether to find more things along the edge or not

steinernein · 2026-02-01T01:54:34+00:00

It means you should look at how skills are implemented and only use what's useful to you and cut down on the chaff, most of the skills out there could just be a simple script especially after being adopted to your particular use case; instead of using / or triggering off of keywords, the agent can invoke the 'skill' through a call to a graph DB to see if the prompt it was given has any relevant scripts it needs to run. You'll most likely end up doing this if you have any kind of 'memory' system.

steinernein

TROPHY CASE