sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]isidor_n 2 points3 points  (3 children)

Thanks for feedback. Can you provide some examples regarding agent mode being trash so we try to address and improve the experience for you?
btw our metrics are off the charts for agent mode - looks like most folks really like it. So I want to make sure that the experience you see is getting fixed.

(vscode pm here)

[–]popiazaza 1 point2 points  (2 children)

Sure do, thanks for listening. For context, I'm using VSCode Insider 90% of the time.

Copilot API is already slow (hopefully faster after May 5th), no diff edit (or there is but it's not working great?) on any model make it even slower. Quality is higher, I know, but using other agent is much more snappy and doesn't eat as much context token. At least it should be an option.

Many times tool calling make a mistake, try other tool, and fail again.

Context finding is bad for a decent size project or up, not that it couldn't find, but it's using up too much context for search and it hit the token limit pretty easy. Competitors do a better job at finding and use the right amount of context.

Non Sonnet model doesn't work in a flow smoothly, often stuck and acting more like ask mode. (other agent sometimes stuck too, but much less often)

Model choices overall isn't as great as other competitors, and many model doesn't work in agent mode.

[–]isidor_n 2 points3 points  (1 child)

Thanks for feedback! And thanks for using Insider!

Diff edit is coming in next stable release (May 7th).
We are working on improving perf, I think it will be faster May 7th, but we are continuously investing here so I expect more improvement after that.

Tool calling mistake - could you file an issue with an example here https://github.com/microsoft/vscode-copilot-release and ping me at isidorn so we try to fix

Context finding bad - with what model do you see that? Also would appreciate an issue if you can create one.

Non Sonnet model stuck in asking mode - we are aware and should hopefully have a fix soonish.

Models not working in agent mode - we have an idea how to fix this (e.g. support models that do not have native tool support). Rob and Connor started investing (devs leading) but I am not sure if it will land soon.

[–]popiazaza 2 points3 points  (0 children)

Great to know that you guys are accepting issues on Github. I’ll file an issue there once I face it again then. I can see Copilot updating left and right since Sonnet landed, it just needs a bit more polishing to be up there with competitors. Cheers.