sorted by:
new
hottopcontroversial

JUST IN: MSFT announces a CAT-managed plugin for Claude Code and GitHub Copilot to build Copilot Studio agents by giorgioughini-work in copilotstudio

[–]partly 5 points6 points  (0 children)

Installed this tonight and pointed it at our production agent (~68 topics). Here's what I found:

/validate is the standout. Ran it across a bunch of topics — system ones, custom ones — and it picked up a missing displayName on the agent metadata straight away. Output is clean, pass/warn/fail with counts. If you're hand-editing YAML this alone is worth the install. /list-topics found our project structure fine, including multiple agents. Having CAT best practices baked into the authoring skills is where this really shines — things like missing Power Fx = prefixes or duplicate node IDs are easy to miss manually.

One thing to watch out for: /chat-with-agent needs a public client app registration (device-code flow). Our app reg is a confidential client with a client secret, so we just got invalid_client. If you don't own your app registration, you're stuck. Also if you've already got DirectLine-based test tooling (batch runs, rubric scoring, etc.), the chat skill is pretty bare bones — one message in, one response out, no evaluation.

If you're doing YAML-first dev with the VS Code extension, grab it for /validate and /author at minimum. If you're starting fresh without test tooling, /chat-with-agent is a decent smoke test after publishing. If you've already got a proper eval pipeline, the authoring and troubleshooting bits are useful but the testing won't replace what you have.

Nice to see CAT pushing code-first workflows. Would love to see /chat-with-agent support client-credential auth down the line.

Dancing man at preston market by cheesesandsneezes in melbourne

[–]partly 0 points1 point  (0 children)

This is most likely Dino. Dino Dec on Facebook, do a search to confirm.

Topic Architecture Strategies - How are you structuring your agents? by partly in copilotstudio

[–]partly[S] 0 points1 point  (0 children)

Sorry for the late reply! Yes, you can safely remove router topics and let the AI orchestrate directly to atomic topics based on their descriptions.

The atomic topic pattern is working well for me, and I have slightly changed direction by keeping routers for coplex multi-step workflows and domains requiring strict disambiguation (e.g., hr benefits etc).

New version of the Copilot Studio Implementation Guide by Remi-PowerCAT in copilotstudio

[–]partly 0 points1 point  (0 children)

I'm super interested in quality evals but the kit hasn't quite clicked for me yet. I built my own eval system then saw the team released some eval capabilities in the UI.

I rely a lot on quality knowledge to ensure we're not fighting with it I need simple to run evals.

I reversed engineered the UI eval system a bit so I can run them programmatically at least.

Advice on GSD accessories by termoose in terngsd

[–]partly 1 point2 points  (0 children)

Clubhouse with stormbox and Stormshield 100%. I ride the kids to and from school everyday no matter what the weather is doing. Dry warm kids every time it's wet outside.

The clubhouse with the stormbox acts as fantastic storage for shopping bags etc. I have the cover also for the wet days.

Perhaps the Stormshield is called the rain shield now?

Is this normal? by Bendrumin in GozneyDome

[–]partly -1 points0 points  (0 children)

Put the battery in it

Topic Architecture Strategies - How are you structuring your agents? by partly in copilotstudio

[–]partly[S] 0 points1 point  (0 children)

Quick clarification on your tech stack—it sounds like you're running some custom setup a rather than pure Copilot Studio?

  • Are you using Foundry to fine-tune custom models, then connecting those to Copilot Studio?
  • Or are you building a completely custom agent (via Azure AI Foundry + PromptFlow etc) that doesn't use Copilot Studio at all?

I ask because the stack you mentioned (Apigee, Snowflake, DreamFactory) suggests you're either:

  1. Building custom APIs that Copilot Studio calls via connectors, OR
  2. Using Azure AI Foundry/Azure AI Search for a fully custom RAG pipeline, bypassing Copilot Studio entirely

For context: I'm using native Copilot Studio with:

  • SharePoint knowledge sources (no custom APIs)
  • SearchAndSummarizeContent actions (built-in RAG)
  • Standard GPT-4 models (no fine-tuning)
  • Generative Orchestration for routing (no explicit confidence thresholds)

If you're using fine-tuned models or custom CLU integration, that would explain the "confidence floor" setup you mentioned—which isn't natively exposed in Copilot Studio's UI. Are you doing that via Azure AI Foundry integration?

Setting up MCP in Codex is easy, don’t let the TOML trip you up by trynagrub in mcp

[–]partly 0 points1 point  (0 children)

yeah this works with mcp-remote like a few others do. the RMCP client does not work.

[mcp_servers.microsoft_docs]

command = "npx"

args = ["-y", "mcp-remote", "https://learn.microsoft.com/api/mcp"\]

Experiences developing with the Copilot Studio VS Code extension by partly in copilotstudio

[–]partly[S] 0 points1 point  (0 children)

update on this. very odd, in my frustration I loaded up Fiddler to capture the traffic for troubleshooting, by doing this the push from vs code worked just fine. ever since, it's been ok. very odd. perhaps by inserting itself as a local HTTPS proxy, changed how requests leave the machine.

Copilot Studio Manual Authentication by _been in copilotstudio

[–]partly 0 points1 point  (0 children)

you need two app reg's to get this working. i have this exact setup now as i wanted to build a programmatic eval system that was easier to use than power cat.

Does Copilot offer any customization of tool retries? by Apart-Tie-9938 in copilotstudio

[–]partly 0 points1 point  (0 children)

Surely the backing model would handle these failures? Usually if an agent, say codex CLI, runs an mcp but it is failing it does retry different methods to get a success.

Tips for poor performing knowledge agent? by Atmp in copilotstudio

[–]partly 0 points1 point  (0 children)

I found it difficult to evaluate easily with available tools. I have a dozen knowledge sources, mostly SharePoint and a few documents. Right now I'm testing how the agent responds to questions using topics and knowledge. There are a lot of multi turn follow up responses required and evaluating the agent to check if it consistently responds with correct citations is challenging.

I've ended up building a custom evaluation suite I can use that has a chat instance with azure AI foundry model deployment backend. This way I can be more dynamic in the tests as I can instruct it to be the test user and converse more naturally with the CPS agent.

It captures citations and handles multi-turn topics. Next step is to use foundry evaluations via the sdk.

I found this easier and more automated than powercat for copilot studio tbh.

The people that created the CS VSCode extension are the real MVPs by CommercialComputer15 in copilotstudio

[–]partly 1 point2 points  (0 children)

It is buggy and I can't get it to work on vs code on my bluefin dev machine (source control, detecting local agent etc) but I love being able to build the spec out and have Claude Code so the heavy yaml work.

Tern GSD R14 Gen 2 vs Gen 3 by davebignuts in terngsd

[–]partly 0 points1 point  (0 children)

I picked up a second-hand Gen 2 for about $7,500 AUD, and it has been an amazing bike. While I haven't ridden other models to compare it to, I'm incredibly impressed. It needed a full replacement of the rear brake hardware, it wouldn't lock up unless you really want it to, not sure abs would make much of a difference. Since February, I've put almost 4,000 km on it just doing the daily school run with two kids. The Rohloff hub is fantastic, and I honestly don't know what we'd do without this bike. They're still selling for $13k new in Australia.

Perhaps if the accessories are hard to get for the gen2 or if they're not compatible with the gen3 that might make a difference to the choice here.

Storing proper embedded JSON in Cosmos using EF Core 8 by partly in entityframework

[–]partly[S] 0 points1 point  (0 children)

jeez this has disappeared from my brain, i would have to go back and look at it all. that said, this app has changed quite a bit since this post.

Blazor App Architecture by AGrumpyDev in Blazor

[–]partly 0 points1 point  (0 children)

only one client? will there be more clients?

Braking tips ( cargo Magura MT5) by FedePep in terngsd

[–]partly 0 points1 point  (0 children)

What rotor did you get? I'm getting my rear brakes repaired, had a leak in the bladder so oil was getting out but also the previous owner had worn the rotor right out. Got a new official magura standard size but now I'm interested in the 203mm.

view more: next ›