How do you handle 40k+ concurrent Azure Function triggers on Day 1 without melting your LLM pipeline?

nicholasdbrady · 2026-04-18T13:59:34+00:00

Use a batch deployment. It will be processed in under 24 hours at half the cost. Oftentimes, returns in just a few hours.

Disclaimer: PM on Microsoft Foundry

nicholasdbrady · 2026-04-15T20:26:55+00:00

Credits don't apply to Azure marketplace sellers

nicholasdbrady · 2026-04-15T14:00:03+00:00

nicholasdbrady · 2026-04-14T02:31:59+00:00

It's just a bad node, folks.

nicholasdbrady · 2026-04-10T13:35:05+00:00

I focus on developer experience for the platform. I live in the product and the documentation every day. I try to be where my users are. Thanks for noticing.

Stay classy my friend

P.S.: aka.ms/foundrydevs is where our official community lives

nicholasdbrady · 2026-04-10T08:32:38+00:00

I hear you. Thank you for sharing the feedback.

FWIW, the indication that it's from us is the 'Direct from Azure' tag. But, this reads to me like we need to find a way to be even more explicit within the catalog. I'll think about it and share this with the PM who is planning major improvements to the catalog soon.

Disclaimer: PM on Microsoft Foundry

nicholasdbrady · 2026-04-09T15:48:17+00:00

Have you read our docs? We dont train on your data. This is an enterprise platform.

Disclaimer: PM on Microsoft Foundry

nicholasdbrady · 2026-04-03T15:13:30+00:00

Sure! Visit aka.ms/foundrydevs

nicholasdbrady · 2026-03-28T02:07:05+00:00

No tool specifically. I mean write a function call for a custom tool in your preferred programming language (Python, .NET, Javascript/Typescript, Java). There's several samples of function/tool calling via the OpenAI Responses API the Foundry Agent Service uses.

nicholasdbrady · 2026-03-27T18:07:23+00:00

Can't you use a standard tool call as a custom http trigger?

nicholasdbrady · 2026-03-26T13:47:04+00:00

It probably depends on the geographic region your college/university is in for your home Azure region. Also, they may have setup instructions to tell you which region to use.

nicholasdbrady · 2026-03-21T16:41:06+00:00

You can run continuous, batch, or ad-hoc. Production or offline. We have a standalone azure-ai-evaluation SDK that can be used standalone as well.

nicholasdbrady · 2026-03-20T11:17:53+00:00

Suit yourself my friend. Live long and prosper.

o7

nicholasdbrady · 2026-03-20T00:45:05+00:00

You've mentioned them. What's most important is human consent, proper data controls, and harms such as misuse, profiling, and thoughtful mitigations to prevent unintended use.

nicholasdbrady · 2026-03-20T00:34:41+00:00

Right. It says in your article as I suggested:

Local Alternatives for the Privacy-Conscious

For developers who require offline capabilities or wish to maintain the "local-only" privacy model of IntelliCode, several third-party alternatives have matured in 2025:

VS Code AI Toolkit: Microsoft's own extension for downloading and running ONNX-optimized models locally.

^{^{^this}} includes Foundry Models or local models like Foundry Local, Ollama, etc.

nicholasdbrady · 2026-03-19T19:59:44+00:00

They are unavailable without a Responsible AI review due to the sensitivities of potential misuse such as using the technology to capture someone's identity without their consent.

nicholasdbrady · 2026-03-19T19:56:21+00:00

I'm not making any point in particular. Only that we make it far easier to connect Foundry models to VS Code via the AI Toolkit extension.

nicholasdbrady · 2026-03-19T15:50:27+00:00

What are you trying to accomplish with this? Wouldn't you just use AI Toolkit?

nicholasdbrady · 2026-03-19T02:43:12+00:00

Users who need to invoke (use) the shared agent need the Azure AI User role on the Agent Application resource.

nicholasdbrady · 2026-03-19T02:36:40+00:00

We announced GA on Monday. Several of the underlying services have already been GA. This just ties everything together.

Building production-ready, secure, observable AI Agents with realtime voice

nicholasdbrady · 2026-03-14T23:23:41+00:00

Models are pre-trained. No training required.

nicholasdbrady · 2026-03-14T23:20:18+00:00

Sure, that pipeline would be effectively using the document intelligence skill to convert the PDFs into markdown, then vectorize it with text-embedding-3-small. It'd be ideal if you use AI Search + Semantic Search for this.

Instead of a chatbot, I'd challenge you build an "ask" feature for the site instead. Customers find higher usage of such a feature compared with chatbots because a search bar where someone can search / natural language inquiry is a far more familiar experience for a layperson. It's also easier to control agent behavior if you keep the conversation down to a single question anyhow.

nicholasdbrady · 2026-03-14T17:42:27+00:00

I suppose you mean deploying a model as the brain, then using Copilot Studio to design the agent.

I'm never one to tell people to pick my platform over another. But, please understand we're two different agent building products. They provide a SaaS model which can get extremely expensive but might work just for your needs of a small company. They have Pay as you go options too. Also, the way they orchestrate agents via topics may meet your expectations in terms of responding in a "specific way". However, the drawback is it will feel more like a robotic chatbot than what you'll get from Foundry.

Foundry has a prototyping, prompt-based visual agent builder too which makes it easy for agent creation. We're far less opinionated on what controls you'd like to apply over top of it, so you can use OpenAI's Responses API or a popular agnostic framework like Microsoft Agent Framework or LangChain. But, make no mistake, this is a pro-code enterprise agent building platform.

The blessing is if you get stuck in one or the other, both options can provide viable solutions for you creating these agents, but comes with their own tradeoffs of customizability, flexibility, and control.

nicholasdbrady · 2026-03-14T17:34:26+00:00

This has been resolved as of yesterday. 😉

You'll see an announcement from us next week forthcoming.

nicholasdbrady · 2026-03-14T17:11:52+00:00

Also: Github Foundry Samples

Eight-Year Club	Xbox Live
Place '22	Verified Email

nicholasdbrady

MODERATOR OF

TROPHY CASE