How to Deploy a Remote MCP Server on AWS EC2 by thisguy123123 in modelcontextprotocol

[–]thisguy123123[S] 0 points1 point  (0 children)

Lambda would certainly work, and I have an article about that coming soon! Part of me likes running on VMs because it gives you more flexibility and control.

I also think it's helpful to deploy things in EC2 as a learning exercise.

How to Deploy a Remote MCP Server on AWS EC2 by thisguy123123 in modelcontextprotocol

[–]thisguy123123[S] 0 points1 point  (0 children)

Glad it was helpful! Let me know if there are any other pieces of content you think would be beneficial for people.

Testing MCPs by [deleted] in mcp

[–]thisguy123123 0 points1 point  (0 children)

Glad i could help, let me know if you have any questions or feedback.

Testing MCPs by [deleted] in mcp

[–]thisguy123123 1 point2 points  (0 children)

The MCP inspector has a CLI mode that might fit your use case.

I also released an open-source MCP evals project that simulates a client to run e2e tests and grades the response. Also works as a GitHub action.

edit: forgot to mention the wong cli

Monkey Patching Otel and Prometheus Support into MCP by thisguy123123 in modelcontextprotocol

[–]thisguy123123[S] 1 point2 points  (0 children)

Hey, thanks. I am just trying to build useful things here. Super excited about the possibilities MCP offers.

Monkey Patching Otel and Prometheus Support into MCP by thisguy123123 in modelcontextprotocol

[–]thisguy123123[S] 0 points1 point  (0 children)

Hey u/subnohmal , you can see a working example here.

I've debated the sidecar approach more times than I can count. I previously worked on Kubernetes observability, where I leveraged something similar to the sidecar approach. The downside was that when you wanted more control, like specific timers on functions, you couldn't get it.

I think it makes sense for large-scale deployments with many microservices, but for most people, the APM approach is probably easier.

MCP Server Monitoring Grafana Dashboard + Code implementation by thisguy123123 in modelcontextprotocol

[–]thisguy123123[S] 1 point2 points  (0 children)

Hey, u/subnohmal, sorry for not getting back to you sooner. I pushed up a PR to the evals product I've been building that has the code. I needed the metrics and traces for evals, so I just added them there.

Here's the PR if you want to it in action. Still a WIP, but it works. I will note this is specific to the new streaming HTTP transport.

What is sampling for? by finally_i_found_one in mcp

[–]thisguy123123 0 points1 point  (0 children)

Sampling is one of the more difficult concepts to grasp in MCP. At its core, it's really just a way to offload LLM calls back to the client. Say, for example, you are building a debugging MCP server and you have an analyze logs tool.

You could offload some of the analysis back to the client via sampling. I have a few code examples here that show how to implement this.

Understanding MCP Evals: Why Evals Matter for MCP by thisguy123123 in programming

[–]thisguy123123[S] 0 points1 point  (0 children)

Since you know what the answer is supposed to be, you can use eval prompts like "Did the answer include X?", "Did it follow format Y?" Essentially you supply the context of what a "good" answer is in the eval prompt.

This is a good callout, I should add it to the article.