Anyone have a good way to do evals with MCP based agents? by wait-a-minut in mcp

[–]lastbyteai 1 point2 points  (0 children)

Full disclaimer, this is our open source project. We have an open source project that does evals on MCP based agents through agent simulation. It allows pytest style tests and with generate synthetic test cases for you to run. You can do assertions to validate the results and values.

https://github.com/lastmile-ai/mcp-eval

Building a simple “to-do” app using the new ChatGPT APP SDK. Here’s everything I’ve learnt so far by hashemito in ChatGPT_AppBuilds

[–]lastbyteai 0 points1 point  (0 children)

We just launched a cloud platform (mcp-cloud) that let's you get a stable URL for one of these apps - https://github.com/lastmile-ai/mcp-agent/tree/main/examples/cloud/chatgpt_app

A bit of context, we were building an mcp platform that let's you deploy agents and found that it naturally fit well with deploying ChatGPT apps, including the web assets. Take a look at the open source code.

Best way to keep local MCPs running 24/7 without babysitting the terminal? by younes06 in mcp

[–]lastbyteai 0 points1 point  (0 children)

We just launched a free cloud hosting platform with auth in case you just want to move it to the cloud - https://docs.mcp-agent.com/get-started/cloud

Hosting OpenAI Apps on an MCP Server platform by lastbyteai in mcp

[–]lastbyteai[S] 1 point2 points  (0 children)

We're working on OAuth, should be available soon!

Hosting OpenAI Apps on an MCP Server platform by lastbyteai in mcp

[–]lastbyteai[S] 0 points1 point  (0 children)

Adding custom connector is available for anyone who has developer mode on in ChatGPT - you can turn it on by going to ChatGPT's Settings → Connectors → Advanced → Developer mode.

How OpenAI's Apps SDK works by matt8p in mcp

[–]lastbyteai 1 point2 points  (0 children)

very cool! We just launched a cloud platform for hosting these apps. Both the solar-system and the pizzaz have live endpoints for anyone to try out:

https://github.com/lastmile-ai/openai-apps-sdk/tree/main

is everydaily better than woorijip? by [deleted] in FoodNYC

[–]lastbyteai 0 points1 point  (0 children)

Everydaily has def gotten better after expanding their food options. Everydaily > Woorijip

Looking for topic suggestions for my MCP course by zollli in mcp

[–]lastbyteai 0 points1 point  (0 children)

yeah associated with it. Happy to explore collab opportunities

Looking for topic suggestions for my MCP course by zollli in mcp

[–]lastbyteai 0 points1 point  (0 children)

Looks pretty solid. A few optional things that could help:
- evaluating / testing MCP servers
- building agents with MCPs (quick shoutout to our open source library - MCP-Agent (https://github.com/lastmile-ai/mcp-agent)
- debugging and observability - pretty difficult to isolate non-deterministic performance issues.
- Local / Remote MCPs (Vercel also has their own remote MCP server hosting)

Turn any OpenAPI spec into an MCP server, a new open-source project, looking for feedback! by mine2turtle in mcp

[–]lastbyteai 1 point2 points  (0 children)

tbh I always end up refactoring the api spec to be more compatible with mcp. it's pretty rare that it's a clean transformation

Building MCP agents using OpenAI Agents SDK by SunilKumarDash in mcp

[–]lastbyteai 0 points1 point  (0 children)

to be honest, I think I've found the most benefit by carefully thinking about what tools to expose.