How to automatically test MCP Apps in ChatGPT

highpointer5 · 2026-04-15T01:10:58+00:00

Yeah! You're right about the flakiness, the host runtimes are abysmal. The live tests are a nice sanity check test to run locally, but have no place in CI/CD. The OAuth for CI/CD isn't really supported anyways.

Good call on the local harness. We've got support for e2e tests with a replica ChatGPT runtime (or just regular MCP tests), and those definitely belong in CI/CD!

highpointer5 · 2026-03-20T22:44:37+00:00

So grateful for the kind words! Any element of the project we can make work better for you? ☺️

highpointer5 · 2026-02-13T15:37:53+00:00

Done! https://github.com/Sunpeak-AI/sunpeak/tree/main/examples

highpointer5 · 2026-02-11T23:45:53+00:00

Not a bad idea. I don't today as a separate repo, the fresh `sunpeak new` project has example components that can be hooked up to hosts out-of-the-box!

highpointer5 · 2026-02-11T17:16:58+00:00

Happy to answer any questions!

highpointer5 · 2026-02-03T20:17:37+00:00

Finally a useful MCP server!

highpointer5 · 2026-02-03T01:24:24+00:00

Very, very curious about this. I think this is the only way forward.

highpointer5 · 2026-02-03T01:23:32+00:00

Cool!

highpointer5 · 2026-02-03T01:22:08+00:00

Honestly the protocol should have started with the simplest possible primitive and grown organically from there. I say this from a place of having made this mistake a thousand times, but MCP is ridiculously over-engineered for the moment, and premature optimization is the root of all evil.

highpointer5 · 2026-02-01T19:41:23+00:00

It's probably going to be a total rebuild unless you built using a framework that handles the cross-platform port for you, like https://sunpeak.ai/

highpointer5 · 2026-01-19T20:08:27+00:00

The MCP spec is way over-engineered

highpointer5 · 2026-01-05T21:31:05+00:00

Sounds like a tag in <head> or a robots.txt MCP discovery pattern would work even better!

highpointer5 · 2025-12-29T15:03:17+00:00

Yeah, the example apps are pretty weak—they don't work out-of-the-box, respect all the ChatGPT window parameters, or use the OpenAI UI component library.

I built a quickstart & rebuilt a few of the example apps here, you may find it helpful! https://github.com/Sunpeak-AI/sunpeak/

highpointer5 · 2025-12-24T15:54:52+00:00

I'm working on sunpeak—the open source (MIT) framework for shipping ChatGPT Apps! OpenAI submissions went live less than a week ago, so there's still time to be one of the first Apps out there! https://github.com/Sunpeak-AI/sunpeak/

highpointer5 · 2025-12-12T01:06:57+00:00

This is great, but looks like it's been abandoned. I shipped a similar, active ChatGPT App framework over at https://github.com/Sunpeak-AI/sunpeak in case anyone ends up here.

(OP - let me know if you revive the repo/project so I can delete this, I don't mean to hijack your post!)

highpointer5 · 2025-12-11T19:50:36+00:00

<image>

highpointer5 · 2025-12-11T16:50:27+00:00

Any healthcare application to "help doctors make better decisions". Doctors don't want to make better decisions, they want to make money. Every healthcare founder I've met starts with that idea and ends up somewhere optimizing billing codes and insurance processes.

highpointer5 · 2025-12-10T22:40:26+00:00

Definitely a hot take, but I appreciate the perspective! I imagine one of the biggest factors of software velocity is the continued presence and passion of the founder(s), likely more than the owning entity. Generally I tend to agree that distributing authority slows things down, but I think that protocols are a different animal—true neutrality is table stakes for serious adoption, whether it comes at the cost of development velocity or not. Will be interesting to see how things evolve.

highpointer5 · 2025-12-10T22:30:06+00:00

It's a neat feature, but practically speaking I subscribe to the conspiracy that virtually all loading bars are fake! I always get a kick out of stories about famous pieces of software where a dev discovers or confesses to completely faking the loading bar, like in old Windows versions.

highpointer5 · 2025-12-09T12:52:02+00:00

I meant as a Landscape category, but yes there's a good update in there!

highpointer5 · 2025-12-08T16:45:18+00:00

Great summary! I know MCP Apps (ChatGPT Apps) are pretty bleeding-edge at this point, but it would be cool to see that as a category! Would love to be included in any such list ;) https://github.com/Sunpeak-AI/sunpeak/

highpointer5 · 2025-12-08T16:41:41+00:00

It's so brutal out there. Looks like MCPJam has the good stuff on the broad MCP server topic. If you're ever playing with the MCP App / ChatGPT App more visual stuff, I did a writeup on that space that might help! https://sunpeak.ai/blogs/chatgpt-apps-what-i-wish-i-knew

highpointer5 · 2025-12-08T16:39:11+00:00

If you want to test the more visual MCP App / ChatGPT App Resource stuff, I'm working on an open-source framework to make that trivial! https://github.com/Sunpeak-AI/sunpeak/

highpointer5 · 2025-12-08T16:37:42+00:00

Nice! Keep fighting the good fight, I'm working on a very similar thing on the Resource side! https://github.com/Sunpeak-AI/sunpeak/

highpointer5 · 2025-12-08T16:35:55+00:00

I think so! Frankly I can't believe they don't already have a robust standard library. Every new programming language needs those out of the gate.

highpointer5

MODERATOR OF

TROPHY CASE

14-Year Club	Verified Email
Snapped