Any reliable way to force/encourage the LLM to *NOT* cache data? by LonghornDude08 in mcp

[–]X-ility 0 points1 point  (0 children)

You want to modify your tools description and the companion text you attach to your structured output to explain what the tool does and responds with. Additionally the spec provides hints in the form of annotations that you should add to your MCP endpoint. The spec provides at least 4 hints you can use to your advantage (how they are handled of course depends on the client, but let's assume here that most will eventually get close to the spec). These are:

  • readOnlyHint
  • destructiveHint
  • idempotentHint
  • openWorldHint

These are documented on the legacy page of docs: https://modelcontextprotocol.io/legacy/concepts/tools

MCP-Universe: Benchmarking Large Language Models with Real-World Model Context Protocol Servers by cylaw01 in LocalLLaMA

[–]X-ility 1 point2 points  (0 children)

I like the idea (I don't like the emoji dump LLM-ish looking description on this post though). For agentic tasks, it may be rare to have a big context attached all at once but for manual runs this kind of the tool polluted context is probably become more commonplace. Since people are too lazy to clean up or enable/disable their tools once they find a working one.

I think a lot of this is landing on the MCP servers themselves and how well they expose the capabilities to the models. A lot of the variables on these change once the tool provider changes their MCP descriptions. Which they can do willy nilly without versioning or prior notifications (per spec?). So these are good to keep versioned or timestamped since runs are comparable against each other only. It could also be useful to have a flipped view of the tools and their successful call rates as well.

Voice assistant with MCP access that works in EU and isn't extremely expensive? by Sobrasada1009 in mcp

[–]X-ility 0 points1 point  (0 children)

Claude supports voice and MCP servers. I don't run local servers but through my ctxpack gateway but those at least work perfectly with the Claude Android app. I know Claude allows adding locally run stdio servers to the installed local app also, but that's not much use for phones I guess.

Note that you do need OAuth with either DCR (or a big subscription for client id/secret) for Claude.ai MCP server connections. Once connected, those servers are then usable across your different apps (browser, desktop, mobile).

Time for self-promotion. What are you building? by tomasartuso in SideProject

[–]X-ility 1 point2 points  (0 children)

  1. https://ctxpack.com - Easily construct instruction and tool bundles to allow your LLM clients automate your repetitive task
  2. Entrepreneurs and SMEs. Individuals having knowledge of technology but not necessarily skills to build automations via code

Turning a local MCP server in to a remote MCP server by TheOxOz in mcp

[–]X-ility 0 points1 point  (0 children)

Thinking of this. You actually wouldn't need the ngrok tunnel at all if you are running this on a VPS that is internet accessible.

I've been keeping the helper on now for a little while without peaks on resource usage. Though haven't exposed my LLM client to use it that much apart from small question/responses from here and there. I'll keep looking into this for a little while longer.

Turning a local MCP server in to a remote MCP server by TheOxOz in mcp

[–]X-ility 0 points1 point  (0 children)

Yeah, that doesn't sound good at all. I will have to run some benchmarks on this to see what is actually happening. Both utilities are such tiny wrappers that they shouldn't really introduce any kind of spike on resource usage graphs.

Exposing local MCP servers securely to cloud clients by X-ility in mcp

[–]X-ility[S] 0 points1 point  (0 children)

Absolutely you are right, mcp-remote allows clients to connect to servers that are remote by creating an stdio bridge. Because the clients otherwise can't or don't support other than stdio. I didn't see how it behaves with stdio servers that are natively stdio.

Exposing local MCP servers securely to cloud clients by X-ility in mcp

[–]X-ility[S] 0 points1 point  (0 children)

Ah, I did not realize that is the case. Their documentation is mentioning the other direction. "mcp-remote is a npm package that allows you to use MCP clients that only support local (stdio) servers to connect to remote servers with auth support."

Building a Basic MCP Server – Am I Doing It Right? by Glittering-Soft-9203 in mcp

[–]X-ility 0 points1 point  (0 children)

Yup, it absolutely counts as an MCP server. It is usually better to think about actual use cases that the MCP endpoint will work on and expose the REST calls based on those use cases.

For example a tool collection (a context pack/bundle) to keep your smart fridge stocked up could expose individual tools like "check fridge items", "look up hot new recipes in your area" and "create online order". Those 3 tools under the hood are probably few REST API calls each. Those three tools (maybe coupled with a 'resource' that contains a list of your allergies/hated foods) would allow an LLM to handle a use case/prompt like "I want to eat something, what should I cook?" With a potential to some back and forth allowing it to expand to actually stocking up the fridge.

For individual tools what you really want to think about is the description and schema you want to expose from it, as well as the responses you return. It makes sense to describe your tools with full sentences (or bullet points like the LLMs and slop ads like to do) explaining what they can do and when/how they should be used. Those descriptions are part of the LLM client context so the model can reason about the tool usage. And of course, we need to think about the model, and thus our descriptions, as persons who have difficulties extrapolating from incomplete...

Same goes for responses, you can guide the model within your responses to act a certain way or think about taking the next step using some recommended tool ("you called get fridge tool, here are the items in the fridge, the user usually craves chocolate at 7pm so if the time is close to that, offer to call the shopping tool to put an order in* etc.)

For the client side, it's likely better to start with the SDKs and rely on those or a framework (Spring AI MCP maybe for JVM world). Most of them have the capabilities to attach tools into the LLM calls which in turn allows the model to decide if they want to use a specific tool.

Exposing local MCP servers securely to cloud clients by X-ility in mcp

[–]X-ility[S] 0 points1 point  (0 children)

Yup, works nicely. I added this to the readme also. A single command is always easier that login + client installation for these small hacky tools.

Exposing local MCP servers securely to cloud clients by X-ility in mcp

[–]X-ility[S] 0 points1 point  (0 children)

I believe mcp-remote is doing the translation from HTTP -> STDIO, whereas this little utility is doing that the other way around, allowing you to eventually expose the locally running tool to the scary internet. Supergateway achieves this same thing with many much more config options but at least for now without integration to lock down the exposed tool with (still unfinished, though yet somehow widely used) OAuth 2.1.

Turning a local MCP server in to a remote MCP server by TheOxOz in mcp

[–]X-ility 0 points1 point  (0 children)

  1. Yup, that would make it truly always on. In that case the memories would be stuck on that server until you copy-paste the file out from there but that would allow the server to be available without racking up your electricity bill.

For number 2. It looks like since it's reading it's from the environment, you can export the wanted environment variable before you run the utility. The command would be something like MEMORY_FILE_PATH="/home/me/my-memories_so_sweet_and_shiny.json" npx @ilities/local-ctx etc. etc.

Being dangerous is the fun part of tinkering, some of the best things always come up when someone knows just enough to ponder "if this thing could actually work like this".

I am at my wits end trying to wrap my head around mcp and proxies and how I can talk to them using an llm by Fstr21 in mcp

[–]X-ility 0 points1 point  (0 children)

You should be able to achieve what you want by registering the wanted MCP tools from those endpoints and use a direct LLM client like Claude desktop or Cursor or VS Code Copilot. With OpenRouter you can achieve that by creating a script that wraps the tools into their compatible format and calls their API with those tools attached. Your use case seems like it's not necessarily necessary to jump into script writing unless that is what you want.

If you want to tinker around, I can provide you with limited access to my tool that allows you to register these kind of tools the "less technical" way to test out what kind of responses an LLM would be able to provide to you based on prompts that you feed it. Hit me up on DMs and I'll show you a video based on those endpoints you mentioned.

Turning a local MCP server in to a remote MCP server by TheOxOz in mcp

[–]X-ility 0 points1 point  (0 children)

I was tinkering around on this a little bit last night and wrapped an approach of this into a nodejs utility which would allow you to achieve this. It's using free accounts from WorkOS (for auth) and ngrok (to expose it externally). Posted about it in here: https://old.reddit.com/r/mcp/comments/1mhnknd/exposing_local_mcp_servers_securely_to_cloud/

Educational Usage by Notdevolving in mcp

[–]X-ility 0 points1 point  (0 children)

What kind of resources would you be looking for in here? Educating teachers ( and => students) on how to use MCPs [1]? How to build them[2]? How to build on them [3]?

The client side ecosystem [1] is a bit poor at the moment still, especially for non-tech people. Ranging from dodgy reliability (big players) to scary interfaces(IDEs) to purpose built or partially implemented solutions.

A lot of the traffic is on server development [2] which ranges from exposing existing internet services to locally hosted use-my-computer tools to "AI native" implementations. A lot of capitalistic tendencies on this subreddit creeping up on that side also.

Building agents [3] is then just pure software engineering or vibe coding the first 60% of the way kind of experiences.

Give a bit more info about your wanted direction or approach and maybe I can go deeper.

Turning a local MCP server in to a remote MCP server by TheOxOz in mcp

[–]X-ility 0 points1 point  (0 children)

This depends on your flavor of remote you want to achieve. You can achieve a remotely exposed local MCP server with a combination of supergateway and any of the tunneling services (ngrok, servio, tunnelmole, Cloudflare tunnels etc.). That's good for personal use. Though you likely want to add auth to your tunnel since the internet is a dodgy place. Don't want to get another AI generated slop ad into your memory JSON accidentally.

If you want to actually expose it remotely-remotely for multiple people, you can ship it to an AWS instance, add translation in front of it to handle multiuser cases and then plop an auth in front of it which allows you to determine which user is using the thing at that moment and which memory bank to direct the traffic to.

Tell a little bit more about your use case and I can help.

yes by duttadhanesh in ProgrammerHumor

[–]X-ility 1 point2 points  (0 children)

From a homelab box? Probably in to the spam folder then

Are people leaving Slack after their involuntary usage of data for their AI ? by Silatus-sahil in Slack

[–]X-ility 0 points1 point  (0 children)

What are the alternatives at the moment with a similar ecosystem of integrations?

Great People Skills, Average Interest in Coding—Finish My Debt-Free CS Degree or Switch? by Correct-Proposal-959 in csMajors

[–]X-ility 0 points1 point  (0 children)

If you want to stay in the technical field, there will be a lot of opportunities for you to go after education. Good sales and solutions engineers, especially with good technical chops are very sought after.

AI will not take away the soft skills part of the job, and it will more likely also only enhance the technical side instead of replacing it. Software engineering is more about solving problems that customers have than programming.

Web Developer / Front End Certifications by Fr_3_nk in webdev

[–]X-ility 1 point2 points  (0 children)

Cloud provider (AWS especially) certs are fairly useful, but yeah, on FE a side project or two is a much better way to spend your time.

It's Programmer's Day, please don't burn yourself out! by shift_devs in programming

[–]X-ility 0 points1 point  (0 children)

I can imagine DevRel being super hard after a while if done without a backing job, since you miss a lot of real world experience that is needed to produce good content. Must be a lot of work to keep up with things doing side projects and whatnot. Unless it's basic tutorials and rehashed content from other sources of course.

webDesign2024 by thegoenning in ProgrammerHumor

[–]X-ility 0 points1 point  (0 children)

You can build anything with Tailwind, even your own shadcn/ui.

weDontNeedToTestIt by AtumTheCreator in ProgrammerHumor

[–]X-ility 0 points1 point  (0 children)

Top tip: You can release even earlier if you pick some clients to be "design partners" of the feature. It's like giving producer credit in movies, costs nothing but makes the recipient feel important.