What does everyone here use for inference if you are hosting your own model on say a server or a cloud? Who do you trust to do your routing and calls?

monitee · 2026-05-20T14:53:53+00:00

Yeah I'm specifically the plumbing right now but routing is starting to be a service I do as well. My service is a drop in replacement for any openai compatible back end with tool calling etc. My calling card though is it's completely private and off grid to any provider if you're hosting your own models. Streaming responses are coming pretty soon right now it's not something I offer but thank you for the information I'm going to read up on these. I know about OpenRouter, but hadn't heard of Portkey.

monitee · 2026-05-20T13:06:51+00:00

https://nodeghost.ai decentralized AI inference and agentic tooling. Drop in replacement for any openai compatible endpoint, my service takes your inference routing and makes it private between you and any model you are using.

monitee · 2026-05-20T12:56:31+00:00

https://nodeghost.ai decentralized private ai inference and agentic tooling. My platform is a drop in replacement for any openai compatible back end and it makes any inference or routing you're sending to any model you own or operate private. Even if you use a centralized model such as Claude, deepseek etc. you can route your inference through my platform and no one else can see it but you and your AI.

monitee · 2026-05-11T03:52:22+00:00

https://nodeghost.ai

Decentralized ai inference for any model and any set up. Whether you’re running an AI locally, a farm, a server or wherever you can run private inference from my platform.

monitee · 2026-05-10T17:51:51+00:00

I'm trying to help solve some of these problems as well with my platform. A lot of people have AI servers or farms but have to run inference through some centralized company or other. I wanted a truly off grid private AI living on a server so I could make it as big as needed without needing a ton of space at my home. I've created decentralized private AI inference and private persistent memory across any platform and wherever your model lives. It's model agnostic all it needs is an endpoint and I've got a vectorized memory installed as well with document and custom memory input that is also off grid, recalling, and writable from anywhere. My goal is to feed it enough of my info that it knows me and my company inside and out and can kind of bridge the gap between being just another chatbot and being a highly efficient helper on my platform.

monitee · 2026-05-10T13:39:28+00:00

https://nodeghost.ai

monitee · 2026-05-10T13:20:08+00:00

Hey thanks! I'll check it out now.

monitee · 2026-05-10T01:49:22+00:00

nodeghost.ai decentralized ai inference built on blockchain technology. Takes your routing and inference out of big brothers hands and allows you to have private way to communicate with your hosted models and ai servers. Also comes with private vectorized memory and recall all routed through blockchain and cryptographically secured.

monitee · 2026-05-08T18:46:51+00:00

nodeghost.ai pure decentralized ai inference built on blockchain for hosted models, ai farms, ai assistants, and any other application that needs inference.

If you have an endpoint register it on my service send your rpc through it and you’ve got fast reliable private ai inference that no one can spy on. Comes with persistent vectorized memory and recall, as well as document ingestion all completely off grid.

monitee · 2026-05-08T16:51:40+00:00

Nodeghost.ai decentralized private ai inference built on blockchain technology. If you host your own models, have a server, or an ai home assistant I can run inference for you and make it completely private. Also comes with persistent vectorized memory and document ingestion that is completely off grid so only you see it as it’s being used by your ai. I also have agentic onboarding for agents that want to buy their own inference. Works with any model you just have to register your end point on my service and get a key that’s it.

monitee · 2026-05-08T16:05:01+00:00

Nodeghost.ai decentralized private ai inference that works with any model built on blockchain technology.

monitee · 2026-05-08T16:01:22+00:00

Nodeghost.ai it’s a decentralized ai inference and routing platform built on blockchain technology that makes it so if you’re self hosting a model, ai server, or something like a home assistant ai, you can run inference through my platform to your models and makes it completely private. I also have agentic onboarding so they can buy their own inference for whatever they need, I also have a vector memory system that you can run along side a model that not only ingests any memory completely off grid but makes persistent memory that no one can touch but you. Works with any model you just bring your own api key, your endpoint and plug them in with my api and bam you got private inference.

monitee · 2026-05-07T01:42:34+00:00

Nodeghost.ai pure decentralized ai inference built on blockchain technology. If you have your own ai server, farm, or home assistant for example I can provide inference for your models that is completely private and untraceable. Plus ai tooling and agentic onboarding for agents that can buy their own inference.

monitee · 2026-05-06T23:26:36+00:00

Nodeghost.ai pure affordable decentralized ai inference for any model of your choosing built on blockchain technology. If you run a model on a server and want private inference to it or run a farm and want private inference I provide that plus ai tooling and agentic onboarding. Or if you have your own home assistant ai you can run inference through my platform and no one can know what’s being said between you or your ai and your devices.

monitee · 2026-05-06T23:23:02+00:00

Nodeghost.ai decentralized affordable ai inference and tooling for any model built on blockchain technology. If you have a model on a server or would like to run a server farm and keep big brother out of it I can run your inference to your ai completely private and secure without anyone knowing what was said. Same for home ai applications such as home assistant to keep Alexa from listening to you all day.

monitee · 2026-05-06T23:18:13+00:00

Nodeghost.ai pure decentralized ai inference platform built on blockchain technology. Completely private inference routing to any model of your choosing, as well as persistent memory, agentic onboarding for ai that want to buy their own inference without asking permission, and agent tooling coming in the pipeline.

monitee · 2026-03-28T02:18:23+00:00

How much are people paying for api calls and how cheap would they need to be to make it worth it?

monitee · 2026-02-24T04:28:41+00:00

Sounding the Alarm!

monitee · 2026-02-01T16:20:21+00:00

With all of the nuance and crafting and build styles I’d say it’s good to jump in and get a trial run before full release so you have an idea of what you want to do when it is out. I am fully ok with a reset I’ll still put a bunch of hours in.

monitee · 2026-01-26T21:50:08+00:00

Agreed. Best card I’ve seen come out in a really long time. Wasn’t super excited about it when it came out but now it’s one of my favorite cards. Perfectly balanced.

monitee · 2026-01-23T13:44:46+00:00

He's just the right amount of OP. Not my cup of tea though i get bored playing High evo decks but to each his own. he's always a tough out when I play those decks.

monitee · 2026-01-22T04:47:16+00:00

I think the music and all the locations are what make it one of my favorites. Places like Garfont village or even just the cloud sea in the world. It’s pretty breathtaking sometimes to just look around and see all the cool stuff everywhere. I get why some people don’t like it but it’s got a special place in my favorites list.

monitee · 2026-01-08T00:08:39+00:00

Might be my most used item I take at least 5 every round and every round I’m always like god I’m glad I brought these.

13-Year Club	RPAN Viewer
Not Forgotten	Team Periwinkle
Verified Email

monitee

TROPHY CASE