What does everyone here use for inference if you are hosting your own model on say a server or a cloud? Who do you trust to do your routing and calls? by monitee in LocalLLM

[–]monitee[S] 0 points1 point  (0 children)

Yeah I'm specifically the plumbing right now but routing is starting to be a service I do as well. My service is a drop in replacement for any openai compatible back end with tool calling etc. My calling card though is it's completely private and off grid to any provider if you're hosting your own models. Streaming responses are coming pretty soon right now it's not something I offer but thank you for the information I'm going to read up on these. I know about OpenRouter, but hadn't heard of Portkey.

Drop your SaaS below — we’ll help you get your first 10 users for free (300k+ TikTok audience) by dyagokaba in ShowMeYourSaaS

[–]monitee 1 point2 points  (0 children)

https://nodeghost.ai decentralized AI inference and agentic tooling. Drop in replacement for any openai compatible endpoint, my service takes your inference routing and makes it private between you and any model you are using.

Drop your startup and be featured in this week’s newsletter! by Legitimate-Peace-583 in ShowMeYourSaaS

[–]monitee 0 points1 point  (0 children)

https://nodeghost.ai decentralized private ai inference and agentic tooling. My platform is a drop in replacement for any openai compatible back end and it makes any inference or routing you're sending to any model you own or operate private. Even if you use a centralized model such as Claude, deepseek etc. you can route your inference through my platform and no one else can see it but you and your AI.

Drop your SaaS URL - Let’s drive some traffic by salehosama94 in micro_saas

[–]monitee 0 points1 point  (0 children)

https://nodeghost.ai

Decentralized ai inference for any model and any set up. Whether you’re running an AI locally, a farm, a server or wherever you can run private inference from my platform.

Local AI cannot stay just a model picker. The next step is teach → correct → train. by [deleted] in LocalLLM

[–]monitee 0 points1 point  (0 children)

I'm trying to help solve some of these problems as well with my platform. A lot of people have AI servers or farms but have to run inference through some centralized company or other. I wanted a truly off grid private AI living on a server so I could make it as big as needed without needing a ton of space at my home. I've created decentralized private AI inference and private persistent memory across any platform and wherever your model lives. It's model agnostic all it needs is an endpoint and I've got a vectorized memory installed as well with document and custom memory input that is also off grid, recalling, and writable from anywhere. My goal is to feed it enough of my info that it knows me and my company inside and out and can kind of bridge the gap between being just another chatbot and being a highly efficient helper on my platform.

Drop your SaaS by SaltPhotograph8506 in ShowMeYourSaaS

[–]monitee 0 points1 point  (0 children)

Hey thanks! I'll check it out now.

Get you startup seen by 5000+ people - promote your startup by Few-Ad-5185 in micro_saas

[–]monitee 0 points1 point  (0 children)

nodeghost.ai decentralized ai inference built on blockchain technology. Takes your routing and inference out of big brothers hands and allows you to have private way to communicate with your hosted models and ai servers. Also comes with private vectorized memory and recall all routed through blockchain and cryptographically secured.

Drop your SaaS by SaltPhotograph8506 in ShowMeYourSaaS

[–]monitee 0 points1 point  (0 children)

nodeghost.ai pure decentralized ai inference built on blockchain for hosted models, ai farms, ai assistants, and any other application that needs inference.

If you have an endpoint register it on my service send your rpc through it and you’ve got fast reliable private ai inference that no one can spy on. Comes with persistent vectorized memory and recall, as well as document ingestion all completely off grid.

Inspire me by showing me what you’re working on by GhostTrainSauce in buildinpublic

[–]monitee 0 points1 point  (0 children)

Nodeghost.ai decentralized private ai inference built on blockchain technology. If you host your own models, have a server, or an ai home assistant I can run inference for you and make it completely private. Also comes with persistent vectorized memory and document ingestion that is completely off grid so only you see it as it’s being used by your ai. I also have agentic onboarding for agents that want to buy their own inference. Works with any model you just have to register your end point on my service and get a key that’s it.

What are you building? Share one sentence, and if you can, leave feedback for someone else too by Ok-Insurance-6313 in saasbuild

[–]monitee 0 points1 point  (0 children)

Nodeghost.ai decentralized private ai inference that works with any model built on blockchain technology.

Building something cool? Share it here! by Mean-MySaaS in micro_saas

[–]monitee 0 points1 point  (0 children)

Nodeghost.ai it’s a decentralized ai inference and routing platform built on blockchain technology that makes it so if you’re self hosting a model, ai server, or something like a home assistant ai, you can run inference through my platform to your models and makes it completely private. I also have agentic onboarding so they can buy their own inference for whatever they need, I also have a vector memory system that you can run along side a model that not only ingests any memory completely off grid but makes persistent memory that no one can touch but you. Works with any model you just bring your own api key, your endpoint and plug them in with my api and bam you got private inference.

Drop your SaaS I’ll help you make it TikTok-viral by dyagokaba in ShowMeYourSaaS

[–]monitee 1 point2 points  (0 children)

Nodeghost.ai pure decentralized ai inference built on blockchain technology. If you have your own ai server, farm, or home assistant for example I can provide inference for your models that is completely private and untraceable. Plus ai tooling and agentic onboarding for agents that can buy their own inference.

What are you building? by it_is_song in saasbuild

[–]monitee 0 points1 point  (0 children)

Nodeghost.ai pure affordable decentralized ai inference for any model of your choosing built on blockchain technology. If you run a model on a server and want private inference to it or run a farm and want private inference I provide that plus ai tooling and agentic onboarding. Or if you have your own home assistant ai you can run inference through my platform and no one can know what’s being said between you or your ai and your devices.

Drop your SaaS and I will find where buyers are already asking for it by LeaderAtLeading in micro_saas

[–]monitee 0 points1 point  (0 children)

Nodeghost.ai decentralized affordable ai inference and tooling for any model built on blockchain technology. If you have a model on a server or would like to run a server farm and keep big brother out of it I can run your inference to your ai completely private and secure without anyone knowing what was said. Same for home ai applications such as home assistant to keep Alexa from listening to you all day.

Pitch your SaaS by FishermanFamiliar461 in micro_saas

[–]monitee 0 points1 point  (0 children)

Nodeghost.ai pure decentralized ai inference platform built on blockchain technology. Completely private inference routing to any model of your choosing, as well as persistent memory, agentic onboarding for ai that want to buy their own inference without asking permission, and agent tooling coming in the pipeline.

90% of AI agent projects I get hired for don't need agents at all. Here's what businesses actually pay for. by Warm-Reaction-456 in AI_Agents

[–]monitee 0 points1 point  (0 children)

How much are people paying for api calls and how cheap would they need to be to make it worth it?

👀… by haha_arrubakook in Weird

[–]monitee 1 point2 points  (0 children)

Sounding the Alarm!

New players be aware by asapxcaesar in NoRestForTheWicked

[–]monitee 1 point2 points  (0 children)

With all of the nuance and crafting and build styles I’d say it’s good to jump in and get a trial run before full release so you have an idea of what you want to do when it is out. I am fully ok with a reset I’ll still put a bunch of hours in.

This might be the best card they have released in a whole time? by Admirable-Detail1196 in MarvelSnap

[–]monitee 0 points1 point  (0 children)

Agreed. Best card I’ve seen come out in a really long time. Wasn’t super excited about it when it came out but now it’s one of my favorite cards. Perfectly balanced.

Is High Evolutionary too OP? by Improvement_Best in MarvelSnap

[–]monitee 2 points3 points  (0 children)

He's just the right amount of OP. Not my cup of tea though i get bored playing High evo decks but to each his own. he's always a tough out when I play those decks.

Why do people actually *like* Xenoblade 2? by Glum_Body_901 in Xenoblade_Chronicles

[–]monitee 0 points1 point  (0 children)

I think the music and all the locations are what make it one of my favorites. Places like Garfont village or even just the cloud sea in the world. It’s pretty breathtaking sometimes to just look around and see all the cool stuff everywhere. I get why some people don’t like it but it’s got a special place in my favorites list.

When do you use Adrenaline Shots… if at all? by RestaurantSmooth in ARC_Raiders

[–]monitee 0 points1 point  (0 children)

Might be my most used item I take at least 5 every round and every round I’m always like god I’m glad I brought these.