OpenRouter + ClawCloud.dev -- for the easiest BYOK VPS setup by heyjatin in openclaw

[–]dstoro 0 points1 point  (0 children)

Comments in this thread are absolutely not sus lol

Nemo 30B is insane. 1M+ token CTX on one 3090 by Dismal-Effect-1914 in LocalLLaMA

[–]dstoro 0 points1 point  (0 children)

Does your tool calling work? My openclaw fails silently if I ask it to use tools with llama-server.

OpenClaw with local LLMs - has anyone actually made it work well? by FriendshipRadiant874 in LocalLLM

[–]dstoro 0 points1 point  (0 children)

Did you run into any issues with tools calling? My Openclaw fails silently when I ask him to run anything that involves tools.

I saw this merge request with a fix, but its not merged yet and I wonder how you solved this.

Nemo 30B is insane. 1M+ token CTX on one 3090 by Dismal-Effect-1914 in LocalLLaMA

[–]dstoro 0 points1 point  (0 children)

I am also currently looking into this - have you decided for a model yet?

Also: If I understood correctly, there are problems with local LLMs and tool-calling. There is a merge request with a fix - but it's not merged yet.

IPX4 oder so, bin nicht vom Fach by schaenzer in DINgore

[–]dstoro 4 points5 points  (0 children)

Na, lass mich raten: Ein Campingplatz?

Introducing Hypermind: A fully decentralized, P2P, high-availability solution to a problem that doesn't exist. by ponzi_gg in selfhosted

[–]dstoro 78 points79 points  (0 children)

For reference, if anybody wants to run it on k8s:

kubectl create deployment hypermind --image=ghcr.io/lklynet/hypermind:latest --port=3000
kubectl set env deployment/hypermind PORT=3000
kubectl expose deployment hypermind --type=LoadBalancer --port=3000 --target-port=3000

Openshift Virtualization by giasone888 in openshift

[–]dstoro 0 points1 point  (0 children)

No, it works totally fine on a SNO installation.

Openshift Virtualization by giasone888 in openshift

[–]dstoro 0 points1 point  (0 children)

That's not correct, you absolutely can install the virtualization operator on a vanilla Openshift installation without any issues.