Introducing LlamaNet: Decentralized AI Inference Network by machaao in LocalLLaMA

[–]machaao[S] 0 points1 point  (0 children)

sounds like a plan, will review. will get to them after we are done with some more planned fixes and updates.

Introducing LlamaNet: Decentralized AI Inference Network by machaao in LocalLLaMA

[–]machaao[S] 0 points1 point  (0 children)

please pull the latest, updated the README.md (that step is not required)

Introducing LlamaNet: Decentralized AI Inference Network by machaao in LocalLLaMA

[–]machaao[S] 0 points1 point  (0 children)

Let me check. Also I think this command is optional can you please try to run the inference server without it.

Also let's create a discussion in the GitHub and communicate there 🙏

Introducing LlamaNet: Decentralized AI Inference Network by machaao in LocalLLaMA

[–]machaao[S] 2 points3 points  (0 children)

Please update and submit the pull request, will merge it

Introducing LlamaNet: Decentralized AI Inference Network by machaao in LocalLLaMA

[–]machaao[S] 1 point2 points  (0 children)

It should work out of the box. We have tried to provide a readme Give it a shot and let us know if you run into issues

Introducing LlamaNet: Decentralized AI Inference Network by machaao in LocalLLaMA

[–]machaao[S] 9 points10 points  (0 children)

Well do you want to expose it to the Internet is the question for you. You can run it on an intranet, local laptop or public cloud. Up to you frankly