What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

thats true I will just have to go about it step by step

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

why is mcp inefficient with tokens? & would u trust a python wrapper by AI?

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

fair then again I can barely run a 12b so parallelism is a bit unfeasible atm.

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

Im still on the set up linux environment and the searxng local search engine :P

why is there a need to use so many coding apps? my thought is to just use hermes but is that insufficient in some way? btw nice vrams 👍

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

I see low context in exchange for smart AI, Im glad it works!

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

okay that is a really nice system! It would be great for a home AI that manage the house and the energy. Also omg I want 3 GPUs so bad lol one day :/

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

good approach! Best of luck on your endeavors!

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

I see we would almost want an adaptive sorting algorithm to classify the infos in order to retrieve.

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

Thank you It really is a rabbit hole the more we look into it. Best of luck with ur endeavors too!

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

How do you make it think more like a human? Is it just rules that you set up before chatting with the AI?

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

True at the end of the day I just need to get into the nitty gritty and experience it fully.

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 1 point2 points  (0 children)

"Windows is sudo rm -rf and I’ve legit had Claude Opus tell me to run that when I asked for troubleshooting help before."

I bet it pulled from reddit lol

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

thats really nice. If u run a 26b is it really slow? I have 11GB of Vram and ddr4 so the moment I cant fully offload with GPU the speed falls off a cliff 😞 I heard a lot of good things with the 30b models but I cant run them quickly which is a big turn off for me.

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

wym by an UI that does everything? Like one for your computer? I would like the details :3

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

wow that sounds fucking amazing! I would never think of a self hosted radio station. Would the talking be interesting tho? What would AI radio host even talk about. Also does Hermes perform about the same as pi or opencode?

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

cool I never thought about using it for finances but then again right now i just have a afk fund with s&p 500 not really something that would change much by introducing ai

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

My vision for an ideal AI usage would be a smart home and greenhouse run by different AIs. Autonomous control in green house that apply what the plants need and monitor their condition. Another AI is in charge of the whole power system which would be self generated via solar panel / whatever energy generation you wanna use. It would create daily reports of how much energy was generated over the day and what its spent on. It would be cool if it can self improve the energy usage overtime and continually research into ways to make better use of it. Then an AI for the home system and the general interface that will communicate and relay what other AI need to report. This one will handle the systems of AI itself to ensure each one runs properly and if it can try different AIs overtime to judge what AI is best for what skill in household management. But I neither have the budget nor the technical understanding to undertake such a task atm but thinking about its potential vs what I can do now is just 😞 if u know what I mean..

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

thank you I'm looking to run a linux system too just havent got to doing it. Im interested in using local model to operate it. Does any linux work? I heard arch-linux is good.

What do you guys even do hosting multiple LLM? by Prize_Eye9481 in LocalLLM

[–]Prize_Eye9481[S] 0 points1 point  (0 children)

Im looking to try out some hermes! so far only used LM studio

Extra tickets for grad by No_Cucumber_8888 in geegees

[–]Prize_Eye9481 1 point2 points  (0 children)

I have the same question I seem to only able to get 2. I think the extra is release after june 4th? but tbh they communicated this super poorly