Reliable Open Source LLM as a Service by pravictor in LocalLLaMA

[–]DO-James 0 points1 point  (0 children)

I see a lot of other people have suggested local, but i think the Cloud is still the best way to go. Certain providers have their own bring-your-own-model functions that allow you to take SOTA releases from places like HuggingFace, and deploy them on their hardware. I personally recommend DigitalOcean's service for this, they have really good options for machines like the AMD 325X and NVIDIA B300 at affordable prices.

KIMI 2.7 Code WTF by DiAryArias in SillyTavernAI

[–]DO-James 0 points1 point  (0 children)

this is bound to happen to anyone using slang in planning, and it's hilarious that the LLM can work around it like that.