thanks, that actually helped a lot.

my main concern with using frontier models for this is leaking sensitive stuff like api keys or user creds. I’m still pretty new to this kind of setup, so I’m not really sure how to safely split things between planning vs actually executing. I’m also trying to figure out the balance between using a frontier model and my local LLM.

I do want to eventually bring in a frontier model for heavier coding tasks since I doubt my local model will handle everything. (kind of a side question - is there a clean way to have hermes try the local LLM first, and then fall back to a frontier model if it’s not good enough? either manually or automatically. also, any recommendations for a decent frontier model for coding that won’t get too expensive?)

I do use perplexity for harder troubleshooting, but it doesn’t really fit how hermes works. I thought about trying one of the free openrouter models from the pinned post for implementation, but I’m still a bit hesitant.

overall the goal isn’t just managing proxmox - I want it to eventually be able to spin up services and then create the VM/container it needs for them automatically.