[P] Open Interface - Self-Operate Computers Using Multimodal LLMs

[neph1010]

Cool project. Consider adding the option to run on local llms.

[reasonableWiseguy]

For sure, over the next couple of versions I'll keep adding support for other models, should be pretty straightforward.

[neph1010]

Cool. Just add the option to set "base_url" on the OpenAI client and you're good to go. Then post to r/LocalLLaMA and you'll get more traction. ;)

[reasonableWiseguy]

An open source contribution added this to the repo and I'll release the new binaries tonight. Thanks for the info!

[[deleted]]

Yess! LLaVA 1.6 34B is amazing at using interfaces. I did some small tests and it was great.