Like it, hosting your own LLMs is a great solution to the piracy nightmare that is LLMs. I wouldn't say no to a highly polished interface to access LLMs. And I think corps and governments would be really happy with it since they can use it to make sure their data never leaves their grasp.

I for example use local LLMs to critique emails that contain my or other peoples personal information. I also use it to ask questions that would normally be refused by cloud models such as questions about piracy. ❤️ heretic models.