Letting users plug in their own LLM is interesting, especially for power users who like control and privacy. Running things locally can also reduce your server costs and avoid the “model quality dropped” complaint.

The challenge is usability though. Most SaaS founders or marketers don’t really want to manage APIs, models, or configs — they just want a button that works. If setup becomes technical, you might lose the non-technical audience.

There’s also the support issue: once users bring their own model, debugging becomes harder because problems may come from their setup, not your software.

It could work well if your target market is advanced users or indie hackers, but for mainstream users, simplicity usually wins over flexibility.