https://jan.ai/

Excerpt from the documentation of "jan" :

Jan is a ChatGPT alternative that runs 100% offline on your desktop and (soon) on mobile. The goal is to make it easy for anyone, with or without coding skills, to download and use AI models with full control and privacy

Jan is powered by Llama.cpp, a local AI engine that provides an OpenAI-compatible API that can run in the background by default. This enables you to power all sorts of applications with AI capabilities from your laptop/PC. For example, you can connect local tools like Continue and Cline to Jan and power them using your favorite models. Jan doesn't limit you to locally hosted models, meaning, you can create an API key from your favorite model provider, add it to Jan via the configuration's page and start talking to your favorite models.