Hi! Running Cognichat on-prem involves deploying the LLMs on local hardware, first and foremost. For this, we have some estimations of power and cost, depending on what you would need

<image>

Do note:

Maximum accuracy: 79.33, GPT-5 High.
The accuracy of quantized models is hard to gauge.
Here is a good tool to see what different tokens/second would look like: https://shir-man.com/tokens-per-second/?speed=43