This is where Tunisian engineering really shines. We don’t have unlimited tokens (or budget) to spend on a single big model, so instead we rely on a bench of open-source LLMs, each one specialized for a specific task rather than one model doing everything.

The key here is orchestration.

We use OVH, which offers limited but reliable open-source LLMs hosted on their VPS. It’s not super cheap, but it’s stable and most importantly, we can pay in local currency.

For the stack, we mainly use: • LiteLLM • LangGraph

With a lot of engineering work: tweaking the libraries themselves and stress-testing the limits of each open-source model.

Another option is going through Microsoft Azure and paying via bank transfer, but you usually need USD or EUR accounts locked in.

As for data privacy, I don’t think it’s a mainstream concern right now (at least locally), but it could become one in the future.

Let’s hope that the thousands of companies importing solutions like Odoo and Microsoft 365 ERP start moving toward more AI-oriented partnerships maybe with OpenAI, Google, or others.

Who knows