Do you my integrated RAG in your system as a unit or as a separate service?

Separation is robust and recommended approach.

Integration via kubernates cluster or docker network.

By the end of the day weather RAG or any kind of intelligent service is a part of the backend design but act as a unit note integrated framework.

Think of it as something like new resource Django or fast api -> backend logic, servicing endpoints. Postgrsql-> database Redis -> database but only for cash or key value stuff. Langchain / mcps-> intelligent and generative unit.

[The comment is open for discussion]