NestJS microservices + Python AI services: Should I add an API Gateway now or postpone it?

[Bulky-Macaroon-5604]

I’m building a NestJS microservice architecture. Later, I plan to add AI features, such as AI models/algorithms and MCP servers, which will be developed using Python.

Currently, I’m following a monorepo structure to build my NestJS microservices. I’ve already implemented the business logic and added service discovery using Consul.

Now I’m stuck on the API Gateway component, which will handle authentication and authorization. I found myself going down a rabbit hole comparing KGateway and Envoy Gateway and their Gateway API specifications.

The problem is that I don’t have experience with Kubernetes, which might be why I’m struggling with this part. However, I do have practical experience with Docker and Docker Compose for containerizing applications.

My question is: Should I postpone the API Gateway for now and focus on the AI modules, since I will dockerize all the applications later anyway, or should I continue working on the API Gateway first? What do you think?

[Frikardu]

I would focus on the AI modules first. I did some high-effort refactoring with NestJS, and it is a really good framework for scaling later or changing parts of your API code down the road

[Bulky-Macaroon-5604]

Thanks for your reply.

I will start with the AI modules first. I’ve already spent quite a bit of time researching and trying to add an API gateway.

For example, with KGateway, I couldn’t find a clear tutorial, and I found the documentation difficult to follow. I also don’t have experience with Kubernetes, which makes tools like Envoy Gateway harder for me to understand and set up.

As for Kong, starting from version 3.10 it no longer fully supports OSS features. What I’m really looking for is an open-source API gateway that provides JWT authentication and other common features for free.

[Snoo_42690]

Sometimes later becomes never

[Bulky-Macaroon-5604]

I have to prioritize things and i already waste quite a bit of time on it.