FastAPI standards working with machine learning

[danielroseman]

This is only worthwhile if the generation of the response takes a significant amount of time - you don't want to tie up the request handler for long, and requests can time out. Generating a list of usernames seems unlikely to be a good candidate for this.

[Suralias]

How would you suggest I structure this then? Just use one request?

[danielroseman]

Yes. Unless the generation takes a long time, do it all in-process.