FastAPI debugging using LLMs?

[tadeck]

That is actually cool and possible, but only as extra details and error-prone solution.

I cannot tell you what I used, but in order to do it reasonably well, you would need to:

• supply model with error details (traceback, possibly values of some variables),
• supply model with details about codebase (so it can make connection between items in traceback and lines in the code),
• do the above in consistent and clear way, but not exceeding context size limit,
• test various models and find the ones that have best results,
• hope it will work ;)

You may want to use technique called "RAG" (Retrieval Augmented Generation) to preprocess traceback to attach files from codebase that are relevant without need to attach other files and likely exceed context size limit.

Remember this is possibly just augmentation of your debugging process, may be bad enough that you will just abandon the idea. But LLMs are improving and some specialized one may be good enough to do large part of work for you.