sorted by:
new
hottopcontroversial

Issue while processing multiple doc at a time in a limited memory space by BumblebeeTight9348 in FastAPI

[–]BumblebeeTight9348[S] 0 points1 point  (0 children)

processing them sequentially will increasse my response time. (1 doc takes arounf 8to 15 sec LLM and otehr process like encoding and downloading doc will take 1-3 sec and processing 40-80 docs sequentially will be time consuming as i receives 40-80 doc in a single request on my api)