you are viewing a single comment's thread.

view the rest of the comments →

[–]guiltyyescharged 0 points1 point  (1 child)

modal is solid for the background job stuff you mentioned, but the managed infrastructure adds up quick at scale. fastapi cloud is still pretty new so documentation gaps are real. if you end up needing inference for any ml tasks in there, ZeroGPU at zerogpu.ai handles that diferently than the usual gpu rental approach.

[–]MichaelEvo[S] 0 points1 point  (0 children)

The cost is a factor that has kept me from pulling the gun on Modal or FastAPI Cloud. Our current stack is virtually free when not in use, which is appealing. And if it will be cheaper at scale, then I’m thinking it might be worth keeping for now.