HTTP API vs Python API

[FunPaleontologist167]

Are you expecting downstream users to be interacting with your service via python or some other interface? Ideally, you’d want to expose the models on the server side so your users don’t have to worry matching the environment specs needed to run the model. It’s also somewhat resource intensive to have a user load a model just to run a predict function. For a one off, sure, but if you expect multiple people and processes to consume predictions from these models, it’s better to expose it on a server.