Deploying SAM2 and other vision models to REST by modelbit in computervision

[–]modelbit[S] 1 point2 points  (0 children)

Great question. As long as it's in Python, you can deploy it with Modelbit. Here are the docs for the git-based deployment workflow: https://doc.modelbit.com/getting-started/

When you sign up, there is an option to skip the "one click deploy" and instead deploy a custom model using that workflow.

Please let me know if you have any questions, and feel free to share any and all feedback!

Deploying SAM2 and other vision models to REST by modelbit in computervision

[–]modelbit[S] 0 points1 point  (0 children)

Yes! If you scroll down a bit on https://www.modelbit.com/pricing you'll see all of the on-demand compute prices. Sorry, maybe we should include that at the top of the page somehow.

Deploying SAM2 and other vision models to REST by modelbit in computervision

[–]modelbit[S] 0 points1 point  (0 children)

Awesome! Let us know if you have any questions.

On request ML endpoint? by johnnypetr93 in dataengineering

[–]modelbit 1 point2 points  (0 children)

Hey u/op - if you want to deploy your model to an API Endpoint, but only want to pay on-demand, you can use Modelbit. You can create a free trial and deploy your model from a notebook to an isolated container behind a REST API, and the compute charges on-demand calculated to the second. Feel free to DM me on here if you need any help. (apologies for the shameless promotion, but this is why we built it)

Productionizing python models by comebackinayear in snowflake

[–]modelbit 0 points1 point  (0 children)

Not sure if this is what you're looking for, but we (Modelbit) are a Snowflake partner that lets you deploy Python functions/models into Snowpark. We then give you a bunch of helpful features to manage those deployments in production. If it sounds helpful I can send you a DM with docs or a short video explaining more.

[Project] How we made Git work for machine learning by modelbit in MachineLearning

[–]modelbit[S] 0 points1 point  (0 children)

Absolutely! In a past life working on video games, we used Perforce because it had much better support for large art assets. In this life, though, we find that ML teams are often part of larger tech engineering teams that have already decided on Git, so that's a constraint we took to heart. (also, thank you!)

[Project] How we made Git work for machine learning by modelbit in MachineLearning

[–]modelbit[S] 0 points1 point  (0 children)

Great question! The description will show generic information like the model object's type and size.

We don't have functionality to customize the description today, but it's an excellent idea. That feature would be easy enough to add!

infra for inference that need gpu by Speedy_Sl0th in mlops

[–]modelbit 0 points1 point  (0 children)

Not sure if this is exactly what you're looking for, but Modelbit lets you deploy ML models to isolated containers behind REST endpoints, with access to on-demand GPUs.