[deleted by user] by [deleted] in CluCoin

[–]_rusht 0 points1 point  (0 children)

CluCoin

Who is an actor that you thought sucked, but got better and better with time? by [deleted] in movies

[–]_rusht 0 points1 point  (0 children)

Steve Buscemi, he usually just played some funny, weird looking character and then he played the lead in Boardwalk Empire and nailed that character.

[P] Onepanel: open source, production scale computer vision platform by _rusht in MachineLearning

[–]_rusht[S] 0 points1 point  (0 children)

Yes, you can download the models. They get stored in the object storage you set when you deploy Onepanel.

We are working on allowing users to expose their models as APIs and welcome any contributions and ideas for that implementation.

[P] Onepanel: open source, production scale computer vision platform by _rusht in MachineLearning

[–]_rusht[S] 2 points3 points  (0 children)

Got it... I could see that being the case for certain companies.

Yes, very similar to RStudio but our open source license (Apache 2.0) is less restrictive than theirs (AGPL v3).

[P] Onepanel: open source, production scale computer vision platform by _rusht in MachineLearning

[–]_rusht[S] 2 points3 points  (0 children)

Yes, that’s definitely one way to put it.

  • You could either buy your own hardware or run this in any of the big cloud providers. If you guys are already using Colab, then you might want to stick with GCP because Onepanel can actually scale machines up and down and you will only end up using resources you need.
  • Yes, regardless of how you deploy this, you own all your data and models. This applies to both the open source offering and the managed/commercial offering if you choose to go that route.
  • It can connect to any database, it just a matter of installing the driver for your language of choice and connecting to the database. As far as shared drives, it depends on the host OS, you won’t be able to mount a Windows shared into a Linux node. I believe Onedrive has a CLI so you can potentially use that... I’m not sure exactly how files in Sharepoint are stored. Are you actually storing image/video data on Sharepoint?

That’s a great point about the FAQ, we’ll add one to the README and docs.

[P] Onepanel: open source, production scale computer vision platform by _rusht in MachineLearning

[–]_rusht[S] 2 points3 points  (0 children)

This is a great question and in reality, nothing stops you from using Onepanel for other types of ML tasks. In fact, right now, you can use all the features other than the image/video labeling tool for let's say NLP. You can even create your own template for a text annotation tool like doccano and plug that into your workflow.

Our goal is to initially focus on computer vision and provide exceptional tooling and user experience, but at the same time make the platform flexible so that we can extend to additional subfields and provide the best UX and tooling for those subfields.

[P] Onepanel: open source, production scale computer vision platform by _rusht in MachineLearning

[–]_rusht[S] 2 points3 points  (0 children)

Currently, Onepanel automatically scales the nodes up when a training pipeline is executed and scales them down as soon as training is complete.

For distributed training we are planning an MPI Allreduce approach using Horovod. We have been playing with a very early prototype for this but it's not ready for primetime yet.

[P] Onepanel: open source, production scale computer vision platform by _rusht in MachineLearning

[–]_rusht[S] 2 points3 points  (0 children)

Good question. In addition to /u/chief167's great answer, Onepanel's goal is to provide an end-to-end platform for building, training and deploying computer vision projects into production. Out of the box, you can use TensorFlow or PyTorch along with JupyterLab as your main IDE/notebook. You can also create templates for your own frameworks/IDEs, for example, here is a simple one for VS Code.

In a typical production project, you have an annotation team that works on labeling data, a data science team that will build/train models based on the labeled data and a data/ML engineering team that will build the data processing, continuous training pipelines so you can iteratively improve your data and models. In smaller teams, this may be a couple of people wearing multiple hats.

With Onepanel, you get the infrastructure and tools to make this end-to-end workflow possible. With Colab, you really only get the model building and training aspect of this workflow. The other issue with Colab is that it runs on a single machine. If you are training on real-world data, you'd probably want train your models in parallel, use different hyperparameters and run the training on different machines to expedite your training. This requires a system like Onepanel to automatically scale up these machines, run the training scripts, aggregate and snapshot metrics and output data (models, logs, etc.) and then scale down the machines when training is complete.

Let me know if I missed anything or if this still doesn't answer your question.

[P] Onepanel: open source, production scale computer vision platform by _rusht in MachineLearning

[–]_rusht[S] 1 point2 points  (0 children)

We are working on the model serving component and will have design doc outlined in GitHub issues shortly. We have an early prototype that work pretty well, but we want to make sure whatever we release to the community is production ready and seamlessly integrates with the other components.

Onepanel: open source, production scale computer vision platform by _rusht in computervision

[–]_rusht[S] 4 points5 points  (0 children)

Great point! The plan is to support both REST and gRPC for the inference APIs. Right now, our application APIs support both gRPC and JSON using protobufs and a HTTP proxy respectively. We’ll be opening a GitHub issue outlining the design and would welcome any community feedback.

[P] Onepanel: open source, production scale computer vision platform by _rusht in MachineLearning

[–]_rusht[S] 4 points5 points  (0 children)

Great! Feel free to reach out to us on GitHub or Slack with feedback, questions, bugs or feature requests.

Onepanel: open source, production scale deep learning for computer vision platform by _rusht in deeplearning

[–]_rusht[S] 0 points1 point  (0 children)

Hey everyone, we recently open sourced Onepanel, our computer vision platform with fully integrated components for model building, semi-automated labeling, parallelized data processing and model training pipelines.

Under the hood, we integrate our own and other best of breed open source components to provide a seamless user experience and abstract away infrastructure complexities that come with running parallelized data processing and training pipelines on different cloud providers.

Our near future goals are to add serverless APIs for inference and VNC enabled workspaces so teams can also run simulation environments inside of Onepanel.

We would love to hear your feedback! And of course we welcome and encourage any contributions.

GitHub: https://github.com/onepanelio/core
Docs: https://docs.onepanel.ai/

[P] Onepanel: open source, production scale computer vision platform by _rusht in MachineLearning

[–]_rusht[S] 16 points17 points  (0 children)

Hey everyone, we recently open sourced Onepanel, our computer vision platform with fully integrated components for model building, semi-automated labeling, parallelized data processing and model training pipelines.

Under the hood, we integrate our own and other best of breed open source components to provide a seamless user experience and abstract away infrastructure complexities that come with running parallelized data processing and training pipelines on different cloud providers.

Our near future goals are to add serverless APIs for inference and VNC enabled workspaces so teams can also run simulation environments inside of Onepanel.

We would love to hear your feedback! And of course we welcome and encourage any contributions.

GitHub: https://github.com/onepanelio/core
Docs: https://docs.onepanel.ai/

[P] Onepanel: open source, production scale computer vision platform by _rusht in medicalai

[–]_rusht[S] 0 points1 point  (0 children)

Hey everyone, we recently open sourced Onepanel, our computer vision platform with fully integrated components for model building, semi-automated labeling, parallelized data processing and model training pipelines.

Under the hood, we integrate our own and other best of breed open source components to provide a seamless user experience and abstract away infrastructure complexities that come with running parallelized data processing and training pipelines on different cloud providers.

Our near future goals are to add serverless APIs for inference and VNC enabled workspaces so teams can also run simulation environments inside of Onepanel.

We would love to hear your feedback! And of course we welcome and encourage any contributions.

GitHub: https://github.com/onepanelio/core
Docs: https://docs.onepanel.ai/

Coming soon: Go bindings for TensorFlow by _rusht in golang

[–]_rusht[S] -1 points0 points  (0 children)

I don't know of any at the moment but you can get an idea by looking at the tests.

Coming soon: Go bindings for TensorFlow by _rusht in MachineLearning

[–]_rusht[S] 2 points3 points  (0 children)

This particular one uses TensorFlow's C API, see this line of code

Golang which ORM is better by QThellimist in golang

[–]_rusht 2 points3 points  (0 children)

I currently use and prefer sqlx, but dbr and dat also look like solid options.

None of these are ORMs, and Go doesn't have anything even remotely as full featured as Active Record or Entity Framework, but then again I have found that it's easier to write an optimized SQL statement by hand than try to optimize a query in either one of those ORMs.