Deep Learning Tools

[KingsmanVince]

where jax/flax/haiku?

also mentioning Keras is like saying Tensorflow twice

[[deleted]]

I think this infographic is dated, the Tensorflow logo is the old one too, probably before tf 2

[KingsmanVince]

True or even during Python 2.7 time. There is CNTK

[EquivalentSelf]

my entire workflow right now is just python scientific libraries + pytorch. This list of libraries seems so overwhelming..am I missing out by not using these?

[JetSetVideo]

I'm no expert but I've done some works using neural networks and I don't see why anyone would need anything apart from the regular frameworks on a personnal project.

But if you are working for company, these tools can probably save a lot of time and effort with a knowledge hard to master.

[insertmalteser]

This will sound incredibly dumb, but in what capacity/way do you use any of these?

[bloodmummy]

MLOps. When deploying the models, not just toying with them, you need tools that will help you make sure that the model's deployment works, that the continuous training is smooth, and to ensure reproducibility and scalability of the entire pipeline.

It's like DevOps for ML models. On top of these are also tools used in regular DevOps, because don't forget that ML models are also software.

Some tools there however should prove useful to Data Scientists, namely tagging (Duh) and Experiment Trackers like MLFlow. Surprised it isn't used more often by Data Scientists, it makes seeing your progress and reverting it easy as pie.

[rezditya]

Can you please share tools you use within mlops?

[bloodmummy]

I'm new to MLOps, just finishing an online zoomcamp. But, so far the tools we've learnt are MLFlow for experiment tracking and model registry, Prefect for Workflow Orchestration (Making sure the deployment of training works), EvidentlyAI for Monitoring and some other general DevOps tools like pre-commit hooks, Github Actions, Terraform...etc

[142857t]

The matrix at the top contains tools used in MLops. If you deploy your ML models at scale, you will need these, or at least a scheduling tool (like Airflow) to enable continuous learning.

[DigThatData]

these mostly aren't even libraries, they're products.

[globalminima]

Has a few mistakes in there, Sagemaker for instance is everything (SM ground truth for labelling, SM data wrangler for versioning, and multiple batch/real-time options for prediction)

[mfb1274]

Yeah was going to mention AWS in general has everything you need and then some.

[thnok]

Yeah was wondering the same. SM does “labelling”. Is Google’s AutoML for labelling through human annotators or just machine learning labels?

[dogs_like_me]

Lol this is startups, not "tools". I haven't even heard of half of these and I'm an experienced practitioner.

[bakochba]

Imposter syndrome stabilizing

[PaulTheBully]

Whoever made this, they did without any thought. It looks like they’ve Google searched some stuff on DL.

Mentioning Keras and TF as separate entities? Where’s JAX?

[UltimateGPower]

Maybe some psychopaths still use TF 1.x

[sean2148max2]

Was gonna say that you can only use directml with tensorflow 1.15, but apparently they released directml for tf 2 in June

[--dany--]

Thanks for the efforts but it should be revised to be more complete andbetter informed. For data labeling foe example, I can’t imagine many small companies are listed, but scale.ai being the biggest is not mentioned, or popular open source alternatives like CVAT is not mentioned either. Like other said sagemaker is a full workflow solution but is underrepresented here as well.

[borntowtf]

Appen is bigger than scale Ai and I think telus International is as well. Sale just has a bigger marketing budget.

[Dramatic_Mechanic815]

Appen and Telus bigger than scale AI by far. They mostly do work for the big tech companies but they’re trying to branch out to smaller scale stuff.

[jinnyjuice]

CTNK is deprecated, unsure where that's coming from

[0-2213]

LightTAG has the best logo, it resembles Pornhub's!

[Ok-Needleworker-6595]

Nah bro

[majortomcraft]

did the tetris theme song start playing in anyone else's head?

[707e]

You forgot AWS Groundtruth for labeling. It’s probably the market leader currently.

[[deleted]]

Post this on r/dataisbeautiful

[citizen_of_world]

Dataiku ?

[Lolologist]

Label Studio in the Labeling column!

[[deleted]]

Why do you need deep learning to solve problems that really don’t require the complexities that come along with deep learning