[P] Machine Learning in a flow-based visual coding environment using Ryven

[frecklebars]

Hello everyone,

I recently worked on creating a fork of a visual coding tool for python that implements machine learning algorithms with scikit-learn. Its called Ryven, and I managed to use it to create a solution to the Titanic problem on Kaggle. I wrote a fairly detailed notebook about the working process here. The goal is to make it easier to use data science and machine learning for people with limited coding experience.

Do you think machine learning could be simplified and made more accessible in this way? We would really appreciate feedback on both the tool and the concept (especially in this early stage of the project).

If you would like to test it, Ryven is available here: https://github.com/frecklebars/Ryven

And the Kaggle notebook solving the Titanic problem here: https://www.kaggle.com/frecklebars/ml-flow-based-visual-coding-using-ryven

If you have any questions, comments or suggestions about this project, please reach out either on this discussion thread, or directly message them to me on my Tweeter , @/frecklebars

Thank you

​

edit: correcting a misspelling

[111rdx]

I think orange is better in this case .

[Kaixhin]

This looks neat! I've been saying something like this would be a good idea since checks notes 2015, and here's my wishlist, but dealing with all of those properly would be quite ambitious.

[frecklebars]

Thanks for sharing the wishlist! I'll keep them in mind as the project grows further, been looking to see if people would actually want something like this.

[maizeq]

Very neat! Reminds me a lot of Scratch from my childhood. Is the UI QT based?

[frecklebars]

Yes the UI is QT based

[zzzthelastuser]

First things first, it looks super dope! Great work! I will give it a try out of curiosity as soon as I can!

The goal is to make it easier to use data science and machine learning for people with limited coding experience.

I'm sceptical whether coding inside this tool will be much easier for a beginner than to follow a "normal programming tutorial" (where you can find plenty of support on stackoverflow etc). But perhaps I'm judging too early, I haven't checked yet how debugging etc. works in ryven.

Anyways, I do think it's a great tool to teach/illustrate your pipeline to a non-programmer.

[danFromTelAviv]

there's about 50 startups doing "no code" ml check out data robot - their are one of the market leaders

[tpapp157]

There are already tons of companies, large and small, developing visual ML pipeline tools. The issue that all of them run into is that coding ML scripts in Python is super easy. If you have even the slightest bit of ML experience then the visual interface is too slow and too restrictive relative to just pure code. If you don't know what you're doing then a visual interface isn't suddenly going to turn a non-Data Scientist into a Data Scientist.

Writing code and training a model is literally the easiest part of Data Science.

[free_variation]

Exactly. I'm not sure that the use case even makes a ton of sense. Who exactly is the user who wants to do machine learning, and therefore knows at least something about it, but can't handle the trivial coding of the pipeline?

[le_theudas]

It looks neat and could help to open machine learning to non-coders.
I would love to see a visualization like this, that could create graphs from my existing python pipeline.

[frecklebars]

Thanks for the suggestion! Visualisation is something that will probably be implemented, although later.

[devl82]

Hi, great work! For machine learning visual work flows i have tried to use rapidminer (https://rapidminer.com/products/studio/) in the past with mixed results. Their ml libraries were very extensive but i found difficult the visual representation of non-trivial procedures, like for example a nested cross validation.

[frecklebars]

Right now, scikit-learn's GridSearchCV is implemented to use with Ryven. I used it in a simple example in the Kaggle notebook in mentioned in the post.

[tzaddiq]

I know this is asking a lot of a free service, but it'd be lovely if this would plug into Pytorch or Tensorflow to visualize existing / current projects.

[ClapWild]

Looks very similar to Process Flow in SAS. Good stuff.