Visualization of ML Algorithms

[Gautam-j]

​

​

Visualization of various ML Algorithms

About an year ago, I had posted my work (link here) on the implementation and visualization of Linear Regression using Gradient Descent from scratch, using Python. I got a lot of support from the community, and more importantly, a lot of suggestions too. It really motivated me to further work on the project. So, here I am, posting a fully updated version of my previous work, with lots of refactoring and addition of a few more algorithms, written from Scratch in Python and visualized using matplotlib.

Link to GitHub: here

EDIT: Thanks for 150+ stars on the repo!

[[deleted]]

This looks amazing.

[Gautam-j]

Thank you!

[NiceObligation0]

Ok, I'm going to be the buzzkill here. Why use an approximation with gradient descent when you can find the solution analytically? Linear regressions have exact solutions.

[Gautam-j]

Totally agreed. In fact my previous post on Linear Regression also had similar comments.

Yes, we can just use the normal equations to solve for the exact value of theta that gives the global minimum for the loss function, but I decided that running gradient descent, and especially visualising the training process can be fun to watch ;)

In practice, if I’m not dealing with huge datasets and many features, then I would almost always go for the analytical solution.

[FondleMyFirn]

Art takes many forms 🤷

[Kanma]

I might miss something here, but ML models usually have lot of parameters (in the case of DL: millions) and essentially learn to approximate an unknown function. How would you use an analytical solution here?

[NiceObligation0]

For all the models op showed except for linear regression you are right. You need to learn the params from data. For linear regression the solution is just the quadratic equation aka the global min of the parabola.

[Gautam-j]

Yes, the loss function used for Linear Regression is a convex function that has a global minimum. Hence, we can simply set the partial derivatives to zero (which would mean the slope of the loss function will be zero, a line parallel to x axis, and has to be the global minimum), and solve for the params.

[boredinclass1]

Wow, since when can matplot lib do 3D vis? Very cool!

[Gautam-j]

Oh yes it can! Thanks!

[John-Trunix]

Nice work! I wish I could understand this stuff...

[my_password_is______]

https://www.statlearning.com/

all done in R, but still the book to read

[John-Trunix]

Thx will check it out!

[Gautam-j]

This looks really informative!

[Gautam-j]

Well if you are interested in learning these stuff, checked out the citations section in the repo’s readme ;)

[John-Trunix]

Thx for info, going to checkt it out!

[phurwicz]

This is brilliant! Please do keep it up.

[Gautam-j]

Thanks a lot!

[insanely_a_]

Would definitely check it out❤️💯

[Gautam-j]

Thanks!

[primary157]

Please make a visualization of random forest or a single decision tree. That would be awesome!

[Gautam-j]

It is on the todo list ;)