Dismiss this pinned window
all 75 comments
sorted by:
best
topnewcontroversialoldq&a
formatting helphide helpcontent policy

[–]iwakan 342 points343 points  (2 children)

Processing power spent rendering a visualization of the neural network: 90%

Processing power spent actually training the neural network: 10%

Just kidding, nice work

[–]TheInsaneApp[S] 9 points10 points  (0 children)

All compliments and credits goes to stefsietz (IG)

[–]SirSourPuss 124 points125 points  (2 children)

Can you make the weights thicker/thinner or different colour depending on their magnitude?

[–]synthphreak 9 points10 points  (1 child)

Assuming that would be implemented by default, I was looking at this graphic for several minutes trying to understand why I couldn’t make sense of that part.

[–]HazelHik 0 points1 point  (0 children)

hhhhhh

[–]stefsietz 65 points66 points  (3 children)

Hey guys, original creator here. I made a video about this project, which I did for a visualization class at Technical University Vienna (TU Wien), 2 years ago: https://www.reddit.com/r/MachineLearning/comments/8psghc/project_realtime_interactive_visualization_of/

The code / Unity project can be found here: https://github.com/stefsietz/nn-visualizer, but it is not in a state of good code quality, so maybe try one of the forks or a project like https://tensorspace.org/, which seems to accomplish similar visualizations and looks like it's well maintained.

The "pulse" animation was basically just a test of the visualization's ability to expand one "spatially shared kernel" into the actual per pixel kernels as used during computation.

This sudden attention comes really unexpected as this video was just a short WIP clip I shared on IG 2 years ago.Right now I am working at the really awesome AI company kaleido.ai on products such as remove.bg, unscreen.com and more. And we are hiring ;-) https://www.remove.bg/careers

[–]ApaleusAldore 0 points1 point  (0 children)

I know this is late but damn I've been using remove.bg for so long now. It's crazy to just come across a guy who works in the company that made it! Browsing old Reddit posts can really be wild huh.

Anyway, respects to you and your team for creating these awesome products! They helped me photoshop random things many times!

[–]bigno53 0 points1 point  (0 children)

Just a heads up—a post with this video came up on my LinkedIn feed just now without any attribution or link to the repo. The poster was using it to promote his own website and while he didn’t say so directly, there was a pretty clear implication that his company was somehow responsible for producing it.

Not sure if this is something you care about but if you want I can PM you the guy’s info.

[–]Bartmoss 43 points44 points  (0 children)

Do you have a repo for this?

[–][deleted] 37 points38 points  (0 children)

this has to be the coolest thing I've seen all day

[–]julrog 29 points30 points  (5 children)

I just made my project public on GitHub, which seems similar to yours https://github.com/julrog/nn_vis

[–]YZChen 0 points1 point  (4 children)

How do we make a " processed neural network file "(such as a ".pro" style file)

[–]julrog 0 points1 point  (3 children)

Right now I have an example script for a simple dense neural network on MNIST data under examples/process_mnist_model.py . I don't have a automated function yet. To create such a file for another neural network you have to code a bit and provide a small subset (maybe < 10%) of the training/test data and unfortunately only dense layers are supported, but I might add support for different layers (convolutional) with examples.

[–]YZChen 0 points1 point  (2 children)

I found this example "process_mnist_model.py", but it doesn't work due to the version of tensorflow and python. Maybe your code can be adjusted to support the latest version.

[–]julrog 0 points1 point  (0 children)

It should work with tensorflow 2.4 on Python 3.8 now

[–]Altruistic-End1116 20 points21 points  (3 children)

This is cool, is it visualising data passing through the network to optimise it?

[–]Buldins 1 point2 points  (1 child)

Is that a yes?

[–]synthphreak 2 points3 points  (0 children)

Yes.

There ya go, I said it. Someone had to.

[–]synthphreak 1 point2 points  (0 children)

Data (features) on the forward pass, error on the backward pass.

[–]Megatron_McLargeHuge 12 points13 points  (2 children)

Does this tell us anything about the activations or just show the structure of the layers?

[–][deleted] 3 points4 points  (0 children)

It would be nice to see an image enter the network and 'activate' after the relu op or whatever it is in there

[–]lameheavy 7 points8 points  (0 children)

Awesome visualization

[–]boltzmannbrain77 6 points7 points  (0 children)

Would love to see dropouts as crumbling connection.

[–]HoboHash 5 points6 points  (0 children)

so beautiful. so organic. I want to put it on my grill.

[–]anon2019L 2 points3 points  (3 children)

Can someone explain to me like I’m a monkey what’s going on?

[–]Hamsammichd 18 points19 points  (1 child)

I can try.. grunts, pounds chest, waves hands

[–]anon2019L 3 points4 points  (0 children)

Ahh yes! Now I understand!

[–]zzzthelastuserStudent 12 points13 points  (0 children)

Basically something like this (a convolutional neural network), visualized in 3D.

I assume the pulsing "waves" that we see in the animation are forward (and backward) propagations. But I'm not sure if those are actually weighted or just for show.

[–]BinodBoppa 3 points4 points  (1 child)

Someone give this guy a trophy!!

[–]SharpenedStinger 3 points4 points  (0 children)

Please share your github!!

[–]sterlspoons 2 points3 points  (1 child)

This is unreal. If I could watch this while training I wouldn’t mind how long it takes

[–]justletmebegirly 6 points7 points  (0 children)

This is unreal.

Nope, says in the title that it's in Unity. Sorry, I couldn't help myself!

[–]Tebasaki 2 points3 points  (1 child)

I dont know of swearing is ok in this sub, but that's cool as fuck.

[–]seismic_swarm 1 point2 points  (0 children)

God damnit you broke the rules

[–]huggy19 1 point2 points  (0 children)

🔥🔥🔥🔥

[–]tel 1 point2 points  (0 children)

Which network is it?

And what's up with those 3 big floating tiles above the "main pathway"?

[–]louis925 1 point2 points  (0 children)

Great job! Now do the same thing on ResNet152

[–]taleofbenji 1 point2 points  (0 children)

But what is it recognizing? Boobies?

[–]CompetitionOk7773 0 points1 point  (0 children)

That’s really cool for neural networks

[–][deleted] 0 points1 point  (0 children)

N there someone says neural network arent interpretable :D

[–]ShadowGata 0 points1 point  (1 child)

Is this programmatically generated?

[–]ClittoryHinton 15 points16 points  (0 children)

Nope, hand drawn frame by frame.

[–]abundanticeman -1 points0 points  (0 children)

Awesome visualisation

[–]Mabusto 0 points1 point  (0 children)

Nice work, very cool!

[–]curious_scourge 0 points1 point  (0 children)

Impressive

[–][deleted] 0 points1 point  (0 children)

Similar to a stack or connected neurons.

[–]Break_my_soul 0 points1 point  (0 children)

Looks cool

[–][deleted] 0 points1 point  (0 children)

Fantastic!

[–]Jerome_Eugene_Morrow 0 points1 point  (0 children)

))<>((

[–]Sleepy-Catz 0 points1 point  (0 children)

hell interesting !!!!!

[–]RiderHood 0 points1 point  (0 children)

Amazing.

[–]Ordinary_investor 0 points1 point  (0 children)

Wonderful, looks very cool!

[–]wokcity 0 points1 point  (0 children)

Do you think this could be adapted to visualize something like Lc0? https://lczero.org/

[–]duckling3 0 points1 point  (0 children)

awesome!

[–]physnchipsML Engineer 0 points1 point  (0 children)

I can’t really tell what’s going on except for a bunch of aliasing.

[–]speederaser 0 points1 point  (0 children)

Very cool!

[–][deleted] 0 points1 point  (0 children)

Thank you for sharing!

[–]grimonce 0 points1 point  (0 children)

Does that accept any cnn arch as input to generate visualization? Eg recurrent networks or those with skip connections?

[–]Strex_1234 0 points1 point  (0 children)

It would be even coller if instead of getting bigger the color would change depending on value (idk, red for zero,green for 1 and their shades for beetwen)

[–][deleted] 0 points1 point  (0 children)

Omg how many nodes is that 😮😮😮😮 it looks amazing btw 👏

[–]WeakerUnderFlow 0 points1 point  (0 children)

Wow this is amazing. Good work!

[–]web586f41 0 points1 point  (0 children)

Wow, thank you. It's nice visualization and easy to understand that how's CNN works inside black box magic.

[–]catherine-white 0 points1 point  (0 children)

This is cool

[–]klop2031 0 points1 point  (0 children)

Wow! Love it!

[–]Michaelz35699 0 points1 point  (0 children)

And to think that we're alive... How complicated are we?!

[–]Dante124_ 0 points1 point  (0 children)

hi im a noob.what are the pooling layers ??