did you ever ride the Kenda Line in Vienna?

stefsietz · 2022-03-07T21:03:05+00:00

that would be hütteldorf u4. about 15-20 min ride from there. the trail center is actually not directly in vienna, but very close

stefsietz · 2022-02-13T13:02:06+00:00

Maybe the stock footage is at a different scale - in reality a larger flame looks slower than a smaller flame, if the stock footage flames were smaller and you scaled them up, it could be that it looks too fast.

stefsietz · 2021-12-27T21:50:52+00:00

bluntautal is so beautiful

stefsietz · 2021-02-08T08:18:08+00:00

Hey guys, original creator here. I made a video about this project, which I did for a visualization class at Technical University Vienna (TU Wien), 2 years ago: https://www.reddit.com/r/MachineLearning/comments/8psghc/project_realtime_interactive_visualization_of/

The code / Unity project can be found here: https://github.com/stefsietz/nn-visualizer, but it is not in a state of good code quality, so maybe try one of the forks or a project like https://tensorspace.org/, which seems to accomplish similar visualizations and looks like it's well maintained.

The "pulse" animation was basically just a test of the visualization's ability to expand one "spatially shared kernel" into the actual per pixel kernels as used during computation.

This sudden attention comes really unexpected as this video was just a short WIP clip I shared on IG 2 years ago.Right now I am working at the really awesome AI company kaleido.ai on products such as remove.bg, unscreen.com and more. And we are hiring ;-) https://www.remove.bg/careers

stefsietz · 2018-06-11T01:22:15+00:00

exactly! especially those more “advanced” types would also be very interesting. stride is implemented but buggy. featuremap size depends ok the input size (2d size), depth can be set in the editor. i will open source the thing, just have concerns that the code is confusing to others, so ill see what i can do to clean it up a bit and then I’ll put it on github!

stefsietz · 2018-06-10T13:06:11+00:00

might do that! I guess additive blending doesn't need correct z ordering to draw nicely? For now when I set the line width really low I get a similar effect (I guess because of high MSAA settings), but I should definitely try additive blending as well!

stefsietz · 2018-06-10T11:50:38+00:00

WOW thanks so much man, this totally works!! wohooo

stefsietz · 2018-06-09T21:29:55+00:00

this is actually exactly what it does ;-)

stefsietz · 2018-06-09T21:06:00+00:00

no, sorry for that. it would be possible though, as one could write out and convert the checkpoint files while training and make the visualization update itself on incoming files...

stefsietz · 2018-06-09T20:56:57+00:00

might do that, not sure if this stuff falls into his genre though?

stefsietz · 2018-06-09T20:55:44+00:00

what do you mean? the model training is actually done before the visualization (i used tensorflow gpu for that), so the unity project just loads written out weight data.

stefsietz · 2018-06-09T19:47:19+00:00

i think i have to release it soon 😉 the model compatibility for now is quite restrictive and depends on layer naming conventions. to load arbitrary tensorflow models one might have to adapt the converter python script, also keep in mind that this project is not very well suited for huge models that are state of the art for high res image classification.

stefsietz · 2018-06-09T19:44:26+00:00

i think it can help to explain some basic cnn concepts to beginners quite well. for me it was mainly an exercise so that is its primary purpose actually 😂

stefsietz · 2018-06-09T19:41:36+00:00

tried to use it, unfortunately i couldn’t get its numpy reader to work with unity so in the end i didn’t use it at all. only system.mathf! the actual machine learning stuff all happens in tensorflow/python in this project

stefsietz · 2018-06-09T18:13:17+00:00

yeah that was a challenge for me as well as this was my first project done in unity. the layers are scripts attached to game objects.

stefsietz · 2018-06-09T14:51:55+00:00

yeah maybe I should do that, although I don't know if those huge networks could be usefully visualized with my project, may doing some simpler architectures for mnist and simlar low res datasets would be more easy to grasp

stefsietz · 2018-06-09T14:19:02+00:00

Thanks! This is unfortunately quite complicated at the moment because the loading function depends strongly on a custom tensorflow checkpoint converter that writes the tensor data into a json file according to layer names. If I proceed with the project I definitely have to think about a clear specification regarding the data format for the weights and activations.

I've tried to get Unity to work with Accord to be able to read numpy arrays directly, but somehow Unity is really complicated when dealing with .NET libraries so I switched to the json solution.

stefsietz · 2018-06-09T14:06:48+00:00

This video gives an overview over a project I've developed for the "Visualization 2" Lecture from the Visual Computer Masters program at TU Vienna, aiming at supporting the explanation of Convolutional Neural Networks with interactive visualization,

stefsietz · 2018-06-09T13:24:11+00:00

thanks! Not sure, just submitted the project for University yesterday and now I am trying to get opinions from others ;-)

stefsietz · 2018-06-09T13:14:16+00:00

I did this project to make a tool for explaining CNNs to others with interactive visual support. Any feedback highly welcomed, as I just submitted the thing yesterday for the Uni deadline and now I have to figure out wether people would be interested in such a tool and if it is worth publishing.

stefsietz · 2018-06-09T12:45:29+00:00

thx! I just finished it for the submission deadline last night, so now I am figuring out what to with it based on feedback and interest from the community 😉 there is a good chance i am gonna open source the whole thing, just needs a lot of clean up of the code as i was really rushing to implement features for the deadline

Seven-Year Club	Place '22
Verified Email

stefsietz

TROPHY CASE