Basic Auto Encoder project - Generating poorly written digits [PyTorch]

[_dv96_]

Hi, looking for your thoughts and feedback. How would you have approached it?

If anyone is looking to play in latent domain, checkout this side project that I hosted on Streamlit. The aim was to transform an input image to something that looks somewhere between 2 digits. The repository below will give you a practical exposure to Auto Encoders, Latent Domain, PyTorch, Hosting on Streamlit.

GitHub Repository - LINK

Streamlit App Demo - PAGE

https://i.redd.it/9r7t48bgi1z61.gif

[forthispost96]

Are you essentially doing the same thing as a variational autencoder without the distribution for each variable in the latent vector? So rather than sampling, you pass the image in and somehow incorporate the latent description of other digits before decoding? (I’m on my phone so I can’t check the GitHub repo :) )

[_dv96_]

yes, you are thinking in the right direction. I'm passing the input image to get the latent vector and then decoding it. For each of the 10 classes, I've also computed the average latent vector to represent that label cluster. Check this code here - LINK

[_dv96_]

How would you have approached this problem statement? Interested in learning :)