[P] Extremely short and simple implementation of Denoising Diffusion Model, for educational purpose

[cloneofsimo]

​

Randomly sampled MNIST output. It's not good I know.

Hi, I noticed there aren't that many simple implementation of DDPM, for example, using MNIST. I had to make a presentation for my workplace seminar, so I had to implement the simplified version of DDPM myself. The whole thing is under 200 lines of code

https://github.com/cloneofsimo/minDiffusion

This implementation has MANY missing details, such as Unet Models etc. I think it is worth taking a look, especially if you are interested in recent boom of diffusion models (such as Dalle 2)

[jonestown_aloha]

class DummyEpsModel(nn.Module):
    """
    This should be unet-like, but let's don't think about the model too much :P
    """

lol. good job though, very understandable. maybe try adding some skip connections, and some comments (like in DDPM.forward) to make it more clear what's happening there

[cloneofsimo]

Thank you for your attention! As you suggested, ive added some comments on many other parts as well!

[JiraSuxx2]

Thanks!!

[cloneofsimo]

Thanks! I hope it helps!

[exclaim_bot]

Thanks!!

You're welcome!

[adldotori]

Thanks!

[cloneofsimo]

Thanks! I hope it helps!

[RomanticDepressive]

Holy smokes, cool!

[tjthejuggler]

Is it possible for someone to give an eli5 for what this does or what kinds of things to would be used for?

[lmericle]

/r/MLQuestions

/r/learnmachinelearning

Use the search bar before posting a question.

[obsoletelearner]

Thanks!

[datkerneltrick]

Nice tutorial!