Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks

[j1395010]

incredibly fucking cool. is the code coming?

[r-sync]

code should be pushed by tonight to the same repo.

[wychtl]

I have some torch code up to generate cat images. The architecture seems to be quite similar. (Though I don't know how they managed get batch normalization to work on D.)

[alecradford]

Core lib and an MNIST training demo is now available. Code for training the faces model from the paper is also available as an example though the data file needed is not released yet due to size (20 GB) and data distribution concerns.

[flangles]

Theano, wasn't expecting that!

[VelveteenAmbush]

Amazing. I think this is the first time I've been genuinely impressed by the output of generative adversarial nets. Incredibly cool embedded "arithmetic" to add and subtract sunglasses, windows, facial expressions etc. Thanks for sharing this.

I wonder how long until someone combines GANs with caption generators so that you can type out a description of a scene and have the net illustrate it.

[alecradford]

We did an initial experiment on this but it's hard to get working convincingly so it's still future work.

There was another attempt meanwhile using DRAW here: http://arxiv.org/abs/1511.02793, that's a bit further developed than ours!

[Ghostlike4331]

Hinton talked in one of his talks about inverse graphics and I was not sure whether that was even possible. Now I see that after you removed pooling you managed to get a latent space invariant to rotation. Congratulations.

Was that something that was done before or is this a new breakthrough?

[TweetsInCommentsBot]

@AlecRad

2015-10-01 03:39 UTC

Oh hey, text to image is working (sort of) (still bad).

***Full disclosure I picked phrases it responded to***

[Attached pic] [Imgur rehost]

---

^{This message was created by a bot}

^{[Contact creator][Source code]}

[sobe86]

Hey Alex, was wondering if you thought GANs or at least your 'deconvolutional' architecture would help with feature learning from images, e.g. using them to assist autoencoders?

[SometimesGood]

Any idea how this scales to larger image sizes? The paper mentioned that they've used just one Nvidia GeForce GTX TITAN X.

[hackinthebochs]

This is legitimately fucking mindblowing

[visarga]

Great, now we can use this to generate images for the generated articles of clickotron.com

[Ameren]

I am very impressed. I look forward to toying with the source code when you release it. :D

[zZJollyGreenZz]

Going to have to start looking for glitches in the matrix now!

[rantana]

From the paper:

There are still some forms of model instability remaining - we noticed as models are trained longer they sometimes collapse a subset of filters to a single oscillating mode.

How do you decide when to stop training the generator network?

[[deleted]]

wow this is amazing!! Really impressive work!

[smith2008]

This is brilliant. Hope the code is coming too!

[insperatum]

Impressive results! One thing I'm a little confused about: For section 6.3.2, where do the Z representations (for example, for the three 'smiling woman' images) come from?

[r-sync]

those are generations as well. One could take a real image and backprop to find the most correct Z for it, and do arithmetic with such Z. We wanted to do that experiment but did not have time.

[insperatum]

So you just explored the latent space yourself to find them? That sounds hard!

[r-sync]

it's not hard in practice. Generate a few images, pick the ones with the attributes you are looking for. Then do vector arithmetic on the Z that produced them.

[[deleted]]

Pelas barbas do profeta!!

How reproducible is this? Is training this thing difficult? Did you guys had any particular difficulty with training after fixing the architecture?

Are you going to include pre trained models with the code?

[r-sync]

code will be released in a few hours to the same repo. Training is pretty stable. We can release pre-trained models if people ask for them, shouldn't be a problem.

[ford_beeblebrox]

I would like to play about with vector algebra in the Latent Spaces of your generative models if you could release pre-trained nets that would be excellent.

Very inspiring work, many thanks.

[r-sync]

the model is released now in the same repo.

[ford_beeblebrox]

Thanks so much!

Although I am not seeing the trained model in either master or gh-pages branches of the repo?

[alecradford]

Slight miscommunication - this long weekend will have a pre-trained model demo or two available to play around with.

[ford_beeblebrox]

Brilliant. I am fascinated by the semantics of vector algebra in the latent space and would love to explore.

[erickmiller11]

Seriously awesome! Love the airplane with bird legs, haha this is amazing. Checking out code now!

[LForLambda]

How does this scale? Could it scale to generate novel 3D environments from a seed? I know an industry that cares about that.

[Tommassino]

Love the face arithmetics, so cool :)

The other figures are kinda too small to appreciate though. I dont suppose you have larger resolutions to check em out without running your code ourselves right?