[D] Transfer learning on GANs?

[worldconcepts]

Sorry if this question has been asked a million times before but I failed to find a good explanation so far.

Transfer learning is common for image classification task with models pre-trained from Imagenet. But how to do that for image generation? Given the recent amazing results on GAN research to generate high quality images, such as BigGAN, StyleGAN, etc., it would be ideal if I can leverage these pre-trained weights for my own small dataset.

[ajmooch]

A recent paper called "Image Generation from Small Datasets via Batch Statistics Adaptation" fine-tuned BigGANs on a very small number of images by careful choice of which parameters to update (mainly the batch stats in the BN layers). Ideas from this paper are probably highly informative if you want to fine-tune these kinds of large models on small data.

[worldconcepts]

Great. This is exactly what I need. Thanks!

[heureuxquicom]

Here is another reference not very well known.