A Large-Scale Study on Regularization and Normalization in GANs

Citations Over Time

Abstract

Generative adversarial networks (GANs) are a class of deep generative models which aim to learn a target distribution in an unsupervised fashion. While they were successfully applied to many problems, training a GAN is a notoriously challenging task and requires a significant number of hyperparameter tuning, neural architecture engineering, and a non-trivial amount of "tricks". The success in many practical applications coupled with the lack of a measure to quantify the failure modes of GANs resulted in a plethora of proposed losses, regularization and normalization schemes, as well as neural architectures. In this work we take a sober view of the current state of GANs from a practical perspective. We discuss and evaluate common pitfalls and reproducibility issues, open-source our code on Github, and provide pre-trained models on TensorFlow Hub.

Related Papers

• → Bag of Tricks for Training Deeper Graph Neural Networks: A Comprehensive Benchmark Study(2022)46 cited
• → Classification of Canker on Small Datasets Using Improved Deep Convolutional Generative Adversarial Networks(2019)22 cited
• → Deep learning regularization techniques to genomics data(2021)20 cited
• → Dealing with Limited Access to Data: Comparison of Deep Learning Approaches(2019)