journal article Dec 03, 2022

Generative Adversarial Networks for Face Generation: A Survey

Abstract
Recently, generative adversarial networks (GANs) have progressed enormously, which makes them able to learn complex data distributions in particular faces. More and more efficient GAN architectures have been designed and proposed to learn the different variations of faces, such as cross pose, age, expression, and style. These GAN-based approaches need to be reviewed, discussed, and categorized in terms of architectures, applications, and metrics. Several reviews that focus on the use and advances of GAN in general have been proposed. However, to the best of our knowledge, the GAN models applied to the face, which we call
facial GANs
, have never been addressed. In this article, we review facial GANs and their different applications. We mainly focus on architectures, problems, and performance evaluation with respect to each application and used datasets. More precisely, we review the progress of architectures and discuss the contributions and limits of each. Then, we expose the encountered problems of facial GANs and propose solutions to handle them. Additionally, as GAN evaluation has become a notable current defiance, we investigate the state-of-the-art quantitative and qualitative evaluation metrics and their applications. We conclude this work with a discussion on the face generation challenges and propose open research issues.
Topics

No keywords indexed for this article. Browse by subject →

References
169
[3]
Hamed Alqahtani and Manolya Kavakli-Thorne. 2019. Adversarial disentanglement using latent classifier for pose-independent representation. In Proceedings of the International Conference on Image Analysis and Processing (ICIAP’19).
[4]
Hamed Alqahtani, Manolya Kavakli-Thorne, and Gulshan Kumar. 2019. Applications of generative adversarial networks (GANs): An updated review. Archives of Computational Methods in Engineering 28, 1 (2019), 1–28.
[6]
Martin Arjovsky and Léon Bottou. 2017. Towards principled methods for training generative adversarial networks. arXiv preprint arXiv:1701.04862 (2017).
[7]
Martin Arjovsky, Soumith Chintala, and Léon Bottou. 2017. Wasserstein generative adversarial networks. In Proceedings of the International Conference on Machine Learning. 214–223.
[8]
Sanjeev Arora, Rong Ge, Yingyu Liang, Tengyu Ma, and Yi Zhang. 2017. Generalization and equilibrium in generative adversarial nets (GANs). In Proceedings of the International Conference on Machine Learning. 224–232.
[12]
Samuel A. Barnett. 2018. Convergence problems with generative adversarial networks (GANs). arXiv preprint arXiv:1806.11382 (2018).
[13]
Shane Barratt and Rishi Sharma. 2018. A note on the inception score. arXiv preprint arXiv:1801.01973 (2018).
[14]
David Berthelot, Thomas Schumm, and Luke Metz. 2017. BEGAN: Boundary equilibrium generative adversarial networks. arXiv preprint arXiv:1703.10717 (2017).
[16]
Mikołaj Bińkowski, Danica J. Sutherland, Michael Arbel, and Arthur Gretton. 2018. Demystifying MMD GANs. arXiv preprint arXiv:1801.01401 (2018).
[19]
Andrew Brock, Jeff Donahue, and Karen Simonyan. 2018. Large scale GAN training for high fidelity natural image synthesis. arXiv preprint arXiv:1809.11096 (2018).
[20]
Anpei Chen, Ruiyang Liu, Ling Xie, Zhang Chen, Hao Su, and Jingyi Yu. 2020. SofGAN: A portrait image generator with dynamic styling. arXiv preprint arXiv:2007.03780 (2020).
[21]
Chaofeng Chen, Xiaoming Li, Lingbo Yang, Xianhui Lin, Lei Zhang, and Kwan-Yee K. Wong. 2020. Progressive semantic-aware style transformation for blind face restoration. arXiv preprint arXiv:2009.08709 (2020).
[24]
WenTing Chen, Xinpeng Xie, Xi Jia, and Linlin Shen. 2018. Texture deformation based generative adversarial networks for face editing. arXiv preprint arXiv:1812.09832 (2018).
[25]
Xi Chen, Yan Duan, Rein Houthooft, John Schulman, Ilya Sutskever, and Pieter Abbeel. 2016. InfoGAN: Interpretable representation learning by information maximizing generative adversarial nets. arXiv preprint arXiv:1606.03657 (2016).
[28]
Shiyang Cheng, Michael Bronstein, Yuxiang Zhou, Irene Kotsia, Maja Pantic, and Stefanos Zafeiriou. 2019. MeshGAN: Non-linear 3D morphable models of faces. arXiv preprint arXiv:1903.10384 (2019).
[33]
Joachim D. Curtó, Irene C. Zarza, Fernando De La Torre, Irwin King, and Michael R. Lyu. 2017. High-resolution deep convolutional generative adversarial networks. arXiv preprint arXiv:1711.06491 (2017).
[38]
Chris Donahue, Zachary C. Lipton, Akshay Balsubramani, and Julian McAuley. 2017. Semantically decomposing the latent spaces of generative adversarial networks. arXiv preprint arXiv:1705.07904 (2017).
[39]
Shiqing Fan and Ye Luo. 2021. Deblurring processor for motion-blurred faces based on generative adversarial networks. arXiv preprint arXiv:2103.02121 (2021).
[40]
Charlie Frogner, Chiyuan Zhang, Hossein Mobahi, Mauricio Araya-Polo, and Tomaso Poggio. 2015. Learning with a Wasserstein loss. arXiv preprint arXiv:1506.05439 (2015).
[43]
Jon Gauthier. 2014. Conditional generative adversarial nets for convolutional face generation. Class Project for Stanford CS231N: Convolutional Neural Networks for Visual Recognition, Winter Semester 2014, 5 (2014), 2.
[46]
Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial networks. arXiv preprint arXiv:1406.2661 (2014).
[48]
Shanyan Guan, Ying Tai, Bingbing Ni, Feida Zhu, Feiyue Huang, and Xiaokang Yang. 2020. Collaborative learning for faster StyleGAN embedding. arXiv preprint arXiv:2007.01758 (2020).
[49]
Jie Gui, Zhenan Sun, Yonggang Wen, Dacheng Tao, and Jieping Ye. 2020. A review on generative adversarial networks: Algorithms, theory, and applications. arXiv preprint arXiv:2001.06937 (2020).
[50]
Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, and Aaron Courville. 2017. Improved training of Wasserstein GANs. arXiv preprint arXiv:1704.00028 (2017).

Showing 50 of 169 references

Cited By
123
IEEE Open Journal of the Communicat...
International Journal of Intelligen...
Multimedia Tools and Applications
The Science Teacher
Frontiers in Computer Science
Metrics
123
Citations
169
References
Details
Published
Dec 03, 2022
Vol/Issue
55(5)
Pages
1-37
License
View
Cite This Article
Amina Kammoun, Rim Slama, Hedi Tabia, et al. (2022). Generative Adversarial Networks for Face Generation: A Survey. ACM Computing Surveys, 55(5), 1-37. https://doi.org/10.1145/3527850
Related

You May Also Like

Data clustering

A. K. Jain, M. N. Murty · 1999

9,568 citations

Anomaly detection

Varun Chandola, Arindam Banerjee · 2009

8,799 citations

Machine learning in automated text categorization

Fabrizio Sebastiani · 2002

5,027 citations

Object tracking

Alper Yilmaz, Omar Javed · 2006

3,632 citations

A Survey on Bias and Fairness in Machine Learning

Ninareh Mehrabi, Fred Morstatter · 2021

3,466 citations