HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishment

Lingbo Yang^1,3 Chang Liu² Pan Wang³ Shanshe Wang¹ Shanshe Wang¹ Siwei Ma¹ Wen Gao¹

¹Peking University ²University of Chinese Academy of Sciences ³Alibaba DAMO Academy

Abstract

Existing face restoration researches typically relies on either the degradation prior or explicit guidance labels for training, which often results in limited generalization ability over real-world images with heterogeneous degradations and rich background contents. In this paper, we investigate the more challenging and practical "dual-blind" version of the problem by lifting the requirements on both types of prior, termed as "Face Renovation"(FR). Specifically, we formulated FR as a semantic-guided generation problem and tackle it with a collaborative suppression and replenishment (CSR) approach. This leads to HiFaceGAN, a multi-stage framework containing several nested CSR units that progressively replenish facial details based on the hierarchical semantic guidance extracted from the front-end content-adaptive suppression modules. Extensive experiments on both synthetic and real face images have verified the superior performance of HiFaceGAN over a wide range of challenging restoration subtasks, demonstrating its versatility, robustness and generalization ability towards real-world face processing applications.

Navigation Links

Quantitative Examples

Dynamic Perception-Distortion Tradeoff

Left The performances at 4x bicubic super resolution and blind restoration task on FFHQ dataset. ISPL dominates existing methods simultaneously on both aspects that it even reach beyond our initial hypothesis on the P-D boundary. Note the PSNR axis is inverted to better illustrate the tradeoff relationship.

Right: Super resolution results under varying scaling factors. Compared to explicit prior models, ISPL consistently delivers high-quality restoration results with rich facial details.

BibTeX

If you use our code or data, please cite:

                @article{Yang2020HiFaceGAN,
                  title={HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishment},
                  author={Lingbo Yang and C. Liu and P. Wang and Shanshe Wang and P. Ren and Siwei Ma and W. Gao},
                  journal={Proceedings of the 28th ACM International Conference on Multimedia},
                  year={2020}
                }