View in EDS

Image-to-image translation based face photo de-meshing using GANs.

Saved in:
Bibliographic Details
Title: Image-to-image translation based face photo de-meshing using GANs.
Authors: Jabbar, Abdul1 (AUTHOR) jabbar@zju.edu.cn, Assam, Muhammad1 (AUTHOR) assam@zju.edu.cn, Arslan, Muhammad2 (AUTHOR) mhmd.arslan@outlook.com, Bukhsh, Madiha3 (AUTHOR) madiha@zju.edu.cn, Amin, Muhammad Shoib4 (AUTHOR) 52184501030@stu.ecnu.edu.cn, Ghadi, Yazeed Yasin5 (AUTHOR) yazeed.ghadi@aau.ac.ae, Innab, Nisreen6 (AUTHOR) ninnab@um.edu.sa, Alajmi, Masoud7 (AUTHOR) ms.alajmi@tu.edu.sa, Orken, Mamyrbayev8 (AUTHOR) morkenj@mail.ru, Indira, Salgozha9 (AUTHOR) indi_s@mail.ru, Alkahtan, Hend Khalid1,10 (AUTHOR) Hkalqahtani@pnu.edu.sa
Source: Computer Vision & Image Understanding. Oct2024, Vol. 247, pN.PAG-N.PAG. 1p.
Subjects: Generative adversarial networks, Performance theory
Abstract: Most of the existing face photo de-meshing methods have accomplished promising results; there are certain quality problems with these methods like the inpainted regions would appear blurry and unpleasant boundaries becoming visible. Such artifacts cause generated face photos unreal. Therefore, we propose an effective image-to-image translation framework called Face De-meshing Using Generative Adversarial Networks (De-mesh GANs). The De-mesh GANs is a two-stage model: (i) binary mask generating module, is a three convolution layers-based encoder–decoder network architecture that automatically generates a binary mask for the meshed region, and (ii) face photo de-meshing module, is a GANs-based network that eliminates the mesh mask and synthesizes the meshed area. An arrangement of careful losses (reconstruction loss, adversarial loss, and perceptual loss) is used to reassure the better quality of the de-mesh face photos. To facilitate the training of the proposed model, we have designed a dataset of clean/corrupted photo pairs using the CelebA dataset. Qualitative and quantitative evaluations of the De-mesh GANs on real-world corrupted face photo images show better performance than the previously proposed face photo de-meshing models. Furthermore, we also offer the ablation study for performance assessment of the additional network i.e., perceptual network. [ABSTRACT FROM AUTHOR]
Copyright of Computer Vision & Image Understanding is the property of Academic Press Inc. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:Most of the existing face photo de-meshing methods have accomplished promising results; there are certain quality problems with these methods like the inpainted regions would appear blurry and unpleasant boundaries becoming visible. Such artifacts cause generated face photos unreal. Therefore, we propose an effective image-to-image translation framework called Face De-meshing Using Generative Adversarial Networks (De-mesh GANs). The De-mesh GANs is a two-stage model: (i) binary mask generating module, is a three convolution layers-based encoder–decoder network architecture that automatically generates a binary mask for the meshed region, and (ii) face photo de-meshing module, is a GANs-based network that eliminates the mesh mask and synthesizes the meshed area. An arrangement of careful losses (reconstruction loss, adversarial loss, and perceptual loss) is used to reassure the better quality of the de-mesh face photos. To facilitate the training of the proposed model, we have designed a dataset of clean/corrupted photo pairs using the CelebA dataset. Qualitative and quantitative evaluations of the De-mesh GANs on real-world corrupted face photo images show better performance than the previously proposed face photo de-meshing models. Furthermore, we also offer the ablation study for performance assessment of the additional network i.e., perceptual network. [ABSTRACT FROM AUTHOR]
ISSN:10773142
DOI:10.1016/j.cviu.2024.104080