Scrupulous SCGAN Framework for Recognition of Restored Images with Caffe based PCA Filtration
Computer vision enables to detect many objects in any scenario which helps in various real time application but still face recognition and detection remains a tedious process due to the low resolution, blurriness, noise, diverse pose and expression and occlusions. This proposal develops a novel scrupulous Standardized Convolute Generative Adversarial Network (SCGAN) framework for performing accurate face recognition automatically by restoring the occluded region including blind face restoration. Initially, a scrupulous image refining technique is utilised to offer the appropriate input to the network in the subsequent process. Following the pre-processing stage, a Caffe based Principle Component Analysis (PCA) filtration is conducted which uses convolutional architecture for fast feature embedding that collects spatial information and significant differentiating characteristics to counteract the loss of information existing in pooling operations. Then a filtration method identifies the specific match of the face based on the extracted features, creating uncorrelated variables that optimise variance across time while minimising information loss. To handle all the diversification occurring in the image and accurately recognise the face with occlusion in any part of the face, a novel Standardized Convolute GAN network is used to restore the image and recognise the face using novel Generative Adversarial Network (GAN) networks are modelled. This GAN ensures the normal distribution along with parametric optimization contributing to the high performance with accuracy of 96.05% and Peak Signal to Noise Ratio (PSNR) of 18 and Structural Similarity Index Metric (SSIM) of 98% for restored face recognition. Thus, the performance of the framework based on properly recognizing the face from the generated images is evaluated and discussed.
[1] Almabdy S. and Elrefaei L., “Deep Convolutional Neural Network-Based Approaches for Face Recognition,” Applied Sciences, vol. 9, no. 20, pp. 4397, 2019. 10.3390/app9204397
[2] Cao L. and Liu D., “Face Image Super Resolution via Adaptive-Block PCA,” The International Arab Journal of Information Technology, vol. 13, no. 6, pp. 699-706, 2016.
[3] Guo J., Zhu X., Yang Y., Yang F., Lei Z., and Li S., “Towards Fast, Accurate and Stable 3d Dense Face Alignment,” in Proceedings of the European Conference on Computer Vision, Glasgow, pp. 152-168, 2020.
[4] Hariri W., “Efficient Masked Face Recognition Method During the Covid-19 Pandemic,” Signal, Image and Video Processing, vol. 16, no. 3, pp. 605-612, 2022.
[5] Hu X., Ren W., LaMaster J., Cao X., Li X., Li Z., and Liu W., “Face Super-Resolution Guided by 3d Facial Priors,” in Proceedings of the European Conference on Computer Vision, Glasgow, pp. 763-780, 2020.
[6] Karras T., Laine S., Aittala M., Hellsten J., Lehtinen J., and Aila T., “Analyzing and Improving the Image Quality of Stylegan,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Canada, pp. 8110-8119, 2020.
[7] Lee C., H., Liu Z., Wu L., and Luo P., “Maskgan: Towards Diverse and Interactive Facial Image Manipulation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, pp. 5549-5558, 2020.
[8] Li X., Hao P., He L., and Feng Y., “Image Gradient Orientations Embedded Structural Error Coding for Face Recognition with Occlusion,” Journal of Ambient Intelligence and Humanized Computing, vol. 11, no. 6, pp. 2349-2367, 2020. https://doi.org/10.1007/s12652-019-01257-7
[9] Li X., Chen C., Zhou S., Lin X., Zuo W., and Zhang L., “Blind face Restoration Via Deep Multi-Scale Component Dictionaries,” in 116 The International Arab Journal of Information Technology, Vol. 21, No. 1, January 2024 Proceedings of the European Conference on Computer Vision, Glasgow, pp. 399-415, 2020.
[10] Li X., Li W., Ren D., Zhang H., Wang M., and Zuo W., “Enhanced Blind Face Restoration with Multi-Exemplar Images and Adaptive Spatial Feature Fusion,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, pp. 2706-2715, 2020.
[11] Loussaief S. and Abdelkrim A., “Deep Learning Vs. Bag of Features in Machine Learning for Image Classification,” in Proceedings of the International Conference on Advanced Systems and Electric Technologies, Hammamet, pp. 6-10, 2018. DOI: 10.1109/ASET.2018.8379825
[12] Lu Y., Wang S., Zhao W., and Zhao Y., “Wgan- Based Robust Occluded Facial Expression Recognition,” IEEE Access, vol. 7, pp. 93594- 93610, 2019. DOI:10.1109/ACCESS.2019.2928125
[13] Navabifar F. and Emadi M., “A Fusion Approach Based on HOG and Adaboost Algorithm for Face Detection under Low-Resolution Images,” The International Arab Journal of Information Technology, vol. 19, no. 5, pp. 728-735, 2022.
[14] Qiu H., Gong D., Li Z., Liu W., and Tao D., “End2End Occluded Face Recognition by Masking Corrupted Features,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 10, pp. 6939-6952 2021. DOI:10.1109/TPAMI.2021.3098962
[15] Richardson E., Alaluf Y., Patashnik O., Nitzan Y., Azar Y., Shapiro S., and Cohen-Or D., “Encoding in Style: A Stylegan Encoder for Image-To-Image Translation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, pp. 2287-2296, 2021.
[16] Sharma S. and Kumar V., “Voxel-based 3D Face Reconstruction and its Application to Face Recognition Using Sequential Deep Learning,” Multimedia Tools and Applications, vol. 79, no. 25, pp. 17303-17330, 2020.
[17] Wang S., Cheng Z., Deng X., Chang L., Duan F., and Lu K., “Leveraging 3D Blendshape for Facial Expression Recognition Using CNN,” Science China Information Sciences, vol. 63, no. 120114, pp. 1-120114, 2020.
[18] Wang Z., Wang G., Huang B., Xiong Z., Hong Q., Wu H., Liang J., and et al., “Masked Face Recognition Dataset and Application,” arXiv preprint arXiv:2003.09093, 2020.
[19] Yu X. and Porikli F., “Hallucinating Very Low- Resolution Unaligned and Noisy Face Images by Transformative Discriminative Autoencoders,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, pp. 3760-3768, 2017.
[20] Zeng X., Peng X., and Qiao Y., “Df2net: A Dense- Fine-Finer Network for Detailed 3d Face Reconstruction,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 2315-2324, 2019.
[21] Zhao D. and Qi Y., “Generative Contour Guided Occlusions Removal 3D Face Reconstruction,” in Proceedings of the International Conference on Virtual Reality and Visualization, Phu Quoc, pp. 74-79, 2021. https://doi.org/10.1007/978-3-030- 98355-0_10
[22] Zhao D. and Qi Y., “Generative Landmarks Guided Eyeglasses Removal 3D Face Reconstruction,” in Proceedings of the International Conference on Multimedia Modeling, Phu Quoc, pp. 109-120, 2022.
[23] Zhao D., Cai J., and Qi Y., “Convincing 3D Face Reconstruction from a Single Color Image under Occluded Scenes,” Electronics, vol. 11, no. 4, pp. 543, 2022. DOI:10.3390/electronics11040543