
Facial Expression Recognition and Classification Using Optimized EfficientNet-B7
Humans use their faces to express their emotions and intentions in a simple and natural way. Face expressions are the essential components of nonverbal communication. In human-computer interaction and affective computing, facial expression recognition has various applications. There are several methods devised for recognition and classification of facial expression; still, the accurate recognition is the challenging task. Hence, in this research an automatic facial expression recognition and classification based on deep learning is introduced. Initially the input image is collected from facial expression recognition dataset. Then, the collected image is fed into pre-processing using Gaussian filtering which is used for noise reduction. Then the pre-processed images are given to feature extraction phase using Gray-Level Co-Occurrence Matrix (GLCM). GLCM is used to extract texture features for the facial expression recognition. Then the EfficientNet-B7 is utilized for the recognition and classification of facial expression due to the enhanced outcome with faster inference and smaller size. The proposed IC_EfficientNet method combines the gannet’s ability to capture food with the coot bird’s ability to forage. The optimization technique achieves higher convergence rates due to this hybridization, which improves the EfficientNet-B7 model's parameter tuning. In comparison to existing techniques, the hybrid Improved Coot (IC) algorithm balances exploration and exploitation, leading to a quicker and more effective optimization process. The proposed IC_EfficientNet provides better results compared to existing methods such as Deep Neural Network (DNN), MultiLayer Perceptron (MLP) neural network, Facial Detection using a Convolutional Neural Network (FD-CNN) and Convolutional Neural Network (CNN). Thus, the proposed IC_EfficientNet provides the better outcome in terms of Accuracy, Specificity, Precision, Recall, F1-Measure, and MSE acquired the better outcome of 99.13, 98.80, 97.80, 99.13, 98.44, and 0.87 respectively.
[1] Aslan M., “CNN Based Efficient Approach for Emotion Recognition,” Journal of King Saud University-Computer and Information Sciences, vol. 34, no. 9, pp. 7335-7346, 2022. DOI:doi.org/10.1016/j.jksuci.2021.08.021
[2] Bhatia Y., Bari A., Hsu G., and Gavrilova M., “Motion Capture Sensor-Based Emotion Recognition Using a Bi-Modular Sequential Neural Network,” Sensors, vol. 22, no. 1, pp. 403, 2022. https://doi.org/10.3390/s22010403
[3] Boughida A., Kouahla M., and Lafifi Y., “A Novel Approach for Facial Expression Recognition Based on Gabor filters and Genetic Algorithm,” Evolving Systems, vol. 13, no. 2, pp. 331-345, 2022. doi.org/10.1007/s12530-021-09393-2
[4] Cha H. and Im C., “Performance Enhancement of Facial Electromyogram-Based Facial-Expression Recognition for Social Virtual Reality Applications Using Linear Discriminant Analysis Adaptation,” Virtual Reality, vol. 26, no. 1, pp. 385-398, 2022. doi.org/10.1007/s10055-021- 00575-6
[5] Dino H. and Abdulrazzaq M., “Facial Expression Classification Based on SVM, KNN and MLP Classifiers,” in Proceedings of the International Conference on Advanced Science and Engineering, Duhok, pp. 70-75, 2019. DOI:10.1109/ICOASE.2019.8723728
[6] Dresvyanskiy D., Ryumina E., Kaya H., Markitantov M., Karpov A., and Minker W., “End-to-End Modeling and Transfer Learning for Audiovisual Emotion Recognition in-the-Wild,” Multimodal Technologies and Interaction, vol. 6, no. 2, pp. 11, 2022. https://doi.org/10.3390/mti6020011
[7] Fard A. and Mahoor M., “AD-CORRE: Adaptive Correlation-Based Loss for Facial Expression Recognition in the wild,” IEEE Access, vol. 10, pp. 26756-26768, 2022. DOI:10.1109/ACCESS.2022.3156598
[8] Guo J., “Deep Learning Approach to Text Analysis for Human Emotion Detection from Big Data,” Journal of Intelligent Systems, vol. 31, no. 1, pp. 113-126, 2022. DOI:10.1515/jisys-2022- 0001
[9] Keshri A., Singh A., Kumar B., Pratap D., and Chauhan A., “Automatic Detection and Classification of Human Emotion in Real-Time Scenario,” Journal of IoT in Social, Mobile, Analytics, and Cloud, vol. 4, no. 1, pp. 41-53, 2022. DOI:10.36548/jismac.2022.1.005
[10] Kim J., Kim B., Roy P., and Jeong D., “Efficient Facial Expression Recognition Algorithm based on Hierarchical Deep Neural Network Structure,” IEEE Access, vol. 7, pp. 41273-41285, 2019. DOI:10.1109/ACCESS.2019.2907327
[11] Kim J., Kim N., and Won C., “Facial Expression Recognition with Swin Transformer,” arXiv preprint, vol. arXiv:2203, pp. 13472, 2022. https://doi.org/10.48550/arXiv.2203.13472
[12] Li Y., Wei J., Liu Y., Kauttonen J., and Zhao G., “Deep Learning for Micro-Expression Recognition: A Survey,” IEEE Transactions on Affective Computing. vol. 13, no. 4, pp. 2028- 2046, 2022. DOI:10.1109/TAFFC.2022.3205170
[13] Liu Y., Feng C., Yuan X., Zhou L., Wang W., Qin J., and Luo Z., “Clip-Aware Expressive Feature Learning for Video-Based Facial Expression Recognition,” Information Sciences, vol. 598, pp. 182-195, 2022. https://doi.org/10.1016/j.ins.2022.03.062
[14] Moung E., Wooi C., Sufian M., On C., and Dargham J., “Ensemble-Based Face Expression Recognition Approach for Image Sentiment Analysis,” International Journal of Electrical and Computer Engineering, vol. 12, no. 3, pp. 2588, 2022. DOI: http://doi.org/10.11591/ijece.v12i3.pp2588-2600
[15] Nan F., Jing W., Tian F., Zhang J., Chao K., Hong Z., and Zheng Q., “Feature Super-Resolution Based Facial Expression Recognition for Multi- Scale Low-Resolution Images,” Knowledge- Based Systems, vol. 236, pp. 107678, 2022. https://doi.org/10.1016/j.knosys.2021.107678
[16] Nan Y., Ju J., Hua Q., Zhang H., and Wang B., “A-MobileNet: An Approach of Facial Expression Recognition,” Alexandria Engineering Journal, vol. 61, no. 6, pp. 4435-4444, 2022. https://doi.org/10.1016/j.aej.2021.09.066
[17] Naruei I. and Keynia F., “A New Optimization 488 The International Arab Journal of Information Technology, Vol. 22, No. 3, May 2025 Method Based on COOT Bird Natural Life Model,” Expert Systems with Applications, vol. 183, pp. 115352, 2021. https://doi.org/10.1016/j.eswa.2021.115352
[18] Pan J., Zhang L., Wang R., Snášel V., and Chu S., “Gannet Optimization Algorithm: A New Metaheuristic Algorithm for Solving Engineering Optimization Problems,” Mathematics and Computers in Simulation, vol. 202, pp. 343-373, 2022. https://doi.org/10.1016/j.matcom.2022.06.007
[19] Peng X., Gu Y., and Zhang P., “Au-Guided Unsupervised Domain-Adaptive Facial Expression Recognition,” Applied Sciences, vol. 12, no. 9, pp. 4366, 2022. https://doi.org/10.3390/app12094366
[20] Phan K., Nguyen H., Huynh V., and Kim S., “Facial Expression Classification using Fusion of Deep Neural Network in Video,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, pp. 2507- 2511, 2022. DOI:10.1109/CVPRW56347.2022.00280
[21] Rawal N. and Stock-Homburg R., “Facial Emotion Expressions in Human-Robot Interaction: A Survey,” International Journal of Social Robotics, vol. 14, no. 7, pp. 1583-1604, 2022. https://doi.org/10.1007/s12369-022-00867- 0
[22] Saeed S., Shah A., Ehsan M., Amirzada M., Mahmood A., and Mezgebo T., “Automated Facial Expression Recognition Framework Using Deep Learning,” Journal of Healthcare Engineering, vol. 2022, pp. 1-11, 2022. https://doi.org/10.1155/2022/5707930
[23] Saeed V., “A Framework for Recognition of Facial Expression Using HOG Features,” International Journal of Mathematics, Statistics, and Computer Science, vol. 2, pp. 1-8, 2024. https://doi.org/10.59543/ijmscs.v2i.7815
[24] Shanthi P. and Nickolas S., “Facial Landmark Detection and Geometric Feature-Based Emotion Recognition,” International Journal of Biometrics, vol. 14, no. 2, pp. 138-154, 2022. https://doi.org/10.1504/IJBM.2022.121799
[25] Shen J., Yang H., Li J., and Cheng Z., “Assessing Learning Engagement Based on Facial Expression Recognition in MOOC’s Scenario,” Multimedia Systems, vol. 28, pp. 469-478, 2022. https://doi.org/10.1007/s00530-021-00854-x
[26] Siam A., Soliman N., Algarni A., El-Samie A., Fathi E., and Sedik A., “Deploying Machine Learning Techniques for Human Emotion Detection,” Computational Intelligence and Neuroscience, vol. 2022, pp. 1-16, 2022. https://doi.org/10.1155/2022/8032673
[27] Swaminathan A., Vadivel A., and Arock M., “FERCE: Facial Expression Recognition for Combined Emotions Using FERCE Algorithm,” IETE Journal of Research, vol. 68, no. 5, pp. 3235-3250, 2022. https://doi.org/10.1080/03772063.2020.1756471
[28] Talaat F., Ali Z., Mostafa R., and El-Rashidy N., “Real-Time Facial Emotion Recognition Model Based on Kernel Autoencoder and Convolutional Neural Network for Autism Children,” Soft Computing, vol. 28, pp. 6695-6708, 2024. https://doi.org/10.1007/s00500-023-09477-y
[29] Xue F., Tan Z., Zhu Y., Ma Z., and Guo G., “Coarse-to-Fine Cascaded Networks with Smooth Predicting for Video Facial Expression Recognition,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, pp. 2412-2418, 2022. DOI:10.1109/CVPRW56347.2022.00269
[30] Yu J., Cai Z., He P., Xie G., and Ling Q., “Multi- Model Ensemble Learning Method for Human Expression Recognition,” arXiv preprint, vol. arXiv:2203, pp.14466, 2022. doi.org/10.48550/arXiv.2203.14466
[31] Zeng D., Lin Z., Yan X., Liu Y., Wang F., and Tang B., “Face2exp: Combating Data Biases for Facial Expression Recognition,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, pp. 20291-20300, 2022. DOI:10.1109/CVPR52688.2022.01965
[32] Zhi J., Song T., Yu K., Yuan F., Wang H., Hu G., and Yang H., “Multi-Attention Module for Dynamic Facial Emotion Recognition,” Information, vol. 13, no. 5, pp. 207, 2022. doi.org/10.3390/info13050207
[33] Ziade H., Ayoubi R., and Velazco R., “A Survey on Fault Injection Techniques,” The International Arab Journal on Information Technology, vol. 1, no. 2, pp. 171-186, 2004.