The International Arab Journal of Information Technology (IAJIT)

..............................
..............................
..............................


Analyzing Sentiments using Optimized Novel Ensemble Fuzzy and DL based Approach with Efficient Feature Selection and Extraction Models

The most popular and active area of data mining study is sentiment analysis. Twitter is a crucial platform for collecting and distributing people’s thoughts, feelings, views, and attitudes regarding specific entities. There are several social media networks available today. In light of this, sentiment analysis in the Natural Language Processing (NLP) field became fascinating. Various methods for analyzing sentiment have been explored. However, improvements are still required regarding reliability and system efficacy. Additionally, user emotional expressions typically take the form of naturally occurring human-written textual data with numerous noises and ambiguities. The intricate contextual significance of sentiment expressions is difficult for present studies on sentiment analysis to precisely capture and interpret, particularly in linguistics with complex frameworks. To address these issues, we presented a new integrated fuzzy neural network. The proposed framework is developed for effective and efficient feature selection and hybrid approach based sentiment analysis. Ensemble of novel Deep Convolutional Neuro- Fuzzy Inference System (DCNFIS) and Deep Learning-based (DL) Long short-term memory neural network multilayer stacked bidirectional LSTM neural network analyzes the sentiments. The provided dataset is initially cleaned up and filtered out as part of preprocessing. Utilizing the preprocessed data, sentiment-based features are extracted using the inception-ResNet-V2 model. Then, the relevant features are selected by employing the Enhanced Reptile Search Algorithm (ERSA). The Al-Biruni Earth Radius (BER) optimization algorithm is used to optimize the hyperparameters of the ensemble approach, which analyzes the sentiment categories such as positive, negative, very positive, very negative, and neutral. Finally, an effectiveness assessment of the suggested and present classifiers is presented. Using three distinct research datasets, we conducted an experimental evaluation of the suggested model. While differentiating from the proposed approach, the proposed approach yields a greater performance of 98.97% recall, 99.06% precision, 99.13% accuracy and 99.01% F1-score. The experimental investigation analyzes that the proposed approach gains superior performance over existing approaches.

[1] Basiri M., Nemati S., Abdar M., Asadi S., and Rajendra Acharrya U., “A Novel Fusion-based Deep Learning Model for Sentiment Analysis of COVID-19 Tweets,” Knowledge-based Systems, vol. 228, pp. 107242, 2021. https://doi.org/10.1016/j.knosys.2021.107242

[2] Basiri M., Nemati S., Abdar M., Cambria E., and Rajendra Acharya U., “ABCDM: An Attention- based Bidirectional CNN-RNN Deep Model for Sentiment Analysis,” Future Generation Computer Systems, vol. 115, no. C, pp. 279-294, 2021. https://doi.org/10.1016/j.future.2020.08.005

[3] Behera R., Jena M., Rath S., and Misra S., “Co- LSTM: Convolutional LSTM Model for Sentiment Analysis in Social Big Data,” Information Processing and Management, vol. 58, no. 1, pp. 102435, 2021. https://doi.org/10.1016/j.ipm.2020.102435

[4] Chauhan P., Sharma N., and Sikka G., “The Emergence of Social Media Data and Sentiment Analysis in Election Prediction,” Journal of Ambient Intelligence and Humanized Computing, vol. 12, no. 2, pp. 2601-2627, 2021. https://link.springer.com/article/10.1007/s12652- 020-02423-y

[5] Dashtipour K., Gogate M., Adeel A., Larijani H., and Hussain A., “Sentiment Analysis of Persian Movie Reviews Using Deep Learning,” Entropy, vol. 23, no. 5, pp. 1-16, 2021. https://doi.org/10.3390/e23050596

[6] Dashtipour K., Gogate M., Cambria E., and Hussain A., “A Novel Context-Aware Multimodal Framework for Persian Sentiment Analysis,” Neurocomputing, vol. 457, pp. 377-388, 2021. https://doi.org/10.1016/j.neucom.2021.02.020

[7] Elgeldawi E., Sayed A., Galal A., and Zaki A., “Hyperparameter Tuning for Machine Learning Algorithms Used for Arabic Sentiment Analysis,” Informatics, vol. 8, no. 4, pp. 1-21, 2021. https://doi.org/10.3390/informatics8040079

[8] Fatouros G., Soldatos J., Kouroumali K., Makridis G., and Kyriazis D., “Transforming Sentiment Analysis in the Financial Domain with ChatGPT,” Machine Learning with Applications, vol. 14, no. 1, pp. 100508, 2023. https://doi.org/10.1016/j.mlwa.2023.100508

[9] Garcia K. and Berton L., “Topic Detection and Sentiment Analysis in Twitter Content Related to COVID-19 from Brazil and the USA,” Applied Soft Computing, vol. 101, pp. 107057, 2021. https://doi.org/10.1016/j.asoc.2020.107057

[10] Iddrisu A., Mensah S., Boafo F., Yeluripati G., and Kudjo P.,“A Sentiment Analysis Framework to Classify Instances of Sarcastic Sentiments within the Aviation Sector,” International Journal of Information Management Data Insights, vol. 3, 758 The International Arab Journal of Information Technology, Vol. 21, No. 4, July 2024 no. 2, pp. 100180, 2023. https://doi.org/10.1016/j.jjimei.2023.100180

[11] Jain D., Boyapati P., Venkatesh J., and Prakash M., “An Intelligent Cognitive-Inspired Computing with Big Data Analytics Framework for Sentiment Analysis and Classification,” Information Processing and Management, vol. 59, no. 1, pp. 102758, 2022. https://doi.org/10.1016/j.ipm.2021.102758

[12] Jain P., Quamer W., Saravanan V., and Pamula R., “Employing BERT-DCNN with Sentic Knowledge Base for Social Media Sentiment Analysis,” Journal of Ambient Intelligence and Humanized Computing, vol. 14, no. 8, pp. 10417- 10429, 2023. https://doi.org/10.1007/s12652-022- 03698-z

[13] Jing N., Wu Z., and Wang H., “A Hybrid Model Integrating Deep Learning with Investor Sentiment Analysis for Stock Price Prediction,” Expert Systems with Applications, vol. 178, pp. 115019, 2021. https://doi.org/10.1016/j.eswa.2021.115019

[14] Kaur G. and Sharma A., “A Deep Learning-based Model Using Hybrid Feature Extraction Approach for Consumer Sentiment Analysis,” Journal of Big Data, vol. 10, no. 1, pp. 1-23, 2023. https://doi.org/10.1186/s40537-022-00680-6

[15] Kaur H., Ul Ahsaan S., Alankar B., and Chang V., “A Proposed Sentiment Analysis Deep Learning Algorithm for Analyzing COVID-19 Tweets,” Information Systems Frontiers, vol. 23, no. 6, pp. 1417-1429, 2021. https://doi.org/10.1007/s10796- 021-10135-7

[16] Li R., Chen H., Feng F., Ma Z., Wang X., and Hovy E., “Dual Graph Convolutional Networks for Aspect-based Sentiment Analysis,” in Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, Bangkok, pp. 6319-6329, 2021. https://aclanthology.org/2021.acl- long.494.pdf

[17] Li W., Shao W., Ji S., and Cambria E., “BiERU: Bidirectional Emotional Recurrent Unit for Conversational Sentiment Analysis,” Neurocomputing, vol. 467, no. C, pp. 73-82, 2022. https://doi.org/10.1016/j.neucom.2021.09.057

[18] Liang B., Su H., Gui L., Cambria E., and Xu R., “Aspect-based Sentiment Analysis via Affective Knowledge Enhanced Graph Convolutional Networks,” Knowledge-based Systems, vol. 235, pp. 107643, 2022. https://doi.org/10.1016/j.knosys.2021.107643

[19] Liao W., Zeng B., Yin X., and Wei P., “An Improved Aspect-Category Sentiment Analysis Model for Text Sentiment Analysis Based on RoBERTa,” Applied Intelligence, vol. 51, no. 6, pp. 3522-3533, 2021. https://doi.org/10.1007/s10489-020-01964-1

[20] Maree M., Eleyat M., and Mesqali E., “Optimizing Machine Learning-based Sentiment Analysis Accuracy in Bilingual Sentences via Preprocessing Techniques,” The International Arab Journal of Information Technology, vol. 21, no. 2, pp. 257-270, 2024. https://doi.org/10.34028/iajit/21/2/8

[21] Mujahid M., Lee E., Rustam F., Washington P., Ullah S., Reshi A., and Ashraf I., “Sentiment Analysis and Topic Modeling on Tweets about Online Education during COVID-19,” Applied Sciences, vol. 11, no. 18, pp. 1-25, 2021. https://doi.org/10.3390/app11188438

[22] Neogi A., Garg K., Mishra R., and Dwivedi Y., “Sentiment Analysis and Classification of Indian Farmers’ Protest Using Twitter Data,” International Journal of Information Management Data Insights, vol. 1, no. 2, pp. 100019, 2021. https://doi.org/10.1016/j.jjimei.2021.100019

[23] Nezhad Z. and Deihimi M., “Twitter Sentiment Analysis from Iran about COVID 19 Vaccine,” Diabetes and Metabolic Syndrome: Clinical Research and Reviews, vol. 16, no. 1, pp. 102367, 2022. DOI:10.1016/j.dsx.2021.102367

[24] Onan A., “Sentiment Analysis on Product Reviews Based on Weighted Word Embeddings and Deep Neural Networks,” Concurrency and Computation: Practice and Experience, vol. 33, no. 23, pp. 1-12, 2021. https://doi.org/10.1002/cpe.5909

[25] Singh M., Jakhar A., and Pandey S., “Sentiment Analysis on the Impact of Coronavirus in Social Life Using the BERT Model,” Social Network Analysis and Mining, vol. 11, no. 1, pp. 1-33, 2021. https://link.springer.com/article/10.1007/s13278- 021-00737-z#Sec14

[26] Sitaula C., Basnet A., Mainali A., and Shahi T., “Deep Learning-based Methods for Sentiment Analysis on Nepali COVID-19-Related Tweets,” Computational Intelligence and Neuroscience, vol. 2021, no. 1, pp. 1-11, 2021. https://doi.org/10.1155/2021/2158184

[27] Talaat A., “Sentiment Analysis Classification System Using Hybrid BERT Models,” Journal of Big Data, vol. 10, no. 1, pp. 1-18, 2023. https://doi.org/10.1186/s40537-023-00781-w