Improved Performance of Hybrid GRU-BiLSTM for Detection Emotion on Twitter Dataset

M. Khairul Anam, Munawir Munawir, Lusiana Efrizoni, Nurul Fadillah, Wirta Agustin, Irwanda Syahputra, Tri Putri Lestari, Muhammad Bambang Firdaus, Lathifah Lathifah, Atalya Kurnia Sari

Abstract


This study addresses emotion detection challenges in tweets, focusing on contextual understanding and class imbalance. A novel hybrid deep learning architecture combining GRU-BiLSTM with SMOTE is proposed to enhance classification performance on an Israel-Palestine conflict dataset. The dataset contains 40,000 tweets labeled with six emotions: anger, disgust, fear, joy, sadness, and surprise. SMOTE effectively balances the dataset, improving model fairness in detecting minority classes. Experimental results show that the GRU-BiLSTM hybrid with an 80:20 data split achieves the highest accuracy of 89%, surpassing BiLSTM alone, which obtained 88%, and other state-of-the-art models. Notably, the proposed model delivers significant improvement in detecting the emotion of joy (recall: 0.87, F1-score: 0.86). In contrast, the surprise category remains challenging (recall: 0.24). Compared to existing research, this study highlights the effectiveness of combining SMOTE and hybrid GRU-BiLSTM, outperforming models such as CNN, GRU, and LSTM on similar datasets. The incorporation of GloVe embeddings enhances contextual word representations, enabling nuanced emotion detection even in sarcastic or ambiguous texts. The novelty lies in addressing class imbalance systematically with SMOTE and leveraging GRU-BiLSTM's complementary strengths, yielding superior performance metrics. This approach contributes to advancing emotion detection tasks, especially in conflict-related social media data, by offering a robust, context-sensitive, and balanced classification method.


Keywords


BiLSTM-GRU; Emotion; GloVe; SMOTE; Twitter

Full Text:

PDF

References


M. H. Elmasry, A. El Shamy, P. Manning, A. Mills, and P. J. Auter, “Al-Jazeera and Al-Arabiya framing of the Israel-Palestine conflict during war and calm periods,” Int Commun Gaz, vol. 75, no. 8, pp. 750–768, Dec. 2013, doi: 10.1177/1748048513482545.

S. Tezcan, “The Relations Between the Ottomans, Zionists and Palestinian Jews as Refl ected in Israeli History Textbooks,” Belleten, vol. 83, no. 298, pp. 1097–1130, 2019, doi: 10.37879/belleten.2019.1131.

S. Adhim and Yuliati, “The Conflict of the Formation of the State of Israel in 1948-1973,” Asanka: Journal of Social Science and Education, vol. 2, no. 1, pp. 61–70, 2021, doi: 10.21154/asanka.v2i1.2429.

F. I. Pratiwi, M. A. R. Syarafi, and D. Nauvarian, “Israeli-Palestinian Conflict beyond Resolution: A Critical Assessment,” Jurnal Ilmu Sosial dan Ilmu Politik, vol. 26, no. 2, pp. 168–182, Nov. 2022, doi: 10.22146/jsp.66935.

R. W. Pratiwi, Y. Sari, and Y. Suyanto, “Attention-Based BiLSTM for Negation Handling in Sentimen Analysis,” IJCCS (Indonesian Journal of Computing and Cybernetics Systems), vol. 14, no. 4, pp. 397–406, Oct. 2020, doi: 10.22146/ijccs.60733.

Y. H. Hsieh and X. P. Zeng, “Sentiment Analysis: An ERNIE-BiLSTM Approach to Bullet Screen Comments,” Sensors, vol. 22, no. 14, pp. 1–15, Jul. 2022, doi: 10.3390/s22145223.

M. Chihab, M. Chiny, N. M. H. Boussatta, Y. Chihab, and M. Youssef Hadi, “BiLSTM and Multiple Linear Regression based Sentiment Analysis Model using Polarity and Subjectivity of a Text,” IJACSA) International Journal of Advanced Computer Science and Applications, vol. 13, no. 10, pp. 436–442, 2022, doi: 10.14569/IJACSA.2022.0131052.

L. Xiaoyan, R. C. Raga, and S. Xuemei, “GloVe-CNN-BiLSTM Model for Sentiment Analysis on Text Reviews,” J Sens, vol. 2022, pp. 1–12, 2022, doi: 10.1155/2022/7212366.

X. Li, Y. Lei, and S. Ji, “BERT- and BiLSTM-Based Sentiment Analysis of Online Chinese Buzzwords,” Future Internet, vol. 14, no. 11, pp. 1–15, Nov. 2022, doi: 10.3390/fi14110332.

S. Wang, Y. Zhu, W. Gao, M. Cao, and M. Li, “Emotion-semantic-enhanced bidirectional LSTM with multi-head attention mechanism for microblog sentiment analysis,” Information (Switzerland), vol. 11, no. 5, pp. 1–15, Jun. 2020, doi: 10.3390/INFO11050280.

A. Glenn, P. LaCasse, and B. Cox, “Emotion classification of Indonesian Tweets using Bidirectional LSTM,” Neural Comput Appl, vol. 35, no. 13, pp. 9567–9578, May 2023, doi: 10.1007/s00521-022-08186-1.

M. A. Alshamari, “Evaluating User Satisfaction Using Deep-Learning-Based Sentiment Analysis for Social Media Data in Saudi Arabia’s Telecommunication Sector,” Computers, vol. 12, no. 9, p. 170, Aug. 2023, doi: 10.3390/computers12090170.

K. Muludi, M. S. Akbar, D. A. Shofiana, and A. Syarif, “Sentiment Analysis Of Energy Independence Tweets Using Simple Recurrent Neural Network,” IJCCS (Indonesian Journal of Computing and Cybernetics Systems), vol. 15, no. 4, p. 339, Oct. 2021, doi: 10.22146/ijccs.66016.

M. Kowsher et al., “LSTM-ANN & BiLSTM-ANN: Hybrid deep learning models for enhanced classification accuracy,” in Procedia Computer Science, Elsevier B.V., 2021, pp. 131–140. doi: 10.1016/j.procs.2021.10.013.

B. Gupta, P. Prakasam, and T. Velmurugan, “Integrated BERT embeddings, BiLSTM-BiGRU and 1-D CNN model for binary sentiment classification analysis of movie reviews,” Multimed Tools Appl, vol. 81, no. 23, pp. 33067–33086, Sep. 2022, doi: 10.1007/s11042-022-13155-w.

L. Deng et al., “News Text Classification Method Based on the GRU_CNN Model,” International Transactions on Electrical Energy Systems, vol. 2022, pp. 1–11, 2022, doi: 10.1155/2022/1197534.

M. K. Anam, T. A. Fitri, Agustin, Lusiana, M. B. Firdaus, and A. T. Nurhuda, “Sentiment Analysis for Online Learning using The Lexicon-Based Method and The Support Vector Machine Algorithm,” ILKOM Jurnal Ilmiah, vol. 15, no. 2, pp. 290–302, 2023, doi: 10.33096/ilkom.v15i2.1590.290-302.

Z. Fitriyah and M. D. Kartikasari, “TEXT CLASSIFICATION OF TWITTER OPINION RELATED TO PERMENDIKBUD 30/2021 USING BIDIRECTIONAL LSTM,” BAREKENG: Jurnal Ilmu Matematika dan Terapan, vol. 17, no. 2, pp. 1113–1122, Jun. 2023, doi: 10.30598/barekengvol17iss2pp1113-1122.

P. Sunagar and A. Kanavalli, “A Hybrid RNN based Deep Learning Approach for Text Classification,” IJACSA) International Journal of Advanced Computer Science and Applications, vol. 13, no. 6, p. 2022, 2022, doi: 10.14569/IJACSA.2022.0130636.

R. Refianti, A. B. Mutiara, and R. A. Putra, “A Lexicon-Based Long Short-Term Memory (LSTM) Model for Sentiment Analysis to Classify Halodoc Application Reviews on Google Playstore,” Journal of Applied Data Sciences, vol. 5, no. 1, pp. 146–157, Jan. 2024, doi: 10.47738/jads.v5i1.160.

X. Li, Y. Zhang, J. Jin, F. Sun, N. Li, and S. Liang, “A model of integrating convolution and BiGRU dual-channel mechanism for Chinese medical text classifications,” PLoS One, vol. 18, no. 3 March, Mar. 2023, doi: 10.1371/journal.pone.0282824.

M. K. Anam, I. Y. Pasa, K. D. kusuma Wardhani, L. Efrizoni, and M. B. Firdaus, “K-Means Clustering to Identity Twitter Build Operate Transfer (BOT) on Influential Accounts,” ComTech: Computer, Mathematics and Engineering Applications, vol. 14, no. 2, pp. 143–154, 2023, doi: 10.21512/comtech.v14i2.10620.

S. K. Bharti et al., “Text-Based Emotion Recognition Using Deep Learning Approach,” Comput Intell Neurosci, vol. 2022, pp. 1–8, 2022, doi: 10.1155/2022/2645381.

A. N. Ulfah, M. K. Anam, N. Y. S. Munti, S. Yaakub, and M. B. Firdaus, “Sentiment Analysis of the Convict Assimilation Program on Handling Covid-19,” JUITA: Jurnal Informatika, vol. 10, no. 2, pp. 209–216, 2022, doi: 10.30595/juita.v10i2.12308.

R. S. Putra, W. Agustin, M. K. Anam, L. Lusiana, and S. Yaakub, “The Application of Naïve Bayes Classifier Based Feature Selection on Analysis of Online Learning Sentiment in Online Media,” Jurnal Transformatika, vol. 20, no. 1, pp. 44–56, Jul. 2022, doi: 10.26623/transformatika.v20i1.5144.

L. L. Van Fc, M. K. Anam, M. B. Firdaus, Y. Yunefri, and N. A. Rahmi, “Enhancing Machine Learning Model Performance in Addressing Class Imbalance,” COGITO Smart Journal, vol. 10, no. 1, pp. 478–490, 2024.

A. Angdresey and G. Saroinsong, “The Decision Tree Algorithm on Sentiment Analysis: Russia and Ukraine War,” Jurnal Sisfotenika, vol. 13, no. 2, pp. 192–200, 2023, doi: 10.30700/jst.v13i2.1397.

W. K. Sari, D. P. Rini, and R. F. Malik, “Text Classification Using Long Short-Term Memory With GloVe Features,” Jurnal Ilmiah Teknik Elektro Komputer dan Informatika, vol. 5, no. 2, p. 85, Feb. 2020, doi: 10.26555/jiteki.v5i2.15021.

D. S. Asudani, N. K. Nagwani, and P. Singh, “Impact of word embedding models on text analytics in deep learning environment: a review,” Artif Intell Rev, vol. 56, no. 9, pp. 10345–10425, Sep. 2023, doi: 10.1007/s10462-023-10419-1.

I. Salehin and D. K. Kang, “A Review on Dropout Regularization Approaches for Deep Neural Networks within the Scholarly Domain,” Electronics (Switzerland), vol. 12, pp. 1–23, Jul. 2023, doi: 10.3390/electronics12143106.

A. Zafar et al., “A Comparison of Pooling Methods for Convolutional Neural Networks,” Sep. 01, 2022, MDPI. doi: 10.3390/app12178643.

N. Matondang and N. Surantha, “Effects of oversampling SMOTE in the classification of hypertensive dataset,” Advances in Science, Technology and Engineering Systems, vol. 5, no. 4, pp. 432–437, 2020, doi: 10.25046/AJ050451.

A. Mansy, S. Rady, and T. Gharib, “An Ensemble Deep Learning Approach for Emotion Detection in Arabic Tweets,” IJACSA) International Journal of Advanced Computer Science and Applications, vol. 13, no. 4, pp. 980–990, 2022, doi: 10.14569/IJACSA.2022.01304112.

R. C. Setiawan and A. Chowanda, “Emotion Intensity Value Prediction with Machine Learning Approach on Twitter,” CommIT Journal, vol. 17, no. 2, pp. 235–243, 2023, doi: 10.21512/commit.v17i2.8503.

D. Yohanes, J. S. Putra, K. Filbert, K. M. Suryaningrum, and H. A. Saputri, “Emotion Detection in Textual Data using Deep Learning,” in Procedia Computer Science, Elsevier B.V., 2023, pp. 464–473. doi: 10.1016/j.procs.2023.10.547.

M. A. Riza and N. Charibaldi, “Emotion Detection in Twitter Social Media Using Long Short-Term Memory (LSTM) and Fast Text,” International Journal of Artificial Intelligence & Robotics (IJAIR), vol. 3, no. 1, pp. 15–26, May 2021, doi: 10.25139/ijair.v3i1.3827.

O. J. Ying, M. M. A. Zabidi, N. Ramli, and U. U. Sheikh, “Sentiment analysis of informal malay tweets with deep learning,” IAES International Journal of Artificial Intelligence, vol. 9, no. 2, pp. 212–220, Jun. 2020, doi: 10.11591/ijai.v9.i2.pp212-220.




DOI: https://doi.org/10.47738/jads.v6i1.459

Refbacks

  • There are currently no refbacks.



Barcode

Journal of Applied Data Sciences

ISSN:2723-6471 (Online)
Publisher:Bright Publisher
Website:http://bright-journal.org/JADS
Email:taqwa@amikompurwokerto.ac.id (principal contact)
  support@bright-journal.org (technical issues)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0