.png)
Enhancing Support Vector Machines Accuracy Through Firefly Algorithm-Driven Feature Optimization for Forest-Fire Sentiment Classification
Abstract
Forest fires are a growing global environmental issue that significantly impact ecosystems, human health, and exacerbate climate change. Data from 2023 indicate that approximately 11.91 million hectares of forest were lost due to fires, highlighting the urgent need for technological approaches in addressing this issue. One relevant approach is public sentiment analysis based on the social media platform X, which enables the rapid and real-time capture of public perception. In text-based sentiment analysis, key challenges include high-dimensional feature space and class imbalance, which can degrade the performance of machine learning algorithms. Therefore, this study applies feature selection methods based on swarm intelligence, namely Particle Swarm Optimization (PSO) and Firefly Algorithm (FA), to enhance classification efficiency and accuracy. The models evaluated include Support Vector Machine (SVM), Naïve Bayes (NB), and K-Nearest Neighbors (KNN), using the Knowledge Discovery in Databases (KDD) approach, which involves selection, preprocessing, transformation with Term Frequency-Inverse Document Frequency (TF-IDF) and Synthetic Minority Oversampling Technique (SMOTE), and data splitting with an 80:20 ratio. Model performance was evaluated using four metrics: accuracy, precision, recall, and F1-score. The models achieved strong performance on the balanced training data, indicating effective learning after feature selection, with the fastest execution time recorded by FA optimization at 0.0071 seconds. To ensure a fair assessment of generalization, the main conclusions of this study are based on the testing results. On the testing data, SVM with FA achieved the highest accuracy of 96.36% with an execution time of 0.0064 seconds. Overall, swarm intelligence-based feature selection (PSO and FA) enhances the efficiency of conventional classifiers by reducing high-dimensional feature representations and execution time while maintaining strong predictive performance for forest-fire sentiment classification.
Keywords
Full Text:
PDFReferences
Statista, “Economic damages caused by wildfires worldwide from 1991 to 2023.” [Online]. Available: https://www.statista.com/statistics/1423714/economic-impact-due-to-wildfires-worldwide/
J. MacCarthy, J. Richter, S. Tyukavina, M. Weisse, and N. Harris, “The Latest Data Confirms: Forest Fires Are Getting Worse,” 2024, [Online]. Available: https://www.wri.org/insights/global-trends-forest-fires
G. Tripathy, “AEGA: enhanced feature selection based on ANOVA and extended genetic algorithm for online customer review analysis,” J. Supercomput., vol. 79, no. 12, pp. 13180–13209, 2023, doi: 10.1007/s11227-023-05179-2.
M. Hadni and H. Hjiaj, “New Model of Feature Selection based Chaotic Firefly Algorithm for Arabic Text Categorization,” Int. Arab J. Inf. Technol., vol. 20, no. 3A, pp. 461–468, 2023, doi: 10.34028/iajit/20/3A/3.
A. Zaki Ahmed and M. Rodríguez Díaz, “A Methodology for Machine-Learning Content Analysis to Define the Key Labels in the Titles of Online Customer Reviews with the Rating Evaluation,” Sustain., vol. 14, no. 15, 2022, doi: 10.3390/su14159183.
D. A. Putri, D. A. Kristiyanti, E. Indrayuni, A. Nurhadi, and D. R. Hadinata, “Comparison of Naive Bayes Algorithm and Support Vector Machine using PSO Feature Selection for Sentiment Analysis on E-Wallet Review,” J. Phys. Conf. Ser., vol. 1641, no. 1, 2020, doi: 10.1088/1742-6596/1641/1/012085.
G. Srivastava, V. Singh, and S. Kumar, “Hybrid model for sentiment analysis combination of PSO, genetic algorithm and voting classification,” Indones. J. Electr. Eng. Comput. Sci., vol. 35, no. 2, pp. 1151–1161, 2024, doi: 10.11591/ijeecs.v35.i2.pp1151-1161.
H. Ullah et al., “Comparative study for machine learning classifier recommendation to predict political affiliation based on online reviews,” CAAI Trans. Intell. Technol., vol. 6, no. 3, pp. 251–264, 2021, doi: 10.1049/cit2.12046.
A. Sharma and U. Ghose, “Toward Machine Learning Based Binary Sentiment Classification of Movie Reviews for Resource Restraint Language (RRL) - Hindi,” IEEE Access, vol. 11, pp. 58546–58564, 2023, doi: 10.1109/ACCESS.2023.3283461.
A. Lubis, Y. Irawan, Junadhi, and S. Defit, “Leveraging K-Nearest Neighbors with SMOTE and Boosting Techniques for Data Imbalance and Accuracy Improvement,” J. Appl. Data Sci., vol. 5, no. 4, pp. 1625–1638, 2024, doi: 10.47738/jads.v5i4.343.
A. Londhe and P. V. R. D. P. Rao, “Incremental Learning based Optimized Sentiment Classification using Hybrid Two-Stage LSTM-SVM Classifier,” Int. J. Adv. Comput. Sci. Appl., vol. 13, no. 6, pp. 611–619, 2022, doi: 10.14569/IJACSA.2022.0130674.
M. I. Marwat, J. A. Khan, M. Dahman Alshehri, M. A. Ali, H. Ali, and M. Assam, “Sentiment Analysis of Product Reviews to Identify Deceptive Rating Information in Social Media: A SentiDeceptive Approach,” KSII Trans. Internet Inf. Syst., vol. 16, no. 3, pp. 830–860, 2022, doi: 10.3837/tiis.2022.03.005.
R. Obiedat et al., “Sentiment Analysis of Customers’ Reviews Using a Hybrid Evolutionary SVM-Based Approach in an Imbalanced Data Distribution,” IEEE Access, vol. 10, pp. 22260–22273, 2022, doi: 10.1109/ACCESS.2022.3149482.
M. Rezapour, “Sentiment classification of skewed shoppers’ reviews using machine learning techniques, examining the textual features,” Eng. Reports, vol. 3, no. 1, 2021, doi: 10.1002/eng2.12280.
Dewi Widyawati and Amaliah Faradibah, “Comparison Analysis of Classification Model Performance in Lung Cancer Prediction Using Decision Tree, Naive Bayes, and Support Vector Machine,” Indones. J. Data Sci., vol. 4, no. 2, pp. 80–89, 2023, doi: 10.56705/ijodas.v4i2.76.
M. A. Al-Shabi, “Evaluating the performance of the most important Lexicons used to Sentiment analysis and opinions Mining,” Int. J. Comput. Sci. Netw. Secur., vol. 20, no. 1, pp. 51–57, 2020, [Online]. Available: http://sentiwordnet.isti.cnr.it/.
T. Sinnasamy and N. N. A. Sjaif, “Sentiment Analysis using Term based Method for Customers’ Reviews in Amazon Product,” Int. J. Adv. Comput. Sci. Appl., vol. 13, no. 7, pp. 685–691, 2022, doi: 10.14569/IJACSA.2022.0130780.
D. A. Kristiyanti, S. A. Sanjaya, V. C. Tjokro, and J. Suhali, “Dealing imbalance dataset problem in sentiment analysis of recession in Indonesia,” IAES Int. J. Artif. Intell., vol. 13, no. 2, pp. 2058–2070, 2024, doi: 10.11591/ijai.v13.i2.pp2060-2072.
D. A. Anggoro and S. S. Mukti, “Performance Comparison of Grid Search and Random Search Methods for Hyperparameter Tuning in Extreme Gradient Boosting Algorithm to Predict Chronic Kidney Failure,” Int. J. Intell. Eng. Syst., vol. 14, no. 6, pp. 198–207, 2021, doi: 10.22266/ijies2021.1231.19.
T. M. Shami, A. A. El-Saleh, M. Alswaitti, Q. Al-Tashi, M. A. Summakieh, and S. Mirjalili, “Particle Swarm Optimization: A Comprehensive Survey,” IEEE Access, vol. 10, pp. 10031–10061, 2022, doi: 10.1109/ACCESS.2022.3142859.
D. A. Putri, D. A. Kristiyanti, E. Indrayuni, A. Nurhadi, and D. A. Muthia, “Mining Twitter data on Covid-19 for sentiment analysis using SVM algorithm,” AIP Conf. Proc., vol. 2714, no. May, 2023, doi: 10.1063/5.0128833.
G. Nagarajan and L. D. Dhinesh Babu, “A hybrid feature selection model based on improved squirrel search algorithm and rank aggregation using fuzzy techniques for biomedical data classification,” Netw. Model. Anal. Heal. Informatics Bioinforma., vol. 10, no. 1, pp. 1–29, 2021, doi: 10.1007/s13721-021-00313-7.
Arpita, P. Kumar, and K. Garg, “Data Cleaning of Raw Tweets for Sentiment Analysis,” Indo - Taiwan 2nd Int. Conf. Comput. Anal. Networks, Indo-Taiwan ICAN 2020 - Proc., pp. 273–276, 2020, doi: 10.1109/Indo-TaiwanICAN48429.2020.9181326.
E. Inal Onal, S. Tekeli-Yeşil, and N. Okay, “ The Use of Twitter by Official Institutions in Disaster Risk Communication and Resilience ,” J. Emerg. Manag. Disaster Commun., vol. 03, no. 01, pp. 25–40, 2022, doi: 10.1142/s2689980922500087.
T. Ho, H. M. Bui, and T. K. Phung, “A hybrid model for aspect-based sentiment analysis on customer feedback: research on the mobile commerce sector in Vietnam,” Int. J. Adv. Intell. Informatics, vol. 9, no. 2, pp. 273–285, 2023, doi: 10.26555/ijain.v9i2.976.
L. K. Ramasamy, S. Kadry, and S. Lim, “Selection of optimal hyper-parameter values of support vector machine for sentiment analysis tasks using nature-inspired optimization methods,” Bull. Electr. Eng. Informatics, vol. 10, no. 1, pp. 290–298, 2021, doi: 10.11591/eei.v10i1.2098.
F. Akbarian and F. Z. Boroujeni, “An Improved Feature Selection Method for Sentiments Analysis in Social Networks,” 2020 10h Int. Conf. Comput. Knowl. Eng. ICCKE 2020, pp. 181–186, 2020, doi: 10.1109/ICCKE50421.2020.9303710.
K. Rezaei and H. Rezaei, “An improved firefly algorithm for numerical optimization problems and it’s application in constrained optimization,” Eng. Comput., vol. 38, no. 4, pp. 3793–3813, 2022, doi: 10.1007/s00366-021-01412-9.
H. Noor, J. Ahmad, A. Haider, F. Nasim, and A. Jaffar, “A Machine Learning Sentiment Analysis Approach on News Headlines to Evaluate the Performance of the Pakistani Government,” vol. 07, no. 02, 2024.
M. A. Virgananda, I. Budi, and R. R. Suryono, “Purchase Intention and Sentiment Analysis on Twitter Related to Social Commerce,” Int. J. Adv. Comput. Sci. Appl., vol. 14, no. 7, pp. 543–550, 2023, doi: 10.14569/IJACSA.2023.0140760.
S. Arora and R. Kaur, “An escalated convergent firefly algorithm,” J. King Saud Univ. - Comput. Inf. Sci., vol. 34, no. 2, pp. 308–315, 2022, doi: 10.1016/j.jksuci.2018.10.007.
P. Mehta, S. Pandya, and K. Kotecha, “Harvesting social media sentiment analysis to enhance stock market prediction using deep learning,” PeerJ Comput. Sci., vol. 7, pp. 1–21, 2021, doi: 10.7717/peerj-cs.476.
M. I. A. Latiffi, M. R. Yaakub, and I. S. Ahmad, “Flower Pollination Algorithm for Feature Selection in Tweets Sentiment Analysis,” Int. J. Adv. Comput. Sci. Appl., vol. 13, no. 5, pp. 429–436, 2022, doi: 10.14569/IJACSA.2022.0130551.
H. Benarafa, M. Benkhalifa, and M. Akhloufi, “WordNet Semantic Relations Based Enhancement of KNN Model for Implicit Aspect Identification in Sentiment Analysis,” Int. J. Comput. Intell. Syst., vol. 16, no. 1, 2023, doi: 10.1007/s44196-022-00164-8.
S. Jain and A. Sinha, “Identification of influential users on Twitter: A novel weighted correlated influence measure for Covid-19,” Chaos, Solitons and Fractals, vol. 139, p. 110037, 2020, doi: 10.1016/j.chaos.2020.110037.
F. H. Fadel and S. F. Behadili, “A Comparative Study for Supervised Learning Algorithms to Analyze Sentiment Tweets,” Iraqi J. Sci., vol. 63, no. 6, pp. 2712–2724, 2022, doi: 10.24996/ijs.2022.63.6.36.
P. Hajek, A. Barushka, and M. Munk, “Neural Networks with Emotion Associations, Topic Modeling and Supervised Term Weighting for Sentiment Analysis,” Int. J. Neural Syst., vol. 31, no. 10, 2021, doi: 10.1142/S0129065721500131.
B. N. Hiremath and M. M. Patil, “Enhancing Optimized Personalized Therapy in Clinical Decision Support System using Natural Language Processing,” J. King Saud Univ. - Comput. Inf. Sci., vol. 34, no. 6, pp. 2840–2848, 2022, doi: 10.1016/j.jksuci.2020.03.006.
J. Rumbut et al., “Harmonizing Wearable Biosensor Data Streams to Test Polysubstance Detection,” in 2020 International Conference on Computing, Networking and Communications, ICNC 2020, University of Massachusetts Dartmouth, Computer and Information Science, North Dartmouth, MA, United States: Institute of Electrical and Electronics Engineers Inc., 2020, pp. 445–449. doi: 10.1109/ICNC47757.2020.9049684.
G. A. Tadesse et al., “Multi-Modal Diagnosis of Infectious Diseases in the Developing World,” IEEE J. Biomed. Heal. Informatics, vol. 24, no. 7, pp. 2131–2141, 2020, doi: 10.1109/JBHI.2019.2959839.
N. S. Mohd Nafis and S. Awang, “An Enhanced Hybrid Feature Selection Technique Using Term Frequency-Inverse Document Frequency and Support Vector Machine-Recursive Feature Elimination for Sentiment Classification,” IEEE Access, vol. 9, pp. 52177–52192, 2021, doi: 10.1109/ACCESS.2021.3069001.
J. A. Cummins and V. E. Nambudiri, “Natural language processing: A window to understanding skincare trends,” Int. J. Med. Inform., vol. 160, 2022, doi: 10.1016/j.ijmedinf.2022.104705.
M. A. Nulhakim, Y. Sibaroni, K. Muhammad, and N. Ku, “Geospatial Sentiment Analysis Using Twitter Data on Natural Disasters in Indonesia with Support Vector Machine,” vol. 10, no. 2, pp. 242–258, 2024, doi: 10.21108/ijoict.v10i2.1032.
V. Pandi, P. Nithiyanandam, S. Manickavasagam, I. M. Meerasha, R. Jaganathan, and M. K. Balasubramanian, “A comprehensive analysis of consumer decisions on Twitter dataset using machine learning algorithms,” IAES Int. J. Artif. Intell., vol. 11, no. 3, pp. 1085–1093, 2022, doi: 10.11591/ijai.v11.i3.pp1085-1093.
D. A. Kristiyanti, “Designing an E-Repository of Sentiment Data and Cyberbullying Detection in Indonesian using a Parameter Optimization Algorithm for LSTM INTELLIGENT SYSTEMS AND APPLICATIONS IN Designing an E-Repository of Sentiment Data and Cyberbullying Detection in Indo,” no. July, 2024.
A. Alarifi, A. Tolba, Z. Al-Makhadmeh, and W. Said, “A big data approach to sentiment analysis using greedy feature selection with cat swarm optimization-based long short-term memory neural networks,” J. Supercomput., vol. 76, no. 6, pp. 4414–4429, 2020, doi: 10.1007/s11227-018-2398-2.
DOI: https://doi.org/10.47738/jads.v7i3.1144
Refbacks
- There are currently no refbacks.
Journal of Applied Data Sciences
| ISSN | : | 2723-6471 (Online) |
| Publisher | : | Bright Publisher |
| Website | : | http://bright-journal.org/JADS |
| : | taqwa@amikompurwokerto.ac.id (principal contact) | |
| support@bright-journal.org (technical issues) |
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0