Comparison of Support Vector Machine and Naïve Bayes Algorithms in Sentiment Analysis of Tiktokshop Application User Reviews

Agus Maula Rizki; Bustami Bustami; Said Fadlan Anshari

doi:10.29103/jreece.v5i1.21342

Comparison of Support Vector Machine and Naïve Bayes Algorithms in Sentiment Analysis of Tiktokshop Application User Reviews

Agus Maula Rizki, Bustami Bustami, Said Fadlan Anshari

Abstract

This study presents a comparative analysis of Support Vector Machine (SVM) and Naïve Bayes algorithms for sentiment analysis of TikTokShop application user reviews. As TikTokShop emerges as an innovative platform integrating social media with e-commerce, understanding user sentiments becomes crucial for both consumers and businesses. A balanced dataset of 3,000 user reviews (1,000 positive, 1,000 neutral, and 1,000 negative) was collected through web scraping from Google Play Store. Following comprehensive preprocessing including cleansing, case folding, normalization, tokenization, stopword removal, and stemming, the data was vectorized using TF-IDF. Performance evaluation utilized accuracy, precision, recall, F1-score, confusion matrix, and 10-fold cross-validation. Results demonstrate that SVM consistently outperformed Naïve Bayes with higher accuracy (68.86% vs. 64.48%), precision (68.43% vs. 64.19%), and F1-score (68.58% vs. 62.46%). SVM exhibited balanced classification across all sentiment categories, while Naïve Bayes excelled at identifying negative sentiments (94.1% accuracy) but struggled significantly with neutral reviews (38.5%). Despite SVM's superior performance, Naïve Bayes demonstrated remarkable computational efficiency, with training time 224 times faster than SVM. The study reveals complementary strengths between the algorithms, suggesting potential value in ensemble approaches. These findings contribute to the understanding of sentiment analysis in video-based e-commerce platforms and provide valuable insights for businesses seeking to leverage user feedback for improved decision-making.

Keywords

Sentiment Analysis, Support Vector Machine, Naïve Bayes, TikTokShop, Text Classification

Full Text:

PDF

References

Abdullah, D. M., & Abdulazeez, A. M. (2021). Machine learning applications based on SVM classification a review. Qubahan Academic Journal, 1(2), 81–90.

Ahmed, A., Raj, A., Goel, P. K., & Mahur, L. S. (2024). Social Media Integration with E-Commerce Using AI & Augmented Reality. 2024 OPJU International Technology Conference (OTCON) on Smart Computing for Innovation and Advancement in Industry 4.0, 1–5.

Bharadwaj, L. (2023). Sentiment analysis in online product reviews: mining customer opinions for sentiment classification. Int J Multidiscip Res, 5(5).

Boyko, N., & Boksho, K. (2020). Application of the Naive Bayesian Classifier in Work on Sentimental Analysis of Medical Data. IDDM, 2020, 3rd.

Bray, G. A. (2024). Capturing Consumer Attention: An In-Depth Analysis Of Tiktok Live Shopping. Law and Economy, 3(1), 32–46.

Bustami, B., & Aryani, C. F. (2023). The Nutritional Classification of Pregnant Women Using Support Vector Machine (SVM). JOURNAL OF INFORMATICS AND TELECOMMUNICATION ENGINEERING, 7(1), 174–182.

Chodak, G. (2024). Social Commerce. In The Future of E-commerce: Innovations and Developments (pp. 169–185). Springer.

Elkari, B., Chaibi, Y., & Kousksou, T. (2024). Random forest with feature selection and K-fold cross validation for predicting the electrical and thermal efficiencies of air based photovoltaic-thermal systems. Energy Reports, 12, 988–999.

Gupta, V., & Rattan, P. (2023). Improving twitter sentiment analysis efficiency with SVM-PSO classification and EFWS heuristic. Procedia Computer Science, 230, 698–715.

Hasibuan, S. S. (2024). Sentimen Analisis Terhadap Fitur Tiktok Shop Menggunakan Naive Bayes dan K-Nearest Neighbor. Jurnal Media Informatika Budidarma, 8(1), 303–311.

Huang, H., Zavareh, A. A., & Mustafa, M. B. (2023). Sentiment analysis in e-commerce platforms: A review of current techniques and future directions. IEEE Access, 11, 90367–90382.

Kabra, B., & Nagar, C. (2023). Convolutional neural network based sentiment analysis with tf-idf based vectorization. Journal of Integrated Science and Technology, 11(3), 503.

Kaur, G., & Sharma, A. (2023). A deep learning-based model using hybrid feature extraction approach for consumer sentiment analysis. Journal of Big Data, 10(1), 5.

Khurana, A., & Verma, O. P. (2022). Optimal feature selection for imbalanced text classification. IEEE Transactions on Artificial Intelligence, 4(1), 135–147.

Korkmaz, S. (2020). Deep learning-based imbalanced data classification for drug discovery. Journal of Chemical Information and Modeling, 60(9), 4180–4190.

Kunekar, P., Nimbolkar, A., Patil, A., Lakde, V., Wadile, P., & Rathod, K. (2024). Product Review Sentiment Analysis using Web Crawler and Machine Learning. Grenze International Journal of Engineering & Technology (GIJET), 10.

Mehta, P., & Pandya, S. (2020). A review on sentiment analysis methodologies, practices and applications. International Journal of Scientific and Technology Research, 9(2), 601–609.

Muttaqin, M. N., & Kharisudin, I. (2021). Analisis sentimen aplikasi gojek menggunakan support vector machine dan k nearest neighbor. UNNES Journal of Mathematics, 22–27.

Praneswara, A. O., & Cahyono, N. (2023). Analisis Sentimen Ulasan Aplikasi TikTok Shop Seller Center di Google Playstore Menggunakan Algoritma Naive Bayes. The Indonesian Journal of Computer Science, 12(6).

Premasudha, B. G., & Rampalli, V. (2024). A Comparative Study of Logistic Regression, Support Vector Machines, and LSTM Networks for Sentiment Classification in Academic Reviews. 2024 First International Conference on Innovations in Communications, Electrical and Computer Engineering (ICICEC), 1–11.

Rahmawati, L., & Santoso, D. B. (2023). Implementasi Metode Naive Bayes Untuk Klasifikasi Ulasan Aplikasi E-Commerce Tokopedia. Intecoms: Journal Of Information Technology And Computer Science, 6(1), 116–124.

Rustam, F., Khalid, M., Aslam, W., Rupapara, V., Mehmood, A., & Choi, G. S. (2021). A performance comparison of supervised machine learning models for Covid-19 tweets sentiment analysis. Plos One, 16(2), e0245909.

Sabila, F. L., & Andni, R. (2023). Live Streaming Strategy on TikTok Shop Media in Increasing Sales of Areta Wholesale Negligee. Journal of Social Science Utilizing Technology, 1(2), 86–97.

Sarina, S., & Tanniewa, A. M. (2023). Implementasi algoritma support vector learning Terhadap Analisis Sentimen Penggunaan Aplikasi Tiktok shop seller center. Prosiding SISFOTEK, 7(1), 165–170.

Septiani, A., Voutama, A., Siska, S., Hendriadi, A. A., & Heryana, N. (2024). Analisis Sentimen Menggunakan Algoritma Naïve Bayes Terhadap Regulasi Tiktok Shop Pada Media Sosial X (Twitter). JATI (Jurnal Mahasiswa Teknik Informatika), 8(4), 5729–5735.

Silva, D. (2025). E-Commerce and the Evolution of Consumer Behavior. In Evolving Strategies for Organizational Management and Performance Evaluation (pp. 133–154). IGI Global Scientific Publishing.

Suwanda, R., Fikry, M., & Anshari, S. F. (2024). Implementation of the Naïve Bayes Method in a Web-Based Fish Species Classification System. Proceedings of Malikussaleh International Conference on Multidisciplinary Studies (MICoMS), 4, 46.

Syahputra, R., Yanris, G. J., & Irmayani, D. (2022). SVM and Naïve Bayes Algorithm Comparison for User Sentiment Analysis on Twitter. Sinkron: Jurnal Dan Penelitian Teknik Informatika, 6(2), 671–678.

Wahyuni, I., Arifiansyah, R., Meidasari, E., & Siskawati, I. (2024). The role of brand equity, digital marketing, customer experience, and social media engagement on consumer purchase intention on TikTok Shop application. International Journal of Business, Law, and Education, 5(2), 2806–2815.

Yacob, A., Ghazali, N. E., & Hassan, F. M. (2024). Sentiment Analysis of ChatGPT Using the KNN Algorithm and K-Fold Cross-Validation Optimization of the K Value. JICO: International Journal of Informatics and Computing, 1(2), 48–55.

Zhang, C. (2024). Marketing in the tourism industry: Legal insights from. Adapting to Evolving Consumer Experiences in Hospitality and Tourism, 87.

DOI: https://doi.org/10.29103/jreece.v5i1.21342