Sentiment analysis of user comments on the shopeepay feature in the shopee application: Evaluation of accuracy with k-nearest neighbors (KNN) algorithm
Article Sidebar
Main Article Content
Abstract
This research analyzes Shopeepay user reviews on the Shopee app using the K-Nearest Neighbor (KNN) algorithm with TF-IDF weighting and a Cosine Similarity matrix. Data was collected through web scraping 500 reviews from the Google PlayStore and labelled into positive, neutral, and negative sentiments. The process includes literature study, data collection, labelling, text preprocessing, word weighting, and sentiment classification using KNN. Results show an accuracy range of 86%-91%, with Precision, Recall, and F1-Score as evaluation metrics. The findings indicate that convenience, trust, and risk significantly affect users' interest in Shopeepay, especially during the Covid-19 pandemic. A Word Cloud was also used to visualize common terms in the reviews, providing insights for Shopee to enhance Shopeepay based on user feedback.
Article Details
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
References
F. M. Delta Maharani, A. Lia Hananto, S. Shofia Hilabi, F. Nur Apriani, A. Hananto, and B. Huda, “Perbandingan Metode Klasifikasi Sentimen Analisis Penggunaan E-Wallet Menggunakan Algoritma Naïve Bayes dan K-Nearest Neighbor,” METIK J., vol. 6, no. 2, pp. 97–103, Dec. 2022, doi: 10.47002/metik.v6i2.372.
Azka Fikri, “Pengaruh Penggunaan Shopeepay Sebagai Dompet Digital Terhadap Perilaku Konsumtif Mahasiswa Feb Usu,” KomunikA, vol. 17, no. 2, pp. 1–11, 2021, doi: 10.32734/komunika.v17i2.7556.
L. Anthony and H. Sama, “Studi Kualitatıf Mengenai Faktor Penerimaan Aplikasi E-Commerce Shopee Dan Fintech Shopeepay Bagi Masyarakat Senior,” CoMBIneS, vol. 1, no. 1, pp. 678–686, 2021.
Y. MZ, J. Edwin Bororing, S. Rahayu, and J. Andhika Putra, “Analisis Sentimen Pengguna Apliaksi Shopee Menggunakan Metode Naive Bayes Classifier dan K-NN,” Smart Comp Jurnalnya Orang Pint. Komput., vol. 12, no. 3, pp. 745–753, 2023, doi: 10.30591/smartcomp.v12i3.5494.
M. I. Zulfikar, K. Komariah, and A. Samsudin, “Analisis Promosi Penjualan Dan Kemudahan Terhadap Keputusan Penggunaan Shopeepay (Survei Pada Mahasiswa Universitas Muhammadiyah Sukabumi),” J. Econ. Bussines Account., vol. 5, no. 2, pp. 1492–1498, Jun. 2022, doi: 10.31539/costing.v5i2.2642.
T. Fadiyah Basar, D. E. Ratnawati, and I. Arwani, “Analisis Sentimen Pengguna Twitter terhadap Pembayaran Cashless menggunakan Shopeepay dengan Algoritma Random Forest,” J. Pengemb. Teknol. Inf. dan Ilmu Komput., vol. 6, no. 3, pp. 1426–1433, 2022.
D. I. Jusuf, “The Influence of Service Quality and Ease of Use on Customer Satisfaction Using the Shopee Pay Digital Wallet,” J. Econ. Bus., vol. 4, no. 1, 2023, doi: https://doi.org/10.58471/jecombi.v4i01.72.
Gama Putra Brahmanta and Nuruni Ika Kusuma Wardhani, “Pengaruh Persepsi Kebermanfaatan, Kemudahan, Risiko Terhadap Minat Menggunakan Ulang Shopeepay Di Surabaya,” Sains Manaj., vol. 7, no. 2, pp. 97–108, 2021, doi: 10.30656/sm.v7i2.3580.
F. Mawardani and R. Dwijayanti, “Pengaruh Persepsi Kemudahan Penggunaan dan Promosi Cashback Terhadap Minat Mahasiswa Dalam Menggunakan Dompet Digital Shopeepay Pada Aplikasi Shopee,” J. Pendidik. Tata Niaga, vol. 9, no. 3, pp. 1455–1463, 2021.
M. N. Falah, “Pengaruh Persepsi Kemudahan, Persepsi Kepercayaan, Dan Persepsi Risiko Terhadap Minat Menggunakan Kembali Shopeepay Di Kota Malang Saat Pandemi Covid- 19,” J. Ilm. Mhs. FEB, vol. 9, no. 2, pp. 1–18, 2021.
I. S. K. Idris, Y. A. Mustofa, and I. A. Salihi, “Analisis Sentimen Terhadap Penggunaan Aplikasi Shopee Mengunakan Algoritma Support Vector Machine (SVM),” Jambura J. Electr. Electron. Eng., vol. 5, no. 1, pp. 32–35, Jan. 2023, doi: 10.37905/jjeee.v5i1.16830.
Z. Rais, R. N. Said, and R. Ruliana, “Text Classification on Sentiment Analysis of Marketplace SHOPEE Reviews On Twitter Using K-Nearest Neighbor (KNN) Method,” JINAV J. Inf. Vis., vol. 3, no. 1, pp. 1–8, Jul. 2022, doi: 10.35877/454RI.jinav1389.
E. H. Muktafin, K. Kusrini, and E. T. Luthfi, “Analisis Sentimen pada Ulasan Pembelian Produk di Marketplace Shopee Menggunakan Pendekatan Natural Language Processing,” J. Eksplora Inform., vol. 10, no. 1, pp. 32–42, 2020, doi: 10.30864/eksplora.v10i1.390.
D. Normawati and S. A. Prayogi, “IMPLEMENTASI NAÏVE BAYES CLASSIFIER DAN CONFUSION MATRIX PADA ANALISIS SENTIMEN BERBASIS TEKS PADA TWITTER,” J-SAKTI (Jurnal Sains Komput. Inform., vol. 5, no. 2, 2021.
A. W. Sari, T. I. Hermanto, and M. Defriani, “Sentiment Analysis Of Tourist Reviews Using K-Nearest Neighbors Algorithm And Support Vector Machine,” Sinkron, vol. 8, no. 3, pp. 1366–1378, Jul. 2023, doi: 10.33395/sinkron.v8i3.12447.
N. Agustina, D. H. Citra, W. Purnama, C. Nisa, and A. R. Kurnia, “Implementasi Algoritma Naive Bayes untuk Analisis Sentimen Ulasan Shopee pada Google Play Store,” MALCOM Indones. J. Mach. Learn. Comput. Sci., vol. 2, no. 1, pp. 47–54, Apr. 2022, doi: 10.57152/malcom.v2i1.195.
S. Alfaris and Kusnawi, “Komparasi Metode KNN dan Naive Bayes Terhadap Analisis Sentimen Pengguna Aplikasi Shopee,” Indones. J. Comput. Sci., vol. 12, no. 5, Oct. 2023, doi: 10.33022/ijcs.v12i5.3304.
A. P. Maharani and A. Triayudi, “Sentiment Analysis of Indonesian Digital Payment Customer Satisfaction Towards GOPAY, DANA, and ShopeePay Using Naïve Bayes and K-Nearest Neighbour Methods,” J. MEDIA Inform. BUDIDARMA, vol. 6, no. 1, p. 672, Jan. 2022, doi: 10.30865/mib.v6i1.3545.