Listening to Student Voices: Aspect-Based Sentiment Analysis of Academic Services Using BERT
Submitted : 2025-06-03, Published : 2025-07-01.
Abstract
The inability to systematically process large volumes of unstructured student feedback hinders the enhancement of academic service quality in higher education. To address this challenge, this study develops an Aspect-Based Sentiment Analysis (ABSA) model using a fine-tuned BERT architecture. applied to 1,110 student reviews at Universitas Muhammadiyah Surakarta. The model was trained and evaluated using a dataset of 1,110 student reviews, filtered from an initial dataset of over 40,000 raw data points. To assess its performance, standard metrics such as accuracy, precision, recall, and F1-score were employed. The model demonstrated high performance, achieving an overall accuracy of 98.6% and an F1-score of 0.92 for identifying service aspect terms. The analysis successfully extracted key aspects, including staff interaction, administrative processes, and service efficiency. Critically, it revealed that staff interaction was the aspect with the most significant negative sentiment, providing a clear target for institutional improvement. This research confirms that the BERT-based ABSA model is a reliable and scalable tool for transforming qualitative student feedback into actionable, data-driven insights, enabling targeted enhancements to academic service quality.
Keywords
References
B. Liu, Sentiment Analysis and Opinion Mining. Springer International Publishing, 2012. doi: 10.1007/978-3-031-02145-9.
M. Varga and P. Albuquerque, “The Impact of Negative Reviews on Online Search and Purchase Decisions,” Journal of Marketing Research, Oct. 2023, doi: 10.1177/00222437231190874/SUPPL_FILE/SJ-PDF-1-MRJ-10.1177_00222437231190874.PDF.
C. Dervenis, G. Kanakis, and P. Fitsilis, “Sentiment analysis of student feedback: A comparative study employing lexicon and machine learning techniques,” Studies in Educational Evaluation, vol. 83, Dec. 2024, doi: 10.1016/j.stueduc.2024.101406.
Pooja and R. Bhalla, “A Review Paper on the Role of Sentiment Analysis in Quality Education,” SN Comput Sci, vol. 3, no. 6, pp. 1–9, Nov. 2022, doi: 10.1007/S42979-022-01366-9/FIGURES/3.
Y. Liu et al., “RoBERTa: A Robustly Optimized BERT Pretraining Approach,” Jul. 2019.
T. Shaik, X. Tao, C. Dann, H. Xie, Y. Li, and L. Galligan, “Sentiment analysis and opinion mining on educational data: A survey,” Natural Language Processing Journal, vol. 2, p. 100003, Mar. 2023, doi: 10.1016/J.NLP.2022.100003.
T. Shaik et al., “A Review of the Trends and Challenges in Adopting Natural Language Processing Methods for Education Feedback Analysis,” IEEE Access, vol. 10, pp. 56720–56739, 2022, doi: 10.1109/ACCESS.2022.3177752.
J. Devlin, M. W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” in NAACL HLT 2019 - 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies - Proceedings of the Conference, Association for Computational Linguistics (ACL), 2019, pp. 4171–4186. doi: https://doi.org/10.48550/arXiv.1810.04805.
I. Loshchilov and F. Hutter, “Decoupled Weight Decay Regularization,” 7th International Conference on Learning Representations, ICLR 2019, Nov. 2017, Accessed: Jan. 31, 2025. [Online]. Available: https://arxiv.org/abs/1711.05101v3
W. Zhang, X. Li, Y. Deng, L. Bing, and W. Lam, “A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challenges,” IEEE Trans Knowl Data Eng, vol. 35, no. 11, pp. 11019–11038, Nov. 2023, doi: 10.1109/TKDE.2022.3230975.
M. Widiansyah, F. Frazna Az-Zahra, and A. Pambudi, “Fine-Tuning Model Indobert (Indonesian Bidirectional Encoder Representations from Transformers) untuk Analisis Sentimen Berbasis Aspek pada Aplikasi M-Paspor,” Joutica, vol. 9, no. 2, pp. 183–195, Sep. 2024, doi: 10.30736/INFORMATIKA.V9I2.1310.
D. K. Alfiki Astutik, A. Indrasetianingsih, and F. Fitriani, “Penerapan Text Mining pada Analisis Sentimen Pengguna Twitter Layanan Transportasi Online Menggunakan Metode Density Based Spatial Clustering of Applications With Noise (DBSCAN) dan K-Means,” J Statistika: Jurnal Ilmiah Teori dan Aplikasi Statistika, vol. 15, no. 1, Jul. 2022, doi: 10.36456/JSTAT.VOL15.NO1.A5983.
I. W. Nurdian, D. O. Nooryawati, I. Yulfrian, B. P. Nevista, N. Yudistira, and R. S. Perdana, “COVID-19 Vaccines in Indonesia: A Public Opinion Study Based on Twitter Data Multidimensional Sentiment Analysis,” ACM International Conference Proceeding Series, pp. 165–175, Nov. 2022, doi: 10.1145/3568231.3568246.
C. Husnah and H. Yuliamir, “Analysis of Sales Staff Work Ability and Service Quality on Guest Satisfaction at Openaire Resto Bar and Market,” Journal of Education, Humaniora and Social Sciences (JEHSS), vol. 7, no. 3, pp. 1151–1159, Feb. 2025, doi: 10.34007/JEHSS.V7I3.2500.
V. Ballas, K. Michalakis, G. Alexandridis, and G. Caridakis, “Automating Mobile App Review User Feedback with Aspect-Based Sentiment Analysis,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 14738 LNCS, pp. 179–193, 2024, doi: 10.1007/978-3-031-60487-4_14.
L. Gui and Y. He, “Understanding patient reviews with minimum supervision,” Artif Intell Med, vol. 120, p. 102160, Oct. 2021, doi: 10.1016/J.ARTMED.2021.102160.
A. Adak, B. Pradhan, and N. Shukla, “Sentiment Analysis of Customer Reviews of Food Delivery Services Using Deep Learning and Explainable Artificial Intelligence: Systematic Review,” Foods 2022, Vol. 11, Page 1500, vol. 11, no. 10, p. 1500, May 2022, doi: 10.3390/FOODS11101500.
B. Liu, T. Lin, and M. Li, “Enhancing aspect-category sentiment analysis via syntactic data augmentation and knowledge enhancement,” Knowl Based Syst, vol. 264, p. 110339, Mar. 2023, doi: 10.1016/J.KNOSYS.2023.110339.
Article Metrics
Abstract view: 48 times
Download : 23 times
Download : 6 times
This work is licensed under a Creative Commons Attribution 4.0 International License.
Refbacks
- There are currently no refbacks.