Usability Effectiveness of the State Polytechnic of Malang’s Learning Management System as e-Learning Media

Nadia Layra Aziza, Shelyca Surrayensih, Tita Wijayanti, Arwin Datumaya Wahyudi Sumari

Submitted : 2023-04-08, Published : 2023-05-30.

Abstract

The rapid development of information technology has impacted the education sector by supporting a more efficient and effective learning process. During the Covid-19 pandemic, online learning through e-Learning flourished and encouraged the transformation of conventional education to digital form, one of which is the Learning Management System (LMS). This research is aimed to carry out a deep analysis of its utilization as a learning media and the influencing factors of its utilization to determine the level of its usage effectiveness at the State Polytechnic of Malang. This research uses a quantitative descriptive method with a questionnaire as the research instrument for collecting data. The research uses System Usability Scale (SUS) evaluation method for determining scenarios, selecting respondents, collecting data, and performing calculations. The overall measurement results show that the SUS assessment score is 54.67, with a Learn ability, Efficiency, and Memorability aspect score of 33.61. Then the Errors aspect score is 21.06, while the Satisfaction aspect score is 12.77. The LMS at the State Polytechnic of Malang has a low usability value, with a description Acceptability of Marginal, Grade Scale of D, and Adjective Rating of OK. Based on the final SUS score, the level of usage effectiveness of State Polytechnic of Malang’s LMS is still relatively low. However, its utilization is still accepted but needs improvement in some aspects.

Keywords

E-Learning; LMS; Online Learning; SUS; Usability Effectiveness

References

I. W. P. Pratomo and R. Wahanisa, “Pemanfaatan Teknologi Learning Management System (LMS) di Unnes Masa Pandemi Covid-19,” Semin. Nas. Huk. Univ. Negeri Semarang, vol. 7, no. 2, pp. 547–560, 2021, [Online]. Available: https://proceeding.unnes.ac.id/index.php/snh/article/view/730.

D. Handayani, D. R. Hadi, F. Isbaniah, E. Burhan, and H. Agustin, “Corona Virus Disease 2019,” J. Respirologi Indones., vol. 40, no. 2, pp. 119–129, 2020, doi: 10.36497/jri.v40i2.101.

N. W. Rahayu, R. Ferdiana, and S. S. Kusumawardani, “A systematic Review of Ontology Use in E-Learning Recommender System,” Comput. Educ. Artif. Intell., vol. 3, no. 100047, 2022.

Rusman, D. Kurniawan, and C. Riyana, Pembelajaran Berbasis Teknologi Informasi dan Komunikasi : Mengembangkan Profesionalitas Guru, 1st ed. Jakarta: Rajawali Pers, 2012.

F. Mahnegar, “Learning Mangement System,” Int. J. Bus. Soc. Sci., vol. 3, no. 12, pp. 144–151, 2012.

A. Fatmawati, “Evaluasi Usability pada Learning Management System OpenLearning Menggunakan System Usability Scale,” INOVTEK Polbeng - Seri Inform., vol. 6, no. 1, p. 120, 2021, doi: 10.35314/isi.v6i1.1881.

M. L. Nuriman and N. Mayesti, “Evaluasi Ketergunaan Website Perpustakaan Universitas Indonesia Menggunakan System Usability Scale,” Baca J. Dokumentasi Dan Inf., vol. 41, no. 2, p. 253, 2020, doi: 10.14203/j.baca.v41i2.622.

D. Setiawan and N. Kusuma Dewi, “Evaluasi Purwarupa Sistem Informasi Program Pengembangan Desa Menggunakan System Usablity Scale Design And Evaluation Of The Wireframe Desi,” pp. 539–547, 2020.

F. W. Nugraha and H. M. Jumasa, “Comparative Analysis of Usability Learning Management System in Politeknik Lamandau,” J. Ilmu Pengetah. dan Teknol. Komput., vol. 6, no. 1, pp. 101–106, 2020, doi: 10.33480/jitk.v6i1.1394.

R. Nurlistiani and N. Purwati, “Interpretasi Pengujian Usabilitas E-Learning di Masa Pandemi COVID-19 Menggunakan System Usability Scale,” Inst. Inform. dan Bisnis Darmajaya Tahun 2021, vol. 2020, no. Rusman 2015, pp. 164–171, 2021.

G. Gronier and A. Baudet, “Psychometric Evaluation of the F-SUS: Creation and Validation of the French Version of the System Usability Scale,” Int. J. Hum. Comput. Interact., vol. 37, no. 16, pp. 1571–1582, 2021, doi: 10.1080/10447318.2021.1898828.

Sudjana, Nana, and Ibrahim, Penelitian dan Penilaian Pendidikan, 3rd ed. Bandung: Sinar Baru Algensindo, 2004.

S. Arikunto, Prosedur Penelitian Suatu Pendekatan Praktik. Jakarta: Rineka Cipta, 2013.

H. Bakri and D. Vitalocca, “Analisis Kualitas Learning Management System Universitas Negeri Makassar Menggunakan Metode Metriks Kualitas Perangkat Lunak,” no. April 2018, pp. 1545–1555, 2021.

L. Faulkner, “Beyond the five-user assumption: Benefits of increased sample sizes in usability testing,” Behav. Res. Methods, Instruments, Comput. 2003 353, vol. 35, no. 3, pp. 379–383, 2003, doi: 10.3758/BF03195514.

J. Nielsen, “Usability 101: Introduction to Usability,” Nielsen Norman Gr., 2012.

G. Cockton, Usability Evaluation, 2nd ed. The Interaction Design Foundation, 2013.

J. Sauro and J. R. Lewis, Quantifying the User Experience: Practical Statistics for User Research, 2nd ed. Cambridge: Morgan Kaufmann, 2016.

J. Brooke, Sus: A “Quick and Dirty” Usability Scale. United Kingdom: Redhatch Consulting Ltd, 1996.

J. Sauro, “5 Ways to Interpret a SUS Score,” Measuring U, 2018. https://measuringu.com/interpret-sus-score/.

A. Bangor, P. Kortum, and J. Miller, “Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale,” J. usability Stud., vol. 4, no. 3, pp. 114–123, 2009.

R. N. Kartika and E. Djonaedi, “Pengukuran Usability Pada E-Learning Politeknik Negeri Jakarta,” Pros. Semin. Nas. Teknoka, vol. 5, no. 2502, pp. 139–145, 2020, doi: 10.22236/teknoka.v5i.351.

N. Asnawi, “Analisa Usability Aplikasi e-LMA Sebagai e-Learning Menggunakan Metode USE Questionnaire Usability Analysis of e-LMA Applications as E-learning Using the USE Questionnaire Method,” Res. J. Comput., vol. 4, no. 2, pp. 131–141, 2021.

V. H. Pranatawijaya, W. Widiatry, R. Priskila, and P. B. A. A. Putra, “Penerapan Skala Likert dan Skala Dikotomi Pada Kuesioner Online,” J. Sains dan Inform., vol. 5, no. 2, pp. 128–137, 2019, doi: 10.34128/jsi.v5i2.185.

A. W. Soejono, A. Setyanto, A. F. Sofyan, and W. Anova, “Evaluasi Usability Website UNRIYO Menggunakan S ystem Usability Scale ( Studi Kasus : Website UNRIYO ),” vol. XIII, pp. 29–37, 2018.

http://dx.doi.org/10.28989/compiler.v12i1.1612

Article Metrics

Abstract view: 134 times
Download     : 66   times Download     : 22   times

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Refbacks

  • There are currently no refbacks.