Validation of a Google Sites-Based LMS Evaluation Instrument with the Importance Performance Analysis Approach in Sustainable Learning
DOI:
10.29303/jppipa.v11i11.12901Published:
2025-11-25Downloads
Abstract
Evaluating the feasibility and performance of a Learning Management System (LMS) requires a valid and reliable assessment instrument, especially for platforms such as Google Sites that are widely used in low-resource educational settings. This study aims to validate an LMS evaluation instrument that integrates Importance Performance Analysis (IPA) and Education for Sustainable Development (ESD) indicators. A quantitative descriptive design was employed involving 40 respondents consisting of teachers and students at SMPN 1 Jereweh, Indonesia. Data were analyzed through item–total correlation and Cronbach’s Alpha to determine validity and reliability, followed by IPA quadrant mapping and descriptive analysis for ESD indicators. All items achieved correlation values above 0.30, and the instrument demonstrated strong internal consistency with a Cronbach’s Alpha of 0.782. IPA results showed that Content Quality and Accessibility & Sustainability were classified in the Keep Up the Good Work quadrant, while Design & Navigation and Evaluation & Feedback fell into the Concentrate Here quadrant. ESD analysis indicated high ratings for digital literacy and collaboration, while sustainability values scored the lowest. These findings confirm that the instrument is valid and reliable and can effectively identify priority areas for improving Google Sites–based LMS within the principles of sustainable learning
Keywords:
ESD, Google Sites, Importance performance analysis, LMSReferences
Abo-Khalil, A. G. (2024). Integrating sustainability into higher education challenges and opportunities for universities worldwide. Heliyon, 10(9). https://doi.org/10.1016/j.heliyon.2024.e29946
Alharthi, A. D., Spichkova, M., & Hamilton, M. (2019). Sustainability requirements for eLearning systems: a systematic literature review and analysis. Requirements Engineering, 24(4), 523–543. https://doi.org/10.1007/s00766-018-0299-9
Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214–221. https://doi.org/10.1016/j.sapharm.2018.03.066
Almusfar, L. A. (2025). Improving learning management system performance: a comprehensive approach to engagement, trust, and adaptive learning. IEEE Access, 13, 46408–46425. https://doi.org/10.1109/ACCESS.2025.3550288
Almusharraf, A. I. (2024). An investigation of university students’ perceptions of learning management systems: Insights for enhancing usability and engagement. Sustainability, 16(22), 10037. https://doi.org/10.3390/su162210037
Alturki, U., & Aldraiweesh, A. (2021). Application of learning management system (Lms) during the covid-19 pandemic: A sustainable acceptance model of the expansion technology approach. Sustainability, 13(19), 10991. https://doi.org/10.3390/su131910991
Angelaki, M. E., Bersimis, F., Karvounidis, T., & Douligeris, C. (2024). Towards more sustainable higher education institutions: Implementing the sustainable development goals and embedding sustainability into the information and computer technology curricula. Education and Information Technologies, 29(4), 5079–5113. https://doi.org/10.1007/s10639-023-12025-8
Asi, Y. M., & Williams, C. (2018). The role of digital health in making progress toward Sustainable Development Goal (SDG) 3 in conflict-affected populations. International Journal of Medical Informatics, 114, 114–120. https://doi.org/10.1016/j.ijmedinf.2017.11.003
Ban, O. I., Hatos, R., Bugnar, N.-G., Sasu, D., Popa, A. L., & Fora, A.-F. (2024). Evaluation of the quality of higher education services by revised IPA in the perspective of digitization. Sustainability, 16(7), 3017. https://doi.org/10.3390/su16073017
Bradley, V. M. (2021). Learning Management System (LMS) use with online instruction. International Journal of Technology in Education, 4(1), 68–92. https://doi.org/10.46328/ijte.36
El Marsafawy, H., Roy, R., & Ali, F. (2022). Measuring learning outcomes: bridging accreditation requirements and LMS functionalities. Quality Assurance in Education, 30(4), 555–570. https://doi.org/10.1108/QAE-11-2021-0186
Fajri, I., Suryadi, K., & Anggraeni, L. (2021). Pembelajaran kelas terbalik selama pandemi covid-19: sebuah tinjauan sistematis review dari bukti empiris. Jurnal Pendidikan Kewarganegaraan Undiksha, 9(3), 870–880. https://doi.org/10.23887/jpku.v9i3.39201
Güntem, O., & Kılıç, Y. (2025). Efficiency and Sustainability in Online Education: An Evaluation of LMS Platforms and University Websites in Northern Cyprus. Sustainability, 17(9), 4166. https://doi.org/10.3390/su17094166
Kuo, Y.-F., Chen, J.-Y., & Deng, W.-J. (2012). IPA–Kano model: A new tool for categorising and diagnosing service quality attributes. Total Quality Management & Business Excellence, 23(7–8), 731–748. https://doi.org/10.1080/14783363.2011.637811
Martilla, J. A., & James, J. C. (1977). Importance-performance analysis. Journal of Marketing, 41(1), 77–79. https://doi.org/10.1177/00222429770410011
McLeay, F., Robson, A., & Yusoff, M. (2017). New applications for importance-performance analysis (IPA) in higher education: Understanding student satisfaction. Journal of Management Development, 36(6), 780–800. https://doi.org/10.1108/JMD-10-2016-0187
Mohamed Hashim, M. A., Tlemsani, I., & Matthews, R. (2022). Higher education strategy in digital transformation. Education and Information Technologies, 27(3), 3171–3195. https://doi.org/10.1007/s10639-021-10739-1
Muhidin, N. M. (2025). Menjadi Guru Profesional di Abad 21: Keterampilan Dalam Literasi Digital. Jurnal Pendidikan, 34(2), 145–156. https://doi.org/10.32585/jp.v34i2.6696
Munna, M. S. H., Hossain, M. R., & Saylo, K. R. (2024). Digital education revolution: Evaluating LMS-based learning and traditional approaches. Journal of Innovative Technology Convergence, 6(2). https://doi.org/10.69478/JITC2024v6n002a03
Nashar, A. F., Salim, A., & Utama, A. H. (2024). Pemanfaatan Bisa Design sebagai Learning Management System untuk Mendukung Implementasi Online Learning. J-INSTECH, 5(1), 137–147. https://doi.org/10.20527/j-instech.v5i1.9849
Ngulube, P., & Ncube, M. M. (2025). Leveraging Learning Analytics to Improve the User Experience of Learning Management Systems in Higher Education Institutions. Information, 16(5), 419. https://doi.org/10.3390/info16050419
Pradnyana, P. B., Astuti, N. P. E., Darmayanti, N. W. S., Seran, Y. B., Bere, M. L., Wedayanthi, L. M. D., Sueca, I. N., & Numertayasa, I. W. (2024). Pendampingan Pelaksanaan Pembelajaran Daring Kolaboratif di LMS (Learning Management System) ITP Markandeya Bali. Madaniya, 5(1), 77–86. https://doi.org/10.53696/27214834.695
Puspitasari, W. D., & Febrinita, F. (2021). Pengujian validasi isi (content validity) angket persepsi mahasiswa terhadap pembelajaran daring matakuliah matematika komputasi. Journal Focus Action of Research Mathematic (Factor M), 4(1), 77–90. https://doi.org/10.30762/factor_m.v4i1.3254
Rof, A., Bikfalvi, A., & Marques, P. (2022). Pandemic-accelerated digital transformation of a born digital higher education institution. Educational Technology & Society, 25(1), 124–141. https://eric.ed.gov/?id=EJ1335997
Santiadi, S., Majiah, A. T. P., Ruis, N. D. A., Annabel, K. F., & Karnalim, O. (2024). Analisis Perbandingan Moodle dan Google Classroom Menggunakan Technology Acceptance Model. Jurnal Terapan Teknologi Informasi, 8(1), 13–19. https://doi.org/10.21460/jutei.2024.81.288
Sass, W., De Maeyer, S., Boeve-de Pauw, J., & Van Petegem, P. (2024). Effectiveness of education for sustainability: The importance of an action-oriented approach. Environmental Education Research, 30(4), 479–498. https://doi.org/10.1080/13504622.2023.2229543
Sihotang, D. H. (2025). Urgensi Manajemen Pendidikan dalam Menghadapi Era Digitalisasi. JIIP-Jurnal Ilmiah Ilmu Pendidikan, 8(3), 2536–2541. https://doi.org/10.54371/jiip.v8i3.7207
Tasliah, A. L., Nuraeni, A., & Rachman, I. F. (2024). Literasi Digital: Kunci Menuju Pendidikan Berkualitas Melalui Perspektif Sdgs 2030. Jurnal Multidisiplin Ilmu Akademik, 1(3), 154–165. https://doi.org/10.61722/jmia.v1i3.1385
Veluvali, P., & Surisetti, J. (2022). Learning management system for greater learner engagement in higher education—A review. Higher Education for the Future, 9(1), 107–121. https://doi.org/10.1177/23476311211049855
Zanjani, N. (2017). The important elements of LMS design that affect user engagement with e-learning tools within LMSs in the higher education sector. Australasian Journal of Educational Technology, 33(1). https://doi.org/10.14742/ajet.2938
Zhan, Z., Fong, P. S. W., Mei, H., Chang, X., Liang, T., & Ma, Z. (2015). Sustainability education in massive open online courses: A content analysis approach. Sustainability, 7(3), 2274–2300. https://doi.org/10.3390/su7032274
License
Copyright (c) 2025 Sopan Hidayat, Rizka Donny Agung Saputra
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
