Exploring Research and Service Information System Usability by Heuristic Evaluation as a Compelement of System Usability Scale

Authors

Guntoro , Lisnawita , Loneli Costaner

DOI:

10.29303/jppipa.v9i12.5571

Published:

2023-12-20

Issue:

Vol. 9 No. 12 (2023): December

Keywords:

Heuristic Evaluation, System Usability Scale (SUS), The Research and Community Service Information System

Research Articles

Downloads

How to Cite

Guntoro, Lisnawita, & Costaner, L. . (2023). Exploring Research and Service Information System Usability by Heuristic Evaluation as a Compelement of System Usability Scale . Jurnal Penelitian Pendidikan IPA, 9(12), 11045–11052. https://doi.org/10.29303/jppipa.v9i12.5571
Crossref
Scopus
Google Scholar
Europe PMC

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Abstract

The Research and Community Service Information System of LPPM University Lancang Kuning is a web-based application designed to facilitate research and community service activities at the university. This study incorporated two methodologies: a descriptive approach with qualitative analysis for heuristic data collection, and the System Usability Scale (SUS) method, employing quantitative analysis. The research process included stages of problem analysis, literature review, data collection, data analysis, and formulating recommendations based on the findings and discussions. The heuristic evaluation, the first method applied, revealed that aspects H1, H3, and H4 scored 1 when rounded, indicating these were merely cosmetic issues not requiring immediate attention unless spare time was available. Conversely, aspects H2, H5, H6, H7, H8, H9, and H10 scored 2 when rounded, categorizing them as minor usability issues needing resolution, albeit with low priority, to prevent potential user difficulties. Recommendations for these seven heuristic aspects scoring 2 encompassed improvements in system information clarity, feedback processes, image utilization, color selection, grammar quality, and writing consistency. The second method, the SUS, indicated that most users demonstrated adequate skills in terms of learnability, efficiency, memorability, error management, and overall satisfaction with their system usage experience.

References

Abraham, G. T., Osaisai, E. F., Wariowei, D. S., Ineyekineye, A., & Tuesday, O. T. (2021). Usability Issues with E-Commerce Websites in Nigeria. Asian Journal of Computer Science and Technology, 10(1), 5–12. https://doi.org/10.51983/ajcst-2021.10.1.2694

Afrizon, A., & Hadi Putra, P. (2023). Usability Evaluation Of Social Security For Workers Applications In Public Institutions. Indonesian Journal of Computer Science, 12(4). https://doi.org/10.33022/ijcs.v12i4.3288

Andriawan, Z. A., Pratama, R., & Khadijah. (2020). Usability Testing of Multifinance Mobile Application for End-Customer (Case Study: PT.XYZ). 2020 4th International Conference on Informatics and Computational Sciences (ICICoS), 1–6. https://doi.org/10.1109/ICICoS51170.2020.9298977

Aziz, M. A., Sani, M. H., Baharin, H., Zambri, S., Jiman, N. I., & Nasir, I. N. M. (2022). Heuristic Evaluation Of E-Commerce Marketplace. Malaysian Journal Of Computing, 7(2), 1178-1187. Retrieved from https://myjms.mohe.gov.my/index.php/mjoc/article/view/19070

Baig, M. M., GholamHosseini, H., & Ahmad, F. (2020). A Usability and User-Experience Analysis of VitalsAssist: A mHealth Application to Monitor Vital Signs in Acute Care Settings. 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 5132–5135. https://doi.org/10.1109/EMBC44109.2020.9176467

Berlian, L., Taufik, A. N., & Triyani, I. (2023). Need Analysis for Developing a Natural Science Learning Website with the Theme of Biotechnology in Improving Digital Literacy. Jurnal Penelitian Pendidikan IPA, 9(7), 4999–5006. https://doi.org/10.29303/jppipa.v9i7.2934

Chercules, Ismet, & Sriyanti, I. (2023). Development of Electronic Books Using Website 2 APK Builder Pro Based on Science, Technology, Engineering, and Mathematics (STEM) to Improve Learning Outcomes. Jurnal Penelitian Pendidikan IPA, 9(11), 9381–9390. https://doi.org/10.29303/jppipa.v9i11.5182

Cho, H., Keenan, G., Madandola, O. O., Dos Santos, F. C., Macieira, T. G. R., Bjarnadottir, R. I., Priola, K. J. B., & Dunn Lopez, K. (2022). Assessing the Usability of a Clinical Decision Support System: Heuristic Evaluation. JMIR Human Factors, 9(2), e31758. https://doi.org/10.2196/31758

Cristobal-Fransi, E., Montegut-Salla, Y., Ferrer-Rosell, B., & Daries, N. (2020). Rural cooperatives in the digital age: An analysis of the Internet presence and degree of maturity of agri-food cooperatives’ e-commerce. Journal of Rural Studies, 74, 55–66. https://doi.org/10.1016/j.jrurstud.2019.11.011

Damayanti, C., Triayudi, A., & Sholihati, I. D. (2022). Analisis UI / UX Untuk Perancangan Website Apotek dengan Metode Human Centered Design dan System Usability Scale. Jurnal Media Informatika Budidarma, 6(1), 551–559. https://doi.org/10.30865/mib.v6i1.3526

Donaghy, E., Atherton, H., Hammersley, V., McNeilly, H., Bikker, A., Robbins, L., Campbell, J., & McKinstry, B. (2019). Acceptability, benefits, and challenges of video consulting: A qualitative study in primary care. British Journal of General Practice, 69(686), e586–e594. https://doi.org/10.3399/bjgp19X704141

Gupta, S., Epiphaniou, G., & Maple, C. (2023). AI-augmented usability evaluation framework for software requirements specification in cyber physical human systems. Internet of Things, 23, 100841. https://doi.org/10.1016/j.iot.2023.100841

H. Turhangil Erenlergil Erenler, H. (2018). Heuristic Evaluation of E-Learning. International Journal of Organizational Leadership, 7(2), 195–210. https://doi.org/10.33844/ijol.2018.60235

Hayati, H. (2022). Factors Influencing the Use of Cyber Extension by Gender-Based Extensioners in Supporting Artificial Intelligence in Agriculture in NTB (Case Study of Mataram City). Jurnal Penelitian Pendidikan IPA, 8(6), 3187–3195. https://doi.org/10.29303/jppipa.v8i6.4055

Hidayat, H., Hidayat, O. S., & Widiasih, W. (2023). Development of Google Sites-Based Learning Resources to Improve Mastery of Concepts and Process Skills in Electrical Circuit Materials. Jurnal Penelitian Pendidikan IPA, 9(6), 4624–4631. https://doi.org/10.29303/jppipa.v9i6.3612

Husna, H. N., Zawjiyah, S. M. R., & Widia, C. (2023). Implementation QR-Code for Introducing Optical Instruments. Jurnal Penelitian Pendidikan IPA, 9(10), 7916–7923. https://doi.org/10.29303/jppipa.v9i10.3821

Ishak, N. I. A., & Ahmad, N. A. (2023). GoPrintBot: An Interactive E-Commerce for Online Printing Services. Journal of Information Systems and Informatics, 5(2), 771–784. https://doi.org/10.51519/journalisi.v5i2.502

Kivijärvi, H., & Pärnänen, K. (2023). Instrumental Usability and Effective User Experience: Interwoven Drivers and Outcomes of Human-Computer Interaction. International Journal of Human–Computer Interaction, 39(1), 34–51. https://doi.org/10.1080/10447318.2021.2016236

Klarich, A., Noonan, T. Z., Reichlen, C., Barbara, S. M. J., Cullen, L., & Pennathur, P. R. (2022). Usability of smart infusion pumps: A heuristic evaluation. Applied Ergonomics, 98, 103584. https://doi.org/10.1016/j.apergo.2021.103584

Kumar, B., Roy, S., Sinha, A., Iwendi, C., & Strážovská, Ľ. (2022). E-Commerce Website Usability Analysis Using the Association Rule Mining and Machine Learning Algorithm. Mathematics, 11(1), 25. https://doi.org/10.3390/math11010025

Lewis, J. R. (2018). The System Usability Scale: Past, Present, and Future. International Journal of Human–Computer Interaction, 34(7), 577–590. https://doi.org/10.1080/10447318.2018.1455307

Mertha, I. M. S., Satwika, I. P., & Paramitha, A. A. I. I. (2021). Analisa Usability Pada Website Platform Marketplace Edukasi Menggunakan Metode Heuristic Evaluation System Usability Scale. Jurnal Krisnadana, 1(1), 37–46. https://doi.org/10.58982/krisnadana.v1i1.80

Mohamad Marzuki, M. F., Yaacob, N. A., & Yaacob, N. M. (2018). Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps. JMIR Human Factors, 5(2), e10308. https://doi.org/10.2196/10308

Molina Rodríguez-Navas, P., Medranda Morales, N., & Muñoz Lalinde, J. (2021). Transparency for Participation through the Communication Approach. ISPRS International Journal of Geo-Information, 10(9), 586. https://doi.org/10.3390/ijgi10090586

Mulder, W. R. S. P., Khoiri, N., & Hayat, M. S. (2023). Analysis of the Characteristics of the Development of Web-Based Science Learning Media with the STEAM Approach. Jurnal Penelitian Pendidikan IPA, 9(11), 9586–9592. https://doi.org/10.29303/jppipa.v9i11.5095

Myhre, E. L., Garnweidner-Holme, L., Dahl, B., Reigstad, M. M., & Lukasse, M. (2021). Development of and Experiences With an Informational Website on Early Labor: Qualitative User Involvement Study. JMIR Formative Research, 5(9), e28698. https://doi.org/10.2196/28698

Nazar, M., Nurmalahayati, N., Rusman, R., Puspita, K., & Haris, A. (2022). Introducing Chemical Instruments through Quick Response Code (QR-Code) Based Website. Jurnal Penelitian Pendidikan IPA, 8(3), 1083–1088. https://doi.org/10.29303/jppipa.v8i3.1361

Nielsen, J., & Molich, R. (1990). Heuristic evaluation of user interfaces. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems Empowering People-CHI ’90, 249–256. https://doi.org/10.1145/97243.97281

Okundaye, K., Fan, S. K., & Dwyer, R. J. (2019). Impact of information and communication technology in Nigerian small-to medium-sized enterprises. Journal of Economics, Finance and Administrative Science, 24(47), 29–46. https://doi.org/10.1108/JEFAS-08-2018-0086

Rangraz Jeddi, F., Nabovati, E., Bigham, R., & Farrahi, R. (2020). Usability evaluation of a comprehensive national health information system: A heuristic evaluation. Informatics in Medicine Unlocked, 19, 100332. https://doi.org/10.1016/j.imu.2020.100332

Saad, M., Zia, A., Raza, M., Kundi, M., & Haleem, M. (2022). A Comprehensive Analysis of Healthcare Websites Usability Features, Testing Techniques and Issues. IEEE Access, 10, 97701–97718. https://doi.org/10.1109/ACCESS.2022.3193378

Schrepp, M., Hinderks, A., & Thomaschewski, J. (2017). Construction of a Benchmark for the User Experience Questionnaire (UEQ). International Journal of Interactive Multimedia and Artificial Intelligence, 4(4), 40. https://doi.org/10.9781/ijimai.2017.445

Sevilla-Gonzalez, M. D. R., Moreno Loaeza, L., Lazaro-Carrera, L. S., Bourguet Ramirez, B., Vázquez Rodríguez, A., Peralta-Pedrero, M. L., & Almeda-Valdes, P. (2020). Spanish Version of the System Usability Scale for the Assessment of Electronic Tools: Development and Validation. JMIR Human Factors, 7(4), e21161. https://doi.org/10.2196/21161

Sina, S. A., Uloli, R., & Abdjul, T. (2023). Website Development as a Physics Learning Media on Heat and its Transfer Materials. Jurnal Penelitian Pendidikan IPA, 9(8), 5874–5883. https://doi.org/10.29303/jppipa.v9i8.4189

Somya Khatri & Ritu Sharma. (2022). Emergence Of Human-Computer Interaction: Global And Indian Perspective. Journal of Pharmaceutical Negative Results, 1525–1533. https://doi.org/10.47750/pnr.2022.13.S06.203

Sudiarsa, I. W., & Wiraditya, I. G. B. (2020). Analisis Usability Pada Aplikasi Peduli Lindungi Sebagai Aplikasi Informasi Dan Tracking Covid-19 Dengan Heuristic Evaluation. INTECOMS: Journal of Information Technology and Computer Science, 3(2), 354–364. https://doi.org/10.31539/intecoms.v3i2.1901

Sukardjo, M., Oktaviani, V., Tawari, S., Alfajar, I., & Ichsan, I. Z. (2023). Design of Control System Trainer Based on IoT as Electronic Learning Media for Natural Science Course. Jurnal Penelitian Pendidikan IPA, 9(2), 952–958. https://doi.org/10.29303/jppipa.v9i2.3097

Suryani, I., Hasanuddin, H., Huda, I., Samingan, S., & Abdullah, A. (2022). Analysis of Student Readiness in E-Learning-Based Ecological Learning. Jurnal Penelitian Pendidikan IPA, 8(1), 356–361. https://doi.org/10.29303/jppipa.v8i1.1226

Tom Tullis, B. A. (2013). Measuring the User Experience. Elsevier. https://doi.org/10.1016/C2011-0-00016-9

Wahyuningrum, T., Kartiko, C., & Wardhana, A. C. (2020). Exploring e-Commerce Usability by Heuristic Evaluation as a Compelement of System Usability Scale. 2020 International Conference on Advancement in Data Science, E-Learning and Information Systems (ICADEIS), 1–5. https://doi.org/10.1109/ICADEIS49811.2020.9277343

Yanarti, Y., Jumadi, J., Lelita, I., & Rosiningtias, W. (2022). Development of Archimedes Law Material E-Module on Motion Systems to Improve Student’s Concept Understanding. Jurnal Penelitian Pendidikan IPA, 8(4), 2439–2447. https://doi.org/10.29303/jppipa.v8i4.1905

Zardari, B. A., Hussain, Z., Arain, A. A., Rizvi, W. H., & Vighio, M. S. (2021). QUEST e-learning portal: Applying heuristic evaluation, usability testing and eye tracking. Universal Access in the Information Society, 20(3), 531–543. https://doi.org/10.1007/s10209-020-00774-z

Author Biographies

Guntoro, Universitas Lancang Kuning

Lisnawita, Universitas Lancang Kuning, Pekanbaru

Loneli Costaner, Universitas Lancang Kuning, Pekanbaru

License

Copyright (c) 2023 Guntoro, Lisnawita, Loneli Costaner

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).