Development and Content Validation of a HOTS-Oriented Performance Assessment for Physics Practicum in Higher Education to Support SDG 4
DOI:
10.29303/jppipa.v12i3.14471Published:
2026-03-25Downloads
Abstract
Higher education is expected to equip students with Higher Order Thinking Skills (HOTS); however, assessment practices in physics laboratory learning still often emphasize procedural performance. This study aims to analyze assessment needs and to develop and conduct content validation of a HOTS-oriented performance assessment for physics laboratory learning in higher education to support Sustainable Development Goal 4 (Quality Education). This study employed a research and development (R&D) approach using the ADDIE model, limited to the Analyze, Design, and Develop stages. The participants were 49 undergraduate physics students selected using purposive sampling and laboratory assistants involved in practicum activities. Data were collected through essay tests, practicum module analysis, interviews, and observations, and analyzed using descriptive quantitative and qualitative methods. Content validity was evaluated through expert judgment using Aiken’s V index. The results showed that existing assessments had not optimally measured HOTS, particularly evaluating (C5) and creating (C6). Therefore, a HOTS-oriented performance assessment integrating C4, C5, and C6 was developed, consisting of performance tasks, scoring rubrics, observation sheets, and self- and peer-assessment instruments. The content validation results indicated high validity with an Aiken’s V value of 0.89. These findings provide a validated conceptual foundation for further implementation and evaluation to support SDG 4 in higher education.
Keywords:
Development and Content Validation Higher Education Higher Order Thinking Skill Performance Assessment Physics PracticumReferences
Abrahams, I., & Millar, R. (2008). Does practical work really work? A study of the effectiveness of practical work as a teaching and learning method in school science. International Journal of Science Education, 30(14), 1945–1969. https://doi.org/10.1080/09500690701749305 DOI: https://doi.org/10.1080/09500690701749305
Ahmed, K., Miskovic, D., Darzi, A., Athanasiou, T., & Hanna, G. (2011). Observational tools for assessment of procedural skills: A systematic review. American Journal of Surgery, 202, 469-480.e6. https://doi.org/10.1016/j.amjsurg.2010.10.020 DOI: https://doi.org/10.1016/j.amjsurg.2010.10.020
Appiah, M., & van Tonder, F. (2018). E-Assessment in Higher Education: A Review. International Journal of Business Management and Economic Research, 9(6), 1454–1460. Retrieved from http://www.ijbmer.com/docs/volumes/vol9issue6/ijbmer2018090601.pdf
Arnold, J. (2022). Prioritising students in Assessment for Learning: A scoping review of research on students’ classroom experience. Review of Education, 10(3), 1–36. https://doi.org/10.1002/rev3.3366 DOI: https://doi.org/10.1002/rev3.3366
Bhutta, S. M., Chauhan, S., Ali, S. K., Gul, R., Cassum, S., & Khamis, T. (2019). Developing a rubric to assess critical thinking in a multidisciplinary context in higher education. SOTL in the South, 3(1), 6–25. https://doi.org/10.36615/sotls.v3i1.69 DOI: https://doi.org/10.36615/sotls.v3i1.69
Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5–31. https://doi.org/10.1007/s11092-008-9068-5 DOI: https://doi.org/10.1007/s11092-008-9068-5
Bland, L. M., & Gareis, C. R. (2018). Performance Assessments: A Review of Definitions, Quality Characteristics, and Outcomes Associated with Their Use in K-12 Schools. Teacher Educators’ Journal, 11, 52–69. Retrieved from Retrieved from https://files.eric.ed.gov/fulltext/EJ1174728.pdf
Braun, E. (2021). Performance-based assessment of students’ communication skills. International Journal of Chinese Education, 10(1). https://doi.org/10.1177/22125868211006202 DOI: https://doi.org/10.1177/22125868211006202
Braun, H. I., Shavelson, R. J., Zlatkin-Troitschanskaia, O., & Borowiec, K. (2020). Performance Assessment of Critical Thinking: Conceptualization, Design, and Implementation. Frontiers in Education, 5(September), 1–10. https://doi.org/10.3389/feduc.2020.00156 DOI: https://doi.org/10.3389/feduc.2020.00156
Brown, C., & Mevs, P. (2012). Quality Performance Assessment: Harnessing the Power of Teacher and Student Learning. 1–6. Retrieved from https://www.qualityperformanceassessment.org
Calma, A., & Davies, M. (2025). Studies in Higher Education Assessing students ’ critical thinking abilities via a systematic evaluation of essays. Studies in Higher Education, 1–16. https://doi.org/10.1080/03075079.2025.2470969 DOI: https://doi.org/10.1080/03075079.2025.2470969
Daly, C., Pachler, N., Mor, Y., & Mellar, H. (2010). Exploring formative e-assessment: Using case stories and design patterns. Assessment and Evaluation in Higher Education, 35(5), 619–636. https://doi.org/10.1080/02602931003650052 DOI: https://doi.org/10.1080/02602931003650052
Dusdal, J. (2019). Higher education in Germany – recent developments in an international perspective. In Comparative Education, 55(2). https://doi.org/10.1080/03050068.2019.1575023 DOI: https://doi.org/10.1080/03050068.2019.1575023
Gale, J., Wind, S., Koval, J., Dagosta, J., Ryan, M., & Usselman, M. (2016). Simulation-based performance assessment: an innovative approach to exploring understanding of physical science concepts. International Journal of Science Education, 38(14), 2284–2302. https://doi.org/10.1080/09500693.2016.1236298 DOI: https://doi.org/10.1080/09500693.2016.1236298
Hartina, L., Rosidin, U., & Suyatna, A. (2019). Pengaruh Penerapan Instrumen Performance Assessment pada Pembelajaran IPA Berbasis Laboratorium Real terhadap Hasil Belajar Siswa. Jurnal Penelitian Pendidikan IPA, 6(1), 25. https://doi.org/10.29303/jppipa.v6i1.299 DOI: https://doi.org/10.29303/jppipa.v6i1.299
Hyytinen, H., & Toom, A. (2019). Developing a performance assessment task in the Finnish higher education context: Conceptual and empirical insights. British Journal of Educational Psychology, 89(3), 551–563. https://doi.org/10.1111/bjep.12283 DOI: https://doi.org/10.1111/bjep.12283
Ichsan, I. Z., Hasanah, R., Ristanto, R. H., Rusdi, R., Cahapay, M. B., Widiyawati, Y., & Rahman, M. M. (2020). Designing an Innovative Assessment of HOTS in the Science Learning for the 21st Century. Jurnal Penelitian Dan Pembelajaran IPA, 6(2), 211. https://doi.org/10.30870/jppi.v6i2.4765 DOI: https://doi.org/10.30870/jppi.v6i2.4765
Indrasari, W., Fitriani, W., & Budi, A. S. (2022). The Level of Higher-Order Thinking Skills in Basic Physics Practicum. Journal of Physics: Conference Series, 2377(1). https://doi.org/10.1088/1742-6596/2377/1/012078 DOI: https://doi.org/10.1088/1742-6596/2377/1/012078
Ismailia, T. (2021). Performance assessment using rubric to improve students’ speaking skill. Journal of Applied Linguistics and Literacy, 5(2), 65–82. https://doi.org/10.25157/jall.v5i2.5786
Khadka, J., Dahal, N., Acharya, U., Puri, G., Subedi, N., & Hasan, K. (2025). Higher-order thinking skills in e-learning contexts in higher education : a phenomenological study. Frontiers in Education, 10, 1–13. https://doi.org/10.3389/feduc.2025.1555541 DOI: https://doi.org/10.3389/feduc.2025.1555541
Komisia, F., Tukan, M. B., Yanni, D., Fallo, A., Jenisa, G., Hale, P., Meta, G. B., Lanmai, P. O., Eflani, F., Aloisia, M., & Leba, U. (2025). Validity Analysis of a Science Process Skills Assessment Instrument for High School Students in Chemistry. 11(12), 185–193. https://doi.org/10.29303/jppipa.v11i12.12860 DOI: https://doi.org/10.29303/jppipa.v11i12.12860
Krathwohl, D. R. (2002). A revision of Bloom’s taxonomy: An overview. Theory Into Practice, 41(4), 212–218. https://doi.org/10.1207/s15430421tip4104_2 DOI: https://doi.org/10.1207/s15430421tip4104_2
Olson, J. M., & Krysiak, R. (2021). Rubrics as tools for effective assessment of student learning and program quality. Curriculum Development and Online Instruction for the 21st Century, January 2021, 173–200. https://doi.org/10.4018/978-1-7998-7653-3.ch010 DOI: https://doi.org/10.4018/978-1-7998-7653-3.ch010
Pine, J., & Baxter, G. P. (1991). Performance Assessment in Science. Applied Measurement in Education, 4(4), 347–362. https://doi.org/10.1207/s15324818ame0404_7 DOI: https://doi.org/10.1207/s15324818ame0404_7
Ramos, J. L. S., Dolipas, B. B., & Villamor, B. B. (2013). Higher Order Thinking Skills and Academic Performance in Physics of College Students : A Regression Analysis. International Journal of Innovative Interdisciplinary Research, 4, 48–60. https://doi.org/ISSN 1839‐9053
Retnawati, H. (2016). Analisis kuantitatif instrumen penelitian. Yogyakarta: Parama Publishing.
Reynders, G., Lantz, J., Ruder, S. M., Stanford, C. L., & Cole, R. S. (2020). Rubrics to assess critical thinking and information processing in undergraduate STEM courses. International Journal of STEM Education, 7(1). https://doi.org/10.1186/s40594-020-00208-5 DOI: https://doi.org/10.1186/s40594-020-00208-5
Schildkamp, K., van der Kleij, F. M., Heitink, M. C., Kippers, W. B., & Veldkamp, B. P. (2020). Formative assessment: A systematic review of critical teacher prerequisites for classroom practice. International Journal of Educational Research, 103(April), 101602. https://doi.org/10.1016/j.ijer.2020.101602 DOI: https://doi.org/10.1016/j.ijer.2020.101602
Shavelson, R. J., Zlatkin-Troitschanskaia, O., Beck, K., Schmidt, S., & Marino, J. P. (2019). Assessment of University Students’ Critical Thinking: Next Generation Performance Assessment. International Journal of Testing, 19(4), 337–362. https://doi.org/10.1080/15305058.2018.1543309 DOI: https://doi.org/10.1080/15305058.2018.1543309
Shavelson, R. J., Zlatkin-Troitschanskaia, O., & Mariño, J. P. (2018). International Performance Assessment of Learning in Higher Education (iPAL): Research and Development. Methodology of Educational Measurement and Assessment, March, 193–214. https://doi.org/10.1007/978-3-319-74338-7_10 DOI: https://doi.org/10.1007/978-3-319-74338-7_10
Tan, K., & Leong, W. S. (2015). Assessment rubric for learning. Assessment and Learning, August 2014, 115–128. Retrieved from https://www.researchgate.net/publication/270958483
Ubaidillah, M., Marwoto, P., & Subali, B. (2022). Higher Order Thinking Laboratory ( HOT Lab ) -Based Physics Learning : A Systematic Literature Review. 96–107. https://proceeding.unnes.ac.id/ISET/article/view/1735
Villarta, Y. M., Atibula, L. T., & Gagani, F. S. (2021). Performance-based assessment: Self-efficacy, decision-making, and problem-solving skills in learning science. Journal La Edusci, 2(3), 1–9. https://doi.org/10.37899/journallaedusci.v2i3.381 DOI: https://doi.org/10.37899/journallaedusci.v2i3.381
Vlachopoulos, D., & Makri, A. (2024). A systematic literature review on authentic assessment in higher education: Best practices for the development of 21st century skills, and policy considerations. Studies in Educational Evaluation, 83(November), 101425. https://doi.org/10.1016/j.stueduc.2024.101425 DOI: https://doi.org/10.1016/j.stueduc.2024.101425
Wested, G. S. F., & Shavelson, R. J. (1997). Development of performance assessments in science: Conceptual, practical, and logistical issues. Educational Measurement: Issues and Practice, 16(3), 16–24. https://doi.org/10.1111/j.1745-3992.1997.tb00596.x DOI: https://doi.org/10.1111/j.1745-3992.1997.tb00596.x
Wongvorachan, T., Bulut, O., Tsai, Y.-S., & Lindner, M. A. (2022). Improving Student Feedback Literacy in e-Assessments: A Framework for the Higher Education Context. Trends in Higher Education, 1(1), 16–29. https://doi.org/10.3390/higheredu1010002 DOI: https://doi.org/10.3390/higheredu1010002
Yan, Z., Panadero, E., Wang, X., & Zhan, Y. (2023). A Systematic Review on Students ’ Perceptions of Self ‑ Assessment : Usefulness and Factors Influencing. Educational Psychology Review, 35(3), 1–28. https://doi.org/10.1007/s10648-023-09799-1 DOI: https://doi.org/10.1007/s10648-023-09799-1
Zlatkin-Troitschanskaia, O., & Shavelson, R. J. (2019). Advantages and challenges of performance assessment of student learning in higher education. British Journal of Educational Psychology, 89(3), 413–415. https://doi.org/10.1111/bjep.12314 DOI: https://doi.org/10.1111/bjep.12314
Zlatkin-Troitschanskaia, O., Toepper, M., Pant, H. A., Lautenbach, C., & Kuhn, C. (Eds.). (2018). Assessment of learning outcomes in higher education: Cross-national comparisons and perspectives. Springer. https://doi.org/10.1007/978-3-319-74338-7 DOI: https://doi.org/10.1007/978-3-319-74338-7
License
Copyright (c) 2026 Emiliannur, Fuja Novitra, Rahma Doni, Metta Liana, Nanang Winarno, Lukman Hakim
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
