Evaluation of Higher-Order Thinking Skills of Middle School Students on Vibration and Wave Topic Using Rasch Measurement

Authors

Annur Indra Kusumadani , Harry Afandy , Lina Agustina , Rina Astuti , Muhamad Waluyo

DOI:

10.29303/jppipa.v11i5.10900

Published:

2025-05-25

Issue:

Vol. 11 No. 5 (2025): May

Keywords:

HOTS, Learning evaluation, Rasch model, Two-tier test, Vibration and wave

Research Articles

Downloads

How to Cite

Kusumadani, A. I., Afandy, H., Agustina, L., Astuti, R., & Waluyo, M. (2025). Evaluation of Higher-Order Thinking Skills of Middle School Students on Vibration and Wave Topic Using Rasch Measurement. Jurnal Penelitian Pendidikan IPA, 11(5), 74–84. https://doi.org/10.29303/jppipa.v11i5.10900
Crossref
Scopus
Google Scholar
Europe PMC

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Abstract

Higher-order thinking skills (HOTS) are crucial in science education, yet students often struggle to master them, particularly in complex topics such as vibrations and waves. This study aimed to evaluate the HOTS performance of 165 eighth-grade students from five schools in Purbolinggo Sub-district, East Lampung, using a two-tier multiple-choice test analyzed through the Rasch Measurement Model. The test consisted of 12 items, each with a content question and a reasoning tier, adapted from Treagust (1988) and validated through expert judgment. Rasch analysis indicated that most students demonstrated low HOTS ability, especially in the creating domain (C6), involving generating novel ideas or solutions. In contrast, analyzing (C4) and evaluating (C5) were relatively easier but still reflected limited mastery. The highest difficulty appeared in questions requiring divergent thinking and complex synthesis. Item fit statistics showed good instrument validity (person reliability = 0.93; item reliability = 0.83). These findings highlight the importance of implementing learning strategies that foster creativity and synthesis, such as problem-based learning or project-based approaches. The study was limited to one geographic area, which may restrict generalizability. Future research should explore broader contexts and incorporate qualitative data to deepen understanding of HOTS development in science.

References

Affandy, H., Nugraha, D. A., Pratiwi, S. N., & Cari, C. (2021). Calibration for Instrument Argumentation Skills on the Subject of Fluid Statics Using Item Response Theory. Journal of Physics: Conference Series, 1842(1), 1–10. https://doi.org/10.1088/1742-6596/1842/1/012032

Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., Raths, J., & Wittrock, M. C. (2001). A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives. Longman.

Andrich, D., & Marais, I. (2019). A Course in Rasch Measurement Theory: Measuring in the Educational, Social and Health Sciences. Springer Nature.

Bond, T. (2015). Applying the Rasch model: Fundamental Measurement in the Human Sciences (3rd Ed). Routledge.

Bond, T. G., Yan, Z., & Heene, M. (2021). Applying the Rasch Model: Fundamental Measurement in the Human Sciences (4th ed.). Routledge.

Brookhart, S. M. (2010). How to Assess Higher-Order Thinking Skills in Your Classroom. ASCD.

Cari, C., Pratiwi, S. N., Affandy, H., & Nugraha, D. A. (2020). Investigation of Undergraduate Student Concept Understanding on Hydrostatic Pressure Using Two-Tier Test. Journal of Physics: Conference Series, 1511(1). https://doi.org/10.1088/1742-6596/1511/1/012085

Engelhard, G., & Wang, J. (2021). Rasch Models for Solving Measurement Problems: Invariant Measurement in the Social Sciences. SAGE Publications.

Fathonah, S., Ahmadi, F., Arsyad, A. A., & Rahman, S. (2025). Problem-Based Learning Model Assisted by Interactive Media to Improve Students Higher Order Thinking Skills (HOTS). Jurnal Penelitian Pendidikan IPA, 11(1), 1234–1243. https://doi.org/10.29303/jppipa.v11i1.6649

Fatmawati, B., Wazni, M. K., & Husnawati, N. (2021). The Study of Worksheets Based on Creative Problem Solving for Biology Subjects. Jurnal Penelitian Pendidikan IPA, 7(4), 701–706. https://doi.org/10.29303/jppipa.v7i4.831

Fensham, P. J., & Bellocchi, A. (2013). Higher Order Thinking in Chemistry Curriculum and Its Assessment. Thinking Skills and Creativity, 10, 250–264. https://doi.org/10.1016/j.tsc.2013.06.003

Heong, Y. M., Sern, L. C., Kiong, T. T., & Mohamad, M. M. B. (2016). The Role of Higher Order Thinking Skills in Green Skill Development. EDP Sciences, 70(05001), 1–5. https://doi.org/10.1051/matecconf/20167005001

Hidayatullah, A. R., Yamtinah, S., & Masykuri, M. (2022). Development of A Two-Tier Multiple-Choice Instrument Based on Higher Order Thinking Skills (HOTS) on Acids, Bases, and Salts. Jurnal Penelitian Pendidikan IPA, 8(2), 932–938. https://doi.org/10.29303/jppipa.v8i2.1423

Ibrahim, N. M., Sanjaya, Y., & Nurjhani, M. (2024). Effectiveness of Biology Learning to Improve Digital Literacy and Higher Order Thinking Skills on the Concept of Digestive System. Jurnal Penelitian Pendidikan IPA, 10(9), 7131–7137. https://doi.org/10.29303/jppipa.v10i9.5018

Irdalisa, I., Akbar, B., Fuadi, T. M., Maesaroh, M., & Kartikawati, E. (2024). Ricosre Model with Question Formulation Technique (QFT): Enhancing Students’ Higher Order Thinking Skills (HOTS) and Science Literacy. Jurnal Penelitian Pendidikan IPA, 10(3), 1175–1178. https://doi.org/10.29303/jppipa.v10i3.6764

Istiyono, E. (2016). The Application of GPCM on MMC Test as a Fair Alternative Assessment Model in Physics Learning. Proceeding of 3rd International Conference on Research, Implementation and Education of Mathematics and Science, 25–30.

Istiyono, E., Dwandaru, W. B., & Rahayu, F. (2018). Pengembangan Tes Creative Thinking Skills Fisika SMA (PhysCreTHOTS) Berdasarkan Teori Tes Modern. Cakrawala Pendidikan, 37(2), 190–200. Retrieved from https://journal.uny.ac.id/index.php/cp/article/download/19233/11107

Istiyono, E., Mustakim, S. S., Widihastuti, W., Suranto, S., & Mukti, T. S. (2019). Measurement of Physics Problem-Solving Skills in Female and Male Students by PhysTeProSS. Jurnal Pendidikan IPA Indonesia, 8(2), 170–176. https://doi.org/10.15294/jpii.v8i2.17640

Jansen, T., & Meoller, J. (2022). Teacher Judgments in School Exams: Influences of Students’ Lower Order Thinking Skills on the Assessment of Students’ Higher Order Thinking Skills. Teaching and Teacher Education, 111, 1–10. https://doi.org/10.1016/j.tate.2021.103616

Kaltakci, D., Eryilmaz, A., & McDermott, L. C. (2016). Identifying Pre-Service Physics Teachers’ Misconceptions and Conceptual Difficulties About Geometrical Optics. European Journal of Physics, 37(4), 045705. https://doi.org/10.1088/0143-0807/37/4/045705

Khaeruddin, K., Indarwati, S., Sukmawati, S., Hasriana, H., & Afifah, F. (2023). An Analysis of Students’ Higher Order Thinking Skills Through the Project-Based Learning Model on Science Subject. Jurnal Pendidikan Fisika Indonesia, 19(1), 47–54. https://doi.org/10.15294/jpfi.v19i1.34259

Kwangmuang, P., Jarutkamolpong, S., Sangboonraung, W., & Daungtod, S. (2021). The Development of Learning Innovation to Enhance Higher Order Thinking Skills for Students in Thailand Junior High Schools. Heliyon, 7(6), e07309. https://doi.org/10.1016/j.heliyon.2021.e07309

Leou, M., Abder, P., Riordan, M., & Zoller, U. (2006). Using “HOCS-Centered Learning” as a Pathway to Promote Science Teachers’ Metacognitive Development. Research in Science Education, 36(1–2), 69–84. https://doi.org/10.1007/s11165-005-3916-9

Lewis, A., & Smith, D. (1993). Defining Higher Order Thinking. Theory Into Practice, 32(3), 131–137. https://doi.org/10.1080/00405849309543588

Linacre, J. M. (2011). A User’s Guide to Winsteps Rasch Model Computer Programs. Chicago

Negara, A. H. S., Waston, W., Hidayat, S., & Mulkhan, A. M. (2024). Development of Religious Character to Improve the Effectiveness of Teacher and Student Communication. Revista de Gestao Social e Ambiental, 18(6), 1–26. https://doi.org/10.24857/rgsa.v18n6-037

Nesbitt-Hawes, P. J. (2005). Higher Order Thinking Skills in a Science Classroom Computer Simulation [Queensland University of Technology]. https://doi.org/10.1515/9783050062365

Ningsih, N. R., & Kamaludin, A. (2023). Development of Higher Order Thinking Skills-Based Assessment Instrument on Acid-Base Materials in High School. Jurnal Penelitian Pendidikan IPA, 9(1), 13–19. https://doi.org/10.29303/jppipa.v9i1.1457

Oktadila, S. S., Nasbey, H., & Jaya, I. (2025). Enhancing Higher-Order Thinking Skills in Elementary Science Learning Using the RADEC Model. Jurnal Penelitian Pendidikan IPA, 11(3), 573–579. https://doi.org/10.29303/jppipa.v11i3.10398

PISA. (2023). Programme for International Student Assessment. Retrieved from https://www.oecd.org/

Potvin, P., Skelling-Desmeules, Y., & Sy, O. (2015). Exploring Secondary Students’ Conceptions About Fire Using a Two-Tier, True/False, Easy-to-Use Diagnostic Test. Journal of Education in Science, Environment and Health, 1(2), 63. https://doi.org/10.21891/jeseh.99647

Ramadan, Z. H., Anggriani, M. D., & Dafit, F. (2023). Development of 3-Dimensional Cartoon Animation Videos to Improve Higher Order Thinking Skills of Elementary School Students. Jurnal Penelitian Pendidikan IPA, 9(11), 10506–40516. https://doi.org/10.29303/jppipa.v9i11.5564

Santosa, T. A., Angreni, S., Sari, R. T., Festiyed, F., Yerimadesi, Y., Ahda, Y., Alberida, H., & Arsih, F. (2024). Effectiveness of Higher Order Thinking Skills-based Test Instruments in Science Learning in Indonesia: A Meta-analysis. Jurnal Penelitian Pendidikan IPA, 10(5), 242–249. https://doi.org/10.29303/jppipa.v10i5.6654

Satriya, M. A., & Atun, S. (2024). The Effect of Argument Driven Inquiry Learning Models on Scientific Argumentation Skills and Higher Order Students on The Topics of Acid Base. Jurnal Penelitian Pendidikan IPA, 10(5), 2663–2673. https://doi.org/10.29303/jppipa.v10i5.6834

Seibert, S. A. (2021). Problem-Based Learning: A Strategy to Foster Generation Z’s Critical Thinking and Perseverance. Teaching and Learning in Nursing, 16(1), 85–88. https://doi.org/10.1016/j.teln.2020.09.002

Smith, R. M. (2003). Rasch Measurement Models: Interpreting WINSTEPS/BIGSTEPS and FACETS Output. JAM Press.

Susantini, E., Isnawati, I., & Raharjo, R. (2022). HOTS-Link Mobile Learning Application: Enabling Biology Pre-Service Teachers to Devise HOTS-Based Lesson Plans. Journal of Science Education and Technology, 31, 783–794. https://doi.org/10.1007/s10956-022-09993-w

Treagust, D. F. (1988). Development and Use of Diagnostic Tests to Evaluate Students’ Misconceptions in Science. International Journal of Science Education, 10(2), 159–169. https://doi.org/10.1080/0950069880100204

Waluyo, J., & Ridlo, Z. R. (2025). Implementation of Science Module Based on Microcontroller to Improve Students’ Computational Thinking Skills in Earth Science Course Thinking. Jurnal Penelitian Pendidikan IPA, 11(2), 752–760. https://doi.org/10.29303/jppipa.v11i2.10348

Widiyatmoko, A., & Shimizu, K. (2018). The Development of Two-Tier Multiple Choice Test to Assess Students’ Conceptual Understanding About Light and Optical Instruments. Jurnal Pendidikan IPA Indonesia, 7(4), 491–501. https://doi.org/10.15294/jpii.v7i4.16591

Yanti, N. L. I. M., Redhana, W., & Suastra, W. (2023). Multiple Scaffolding STEAM Project-Based Learning Model In Science Learning. Jurnal Penelitian Pendidikan IPA, 9(8), 6493–6502. https://doi.org/10.29303/jppipa.v9i8.4470

Zakwandi, R., Istiyono, E., & Dwandaru, W. S. B. (2024). A Two-Tier Computerized Adaptive Test to Measure Student Computational Thinking Skills. Education and Information Technologies, 29(7), 8579–8608. https://doi.org/10.1007/s10639-023-12093-w

Author Biographies

Annur Indra Kusumadani, Universitas Muhammadiyah Surakarta

Harry Afandy, Universitas Sebelas Maret

Lina Agustina, Universitas Muhammadiyah Surakarta

Rina Astuti, Universitas Muhammadiyah Surakarta

Muhamad Waluyo, Universitas Muhammadiyah Surakarta

License

Copyright (c) 2025 Annur Indra Kusumadani, Harry Afandy, Lina Agustina, Rina Astuti, Muhamad Waluyo

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).