Empirical Validation of a Conceptual Understanding Test on Dynamic Electricity for High School Students
DOI:
10.29303/jppipa.v11i11.12428Published:
2025-11-25Downloads
Abstract
The quality of measurement instruments is an essential factor in ensuring accurate and meaningful learning assessments. However, many test instruments have not undergone empirical validation, which reduces their reliability and accuracy. This study aimed to develop and empirically validate a conceptual understanding test on dynamic electricity for high school students. A quantitative descriptive design was employed involving 66 students who had studied the topic of dynamic electricity. Item analysis included validity, reliability, discrimination index, and difficulty level tests. The results showed that 11 multiple-choice items met the criteria for validity and reliability with appropriate levels of difficulty and discrimination. These findings indicate that the developed instrument has good quality and can consistently measure students’ conceptual understanding. Therefore, this test instrument can be used by teachers and researchers as a representative and high-quality tool to evaluate students’ conceptual mastery and improve the quality of physics learning assessment.
Keywords:
Conceptual understanding, Dynamic electricity, Empirical validation, Test instrumentsReferences
Afrizon, R., Hidayati, & Novitri, L. (2022). Validity and reliability to instruments of student’s initial competence for development of physics learning games integrated with scientific literacy. Journal of Physics: Conference Series, 2309(1). https://doi.org/10.1088/1742-6596/2309/1/012098
Ahmed, I., & Ishtiaq, S. (2021). Reliability and Validity: Importance in medical research. Journal of the Pakistan Medical Association, 71(10), 2401–2406. https://doi.org/10.47391/JPMA.06-861
Balta, N., & Eryılmaz, A. (2020). Development of Modern Physics Achievement Test: Validity and Reliability Study. The European Educational Researcher, 3(1), 29–38. https://doi.org/10.31757/euer.313
Bashooir, K., & Supahar, S. (2018). Validitas dan reliabilitas instrumen asesmen kinerja literasi sains pelajaran fisika berbasis STEM. Jurnal Penelitian Dan Evaluasi Pendidikan, 22(2), 219–230. https://doi.org/10.21831/pep.v22i2.19590
Basri, N. A., Salmah, U., Irawan, I. D. A., Indraloka, R. M., & Parno, P. (2024). Rasch Analysis of the Force and Motion Conceptual Evaluation Test: Validity and Reliability in Measuring Force and Motion Understanding of Students. Jurnal Pembelajaran Fisika, 12(1), 37–50. https://doi.org/10.23960/jpf.v12.n1.202404
Bhakti, Y. B., Arthur, R., & Supriyati, Y. (2023). Development of an assessment instrument for critical thinking skills in Physics: A systematic literature review. Journal of Physics: Conference Series, 2596(1). https://doi.org/10.1088/1742-6596/2596/1/012067
Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5–31. https://doi.org/10.1007/s11092-008-9068-5
Camacho-Tamayo, E., & Bernal-Ballen, A. (2023). Validation of an Instrument to Measure Natural Science Teachers’ Self-Perception about Implementing STEAM Approach in Pedagogical Practices. Education Sciences, 13(8). https://doi.org/10.3390/educsci13080764
Danni, R., Wahyuni, A., & Tauratiya, T. (2021). Item Response Theory Approach: Kalibrasi Butir Soal Penilaian Akhir Semester Mata Pelajaran Bahasa Arab. Arabi : Journal of Arabic Studies, 6(1), 93. https://doi.org/10.24865/ajas.v6i1.320
Ekawati, E. Y., Sabrilla Almas Azzahra, & Hanun Fithriyah. (2024). Construction of Critical Reasoning Skills Assessment Instruments as Diagnostic Assessments in Physics Learning with Polytomus Scoring. Journal of Education Research and Evaluation, 8(2), 338–349. https://doi.org/10.23887/jere.v8i2.69259
Faridah, A. (2021). Karakteristik butir soal ujian akhir semester mata pelajaran sejarah. Ekspose: Jurnal Penelitian Hukum dan Pendidikan, 20(2), 1281-1288. https://doi.org/10.30863/ekspose.v20i2.1819
Irawan, I. D. A., Indraloka, R. M., Basri, N. A., Salmah, U., & Parno, P. (2025). Analysis of Concept Understanding Test Items on Static Fluid Material Using Rasch Model. Jurnal Pendidikan Fisika, 13(1), 1-13. https://doi.org/10.26618/jpf.v13i1.15687
Irawan, I. D. A., Basri, N. A., Kusairi, S., & Islamiyah, M. (2025). Trends and Research Directions on Formative Feedback in Physics Learning: A Systematic Review. Jurnal Riset Pendidikan Fisika, 10(1), 39-52. https://doi.org/10.26618/jpf.v13i2.17899
Irawan, I. D. A., Kusairi, S., Khusaini, K., Basri, N. A., Faizah, R., & Habibbulloh, M. (2025). Computer-assisted Formative Feedback: Perspectives of Physics Students and Teachers - A Comprehensive Needs Analysis. Science Education International, 36(3), 311–319. https://doi.org/10.33828/sei.v36.i3.6
Kaigama, E. D., & Daniel, E. (2022). Assessment of Teachers’ Attitude Towards Validation of Non-standardized Achievement Test in Secondary Schools in Borno State. Nigeria. Education Journal, 11(4), 200–207. https://doi.org/10.11648/j.edu.20221104.20
Kartini, K., Doyan, A., Kosim, K., Susilawati, S., Khasanah, B. U., Hakim, S., & Muliyadi, L. (2019). Analysis of Validation Development Learning Model Attainment Concept to Improve Critical Thinking Skills and Student Learning Outcomes. Jurnal Penelitian Pendidikan IPA, 5(2), 185-188. https://doi.org/10.29303/jppipa.v5i2.262
Khasanah, B. U., Doyan, A., Gunawan, G., Susilawati, S., Kartini, K., Hakim, S., & Muliyadi, L. (2019). Analysis Validation of Learning Media Quantum Phenomenon. Jurnal Penelitian Pendidikan IPA, 5(2), 189-193. https://doi.org/10.29303/jppipa.v5i2.265
Khidzir, K. A. M., Ismail, N. Z., & Abdullah, A. R. (2018). Validity and River. International Journal of Development and Sustainability, 7(3), 1026–1037. Retrieved from www.isdsnet.com/ijds
Kurniawan, A., Istiyono, E., & Naba, S. D. (2024). Item Quality Analysis of Physics Concept Understanding Test with Rasch Model. JIPF (Jurnal Ilmu Pendidikan Fisika), 9(3), 474. https://doi.org/10.26737/jipf.v9i3.5692
Kusairi, S. (2020). A web-based formative feedback system development by utilizing isomorphic multiple choice items to support physics teaching and learning. Journal of Technology and Science Education, 10(1), 117–126. https://doi.org/10.3926/jotse.781
Mardian, V., Samsudin, A., Utama, J. A., Suwarma, I. R., & Coştu, B. (2023). Validity and Reliability of Elasticity Multiple-Choice Items (EMCI) Using Rasch Model. Jurnal Ilmiah Pendidikan Fisika Al-Biruni, 12(2), 265. https://doi.org/10.24042/jipfalbiruni.v12i2.17037
Mujlli, G., Al-Ghosen, A., Alrabah, R., Munshi, F., & Ozdemir, B. (2023). Development and validation of Simulation Scenario Quality Instrument (SSQI). BMC Medical Education, 23(1). https://doi.org/10.1186/s12909-023-04935-5
Mulyana, V., & Desnita, D. (2023). Empirical Validity and Reliability of the Scientific Literacy Assessment Instrument Based on the Tornado Physics Enrichment Book. Jurnal Penelitian Pendidikan IPA, 9(5), 3961–3967. https://doi.org/10.29303/jppipa.v9i5.3290
Ntuli, T. G. (2024). The influence of natural science scientific register in isiNdebele on classroom practices. Eurasia Journal of Mathematics, Science and Technology Education, 20(4). https://doi.org/10.29333/ejmste/14417
Phipps, S. D., Brackbill, M. L., & Bernard, P. J. (2009). Relationship Between Assessment Item Format and Item Performance Characteristics. American Journal Of Pharmaceutical Education, 73(9), 1–6. https://doi.org/10.5688/aj7308146
Pramita, C., & Putri, T. R. (2023). Effect of Learning Interest on Students’ Concept Understanding Ability Against Subject Pressure. International Journal of Education and Teaching Zone, 2(2), 243–253. https://doi.org/10.57092/ijetz.v2i2.59
Pratama, B., & Istiyono, E. (2024). Development of a Three-Tier Diagnostic Test Instrument to Identify Students’ Misconceptions on Motion Kinematics Material. Impulse: Journal of Research and Innovation in Physics Education, 4(2), 79–95. https://doi.org/10.14421/impulse.2023.42-02
Pribadi, F. O., Supahar, & Afriwardani, P. (2023). Certainty of Response Index-based E-Diagnostics Assisted by Google Forms to Identify Misconceptions in Simple Harmonic Waves. Journal of Education Research and Evaluation, 7(1), 168–174. https://doi.org/10.23887/jere.v7i1.56351
Rahmawati, R., Widiasih, W., Marisda, D. H., & Riskawati, R. (2023). Using Four-Tier Test to Identify Prospective Elementary Teacher Students’ Misconception on Electricity Topic. Jurnal Penelitian Pendidikan IPA, 9(10), 7793–7802. https://doi.org/10.29303/jppipa.v9i10.3272
Rashel, U. M., & Kinya, S. (2021). Development and Validation of a Test to Measure the Secondary Students’ Critical Thinking Skills: A focus on Environmental Education in Bangladesh. International Journal of Educational Research Review, 6(3), 264–274. Retrieved from www.ijere.com
Resbiantoro, G., Setiani, R., & Dwikoranto. (2022). A Review of Misconception in Physics: The Diagnosis, Causes, and Remediation. Journal of Turkish Science Education, 19(2), 403–427. https://doi.org/10.36681/tused.2022.128
Rezai, A. (2022). Fairness in classroom assessment: development and validation of a questionnaire. Language Testing in Asia, 12(1). https://doi.org/10.1186/s40468-022-00162-9
Rismaulhijjah, W. A., & Kuswanti, N. (2022). Anslisis Butir Soal Ulangan Harian Hasil Pengembangan Guru Materi Sistem Gerak Manusia Kelas XI IPA. BIOEDU : Berkala Ilmiah Pendidikan Biologi, 11(3), 643–661. https://doi.org/10.26740/bioedu.v11n3.p643-661
Rush, B. R., Rankin, D. C., & White, B. J. (2016). The impact of item-writing flaws and item complexity on examination item difficulty and discrimination value. BMC Medical Education, 16(1). https://doi.org/10.1186/s12909-016-0773-3
Sari, D. K. (2020). Analisis Instrumen Penilaian Kemampuan Pemodelan Matematis Pada Kelas Fisika Menggunakan Rasch Model. MEGA : Jurnal Pendidikan Matematika, 1(1), 47–52. https://doi.org/10.59098/mega.v1i1.182
Sharma, U., Sokal, L., Wang, M., & Loreman, T. (2021). Measuring the use of inclusive practices among pre-service educators: A multi-national study. Teaching and Teacher Education, 107, 103506. https://doi.org/10.1016/j.tate.2021.103506
Sukarelawan, M. I., Indratno, T. K., Oktova, R., & Abdullah, N. S. Y. (2024). Quality of Four-Tier Diagnostic Test on Wave and Vibration Materials: An Empirical Study Using Rasch Modeling. Jurnal Pendidikan Fisika Indonesia, 20(1), 27–37. https://doi.org/10.15294/jpfi.v20i1.47493
Sukarelawan, M. I., Jumadi, Kuswanto, H., & Anas Thohir, M. (2021). The Indonesian version of the physics metacognition inventory: Confirmatory Factor Analysis and Rasch Model. European Journal of Educational Research, 10(4), 2133–2144. https://doi.org/10.12973/EU-JER.10.4.2133
Susilawati, S., Doyan, A., & Muliyadi, L. (2022). Effectiveness of Guided Inquiry Learning Tools to Improve Understanding Concepts of Students on Momentum and Impulse Materials. Jurnal Penelitian Pendidikan IPA, 8(3), 1548-1552. https://doi.org/10.29303/jppipa.v8i3.1919
Susilawati, Doyan, A., Wahyudi, Ayub, S., & Ardhuha, J. (2022). Concept understanding of students through core physics learning tools based on guided inquiry assisted by PhET virtual media. Journal of Physics: Conference Series, 2165(1). https://doi.org/10.1088/1742-6596/2165/1/012045
Wang, J., Wang, Y., Thacker, B., Wipfli, K., & Hart, S. (2024). Unveiling the influence of pedagogical content knowledge in questioning on college students’ conceptual learning of introductory physics. Physical Review Physics Education Research, 20(2). https://doi.org/10.1103/PhysRevPhysEducRes.20.020122
Wardi, L. Z., & Jauhariyah, M. N. R. (2025). Validity and reliability scientific literacy-based physics assessment instrument on atomic nucleus and radioactivity material. Momentum: Physics Education Journal, 9(1), 109–119. https://doi.org/10.21067/mpej.v9i1.10450
Wulandari, T., Ramli, M., & Muzzazinah, M. (2022). Analisis Butir Soal Dynamic Assessment untuk Mengukur Pemahaman Konsep Klasifikasi Tumbuhan pada Mahasiswa. Jurnal Pendidikan Sains Indonesia, 10(1), 191–201. https://doi.org/10.24815/jpsi.v10i1.22082
Zhang, H., Lee, I., Ali, S., DiPaola, D., Cheng, Y., & Breazeal, C. (2023). Integrating Ethics and Career Futures with Technical Learning to Promote AI Literacy for Middle School Students: An Exploratory Study. International Journal of Artificial Intelligence in Education, 33(2), 290–324. https://doi.org/10.1007/s40593-022-00293-3
License
Copyright (c) 2025 Karolus Boromeus Mura, Sujito, Ahmad Taufiq, Ivan Danar Aditya Irawan, Nur Akhyar Basri
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
