Content Validity Analysis of a Virtual Reality Based Two-Tier Multiple Choice Assessment Instrument with Ethnochemistry to Early Detect Misconceptions in Reaction Rate Topics
DOI:
10.29303/jppipa.v11i5.11429Published:
2025-05-25Downloads
Abstract
This study aimed to develop a detection instrument for reaction rate misconceptions in prospective chemistry teachers. A Two-Tier Multiple Choice (TTMC) test with ethnochemistry content and a virtual reality (VR) storyboard were designed as assessment tools. The research followed the ADDIE model within a research and development framework. Content validity was evaluated by material and media experts through a Focus Group Discussion (FGD), with 10 TTMC questions assessed for content, language, and presentation using the Aiken formula on a 1-4 rating scale. The TTMC instrument demonstrated strong content validity, with Aiken values ranging from 0.81 to 1.00. The VR storyboard also showed content validity, with Aiken values between 0.76 and 1.00, which is above the minimum acceptable limit. These results indicate that the TTMC test and VR storyboard are valid tools for detecting misconceptions in reaction rate material, offering valuable insights for chemistry education, particularly in teacher training programs.
Keywords:
Content validity, Ethnochemistry, Reaction rate, Two Tier Multiple Choice (TTMC), Virtual reality based assessmentReferences
Adriani, D., Lubis, P., & Triono, M. (2020). Teaching Material Development of Educational Research Methodology with ADDIE Models. The 3rd International Conference Community Research and Service Engagements, IC2RSE 2019. 4th December 2019, North Sumatra, Indonesia. https://doi.org/10.4108/eai.4-12-2019.2293793
Aiken, L. R. (1980). Content Validity and Reliability of Single Items or Questionnaires. Educational and Psychological Measurement, 40(4), 955–959. https://doi.org/10.1177/001316448004000419
Aiken, L. R. (1985). Three Coefficients for Analyzing the Reliability and Validity of Ratings, Educational and Psychological Measurument. Educational and Psychological Measurement, 45(1). 131–142. https://doi.org/10.1177/0013164485451012
Arif, I. H., Lukman, A., & Tuara, Z. I. (2021). Penerapan Pendekatan Culturally Responsive Teaching Terintegrasi Etnokimia dalam Mengembangkan Keterampilan Siswa Abad 21 pada Materi Hidrolisis di MAN 1 TIKEP. Urnal Ilmiah Wahana Pendidikan, 7(2), 194–204. https://doi.org/10.5281/zenodo.4661844
Barke, H. D., Hazari, A., & Yitbarek, S. (2009). Misconceptions in Chemistry: Addressing Perceptions in Chemical Education. Misconceptions in Chemistry: Addressing Perceptions in Chemical Education, 1–294. https://doi.org/10.1007/978-3-540-70989-3
Coduto, J. R., Lazicki, A., & Leddy, J. (2024). Visualizing 3D Objects in Analytical Chemistry. Journal of Chemical Education, 101(1), 77–87. https://doi.org/10.1021/acs.jchemed.3c00821
Darnawati, O. E., & Yulianto, S. (2024). Development of Nearpod-Based Learning Media to Improve Learning Outcomes in Elementary School Grade V IPAS Subjects. Jurnal Penelitian Pendidikan IPA, 10(11), 8568–8577. https://doi.org/10.29303/jppipa.v10i11.7552
Elford, D., Lancaster, S. J., & Jones, G. A. (2022). Fostering Motivation Toward Chemistry Through Augmented Reality Educational Escape Activities. A Self-Determination Theory Approach. Journal of Chemical Education, 99(10), 3406–3417. https://doi.org/10.1021/acs.jchemed.2c00428
Gultom, H., & Rohaeti, E. (2024). The Effectiveness of the Ethnochemistry-Based Problem Based Learning Model on Students’ Problem-Solving Ability in Chemistry Learning: A Meta-analysis Study in 2021-2024. Jurnal Penelitian Pendidikan IPA, 10(7), 508–514. https://doi.org/10.29303/jppipa.v10i7.8089
Jusniar, J., Effendy, E., Budiasih, E., & Sutrisno, S. (2020). Misconceptions in Rate of Reaction and Their Impact on Misconceptions in Chemical Equilibrium. European Journal of Educational Research, 9(4), 1405–1423. https://doi.org/10.12973/eu-jer.9.4.1405
Kharisma, I., Pada, A. U. T., Supriatno, S., Safrida, S., & Huda, I. (2024). Content Validity of the Critical Thinking Skill Test Instrument on Computer Based Test (CBT) Ecology Lesson for High School Education. Jurnal Penelitian Pendidikan IPA, 10(6), 3533–3540. https://doi.org/10.29303/jppipa.v10i6.6914
Maksimenko, N., Okolzina, A., Vlasova, A., Tracey, C., & Kurushkin, M. (2021). Introducing Atomic Structure to First-Year Undergraduate Chemistry Students with an Immersive Virtual Reality Experience. Journal of Chemical Education, 98(6), 2104–2108. https://doi.org/10.1021/acs.jchemed.0c01441
Mohamad, M. M., Sulaiman, N. L., Sern, L. C., & Salleh, K. M. (2015). Measuring the Validity and Reliability of Research Instruments. Procedia - Social and Behavioral Sciences, 204(November 2014), 164–171. https://doi.org/10.1016/j.sbspro.2015.08.129
Natalia, P. D., & Sudrajat, A. (2023). Development of Three˗Tier Diagnostic Test Instrument to Measure Misconceptions of Class XI Students on Reaction Rate Materials. Jurnal Teknologi Pendidikan Jurnal Penelitian dan Pengembangan Pembelajaran, 8(1), 1. https://doi.org/10.33394/jtp.v8i1.6192
Novianty, I., Sholihah, W., & Aditama, Y. (2020). Aplikasi Virtual Reality Atom Kimia di Seamolec. MATRIK: Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer, 19(2), 257–262. https://doi.org/10.30812/matrik.v19i2.718
Oktaviana, D., Jamaluddin, J., & Bahri, S. (2024). Penyebab Miskonsepsi Peserta Didik pada Materi Pencemaran Lingkungan di SMA Negeri 1 Kediri. Jurnal Pendidikan, Sains, Geologi, dan Fisika (Geoscienceed Journal, 5(1), 6-16. https://doi.org/10.29303/goescienceed.v5i1.295
Paristiowati, M., Zulmanelis, Z., & Nurhadi, M. F. (2019). Green Chemistry-Based Experiments as the Implementation of Sustainable Development Values. JTK (Jurnal Tadris Kimiya), 4(1), 11–20. https://doi.org/10.15575/jtk.v4i1.3566
Rahayu, I. W., Widhiyanti, T., & Mulyani, S. (2024). Analysis of Misconceptions on the Factors that Affect the Reaction Rate. KnE Social Sciences, 2024, 140–150. https://doi.org/10.18502/kss.v9i13.15914
Rahayu, S. (2019). Socio-Scientific Issues (SSI) in Chemistry Education: Enhancing Both Students’ Chemical Literacy & Transferable Skills. Journal of Physics: Conference Series, 1227(1). https://doi.org/10.1088/1742-6596/1227/1/012008
Reiser, P., Neubert, M., Eberhard, A., Torresi, L., Zhou, C., Shao, C., Metni, H., Hoesel, C. V., Schopmans, H., Sommer, T., & Friederich, P. (2022). Graph Neural Networks for Materials Science and Chemistry. Communications Materials, 3(1), 1–18. https://doi.org/10.1038/s43246-022-00315-6
Retnawati, H., Hidayati, K., Apino, E., Rafi, I., & Rosyada, M. N. (2024). Exploring Influential Factors and Conditions Shaping Statistical Literacy Among Undergraduate Students in Mathematics Education. International Journal of Cognitive Research in Science Engineering and Education, 12(1), 1-17. http://dx.doi.org/10.23947/2334-8496-2024-12-1-1-17
Rodriguez, J. M. G., Hunter, K. H., Scharlott, L. J., & Becker, N. M. (2020). A Review of Research on Process Oriented Guided Inquiry Learning: Implications for Research and Practice. Journal of Chemical Education, 97(10), 3506–3520. https://doi.org/10.1021/acs.jchemed.0c00355
Romine, W. L., Todd, A. N., & Clark, T. B. (2016). How Do Undergraduate Students Conceptualize Acid–Base Chemistry? Measurement of a Concept Progression. Science Education, 100(6), 1150–1183. https://doi.org/10.1002/sce.21240
Safiatuddin, S., & Asnawi, R. (2023). Effectiveness of Using Virtual Reality-Based Virtual Laboratories in the Internet of Things Course. Jurnal Penelitian Pendidikan IPA, 9(7), 5062–5070. https://doi.org/10.29303/jppipa.v9i7.4040
Sarwi, S., Fathonah, S., Anis, M., Rozi, F., Wardani, S., & Winarto, W. (2023). Effects of Teaching Materials on Learning Salt Factory Topics Based on Ethnoscience to Improve Mastery of Students Concepts and Life Skills. Jurnal Penelitian Pendidikan IPA, 9(11), 10418–10425. https://doi.org/10.29303/jppipa.v9i11.5611
Shidiq, A. S., Masykuri, M., & Susanti, E. (2014). Pengembangan Instrumen Penilaian Two-Tier Multiple Choice untuk Mengukur Keterampilan Berpikir Tingkat Tinggi (Higher Order Thinking Skills) pada Materi Kelarutan dan Hasil Kali Kelarutan untuk Siswa SMA/MA Kelas XI. Jurnal Pendidikan Kimia, 3(4), 83–92. Retrieved from https://www.researchgate.net/publication/316076450
Soeharto, S., & Csapó, B. (2021). Evaluating Item Difficulty Patterns for Assessing Student Misconceptions in Science Across Physics, Chemistry, and Biology Concepts. Heliyon, 7(11). https://doi.org/10.1016/j.heliyon.2021.e08352
Stieff, M. (2019). Improving Learning Outcomes in Secondary Chemistry with Visualization-Supported Inquiry Activities. Journal of Chemical Education, 96(7), 1300–1307. https://doi.org/10.1021/acs.jchemed.9b00205
Supriyadi, S. (2023). Effect of Emotional Intelligence on Science Learning Outcomes in Students Given Associational and Conventional Multiple-Choice Tests. Jurnal Penelitian Pendidikan IPA, 9(4), 2002–2009. https://doi.org/10.29303/jppipa.v9i4.3220
Sweller, J., & Chandler, P. (1991). Evidence for Cognitive Load Theory. Cognition and Instruction, 8(4), 351–362. https://doi.org/10.1207/s1532690xci0804_5
Tüysüz, C. (2009). Development of Two-Tier Diagnostic Instrument and Assess Students’ Understanding in Chemistry. Scientific Research and Essays, 4(6), 626–631. Retrieved from https://www.researchgate.net/publication/254383547
Vishnumolakala, V. R., Southam, D. C., Treagust, D. F., Mocerino, M., & Qureshi, S. (2017). Students’ Attitudes, Self-Efficacy and Experiences in a Modified Process-Oriented Guided Inquiry Learning Undergraduate Chemistry Classroom. Chemistry Education Research and Practice, 18(2), 340–352. https://doi.org/10.1039/c6rp00233a
Warman, O., Fajri, B. R., & Irfan, D. (2023). Rancang Bangun Virtual Lab untuk Materi Pembelajaran Tegangan Permukaan pada Praktikum Kimia Fisika I Program Studi Pendidikan Teknik Informatika, Universitas Negeri Padang. Jurnal Pendidikan Tambusai, 7(3), 24718–24729. Retrieved from https://www.jptam.org/index.php/jptam/article/download/10532/8442
Widarti, H. R., Wiyarsi, A., Yamtinah, S., Shidiq, A. S., Sari, M. E. F., Fauziah, P. N., & Rokhim, D. A. (2025). Analysis of Content Development in Chemical Materials Related to Ethnoscience: A Review. Journal of Education and Learning, 19(1), 422–430. https://doi.org/10.11591/edulearn.v19i1.21210
Widiyatmoko, A., & Shimizu, K. (2018). The Development of Two-Tier Multiple Choice Test to Assess Students’ Conceptual Understanding About Light and Optical Instruments. Jurnal Pendidikan IPA Indonesia, 7(4). https://doi.org/10.15294/jpii.v7i4.16591
Yamtinah, S., Susanti, V. H. E., Saputro, S., Ariani, S. R. D., Shidiq, A. S., Sari, D. R., & Ilyasa, D. G. (2023). Augmented Reality Learning Media Based on Tetrahedral Chemical Representation: How Effective in Learning Process? Eurasia Journal of Mathematics, Science and Technology Education, 19(8). https://doi.org/10.29333/ejmste/13436
Yonata, B., Suyono, S., & Azizah, U. (2022). Answers Argumentation Instrument to Strengthen Conception Diagnostic Test on the Concept of Chemical Kinetics: Validity Aspect. SHS Web of Conferences, 149, 1007. https://doi.org/10.1051/shsconf/202214901007
Zamudio, J. O., Miguel-Gómez, J. E., Santiago, A., Montaño-Hilario, J. M., Franco-Bodek, D., García-Ortega, H., Reina, A., & Reina, M. (2024). Chemical Element Lotto: A Captivating Guessing and Cultural Game Inspired by the Mexican Lottery. Journal of Chemical Education, J. Chem. Educ. 2024, 101(11), 4820–4829. https://doi.org/10.1021/acs.jchemed.4c00759
Zidny, R., & Eilks, I. (2022). Learning About Pesticide Use Adapted from Ethnoscience as a Contribution to Green and Sustainable Chemistry Education. Education Sciences, 12(4). https://doi.org/10.3390/educsci12040227
Zidny, R., Sjöström, J., & Eilks, I. (2020). A Multi-Perspective Reflection on How Indigenous Knowledge and Related Ideas Can Improve Science Education for Sustainability. Science and Education, 29(1), 145–185. https://doi.org/10.1007/s11191-019-00100-x
License
Copyright (c) 2025 Arin Ika Ningtyas, Sri Yamtinah, Sulistyo Saputro, Ari Syahidul Shidiq, Sudarmin, Sri Rahayu
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
