Testing the Validity and Reliability of Conceptual Chemistry Learning Instruments during the COVID-19 Pandemic Using Rasch Modeling
AuthorsAlusti Cundo Manik , Hari Sutrisno , Ifan Rivaldo
Issue:Vol. 8 No. 3 (2022): July
Keywords:Conception of Chemistry Learning, Rasch models, Instrument reliability validity
Articles "Regular Issue"
How to Cite
This study aims to determine the validity and reliability of students' conception of chemistry learning instruments during the Covid-19 pandemic using Rasch modeling. The developed instrument consists of 24 items tested on 150 students from 3 selected schools classes X, XI, and XII MIPA State Senior High School in Tuban Regency for the 2021/2022 academic year. Two experts tested the content validity of the instrument while the construct validity and item reliability used the Rasch model with Winsteps Rasch software version 3.73. The analysis of the Rasch model used is in the form of item and person separation and reliability, correlation and point measure, Item fit, item rating scale functionality and unidimensionality. The results obtained indicate that the conceptual instrument for chemistry learning that has been developed is valid and reliable. However, the COLS4, COLS6, and COLS11 items are invalid and should be revised or removed
Anugrahana, A. (2020). Hambatan, solusi dan harapan: Pembelajaran daring selama masa pandemi covid-19 oleh guru sekolah dasar. Scholaria: Jurnal Pendidikan Dan Kebudayaan, 10(3), 282–289. https://doi.org/10.24246/j.js.2020.v10.i3.p282-289
Beerenwinkel, A., Parchmann, I., & Gräsel, C. (2011). Conceptual change texts in chemistry teaching: A study on the particle model of matter. International Journal of Science and Mathematics Education, 9(5), 1235–1259. https://doi.org/10.1007/s10763-010-9257-9
Bradley, J. D., & Mosimege, M. D. (1998). Misconceptions in acids and bases: A comparative study of student teachers with different chemistry backgrounds. South African Journal of Chemistry, 51(3), 137–143. https://doi.org/10.1016/j.sbspro.2010.03.384
Bond, T. G., & Fox, C. (2015). Applying the Rasch model fundamental measurement in the human sciences (3rd ed.). New York, NY: Routledge
Boone, W. J., Staver, J. R., & Yale, M.S. (2014). Rasch analysis in the human sciences. Dordrecht, The Netherlands: Springer.
Cano, F. (2005). Epistemological beliefs and approaches to learning: their change through
secondary school and their influence on academic performance. British Journal of
Educational Psychology, 75, 203–221.https://doi.org/10.1348/000709904x22683
Dart, B. C., Burnett, P. C., Purdie, N., Boulton-Lewis, G., Campbell, J., & Smith, D. (2000). Students’ conceptions of learning, the classroom environment, and approaches to learning. Journal of Educational Research, 93(4), 262–270. https://doi.org/10.1080/00220670009598715
Fan, L., & Bokhove, C. (2014). Rethinking the role of algorithms in school mathematics: A
conceptual model with focus on cognitive development. ZDM Mathematics Education, 46(3), 481–492. https://doi.org/10.1007/s1185 8-014-0590-2
Fisher, W.P., Jr. (2007). Rating scale instrument quality criteria. Rasch Measurement Transsactions, 21 (1). 1095.
Fox, C. M., & Jones, J.A (1998). Uses of Rasch modeling modeling in counseling psychology research. Journal of Counseling Psychology, 45 (1), 30. https://doi.org./10.1037/0022-018.104.22.168
Garnett, P. J., Garnett, P. J., & Hackling, M. W. (1995). Students’ alternative conceptions in chemistry: A review of research and implications for teaching and learning. Studies in Science Education, 25(1), 69–96. https://doi.org/10.1080/03057269508560050
Hofer, B.K. and Pintrich, P.R. (1997). The development of epistemological theories:
beliefs about knowledge and knowing and their relation to learning. Review of
Educational Research, 67, 88–140. http://dx.doi.org/10.3102/00346543067001088
İlhan, M., & Güler, N. (2017). Testing the agreement between ability estimations made through classical test theory and the ones made through Rasch analysis in likert type scales. Ege Journal of Education, 18(1), 244-265. https://doi:10.12984/egeefd.289576
Johnstone, A. H. (2000). the Practice of Chemistry Education (Invited Contribution*). Chemistry Education: Research and Practice in Europe Educ. Res. Pract. Eur, 1(1), 9–15. https://doi.org/10.1039/A9RP90001B
Kizilaslan, A. (2013). KİMEği̇ti̇mÖğrenci̇leri̇ni̇n Sorgulamaya Dayali Öğrenmeİli̇şki̇nGörüşleri̇. The Journal of Academic Social Sciences, 1(1), 12–12. https://doi.org/10.16992/asos.5
Li, W. T., Liang, J. C., & Tsai, C. C. (2013). Relational analysis of college chemistry-major students’ conceptions of and approaches to learning chemistry. Chemistry Education Research and Practice, 14(4), 555–565. https://doi.org/10.1039/c3rp00034f
Lin, C., Liang, J. C., & Tsai, C. C. (2012). The Relationships Between Epistemic Beliefs in Biology and Approaches to Learning Biology Among Biology-Major University Students in Taiwan. Journal of Science Education and Technology, 21(6), 796–807. https://doi.org/10.1007/s10956-012-9367-y
Linarce, J.M. (2018). A user's guide to Winstep mini step
Rasch-Model computer programs. Beaverton, OR:
Linacre, J. M. (1999). Investigating rating scale category
utility. Journal of Outcome Measurement, 3, 103-122.
Linacre, J.M. (2011). Winsteps® (Versi 22.214.171.124) [Computer Software]. Beaverton, OR: Winsteps.com.
Marton, F., & Booth, S. (1997). Learning and awareness.
Marton, F. M., Dall’ Alba, G., & Beaty, E. (1993). Conceptions of learning. International Journal of Educational Research, 19, 277–300.
Meidawati, S. A. N. B. R. (2019). Persepsi Siswa Dalam Studi Pengaruh Daring Learning Terhadap Minat Belajar Ipa. SCAFFOLDING: Jurnal Pendidikan Islam Dan Multikulturalisme, 1(2), 30–38. https://doi.org/10.37680/scaffolding.v1i2.117
Nakhleh, M. B. (1992). Why some students don’t learn chemistry: Chemical misconceptions. Journal of Chemical Education, 69(3), 191–196. https://doi.org/10.1021/ed069p191
Negovan, V., Sterian, M., & Colesniuc, G. (2015). Conceptions of learning and intrinsic motivation in different learning environments. Procedia - Social and Behavioral Sciences, 187, 642–646. https://doi.org/10.1016/j.sbspro.2015.03.119.
Pérez-Tello, S., Antonietti, A., Liverta Sempio, O., Marchetti, A. (2005). Che cos’è l’apprendimento? Le concezioni degli studenti. [Translated title: What does learning mean? Students’ conceptions]. Rome: Carocci. http://hdl.handle.net/10807/8242
Periantalo, J. (2015). Penyusunan Skala Psikologi: Asyik, Mudah & Bermanfaat.Yogyakarta: Pustaka Pelajar.
Peterson, E. R., Brown, G. T. L., & Irving, S. E. (2010). Secondary school students’ conceptions of learning and their relationship to achievement. Learning and Individual Differences, 20, 167–176. https://doi.org/10.1016/j.lindif.2009.12.004
Renner, J. W., Abraham, M. R., Grzybowski, E. B., & Marek, E. A. (1990). Understandings and misunderstandings of eighth graders of four physics concepts found in textbooks. Journal of Research in Science Teaching, 27(1), 35–54. https://doi.org/10.1002/tea.3660270105
Rogers, F., Huddle, P. A., & White, M. D. (2000). Using a Teaching Model to Correct Known Misconceptions in Electrochemistry. Journal of Chemical Education, 77(1), 104. https://doi.org/10.1021/ed077p104
Rosli, R., Abdullah, M., Siregar, N. C., Shazana, N., Hamid, A., Abdullah, S., Halim, L., Daud, N. M., Bahari, S. A., Majid, R. A., & Bais, B. (2020). Student Awareness of Space Science : Rasch Model Analysis for Validity and Reliability. 10(3), 170–177. https://doi.org/10.5430/wje.v10n3p170
Sadikin, A., & Hamidah, A. (2020). Pembelajaran Daring di Tengah Wabah Covid-19. Biodik, 6(2), 109–119. https://doi.org/10.22437/bio.v6i2.9759
Säljö, R. (1979). Learning in the learner’s perspective. I: Some commonsense conceptions (Report No.76). Gothenburg, Sweden: University of Gothenburg.
Schommer, M. (1998). The influence of age and education on epistemological beliefs. British Journal of Educational Psychology, 68, 551–562. https://doi.org/10.1111/j.2044-8279.1998.tb01311.x
Shadreck, Mandina., Enunuwe. O.C (2017). Probelem Solving Intruction for Overcoming
Students' Difficulties in Stoichiometric Problems: S Trategies and S Elf -Regulated Earning. Acta Didactica Napocensia, 4(1), 21–30.
Sinatra, G.M. (2001). Knowledge, beliefs, and learning. Educational Psychology Review, 13, 321–323.
Suyono, S. (2020). Miskonsepsi kimia, sebuah misteri. J-PEK (Jurnal Pembelajaran Kimia), 5(1), 1–7.
Tabatabaee-Yazdi, M., Motallebzadeh, K., Ashraf, H., & Baghaei, P. (2018). Development and validation
of a teacher success questionnaire using the rasch model. International Journal of Instruction, 11(2),
Tsai, C. C. (2004). Conceptions of learning science among high school students in Taiwan: A phenomenographic analysis. International Journal of Science Education, 26(14), 1733–1750. https://doi.org/10.1080/0950069042000230776
Tsai, C.-C., Ho, H. N. J., Liang, J.-C., & Lin, H.-M. (2011). Scientific epistemic beliefs, conceptions of learning science and self-efficacy of learning science among high school students. Learning and Instruction, 21, 757–769.
Tsai, R.H., Liu, C.Q., Maltese, A.V., & Fan, X. (2006). Planning early for careers in science. Science, 312, 1143–1144.
Üce, M., & Ceyhan, İ. (2019). Misconception in Chemistry Education and Practices to Eliminate Them: Literature Analysis. Journal of Education and Training Studies, 7(3), 202. https://doi.org/10.11114/jets.v7i3.3990
Yunitasari, R., & Hanifah, U. (2020). Pengaruh Pembelajaran Daring terhadap Minat
Belajar Siswa pada Masa COVID 19. Edukatif : Jurnal Ilmu Pendidikan, 2(3), 232–243. https://doi.org/10.31004/edukatif.v2i3.142
Vermunt, J. D. (1998). The regulation of constructive learning processes. British Journal of Educational Psychology, 68, 149–171. https://doi.org/10.1111/j.20448279.1998.tb01281.x
Vermunt, J. D. (2005). Relations between student learning patterns and personal and contextual factors and academic performance. Higher Education, 49, 205–234. https://doi.org/10.1007/s10734-004-6664-2
Vermunt, J. D., & Vermetten, Y. J. (2004). Patterns in student learning: relationships between learning strategies, conceptions of learning, and learning orientations. Educational Psychology Review, 16, 359–384. https://doi.org/10.1007/s10648-004-0005-y.
Zheng, L., Dong, Y., Huang, R., Chang, C. Y., & Bhagat, K. K. (2018). Investigating the interrelationships among conceptions of, approaches to, and self-efficacy in learning science. International Journal of Science Education, 40(2), 139–158. https://doi.org/10.1080/09500693.2017.1402142
Wong, S. Y., Liang, J. C., & Tsai, C. C. (2019). Uncovering Malaysian Secondary School Students’ Academic Hardiness in Science, Conceptions of Learning Science, and Science Learning Self-Efficacy: a Structural Equation Modelling Analysis. Research in Science Education. https://doi.org/10.1007/s11165-019-09908-7
Wilmskoetter, J., Bonilha, H., Hong, I., Hazelwood, R. J., Martin-Harris, B., & Velozo, C. (2019). Construct validity of the Eating Assessment Tool (EAT-10). Disability and Rehabilitation, 41(5), 549–559. https://doi.org/10.1080/09638288.2017.1398787
Copyright (c) 2022 Alusti Cundo Manik, Hari Sutrisno, Ifan Rivaldo
This work is licensed under a Creative Commons Attribution 4.0 International License.Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).