Testing the Validity and Reliability of Conceptual Chemistry Learning Instruments during the COVID-19 Pandemic Using Rasch Modeling

Authors

Alusti Cundo Manik , Hari Sutrisno , Ifan Rivaldo

DOI:

10.29303/jppipa.v8i3.1486

Published:

2022-07-31

Issue:

Vol. 8 No. 3 (2022): July

Keywords:

Conception of Chemistry Learning, Rasch models, Instrument reliability validity

Research Articles

Downloads

How to Cite

Manik, A. C., Sutrisno, H. ., & Rivaldo, I. . (2022). Testing the Validity and Reliability of Conceptual Chemistry Learning Instruments during the COVID-19 Pandemic Using Rasch Modeling. Jurnal Penelitian Pendidikan IPA, 8(3), 1561–1568. https://doi.org/10.29303/jppipa.v8i3.1486
Crossref
Scopus
Google Scholar
Europe PMC

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Abstract

This study aims to determine the validity and reliability of students' conception of chemistry learning instruments during the Covid-19 pandemic using Rasch modeling. The developed instrument consists of 24 items tested on 150 students from 3 selected schools classes X, XI, and XII MIPA State Senior High School in Tuban Regency for the 2021/2022 academic year. Two experts tested the content validity of the instrument while the construct validity and item reliability used the Rasch model with Winsteps Rasch software version 3.73. The analysis of the Rasch model used is in the form of item and person separation and reliability, correlation and point measure, Item fit, item rating scale functionality and unidimensionality. The results obtained indicate that the conceptual instrument for chemistry learning that has been developed is valid and reliable. However, the COLS4, COLS6, and COLS11 items are invalid and should be revised or removed

References

Anugrahana, A. (2020). Hambatan, solusi dan harapan: Pembelajaran daring selama masa pandemi covid-19 oleh guru sekolah dasar. Scholaria: Jurnal Pendidikan Dan Kebudayaan, 10(3), 282–289. https://doi.org/10.24246/j.js.2020.v10.i3.p282-289

Beerenwinkel, A., Parchmann, I., & Gräsel, C. (2011). Conceptual change texts in chemistry teaching: A study on the particle model of matter. International Journal of Science and Mathematics Education, 9(5), 1235–1259. https://doi.org/10.1007/s10763-010-9257-9

Bradley, J. D., & Mosimege, M. D. (1998). Misconceptions in acids and bases: A comparative study of student teachers with different chemistry backgrounds. South African Journal of Chemistry, 51(3), 137–143. https://doi.org/10.1016/j.sbspro.2010.03.384

Bond, T. G., & Fox, C. (2015). Applying the Rasch model fundamental measurement in the human sciences (3rd ed.). New York, NY: Routledge

Boone, W. J., Staver, J. R., & Yale, M.S. (2014). Rasch analysis in the human sciences. Dordrecht, The Netherlands: Springer.

Cano, F. (2005). Epistemological beliefs and approaches to learning: their change through

secondary school and their influence on academic performance. British Journal of

Educational Psychology, 75, 203–221.https://doi.org/10.1348/000709904x22683

Dart, B. C., Burnett, P. C., Purdie, N., Boulton-Lewis, G., Campbell, J., & Smith, D. (2000). Students’ conceptions of learning, the classroom environment, and approaches to learning. Journal of Educational Research, 93(4), 262–270. https://doi.org/10.1080/00220670009598715

Fan, L., & Bokhove, C. (2014). Rethinking the role of algorithms in school mathematics: A

conceptual model with focus on cognitive development. ZDM Mathematics Education, 46(3), 481–492. https://doi.org/10.1007/s1185 8-014-0590-2

Fisher, W.P., Jr. (2007). Rating scale instrument quality criteria. Rasch Measurement Transsactions, 21 (1). 1095.

Fox, C. M., & Jones, J.A (1998). Uses of Rasch modeling modeling in counseling psychology research. Journal of Counseling Psychology, 45 (1), 30. https://doi.org./10.1037/0022-0167.45.1.30

Garnett, P. J., Garnett, P. J., & Hackling, M. W. (1995). Students’ alternative conceptions in chemistry: A review of research and implications for teaching and learning. Studies in Science Education, 25(1), 69–96. https://doi.org/10.1080/03057269508560050

Hofer, B.K. and Pintrich, P.R. (1997). The development of epistemological theories:

beliefs about knowledge and knowing and their relation to learning. Review of

Educational Research, 67, 88–140. http://dx.doi.org/10.3102/00346543067001088

İlhan, M., & Güler, N. (2017). Testing the agreement between ability estimations made through classical test theory and the ones made through Rasch analysis in likert type scales. Ege Journal of Education, 18(1), 244-265. https://doi:10.12984/egeefd.289576

Johnstone, A. H. (2000). the Practice of Chemistry Education (Invited Contribution*). Chemistry Education: Research and Practice in Europe Educ. Res. Pract. Eur, 1(1), 9–15. https://doi.org/10.1039/A9RP90001B

Kizilaslan, A. (2013). KİMEği̇ti̇mÖğrenci̇leri̇ni̇n Sorgulamaya Dayali Öğrenmeİli̇şki̇nGörüşleri̇. The Journal of Academic Social Sciences, 1(1), 12–12. https://doi.org/10.16992/asos.5

Li, W. T., Liang, J. C., & Tsai, C. C. (2013). Relational analysis of college chemistry-major students’ conceptions of and approaches to learning chemistry. Chemistry Education Research and Practice, 14(4), 555–565. https://doi.org/10.1039/c3rp00034f

Lin, C., Liang, J. C., & Tsai, C. C. (2012). The Relationships Between Epistemic Beliefs in Biology and Approaches to Learning Biology Among Biology-Major University Students in Taiwan. Journal of Science Education and Technology, 21(6), 796–807. https://doi.org/10.1007/s10956-012-9367-y

Linarce, J.M. (2018). A user's guide to Winstep mini step

Rasch-Model computer programs. Beaverton, OR:

Winsteps

Linacre, J. M. (1999). Investigating rating scale category

utility. Journal of Outcome Measurement, 3, 103-122.

Linacre, J.M. (2011). Winsteps® (Versi 3.71.0.1) [Computer Software]. Beaverton, OR: Winsteps.com.

Marton, F., & Booth, S. (1997). Learning and awareness.

Lawrence Erlbaum.

Marton, F. M., Dall’ Alba, G., & Beaty, E. (1993). Conceptions of learning. International Journal of Educational Research, 19, 277–300.

Meidawati, S. A. N. B. R. (2019). Persepsi Siswa Dalam Studi Pengaruh Daring Learning Terhadap Minat Belajar Ipa. SCAFFOLDING: Jurnal Pendidikan Islam Dan Multikulturalisme, 1(2), 30–38. https://doi.org/10.37680/scaffolding.v1i2.117

Nakhleh, M. B. (1992). Why some students don’t learn chemistry: Chemical misconceptions. Journal of Chemical Education, 69(3), 191–196. https://doi.org/10.1021/ed069p191

Negovan, V., Sterian, M., & Colesniuc, G. (2015). Conceptions of learning and intrinsic motivation in different learning environments. Procedia - Social and Behavioral Sciences, 187, 642–646. https://doi.org/10.1016/j.sbspro.2015.03.119.

Pérez-Tello, S., Antonietti, A., Liverta Sempio, O., Marchetti, A. (2005). Che cos’è l’apprendimento? Le concezioni degli studenti. [Translated title: What does learning mean? Students’ conceptions]. Rome: Carocci. http://hdl.handle.net/10807/8242

Periantalo, J. (2015). Penyusunan Skala Psikologi: Asyik, Mudah & Bermanfaat.Yogyakarta: Pustaka Pelajar.

Peterson, E. R., Brown, G. T. L., & Irving, S. E. (2010). Secondary school students’ conceptions of learning and their relationship to achievement. Learning and Individual Differences, 20, 167–176. https://doi.org/10.1016/j.lindif.2009.12.004

Renner, J. W., Abraham, M. R., Grzybowski, E. B., & Marek, E. A. (1990). Understandings and misunderstandings of eighth graders of four physics concepts found in textbooks. Journal of Research in Science Teaching, 27(1), 35–54. https://doi.org/10.1002/tea.3660270105

Rogers, F., Huddle, P. A., & White, M. D. (2000). Using a Teaching Model to Correct Known Misconceptions in Electrochemistry. Journal of Chemical Education, 77(1), 104. https://doi.org/10.1021/ed077p104

Rosli, R., Abdullah, M., Siregar, N. C., Shazana, N., Hamid, A., Abdullah, S., Halim, L., Daud, N. M., Bahari, S. A., Majid, R. A., & Bais, B. (2020). Student Awareness of Space Science : Rasch Model Analysis for Validity and Reliability. 10(3), 170–177. https://doi.org/10.5430/wje.v10n3p170

Sadikin, A., & Hamidah, A. (2020). Pembelajaran Daring di Tengah Wabah Covid-19. Biodik, 6(2), 109–119. https://doi.org/10.22437/bio.v6i2.9759

Säljö, R. (1979). Learning in the learner’s perspective. I: Some commonsense conceptions (Report No.76). Gothenburg, Sweden: University of Gothenburg.

Schommer, M. (1998). The influence of age and education on epistemological beliefs. British Journal of Educational Psychology, 68, 551–562. https://doi.org/10.1111/j.2044-8279.1998.tb01311.x

Shadreck, Mandina., Enunuwe. O.C (2017). Probelem Solving Intruction for Overcoming

Students' Difficulties in Stoichiometric Problems: S Trategies and S Elf -Regulated Earning. Acta Didactica Napocensia, 4(1), 21–30.

Sinatra, G.M. (2001). Knowledge, beliefs, and learning. Educational Psychology Review, 13, 321–323.

Suyono, S. (2020). Miskonsepsi kimia, sebuah misteri. J-PEK (Jurnal Pembelajaran Kimia), 5(1), 1–7.

https://doi.org/10.17977/um026v5i12020p001

Tabatabaee-Yazdi, M., Motallebzadeh, K., Ashraf, H., & Baghaei, P. (2018). Development and validation

of a teacher success questionnaire using the rasch model. International Journal of Instruction, 11(2),

–144.https://doi.org/10.12973/iji.2018.11210a

Tsai, C. C. (2004). Conceptions of learning science among high school students in Taiwan: A phenomenographic analysis. International Journal of Science Education, 26(14), 1733–1750. https://doi.org/10.1080/0950069042000230776

Tsai, C.-C., Ho, H. N. J., Liang, J.-C., & Lin, H.-M. (2011). Scientific epistemic beliefs, conceptions of learning science and self-efficacy of learning science among high school students. Learning and Instruction, 21, 757–769.

Tsai, R.H., Liu, C.Q., Maltese, A.V., & Fan, X. (2006). Planning early for careers in science. Science, 312, 1143–1144.

Ãœce, M., & Ceyhan, Ä°. (2019). Misconception in Chemistry Education and Practices to Eliminate Them: Literature Analysis. Journal of Education and Training Studies, 7(3), 202. https://doi.org/10.11114/jets.v7i3.3990

Yunitasari, R., & Hanifah, U. (2020). Pengaruh Pembelajaran Daring terhadap Minat

Belajar Siswa pada Masa COVID 19. Edukatif : Jurnal Ilmu Pendidikan, 2(3), 232–243. https://doi.org/10.31004/edukatif.v2i3.142

Vermunt, J. D. (1998). The regulation of constructive learning processes. British Journal of Educational Psychology, 68, 149–171. https://doi.org/10.1111/j.20448279.1998.tb01281.x

Vermunt, J. D. (2005). Relations between student learning patterns and personal and contextual factors and academic performance. Higher Education, 49, 205–234. https://doi.org/10.1007/s10734-004-6664-2

Vermunt, J. D., & Vermetten, Y. J. (2004). Patterns in student learning: relationships between learning strategies, conceptions of learning, and learning orientations. Educational Psychology Review, 16, 359–384. https://doi.org/10.1007/s10648-004-0005-y.

Zheng, L., Dong, Y., Huang, R., Chang, C. Y., & Bhagat, K. K. (2018). Investigating the interrelationships among conceptions of, approaches to, and self-efficacy in learning science. International Journal of Science Education, 40(2), 139–158. https://doi.org/10.1080/09500693.2017.1402142

Wong, S. Y., Liang, J. C., & Tsai, C. C. (2019). Uncovering Malaysian Secondary School Students’ Academic Hardiness in Science, Conceptions of Learning Science, and Science Learning Self-Efficacy: a Structural Equation Modelling Analysis. Research in Science Education. https://doi.org/10.1007/s11165-019-09908-7

Wilmskoetter, J., Bonilha, H., Hong, I., Hazelwood, R. J., Martin-Harris, B., & Velozo, C. (2019). Construct validity of the Eating Assessment Tool (EAT-10). Disability and Rehabilitation, 41(5), 549–559. https://doi.org/10.1080/09638288.2017.1398787

Author Biographies

Alusti Cundo Manik, Universitas Negeri Yogyakarta

Hari Sutrisno, Yogyakarta State University

Ifan Rivaldo, Yogyakarta State University

License

Copyright (c) 2022 Alusti Cundo Manik, Hari Sutrisno, Ifan Rivaldo

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).