Analysis of Computational Thinking Instrument for High School Student Using Rasch Model
DOI:
10.29303/jppipa.v9i3.2771Published:
2023-03-31Issue:
Vol. 9 No. 3 (2023): MarchKeywords:
Computational thinking instrument, Rasch model, STEM quartetResearch Articles
Downloads
How to Cite
Downloads
Metrics
Abstract
This study is aimed-to construct and analyze the Computational Thinking Instrument at Physics subject using Rasch Measurement Model. The instrument was developed by the researcher to assess students’ computational thinking in Grade Eleventh in high school on heat and transfer topics under STEM Quartet Integrated Learning. The type of the instrument is a multiple choice with multiple-choice reasoning. This test consists of 13 questions to measure five concepts of Computational Thinking which are abstraction, decomposition, algorithm, evaluation, and generalization. The test was tried out on 120 students (87 female and 33 male aged 16-18 years old) in West Java and Banten. The item of the questions on the test was analyzed using Winstep 5.3.2.0. The reliability of the Instrument can be shown at the Cronbach’s alpha, Item Reliability, Person Reliability, Item Separation, and Person Separation. The result shows that Cronbach’s alpha (KR-20) is 0.75 which means the instrument has high reliability. The value of the item reliability is 0.95 and person reliability is 0.72. This means that although the consistency of student in answering questions is sufficient, the instrument has high reliability. The values of the item and person separation are 1.61 and 4.43 which means that the instrument has great separation. The validity of the instrument can be seen in unidimensionality and item fit order. The unidimensionality shows that the value of Raw Variance Explain by Measure is 32.8%, the Unexplained variance 1-5 contrast is below 15% and the eigenvalues are also below 3%. Overall, 8 of 13 items of the test meet 3 criteria of the item fit order, then 5 items have 2 of 3 criteria of the item fit order. We can conclude that this Instrument is reliable and valid. Then, the instrument can be used to measure students’ computational thinking on heat and transfer topics
References
Aksit, O., & Wiebe, E. N. (2020). Exploring Force and Motion Concepts in Middle Grades Using Computational Modeling: a Classroom Intervention Study. Journal of Science Education and Technology, 29(1), 65–82. https://doi.org/10.1007/s10956-019-09800-z
Bond, T. G., & Fox, C. M. (2007). Applying the Rasch Model : Fundamental Measurement in the Human Sciences Second Edition University of Toledo.
Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch Analysis in the Human Sciences.
Dagiene, V., Sentance, S., & Stupuriene, G. (2017). Developing a Two-Dimensional Categorization System for Educational Tasks in Informatics. Informatica (Netherlands), 28(1), 23–44. https://doi.org/10.15388/Informatica.2017.119
Dwyer, H. A., Boe, B., Hill, C., Franklin, D., & Harlow, D. (2013). Computational Thinking for Physics: Programming Models of Physics Phenomenon in Elementary School. In Engelhardt, Churukian, & Jones (Eds.), PERC Proceeding (pp. 133–136). American Association of Physics Teacher. https://doi.org/10.1119/perc.2013.pr.021
Fraenkel, J. R., Wallen, N. E., & Hyun, H. H. (2012). How To Design and Evaluate Research in Education (S. Keifer (ed.); Eigth Edit). McGraw-Hill.
Grover, S., & Pea, R. (2017). Computational thinking: A competency whose time has come. Computer Science Education: Perspectives on Teaching and Learning in School, December, 20–35.
Gustiani, S. (2019). Research and Development (R&D) Method As A Model Design in Educational Research and Its Alternatives. Holistic Journal, 11(2), 12–22. https://jurnal.polsri.ac.id/index.php/holistic/article/view/1849
Handayani, D., Handono, S., Prastowo, B., Prihandono, T., & Nuraini, L. (2022). Computational Thinking : Students ’ Abstraction on the Concepts of Kinematics. Jurnal Penelitian Pendidikan IPA, 8(1), 114–118. https://doi.org/10.29303/jppipa.v8i1.1188
Hutchins, N. M., Biswas, G., Maróti, M., Lédeczi, Ã., Grover, S., Wolf, R., Blair, K. P., Chin, D., Conlin, L., Basu, S., & McElhaney, K. (2019). C2STEM: a System for Synergistic Learning of Physics and Computational Thinking. Journal of Science Education and Technology, 29(1), 83–100. https://doi.org/10.1007/s10956-019-09804-9
Krishnan, S., & Idris, N. (2014). Investigating Reliability and Validity for the Construct of Inferential Statistics. International Journal of Learning, Teaching and Educational Research, 4(1), 51–60. https://ijlter.net/index.php/ijlter/article/download/1198/1204
Li, Y., Schoenfeld, A. H., diSessa, A. A., Graesser, A. C., Benson, L. C., English, L. D., & Duschl, R. A. (2020). Computational Thinking Is More about Thinking than Computing. Journal for STEM Education Research, 3(1), 1–18. https://doi.org/10.1007/s41979-020-00030-2
Mcclelland, K., & Grata, L. (2018). A review of the importance of computational thinking in K-12. The Tenth International Conference on Mobile, Hybrid, and On-Line Learning, c, 32–34. https://rb.gy/tk5z
National Resarch Council. (2013). Next Generation Science Standards: For States, By States. National Academies Press. https://doi.org/10.17226/18290
OECD. (2019). PISA 2018 Assessment and Analytical Framework, PISA. In OECD Publishing. PISA,OECD Publishing. https://doi.org/10.1787/b25efab8-en
Orban, C. M., & Teeling-Smith, R. M. (2020). Computational Thinking in Introductory Physics. The Physics Teacher, 58(4), 247–251. https://doi.org/10.1119/1.5145470
Ridlo, Z. R., Wahyuni, S., Mahardika, I. K., Wicaksono, I., & Marsya, E. (2022). The Analysis of Implementation Project-Based Learning Model of Teaching Integrated with Computer Programming in Improving Computational Thinking Skills in a Classical Mechanics Course. Jurnal Penelitian Pendidikan IPA, 8(4), 1734–1742. https://doi.org/10.29303/jppipa.v8i4.1789
Selby, C., & Woolard, J. (2013). Computational Thinking : The Developing Definition. ITiCSE Conference 2013, 5–8. https://eprints.soton.ac.uk/356481/
Sokolowski, A. (2018). Scientific inquiry in mathematics - Theory and practice: A STEM perspective. In Scientific Inquiry in Mathematics - Theory and Practice: A STEM Perspective (Issue May). Springer International Publishing AG. https://doi.org/10.1007/978-3-319-89524-6
Sumintono, B., & Widhiarso, W. (2014). Aplikasi Model Rasch Untuk Penelitian Ilmu-Ilmu Sosial (B. Trim (ed.)). Trim Komunikata Publishing House.
Tan, A.-L., Teo, T. W., Choy, B. H., & Ong, Y. S. (2019). The S-T-E-M Quartet. Innovation and Education, 1(1), 1–14. https://doi.org/10.1186/s42862-019-0005-x
Tang, X., Yin, Y., Lin, Q., Hadad, R., & Zhai, X. (2020). Assessing computational thinking: A systematic review of empirical studies. Computers and Education, 148(January), 103798. https://doi.org/10.1016/j.compedu.2019.103798
Wing, J. M. (2006). Computational thinking. In Communication of The ACM (Vol. 49, Issue 3, pp. 33–35). https://doi.org/10.1201/b16812-43
Yin, Y., Hadad, R., Tang, X., & Lin, Q. (2020). Improving and Assessing Computational Thinking in Maker Activities: the Integration with Physics and Engineering Learning. Journal of Science Education and Technology, 29(2), 215. https://doi.org/10.1007/s10956-020-09822-y
Zakwandi, R., & Istiyono, E. (2023). A framework for assessing computational thinking skills in the physics classroom : study on cognitive test development. SN Social Sciences. https://doi.org/10.1007/s43545-023-00633-7
Author Biographies
Arif Hidayat, Fakultas Pendidikan Matematika dan Ilmu Pengetahuan Alam, Universitas Pendidikan Indonesia, Kota Bandung, Indonesia.
Taufik Ramlan Ramalis, Fakultas Pendidikan Matematika dan Ilmu Pengetahuan Alam, Universitas Pendidikan Indonesia, Kota Bandung, Indonesia.
License
Copyright (c) 2023 Hani Sulsilah, Arif Hidayat, Taufik Ramlan Ramalis
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
