Systematic Review of Educational Level and Evaluation Tools for Computational Thinking Skill

Authors

Fanny Rahmatina Rahim , Ari Widodo , Andi Suhandi , Minsu Ha

DOI:

10.29303/jppipa.v10i2.5209

Published:

2024-02-28

Issue:

Vol. 10 No. 2 (2024): February

Keywords:

Assessment, Computational thinking, Evaluation tools, Educational level, SLR

Review

Downloads

How to Cite

Rahim, F. R., Widodo, A. ., Suhandi, A. ., & Ha, M. . (2024). Systematic Review of Educational Level and Evaluation Tools for Computational Thinking Skill. Jurnal Penelitian Pendidikan IPA, 10(2), 54–61. https://doi.org/10.29303/jppipa.v10i2.5209
Crossref
Scopus
Google Scholar
Europe PMC

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Abstract

The primary aim of this research was to conduct a systematic review on the assessment of computational thinking skills. The employed research method involved a thorough exploration of diverse databases through Google Scholar, employing the keyword "computational thinking" to retrieve pertinent articles. A total of 96 articles were chosen as research samples and subjected to analysis using content analysis techniques to scrutinize education level and evaluation tools variables. The research revealed that the education level variable was classified into four tiers: elementary school (26.17%), junior high school (29.91%), senior high school (19.63%), and college (24.30%). Simultaneously, the evaluation tool variable was categorized into four segments, comprising traditional tools (22.73%), portfolios (33.33%), interviews (15.91%), and surveys (28.03%). Computational thinking (CT) is predominantly assessed among children due to their developmental stage, fostering receptiveness to novel concepts. This facilitates the teaching of fundamental CT principles, such as programming basics, logic, and algorithms. Regarding evaluation tools, portfolios are frequently employed to assess CT as they can depict a student's proficiency in solving intricate problems, showcasing evidence of their work and completed projects for a more holistic assessment

References

Akhsan, H., Putra, G. S., Wiyono, K., Romadoni, M., & Furqon, M. (2023). Development of A STEM-Based Introduction to Quantum Physics Module on the Sub-Subject of Potential Variations in the Physics Education Study Program. Jurnal Penelitian Pendidikan IPA, 9(9), 7408–7412. https://doi.org/10.29303/jppipa.v9i9.3577

Alvianita, C., Tanti, T., & Hariyadi, B. (2022). Construction and Validation of Evaluation Instruments for Science Learning Programs Based on Context, Input, Process, And Product (CIPP) Models. Jurnal Penelitian Pendidikan IPA, 8(3), 1089–1095. https://doi.org/10.29303/jppipa.v8i3.1369

Bower, M., Wood, L. N., Lai, J. W. M., Highfield, K., & ... (2017). Improving the computational thinking pedagogical capabilities of school teachers. Australian Journal of Teacher Education, 42(3), 53–72. https://doi.org/10.3316/aeipt.215475

Chen, G. (2018). Programming Language Teaching Model Based on Computational Thinking and Problem-based Learning. Proceedings of the 2017 2nd International Seminar on Education Innovation and Economic Management (SEIEM 2017), 128-131. https://doi.org/10.2991/seiem-17.2018.31

Chen, G., Shen, J., Barth-Cohen, L., Jiang, S., Huang, X., & Eltoukhy, M. (2017). Assessing elementary students’ computational thinking in everyday reasoning and robotics programming. Computers & Education, 109, 162–175. https://doi.org/10.1016/j.compedu.2017.03.001

Chen, P., Yang, D., Metwally, A. H. S., Lavonen, J., & Wang, X. (2023). Fostering computational thinking through unplugged activities: A systematic literature review and meta-analysis. In International Journal of STEM Education, 10(1). https://doi.org/10.1186/s40594-023-00434-7

Council, N. R. (2010). Report of a workshop on the scope and nature of computational thinking. National Academies Press.

Council, N. R. (2011). Report of a workshop on the pedagogical aspects of computational thinking. National Academies Press.

CSTA, & ISTE. (2011). Operational definition of computational thinking. Report.

Fauza, N., Ernidawati, E., Zulhelmi, Z., Rahim, F. R., Riwandi, F. O., Latif, A. A., & Mathluba, K. (2023). Microcontroller-Based Mechanics Experiments in Physics Learning: Systematic Literature Review Using PRISMA. Jurnal Penelitian Pendidikan IPA, 9(9), 558–568. https://doi.org/10.29303/jppipa.v9i9.5258

Fields, D., Lui, D., Kafai, Y., Jayathirtha, G., & ... (2021). Communicating about computational thinking: understanding affordances of portfolios for assessing high school students’ computational thinking and participation practices. Computer Science Education, 31(2), 224–258. https://doi.org/10.1080/08993408.2020.1866933

García-Valcárcel-Muñoz-Repiso, A., & Caballero-González, Y.-A. (2019). Robotics to develop computational thinking in early Childhood Education. Comunicar, 27(59), 63–72. https://doi.org/10.3916/C59-2019-06

Garneli, V., & Chorianopoulos, K. (2018). Programming video games and simulations in science education: exploring computational thinking through code analysis. Interactive Learning Environments, 26(3), 386-401. https://doi.org/10.1080/10494820.2017.1337036

González, M. R. (2015). Computational thinking test: Design guidelines and content validation. EDULEARN15 Proceedings, 2436-2444. https://doi.org/10.13140/RG.2.1.4203.4329

Grover, S. (2017a). A framework for using hypothesis-driven approaches to support data-driven learning analytics in measuring computational thinking in block-based programming environments. ACM Transactions on Computing Education, 17(3), 1–25. https://doi.org/10.1145/3105910

Grover, S. (2017b). Assessing algorithmic and computational thinking in K-12: Lessons from a middle school classroom. Emerging Research, Practice, and Policy on Computational Thinking, 269–288. https://doi.org/10.1007/978-3-319-52691-1_17

Grover, S., & Pea, R. (2013). Computational thinking in K–12: A review of the state of the field. Educational Researcher, 42(1), 38-43. https://doi.org/10.3102/0013189X12463051

Gülbahar, Y., Kert, S. B., & Kalelioğlu, F. (2018). The Self-Efficacy Perception Scale for Computational Thinking Skill: Validity and Reliability Study. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 10(1), 1–29. https://doi.org/10.16949/turkbilmat.385097

Handayani, R. D., Prastowo, S. H. B., Prihandono, T., Nuraini, L., Supriadi, B., Maryani, M., Bektiarso, S., Lesmono, A. D. L., & Mahardika, I. K. (2022). Computational Thinking: Students’ Abstraction on the Concepts of Kinematics. Jurnal Penelitian Pendidikan IPA, 8(1). https://doi.org/10.29303/jppipa.v8i1.1188

Hanidar, E., Afifi, N., Hastuti, T. W., & Nisa, D. C. (2023). Computational Thinking Skills to Solve Kinematics Problems at High Cognitive Level Cases. Jurnal Penelitian Pendidikan IPA, 9(12), 10955–10964. https://doi.org/10.29303/jppipa.v9i12.5775

Henderson, P. B., Cortina, T. J., & Wing, J. M. (2007). Computational thinking. Proceedings of the 38th SIGCSE Technical Symposium on Computer Science Education, 195–196. https://doi.org/10.1145/1227310.1227378

Hsu, T. C., Chang, S. C., & Hung, Y. T. (2018). How to learn and how to teach computational thinking: Suggestions based on a review of the literature. Computers & Education, 126, 296–310. https://doi.org/10.1016/J.COMPEDU.2018.07.004

Juita, Z., Sundari, P. D., Sari, S. Y., & Rahim, F. R. (2023). Identification of Physics Misconceptions Using Five-tier Diagnostic Test: Newton’s Law of Gravitation Context. Jurnal Penelitian Pendidikan IPA, 9(8). https://doi.org/10.29303/jppipa.v9i8.3147

Kalelioglu, F., Gulbahar, Y., & Kukul, V. (2016). A framework for computational thinking based on a systematic research review. In Baltic J. Modern Computing. Retrieved from http://acikerisim.baskent.edu.tr/handle/11727/3831

Litts, B. K., Lewis, W. E., & Mortensen, C. K. (2020). Engaging youth in computational thinking practices through designing place-based mobile games about local issues. Interactive Learning Environments, 28(3). https://doi.org/10.1080/10494820.2019.1674883

Lockwood, J., & Mooney, A. (2018). Developing a computational thinking test using Bebras problems. Maynooth University. Retrieved from http://mural.maynoothuniversity.ie/10316

Lui, D. (2020). Communicating computational concepts and practices within high school students’ portfolios of making electronic textiles. Interactive Learning Environments, 28(3), 284–301. https://doi.org/10.1080/10494820.2019.1612446

McMillan, J. H. (2011). Classroom assessment : principles and practice for effective standards-based instruction. In Pearson Education.

Moreno-León, J. (2017). On the automatic assessment of computational thinking skills: A comparison with human experts. In Conference on Human Factors in Computing Systems - Proceedings, 2788–2795. https://doi.org/10.1145/3027063.3053216

Novatania, D. W., & Kamaludin, A. (2021). Development of High Order Thinking Skills (HOTS) Test Instruments on Thermochemistry Topics. JTK (Jurnal Tadris Kimiya), 6(2), 174–184. https://doi.org/10.15575/jtk.v6i2.12746

Relkin, E. (2021). Learning to code and the acquisition of computational thinking by young children. Computers and Education, 169. https://doi.org/10.1016/j.compedu.2021.104222

Rich, K. M., Spaepen, E., Strickland, C., & Moran, C. (2020). Synergies and differences in mathematical and computational thinking: implications for integrated instruction. Interactive Learning Environments, 28(3), 272–283. https://doi.org/10.1080/10494820.2019.1612445

Ridlo, Z. R., Supeno, S., Wahyuni, S., Wicaksono, I., & Ulfa, E. M. (2022). Analysis of Implementation Project-Based Learning Model of Teaching Integrated with Computer Programming in Improving Computational Thinking Skills in a Classical Mechanics Course. Jurnal Penelitian Pendidikan IPA, 8(4), 1734–1742. https://doi.org/10.29303/jppipa.v8i4.1789

Riva, E., Freeman, R., Schrock, L., Jelicic, V., Ozer, C.-T., & Caleb, R. (2020). Student Wellbeing in the Teaching and Learning Environment: A Study Exploring Student and Staff Perspectives. Higher Education Studies, 10(4), 103. https://doi.org/10.5539/hes.v10n4p103

Sáez-López, J. M., Román-González, M., & Vázquez-Cano, E. (2016). Visual programming languages integrated across the curriculum in elementary school: A two year case study using “scratch†in five schools. Computers and Education, 97, 129–141. https://doi.org/10.1016/j.compedu.2016.03.003

Shell, D. F., & Soh, L. K. (2013). Profiles of Motivated Self-Regulation in College Computer Science Courses: Differences in Major versus Required Non-Major Courses. Journal of Science Education and Technology, 22(6), 899–913. https://doi.org/10.1007/s10956-013-9437-9

Sholihah, U., & Firdaus, A. I. (2023). Student’s Computational Thinking Ability in Solving Trigonometry Problems in the Review of Self-Regulated Learning. Jurnal Penelitian Pendidikan IPA, 9(2), 626–633. https://doi.org/10.29303/jppipa.v9i2.2821

Su, J., & Zhong, Y. (2022). Artificial Intelligence (AI) in early childhood education: Curriculum design and future directions. Computers and Education: Artificial Intelligence, 3, 100072. https://doi.org/10.1016/j.caeai.2022.100072

Sulsilah, H., Hidayat, A., & Ramalis, T. R. (2023). Analysis of Computational Thinking Instrument for High School Student Using Rasch Model. Jurnal Penelitian Pendidikan IPA, 9(3), 1445–1450. https://doi.org/10.29303/jppipa.v9i3.2771

Surbakti, D. K. B., Hidayat, T., Purwianingsih, W., Widodo, A., & Supriatno, B. (2023). Analysis of Biology Teacher’s Computational Thinking Skills in Environmental Learning. Jurnal Penelitian Pendidikan IPA, 9(5), 2604–2612. https://doi.org/10.29303/jppipa.v9i5.3411

Tang, X. (2020). Assessing computational thinking: A systematic review of empirical studies. Computers and Education, 148, 103798. https://doi.org/10.1016/j.compedu.2019.103798

Taupik, R. P., & Fitria, Y. (2023). Learning Motivation and Computational Thinking Ability of Elementary School Students in Learning Science. Jurnal Penelitian Pendidikan IPA, 9(9), 7665–7671. https://doi.org/10.29303/jppipa.v9i9.4826

Teo, T. W., Tan, A. L., Ong, Y. S., & Choy, B. H. (2021). Centricities of STEM curriculum frameworks: Variations of the S-T-E-M Quartet. STEM Education, 1(3), 141–156. https://doi.org/10.3934/steme.2021011

Weintrop, D. (2014). Interactive Assessment Tools for Computational Thinking in High School STEM Classrooms. In Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, 136, 22–25. https://doi.org/10.1007/978-3-319-08189-2_3

Weintrop, D., Beheshti, E., Horn, M., Orton, K., Jona, K., Trouille, L., & Wilensky, U. (2016). Defining Computational Thinking for Mathematics and Science Classrooms. Journal of Science Education and Technology, 25(1), 127–147. https://doi.org/10.1007/s10956-015-9581-5

Wing, J. M. (2006). Computational thinking. Communications of the ACM, 49(3), 33-35. https://doi.org/10.1145/1118178.1118215

Wing, J. M. (2008). Computational thinking and thinking about computing. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 366(1881), 3717–3725. https://doi.org/10.1098/rsta.2008.0118

Wong, G. K. W., & Cheung, H. Y. (2020). Exploring children’s perceptions of developing twenty-first century skills through computational thinking and programming. Interactive Learning Environments, 28(4), 438–450. https://doi.org/10.1080/10494820.2018.1534245

Yadav, A., Mayfield, C., Zhou, N., Hambrusch, S., & Korb, J. T. (2014). Computational thinking in elementary and secondary teacher education. ACM Transactions on Computing Education, 14(1), 1–16. https://doi.org/10.1145/2576872

Zeevaarders, A., & Aivaloglou, E. (2021). Exploring the programming concepts practiced by scratch users: An analysis of project repositories. IEEE Global Engineering Education Conference, EDUCON, 1287-1295. https://doi.org/10.1109/EDUCON46332.2021.9453973

Zhang, L. C., & Nouri, J. (2019). A systematic review of learning computational thinking through Scratch in K-9. Computers and Education, 141. https://doi.org/10.1016/j.compedu.2019.103607

Author Biographies

Fanny Rahmatina Rahim, Universitas Negeri Padang

Ari Widodo, Universitas Pendidikan Indonesia

Andi Suhandi, Universitas Pendidikan Indonesia

Minsu Ha, Seoul National University

License

Copyright (c) 2024 Fanny Rahmatina Rahim

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).