Analytical Thinking Abilities in Physics Education Students: A Rasch-Based Diagnostic Study
DOI:
10.29303/jppipa.v11i12.13444Published:
2025-12-31Downloads
Abstract
Analytical thinking is essential for physics education students, yet comprehensive assessment remains challenging. This study investigates the distribution and characteristics of analytical thinking abilities using Rasch model analysis, examining gender differences and performance patterns. A cross-sectional study was conducted with 35 physics education students (20 females, 15 males) using a 20-item multiple-choice assessment covering four domains: identifying problems, recognizing relational patterns, identifying reasoning errors, and summarizing main ideas. Data were analyzed using Winsteps software to examine person abilities and group comparisons. Results revealed highly variable analytical thinking abilities (range = 8.84 logits, M = -0.15, SD = 1.79). Males outperformed females by 0.46 logits (males: M = 0.15; females: M = -0.31), though not statistically significant (p > 0.05). Three performance levels emerged: high achievers (25.7%, n = 9), average achievers (48.6%, n = 17), and low achievers (25.7%, n = 9). The findings reveal significant heterogeneity in analytical thinking abilities with observable gender-based differences. Results suggest the need for differentiated instructional approaches tailored to varying ability levels and targeted interventions to support struggling students. This study demonstrates the utility of Rasch analysis in identifying areas for instructional improvement and optimizing analytical thinking development in physics education contexts
Keywords:
Analytical thinking Physics education Rasch model Student ability Gender differenceReferences
Adawiyah, R., E. Istiyono, I. Wilujeng, and S. Hardiyanti. 2020. “Development of an Instrument Measuring the Multi Representation Ability of Senior High School Students.” in Journal of Physics: Conference Series. Vol. 1440, edited by W. A., P. null, A. N.A., and D. M.I.B.M. Physics Education, Universitas Negeri Yogyakarta, Sleman, Indonesia: Institute of Physics Publishing. DOI: https://doi.org/10.1088/1742-6596/1440/1/012028
Altıntaş, Özge, and Ömer Kutlu. 2020. “Investigating Measurement Invariance of Ankara University Foreign Students Selection Test According to Latent Class and Rasch Model.” Egitim ve Bilim 45(203):287–308. doi:10.15390/EB.2020.8685. DOI: https://doi.org/10.15390/EB.2020.8685
Anthonysamy, Lilian, Poovilashini Sugendran, Lim Ooi Wei, and Teoh Sian Hoon. 2024. “An Improved Metacognitive Competency Framework to Inculcate Analytical Thinking among University Students.” Education and Information Technologies 29(17):22475–97. doi:10.1007/s10639-024-12678-z. DOI: https://doi.org/10.1007/s10639-024-12678-z
Anyafulude, Joy Chinelo. 2013. “Effects of Problem-Based and Discovery-Based Instructional Strategies on Students’ Academic Achievement in Chemistry.” Journal of Educational and Social Research 3(6):105–12. doi:10.5901/jesr.2013.v3n6p105. DOI: https://doi.org/10.5901/jesr.2013.v3n6p105
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). New York, NY: Routledge. DOI: https://doi.org/10.4324/9781315814698
Brookhart, Susan M. 2010. “How to Assess Higher-Order Thinking Skills in Your Classroom.” Ascd 159.
Çoksan, Sami, and Aysenur Didem Yilmaz. 2024. “Focusing on Fake News’ Contents: The Association between Ingroup Identification, Perceived Outgroup Threat, Analytical-Intuitive Thinking and Detecting Fake News.” Analyses of Social Issues and Public Policy 24(1):102–32. doi:10.1111/asap.12371. DOI: https://doi.org/10.1111/asap.12371
Creswell, John W., and J. David Creswell. 2018.“Research Design: Qualitative, Quantitative, and Mixed Methods Approaches - John W. Creswell, J. David Creswell - Google Books.” https://books.google.co.id/books?hl=en&lr=&id=335ZDwAAQBAJ&oi=fnd&pg=PT16&dq=.+Creswell,+J.+W.+(2014)+Research+Design:+Qualitative,+Quantitative,+and+Mixed+Methods+Approaches&ots=YExQLJrvuK&sig=tmrcZzcfQLgDJTmVMsf7BeVtSw0&redir_esc=y#v=onepage&q=. Creswel.
Demir, Engin. 2022. “An Examination of High School Students’ Critical Thinking Dispositions and Analytical Thinking Skills.” Journal of Pedagogical Research 6(4):190–200. doi:10.33902/JPR.202217357. DOI: https://doi.org/10.33902/JPR.202217357
Dewi, Sartika Sari, Andi Muhammad Irfan Taufan Asfar, Andi Muhamad Iqbal Akbar Asfar, and Andi Nurannisa. 2024. “Traditional Game Strategy Bugis Ma’benteng Integrated 4C Skills in Improving Analytical Thinking Ability.” in AIP Conference Proceedings. Vol. 2987, edited by T. J.T., J. I., and L. M.S. Department of Educational Technology, University Muhammadiyah Bone, Abu Dg Pasolong St., Sulawesi Selatan, Watampone, 92713, Indonesia: American Institute of Physics.
Early, Spencer, Seyedmohammadmahdi Mirhoseini, Nour El Shamy, and Khaled Hassanein. 2020. “Relying on System 1 Thinking Leaves You Susceptible to the Peril of Misinformation.” Pp. 42–48 in Lecture Notes in Information Systems and Organisation. Vol. 43, edited by D. F.D., R. R., vom B. J., L. P., R. A.B., and F. T. DeGroote School of Business, McMaster University, Hamilton, Canada: Springer Science and Business Media Deutschland GmbH. DOI: https://doi.org/10.1007/978-3-030-60073-0_5
Fitriani, Fitriani, and Wirawan Fadly. 2022. “Level Analysis and Supporting Factors of Thinking Ability Analytical in Solving Problem Based Problems Reviewed From the Learning Styles of Students.” INSECTA: Integrative Science Education and Teaching Activity Journal 3(2):194–204. doi:10.21154/insecta.v3i2.5318. DOI: https://doi.org/10.21154/insecta.v3i2.5318
Greenholts, Moshe, and Igor M. Verner. 2020. “Fostering Students’ Analytical Thinking and Applied Mathematical Skill through 3D Design and Printing.” Pp. 563–67 in IEEE Global Engineering Education Conference, EDUCON. Vols. 2020-April, edited by C. A., A. G.R., and R. T. Technion - Israel Institute of Technology, Faculty of Education in Science and Technology, Haifa, Israel: IEEE Computer Society. DOI: https://doi.org/10.1109/EDUCON45650.2020.9125384
Hajkowicz, Stefan, Conrad Sanderson, Sarvnaz Karimi, Alexandra Bratanova, and Claire Naughtin. 2023. “Artificial Intelligence Adoption in the Physical Sciences, Natural Sciences, Life Sciences, Social Sciences and the Arts and Humanities: A Bibliometric Analysis of Research Publications from 1960-2021.” Technology in Society 74. doi:10.1016/j.techsoc.2023.102260. DOI: https://doi.org/10.1016/j.techsoc.2023.102260
Hidayat, Riyan, Irham Nugroho, Zamzami Zainuddin, and Tony Anak Ingai. 2024. “A Systematic Review of Analytical Thinking Skills in STEM Education Settings.” Information and Learning Science 125(7–8):565–86. doi:10.1108/ILS-06-2023-0070. DOI: https://doi.org/10.1108/ILS-06-2023-0070
Hong, Bright. 2022. “Initial Task Engagement: Unlocking the Value of Fit and Non-Fit to Improve Audit Judgments.” Accounting Review 97(6):327–56. doi:10.2308/TAR-2019-0607. DOI: https://doi.org/10.2308/TAR-2019-0607
Irdalisa, Irdalisa, Paidi Paidi, Rashmi Ranjan Panigrahi, and Erlia Hanum. 2024. “Project-Based Learning on STEAM-Based Student’s Worksheet with Ecoprint Technique: Effects on Student Scientific Reasoning and Creativity.” Jurnal Inovasi Pendidikan IPA 10(2):222–36. doi:10.21831/JIPI.V10I2.77676. DOI: https://doi.org/10.21831/jipi.v10i2.77676
Karla, Divya, Vijay Kumar Pandey, Prachi Rastogi, and Sunil Kumar. 2022. “A Comprehensive Review on Significance of Problem-Solving Abilities in Workplace.” World Journal of English Language 12(3):88–95. doi:10.5430/wjel.v12n3p88. DOI: https://doi.org/10.5430/wjel.v12n3p88
Kocaman, Berrak. 2023. “The Effect of Coding Education on Analytical Thinking of Gifted Students.” International Journal of Educational Methodology 9(1):95–106. doi:10.12973/ijem.9.1.95. DOI: https://doi.org/10.12973/ijem.9.1.95
Kurrer, Karl Eugen. 2016. “Analytisches Denken und spielerische Baustatik: 20 Jahre Weihnachtspreisaufgabe in „Stahlbau“.” Stahlbau 85(4):241–241. doi:10.1002/STAB.201690051. DOI: https://doi.org/10.1002/stab.201690051
Levin, Laura, and Igor M. Verner. 2020. “Fostering Students’ Analytical Thinking and Applied Mathematical Skills through 3D Design and Printing.” Pp. 145–49 in IEEE Global Engineering Education Conference, EDUCON. Vols. 2020-April, edited by C. A., A. G.R., and R. T. Technion - Israel Institute of Technology, Faculty of Education in Science and Technology, Haifa, Israel: IEEE Computer Society. DOI: https://doi.org/10.1109/EDUCON45650.2020.9125358
Lombardi, Doug. 2023. “On the Horizon: The Promise and Power of Higher Order, Critical, and Critical Analytical Thinking.” Educational Psychology Review 35(2). doi:10.1007/s10648-023-09763-z. DOI: https://doi.org/10.1007/s10648-023-09763-z
Maqruf, Agus, Tatang Herman, Lathiful Anwar, Agung Wicaksono, and Dwi Warli. 2024. “Students’ Analytical Thinking Process in Solving Sets Problems in Terms of The Characteristics of Pseudo Thinking.” Acta Scientiae 26(4):1–24. doi:10.17648/acta.scientiae.8099. DOI: https://doi.org/10.17648/acta.scientiae.8099
Marín-Marín, José Antonio, Antonio José Moreno-Guerrero, Pablo Dúo-Terrón, and Jesús López-Belmonte. 2021. “STEAM in Education: A Bibliometric Analysis of Performance and Co-Words in Web of Science.” International Journal of STEM Education 8(1). DOI: https://doi.org/10.1186/s40594-021-00296-x
Marisda, Dewi Hikmah, Nurlina Nurlina, Ma’Ruf Ma’ruf, Rahmawati Rahmawati, Reski Idamayanti, and Muhammad Akbar. 2024. “Challenges in Secondary School Education: Profile of Physics Students’ Critical Thinking Skills.” Journal of Education and Learning 18(3):1099–1106. doi:10.11591/edulearn.v18i3.21666. DOI: https://doi.org/10.11591/edulearn.v18i3.21666
Mohareb, Triza William Azmy, and Samah Nimer Al Khraisha. 2025. “The Effectiveness of Blackboard Wikis and the KWL Strategy in Promoting Analytical, Creative Thinking and Academic Success in Higher Education.” Smart Learning Environments 12(1). doi:10.1186/s40561-025-00397-y. DOI: https://doi.org/10.1186/s40561-025-00397-y
Nieto-Jalil, José M., Jorge Lozano-Aponte, and Julian Alejandro Yunes Rojas. 2024. “Revolutionizing Chemistry in the Classroom: A University Educational Experience with the Power of MATLAB.” in IEEE Global Engineering Education Conference, EDUCON. Tecnologico de Monterrey, School of Engineering and Sciences, Puebla, Mexico: IEEE Computer Society. DOI: https://doi.org/10.1109/EDUCON60312.2024.10578604
Noris, M., Sajidan Sajidan, Sulistyo Saputro, and Sri Yamtinah. 2025. “Effectiveness of Innovator’s Disruptive-Based Socioscientific Learning (Innova-DB2SL) to Improve Analytical Thinking and Entrepreneurial Skills.” International Journal of Innovative Research and Scientific Studies 8(3):2512–21. doi:10.53894/ijirss.v8i3.7043. DOI: https://doi.org/10.53894/ijirss.v8i3.7043
Özsoy-Güneş, Zeliha, İbrahim Güneş, Yasemin Derelioğlu, and Fatma Gülay Kırbaşlar. 2015. “The Reflection of Critical Thinking Dispositions on Operational Chemistry and Physics Problems Solving of Engineering Faculty Students.” Procedia - Social and Behavioral Sciences 174:448–56. doi:10.1016/j.sbspro.2015.01.688. DOI: https://doi.org/10.1016/j.sbspro.2015.01.688
Puvia, Elisa, Vito Monteleone, Giovanni Fulantelli, and Davide Taibi. 2020. “Facing the Appeal of Social Networks: Methodologies and Tools to Support Students towards a Critical Use of the Web.” Pp. 567–73 in CSEDU 2020 - Proceedings of the 12th International Conference on Computer Supported Education. Vol. 1, edited by L. H.C., Z. S., and U. J. Consiglio Nazionale delle Ricerche, Istituto per le Tecnologie Didattiche, Palermo, Italy: SciTePress. DOI: https://doi.org/10.5220/0009571105670573
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark: Danish Institute for Educational Research.
Samaradiwakera-Wijesundara, Charmika. 2022. “Intersectionality and/or Multiple Consciousness: Re-Thinking the Analytical Tools Used to Conceptualise and Navigate Personhood.” Agenda 36(4):198–205. doi:10.1080/10130950.2022.2184933. DOI: https://doi.org/10.1080/10130950.2022.2184933
Sari, Sri Adelila, Ratna Sari Dewi, Kana Saputra, Agus Kembaren, Hanisah Hasibuan, and Corrienna Abdul Talib. 2025. “Integration of Analytical Chemistry Flipbooks Based on Project-Based Learning in Improving Critical Thinking Skills and Scientific Literacy To Support Sdg-4.” Jurnal Pendidikan IPA Indonesia 14(1):59–69. doi:10.15294/jpii.v14i1.21038. DOI: https://doi.org/10.15294/jpii.v14i1.21038
Setiaji, Bayu, Endang Tri Adiningsih, Zulfa Lutfi Anisa, and Yashinta Putri Sekarini. 2023. “E-PBL Physics Online Module to Enhance Students’ Analytical Thinking Skill in COVID-19 Pandemic Era.” in AIP Conference Proceedings. Vol. 2556, edited by A. N.A., P. K.R., S. H., F. F., and K. P.C. Physics Education, Faculty of Mathematics and Science, Universitas Negeri Yogyakarta, Jl. Colombo No.1, Karang Malang, Depok, Sleman, Yogyakarta, 55281, Indonesia: American Institute of Physics Inc.
Sultan, Mubashir, Alan N. Tump, Nina Ehmann, Philipp Lorenz-Spreen, Ralph Hertwig, Anton Gollwitzer, and Ralf H. J. M. Kurvers. 2024. “Susceptibility to Online Misinformation: A Systematic Meta-Analysis of Demographic and Psychological Factors.” Proceedings of the National Academy of Sciences of the United States of America 121(47). doi:10.1073/pnas.2409329121. DOI: https://doi.org/10.1073/pnas.2409329121
Sunyík, Viktória, and Vladimíra Čavojová. 2023. “Alternative Medicine, COVID-19 Conspiracies, and Other Health-Related Unfounded Beliefs: The Role of Scientific Literacy, Analytical Thinking, and Importance of Epistemic Rationality.” Studia Psychologica 65(3):246–61. doi:10.31577/sp.2023.03.878. DOI: https://doi.org/10.31577/sp.2023.03.878
Surin, Supansa, and Suntonrapot Damrongpanit. 2024. “Quantifying Influence: Propensity Score Matching Unravels the True Effect Sizes of Learning Management Models on Students’ Analytical Thinking.” European Journal of Educational Research volume-13-(volume-13-issue-4-october-2024):1535–53. doi:10.12973/eu-jer.13.4.1535. DOI: https://doi.org/10.12973/eu-jer.13.4.1535
Thabvithorn, Chayaphorn, and Charuni Samat. 2022. “Development of Web-Based Learning with Augmented Reality (AR) to Promote Analytical Thinking on Computational Thinking for High School.” Pp. 125–33 in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 13449 LNCS, edited by H. Y.-M., C. S.-C., B. J., and S. F.E. Educational in Science and Technology, Faculty of Education, Khon Kaen University, Khon Kaen, Thailand: Springer Science and Business Media Deutschland GmbH. DOI: https://doi.org/10.1007/978-3-031-15273-3_14
Tomić, Taeda. 2021. “The Distinction Between False Dilemma and False Disjunctive Syllogism.” Informal Logic 41(4):607–39. doi:10.22329/IL.V41I4.6233. DOI: https://doi.org/10.22329/il.v41i4.6233
Tosyali, Furkan, and Busra Aktas. 2021. “Does Training Analytical Thinking Decrease Superstitious Beliefs? Relationship between Analytical Thinking, Intrinsic Religiosity, and Superstitious Beliefs.” Personality and Individual Differences 183. doi:10.1016/j.paid.2021.111122. DOI: https://doi.org/10.1016/j.paid.2021.111122
Udonsathian, T., and W. Worapun. 2024. “Enhancing Analytical Thinking in Grade 8 Science Education: Integrating 5E Inquiry-Based and 5W1H Techniques.” International Journal of Advanced and Applied Sciences 11(5):62–69. doi:10.21833/ijaas.2024.05.007. DOI: https://doi.org/10.21833/ijaas.2024.05.007
Wang, Rui, and Zhilong Shan. 2025. “DEKT: Difficulty Representation Enriched Knowledge Tracing.” Pp. 33–47 in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) . Vol. 15388 LNAI, edited by S. Q.Z., Z. X., W. J., M. C., D. G., J. J., Z. W.E., M. Y., and M. W. School of Computer Science, South China Normal University, Guangzhou, 510631, China: Springer Science and Business Media Deutschland GmbH. DOI: https://doi.org/10.1007/978-981-96-0814-0_3
Wiyarsi, Antuni, Atina Rizanatul Fachriyah, Didi Supriadi, and Muhd Ibrahim Bin Muhamad Damanhuri. 2019. “A Test of Analytical Thinking and Chemical Representation Ability on ‘Rate of Reaction’ Topic.” Cakrawala Pendidikan 38(2):228–42. doi:10.21831/cp.v38i2.23062. DOI: https://doi.org/10.21831/cp.v38i2.23062
Wright, B.D. and Stone, M.H., 1979. Best test design. Chicago: MESA Press.
License
Copyright (c) 2025 Amsor, M Reza Dwi Saputra, Nurdini, Filzah Nabila Asri, Siti Almaidah
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
