STEM Literacy Proficiency in Prospective Physics Educator: A Comprehensive Analysis Using Rasch Measurement Theory

Authors

Muhammad Zaky , Astija , Supriyatman , Muslimin , Mohammad Jamhari , Ratman

DOI:

10.29303/jppipa.v10i12.8970

Published:

2024-12-30

Issue:

Vol. 10 No. 12 (2024): December

Keywords:

Physics Education, Rasch Measurement Theory, STEM Literacy

Research Articles

Downloads

How to Cite

Zaky, M., Astija, Supriyatman, Muslimin, Jamhari, M., & Ratman. (2024). STEM Literacy Proficiency in Prospective Physics Educator: A Comprehensive Analysis Using Rasch Measurement Theory. Jurnal Penelitian Pendidikan IPA, 10(12), 10799–10810. https://doi.org/10.29303/jppipa.v10i12.8970

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Abstract

This study aims to measure and analyze the level of STEM literacy among prospective physics educators using Rasch measurement theory. A quantitative approach with a descriptive design was employed. The research instrument consisted of a STEM literacy test comprising multiple-choice questions and essays, and the data were analyzed using Winstep software version 5.7.1 to assess the validity and reliability of the measurement instrument. The results reveal that only a small number of prospective physics educators exhibit very high STEM literacy, while the majority demonstrate moderate to low levels of competencies and attitudes toward STEM literacy. The measurement instrument was confirmed to be valid and reliable according to Rasch parameters. These findings highlight the need for targeted interventions to enhance digital literacy, multidisciplinary skills, technology integration, and scientific competence among aspiring educators. Educational institutions are thereby urged to better prepare future educators to teach and promote STEM literacy effectively among students.

References

Agussuryani, Q., Sudarmin, S., Sumarni, W., Cahyono, E., & Ellianawati, E. (2022). STEM Literacy in Growing Vocational School Student HOTS in Science Learning: A Meta-Analysis. International Journal of Evaluation and Research in Education, 11(1), 51–60. https://doi.org/10.11591/ijere.v11i1.21647

Ahmad Kamal, F., Subali, B., Astuti, B., Rusilowati, A., & Widiyatmoko, A. (2024). Development of STEM-Based Digital Student Worksheet to Improve Students’ Numeracy and Science Literacy. Jurnal Penelitian Pendidikan IPA, 10(5 SE-Research Articles), 2454–2464. https://doi.org/10.29303/jppipa.v10i5.6689

Ahmadi, A., Niknami, S., & Ghaffari, M. (2022). Type 2 Diabetes Health Literacy Assessment Tool: Translation and Psychometric Evaluation of the Iranian Version. International Journal of Endocrinology and Metabolism, 20(2). https://doi.org/10.5812/ijem-116983

Ali, R., Bhadra, J., Siby, N., Ahmad, Z., & Al-Thani, N. J. (2021). A STEM Model to Engage Students in Sustainable Science Education through Sports: A Case Study in Qatar. Sustainability, Vol. 13. https://doi.org/10.3390/su13063483

Anderson, T., & Shattuck, J. (2012). Design-Based Research: A Decade of Progress in Education Research? Educational Researcher, 41(1), 16–25. https://doi.org/10.3102/0013189X11428813

Andrich, D. (2018). Advances in social measurement: A Rasch measurement theory. In Perceived Health and Adaptation in Chronic Disease (pp. 66–91). Routledge.

Ardianto, D., Firman, H., Permanasari, A., & Ramalis, T. R. (2019). What is Science, Technology, Engineering, Mathematics (STEM) Literacy? Proceedings of the 3rd Asian Education Symposium (AES 2018), 381–384. Atlantis Press. https://doi.org/10.2991/aes-18.2019.86

Aryadoust, V., Tan, H. A. H., & Ng, L. Y. (2019). A Scientometric review of Rasch measurement: The rise and progress of a specialty. Frontiers in Psychology, 10, 2197. https://doi.org/10.3389/fpsyg.2019.02197

Asiyah, Febrini, D., Topano, A., Mustamin, A. A., & Hakim, M. A. R. (2024). Measuring the Impact of Islamic Values-Based Scientific Literacy on Scientific Competency of Madrasah Teachers. International Journal of Learning, Teaching and Educational Research, 23(4), 476–496. https://doi.org/10.26803/ijlter.23.4.25

Barnett, L. M., Jerebine, A., Keegan, R., Watson-Mackie, K., Arundell, L., Ridgers, N. D., … Dudley, D. (2023). Validity, Reliability, and Feasibility of Physical Literacy Assessments Designed for School Children: A Systematic Review. Sports Medicine, 53(10), 1905–1929. https://doi.org/10.1007/s40279-023-01867-4

Blanchin, M., Guilleux, A., Hardouin, J.-B., & Sébille, V. (2020). Comparison of structural equation modelling, item response theory and Rasch measurement theory-based methods for response shift detection at item level: A simulation study. Statistical Methods in Medical Research, 29(4), 1015–1029. https://doi.org/10.1177/0962280219884

Boone, W., Staver, J., & Yale, M. (2014). Rasch Analysis in the Human Sciences. Springer. https://doi.org/10.1007/978-94-007-6857-4

Braund, M. (2021). Critical STEM literacy and the COVID-19 pandemic. Canadian Journal of Science, Mathematics and Technology Education, 21(2), 339–356. https://doi.org/10.1007/s42330-021-00150-w

Browne, J. P., & Cano, S. J. (2019). A Rasch measurement theory approach to improve the interpretation of patient-reported outcomes. Medical Care, 57, S18–S23. https://doi.org/10.1097/MLR.0000000000001096

Bruckermann, T., Greving, H., Schumann, A., Stillfried, M., Börner, K., Kimmig, S. E., … Harms, U. (2021). To know about science is to love it? Unraveling cause–effect relationships between knowledge and attitudes toward science in citizen science on urban wildlife ecology. Journal of Research in Science Teaching, 58(8), 1179–1202. https://doi.org/10.1002/tea.21697

Chen, K.-Z., & Oakley, B. (2020). Redeveloping a global MOOC to be more locally relevant: design-based research. International Journal of Educational Technology in Higher Education, 17, 1–22. https://doi.org/10.1186/s41239-020-0178-6

Egolf, R. S. (2022). Exploration of Tuckman’s Model of Group Development: Perceived Applications and Prevalence among Adventure Education Practitioners. Prescott College.

Falloon, G., Hatzigianni, M., Bower, M., Forbes, A., & Stevenson, M. (2020). Understanding K-12 STEM education: A framework for developing STEM literacy. Journal of Science Education and Technology, 29, 369–385. https://doi.org/10.1007/s10956-020-09823-x

Fisher, W. P. J. (2007). Rating Scale Instrument Quality Criteria. Rasch Measurement Transactions, 21(1), 1095.

Ghani, U., Zhai, X., & Ahmad, R. (2021). Mathematics skills and STEM multidisciplinary literacy: Role of learning capacity. STEM Education, 1(2), 104–113. https://doi.org/10.3934/steme.2021008

Ginting, F. W., Mellyzar, M., & Lukman, I. R. (2023). Analysis of Student Environmental Literacy: PjBL-Based Learning that is Integrated STEM. Jurnal Penelitian Pendidikan IPA, 9(1 SE-Research Articles), 242–248. https://doi.org/10.29303/jppipa.v9i1.2599

Gravel, B. E., Tucker-Raymond, E., Kohberger, K., & Browne, K. (2018). Navigating worlds of information: STEM literacy practices of experienced makers. International Journal of Technology and Design Education, 28, 921–938. https://doi.org/10.1007/s10798-017-9422-3

Hariyadi, S., Rofi, A., Santosa, T. A., Taqiyuddin, & Sakti, B. P. (2023). Effectiveness of STEM-Based Mind Mapping Learning Model to Improve Students’ Science Literacy in the Era of Revolution 4.0. Jurnal Penelitian Pendidikan IPA, 9(10 SE-Review), 791–799. https://doi.org/10.29303/jppipa.v9i10.5125

Huang, X., Erduran, S., Luo, K., Zhang, P., & Zheng, M. (2023). Investigating in-service teachers’ STEM literacy: the role of subject background and gender. Research in Science & Technological Education, 1–21. https://doi.org/10.1080/02635143.2022.2153243

Hubbard, K. (2021). Disciplinary literacies in STEM: what do undergraduates read, how do they read it, and can we teach scientific reading more effectively? Higher Education Pedagogies, 6(1), 41–65. https://doi.org/10.1080/23752696.2021.1882326

Ismail, Afriana, J., & Saputra, M. (2015). Models of integrated STEM (Sceince, Technology, Engneering, and Mathematis) Learning to Build Scientific Literacy. Proceeding of International Seminar on Science Education. Yogyakarta: UNY. https://doi.org/10.13140/RG.2.1.1914.8888

Ismail, I, Permanasari, A., & Setiawan, W. (2016). STEM virtual lab: An alternative practical media to enhance student’s scientific literacy. Jurnal Pendidikan IPA Indonesia, 5(2), 239–246. https://doi.org/10.15294/jpii.v5i2.5492

Ismail, Ismail, Permanasari, A., & Setiawan, W. (2016). Efektivitas virtual lab berbasis STEM dalam meningkatkan literasi sains siswa dengan perbedaan gender. Jurnal Inovasi Pendidikan IPA, 2(2), 190. https://doi.org/10.21831/jipi.v2i2.8570

Ismail, Ismail, Rochintaniawati, D., Permanasari, A., & Riandi, R. (2022). Content Study Of 7th-Grade Science Textbooks Using An Esd Viewpoint On Living Things And Their Surroundings. Ta’dib, 25(1), 117–128. https://doi.org/10.31958/jt.v25i1.5447

Jackson, C., Mohr-Schroeder, M. J., Bush, S. B., Maiorca, C., Roberts, T., Yost, C., & Fowler, A. (2021). Equity-oriented conceptual framework for K-12 STEM literacy. International Journal of STEM Education, 8, 1–16. https://doi.org/10.1186/s40594-021-00294-z

Junge, R., Bulc, T. G., Anseeuw, D., Yavuzcan Yildiz, H., & Milliken, S. (2019). Aquaponics as an Educational Tool BT - Aquaponics Food Production Systems: Combined Aquaculture and Hydroponic Production Technologies for the Future (S. Goddek, A. Joyce, B. Kotzen, & G. M. Burnell, Eds.). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-15943-6_22

Karimah, F., & Wulandari, F. (2023). The Influence of an Integrated STEM Project-Based Learning toward garScience Literacy Abilities Students in Elementary School. Jurnal Penelitian Pendidikan IPA, 9(11 SE-Research Articles), 10446–10456. https://doi.org/10.29303/jppipa.v9i11.4171

Kleppang, A. L., Steigen, A. M., & Finbråten, H. S. (2020). Using Rasch measurement theory to assess the psychometric properties of a depressive symptoms scale in Norwegian adolescents. Health and Quality of Life Outcomes, 18, 1–8. https://doi.org/10.1186/s12955-020-01373-5

Laksono, A., Rusilowati, A., & Widiyatmoko, A. (2023). Development and Validation of STEM-Based Science Digital Worksheet on Object Motion Material for Junior High School Students . Jurnal Penelitian Pendidikan IPA, 9(5 SE-Research Articles), 2664–2669. https://doi.org/10.29303/jppipa.v9i5.3720

Laupichler, M. C., Aster, A., Perschewski, J.-O., & Schleiss, J. (2023). Evaluating AI Courses: A Valid and Reliable Instrument for Assessing Artificial-Intelligence Learning through Comparative Self-Assessment. Education Sciences, Vol. 13. https://doi.org/10.3390/educsci13100978

Lestari, H., Rahmawati, I., Siskandar, R., & Dafenta, H. (2021). Implementation of Blended Learning with A STEM Approach to Improve Student Scientific Literacy Skills During The Covid-19 Pandemic. Jurnal Penelitian Pendidikan IPA, 7(2 SE-Research Articles), 224–231. https://doi.org/10.29303/jppipa.v7i2.654

Linacre‬, ‪John M. (2021). Winsteps® Rasch measurement computer program User’s Guide. Beaverton, Oregon: Winsteps.com.‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬

Liu, C.-Y., Lin, L. L., Sheu, J.-J., & Sum, R. K. (2022). Psychometric Validation of Senior Perceived Physical Literacy Instrument. International Journal of Environmental Research and Public Health, Vol. 19. https://doi.org/10.3390/ijerph19116726

Moullin, J. C., Ehrhart, M. G., & Aarons, G. A. (2018). Development and testing of the Measure of Innovation-Specific Implementation Intentions (MISII) using Rasch measurement theory. Implementation Science, 13, 1–10. https://doi.org/10.1186/s13012-018-0782-1

Mukti, T. S., Elvira, M., & Hussin, Z. B. (2023). Development of the Game-based HOTS Assessment Instrument for Measuring Science Literacy Skills of Islamic Elementary School Students. Al Ibtida: Jurnal Pendidikan Guru MI, 10(1), 63. https://doi.org/10.24235/al.ibtida.snj.v10i1.11393

Papavlasopoulou, S., Giannakos, M. N., & Jaccheri, L. (2019). Exploring children’s learning experience in constructionism-based coding activities through design-based research. Computers in Human Behavior, 99, 415–427. https://doi.org/10.1016/j.chb.2019.01.008

Patricia Diane Mouboua, Fadeke Adeola Atobatele, & Olateju Temitope Akintayo. (2024). Bridging STEM and linguistic gaps: A review of multilingual teaching approaches in science education. Open Access Research Journal of Multidisciplinary Studies, 7(2), 086–097. https://doi.org/10.53022/oarjms.2024.7.2.0030

Peters, C. N. (2024). Children’s books for research-based outreach and science communication pedagogy. Geoscience Communication, 7(2), 81–90. https://doi.org/10.5194/gc-7-81-2024

Planinic, M., Boone, W. J., Susac, A., & Ivanjek, L. (2019). Rasch analysis in physics education research: Why measurement matters. Physical Review Physics Education Research, 15(2), 20111. https://doi.org/10.1103/PhysRevPhysEducRes.15.020111

Putri, N. H. D., & Ramli, R. (2023). Preliminary Study: Development of STEM-Based E-Students Worksheet to Improve Learners’ Science Literacy Skills. Jurnal Penelitian Pendidikan IPA, 9(4 SE-Research Articles), 2271–2275. https://doi.org/10.29303/jppipa.v9i4.3011

Rasmussen, S. E., Aaby, A., Søjbjerg, A., Mygind, A., Maindal, H. T., Paakkari, O., & Christensen, K. S. (2023). The Brief Health Literacy Scale for Adults: Adaptation and Validation of the Health Literacy for School-Aged Children Questionnaire. International Journal of Environmental Research and Public Health, Vol. 20. https://doi.org/10.3390/ijerph20227071

Rizal, R. (2023). Could the digital literacy of preservice physics teachers be improved by Learning Management System Supported Smartphone (LMS3) application in a physics online lecture? Physics Education, 58(2), 25004. https://doi.org/10.1088/1361-6552/aca864

Rizki, M., & Yusmaita, E. (2021). Pengembangan Butir Soal Literasi Kimia pada Materi Ikatan Kimia Menggunakan Model Rasch. Edukimia, 3(2), 121–134. https://doi.org/10.24036/ekj.v3.i2.a282

Sole, F. B. (2021). Implementation of STEM-Based Learning for Strengthening Science Literacy of Students. Jurnal Penelitian Pendidikan IPA, 7(SpecialIssue SE-Review), 382–388. https://doi.org/10.29303/jppipa.v7iSpecialIssue.1266

Stemler, S. E., & Naples, A. (2021). Rasch measurement v. Item response theory: knowing when to cross the line. Practical Assessment, Research & Evaluation, 26, 11. https://doi.org/10.7275/v2gd-4441

Sujud, R., Rahmawati, Y., & Utami, A. D. (2024). Development of Science Literacy Through Group Choice STEM-PjBL Projects Integrated with Matter State Changes. Jurnal Penelitian Pendidikan IPA, 10(5 SE-Research Articles), 2552–2564. https://doi.org/10.29303/jppipa.v10i5.6441

Supriyatman, S., Kade, A., Darmadi, I. W., Miftah, M., Supriyadi, S., & Ismail, I. (2024). Competence of Junior high Schools’ Science Teachers in Implementing Laboratory Teaching: A Case Study on Palu, Centre Celebes. Jurnal Penelitian Pendidikan IPA, 10(6 SE-Research Articles), 3114–3122. https://doi.org/10.29303/jppipa.v10i6.7510

Taber, K. S. (2018). The use of Cronbach’s alpha when developing and reporting research instruments in science education. Research in Science Education, 48, 1273–1296.

Tang, K., & Williams, P. J. (2019). STEM literacy or literacies? Examining the empirical basis of these constructs. Review of Education, 7(3), 675–697. https://doi.org/10.1002/rev3.3162

Techakosit, S., & Nilsook, P. (2018). The development of STEM literacy using the learning process of scientific imagineering through AR. International Journal of Emerging Technologies in Learning (IJET), 13(1), 230–238. https://doi.org/10.3991/ijet.v13i01.7664

Tenney, K., Stringer, B. P., LaTona-Tequida, T., & White, I. (2023). Conceptualizations and limitations of STEM literacy across learning theories. Journal of Microbiology & Biology Education, 24(1), e00168-22. https://doi.org/10.1128/jmbe.00168-22

Tuckman, B. W. (1965). Developmental sequence in small groups. Psychological Bulletin, 63(6), 384. https://doi.org/10.1037/h0022100

Wahyu, Y., Edu, A. L., & Helmon, A. (2023). STEM-based PjBL Learning Model with Manggaraians Indigenous Science Content to Improve Science Literacy: is it Effective? . Jurnal Penelitian Pendidikan IPA, 9(10 SE-Research Articles), 8263–8273. https://doi.org/10.29303/jppipa.v9i10.4963

Widiyatmoko, A., Nugrahani, R., Yanitama, A., & Darmawan, M. S. (2023). the Effect of Virtual Reality Game-Based Learning To Enhance Stem Literacy in Energy Concepts. Jurnal Pendidikan IPA Indonesia, 12(4), 648–657. https://doi.org/10.15294/jpii.v12i4.48265

Wu, Z., Huang, L., Liu, Y.-K., & Chiang, F.-K. (2024). Developing a Framework of STEM Literacy for Kindergarten Children. Research in Science Education, 1–23. https://doi.org/10.1007/s11165-024-10157-6

Zarestky, J., & Vilen, L. (2023). Adult STEM Education for Democratic Participation. Adult Learning, 34(3), 157–167. https://doi.org/10.1177/10451595231153133

Zirar, A., Muhammad, N., Upadhyay, A., Kumar, A., & Garza-Reyes, J. A. (2023). Exploring lean team development from the Tuckman’s model perspective. Production Planning & Control, 1–22. https://doi.org/10.1080/09537287.2023.2275693

Author Biographies

Muhammad Zaky, Tadulako University

Astija, Tadulako University

Supriyatman, Tadulako University

Muslimin, Tadulako University

Mohammad Jamhari, Tadulako University

Ratman, Tadulako University

License

Copyright (c) 2024 Muhammad Zaky, Astija, Supriyatman, Muslimin, Mohammad Jamhari, Ratman

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).