Teacher Readiness Instrument for Culturally Responsive Teaching (CRT) in Papua Border Schools: Construct Validity, Reliability, and Measurement Invariance
DOI:
10.29303/jppipa.v11i11.13029Published:
2025-11-25Downloads
Abstract
This study addressed the need to strengthen science literacy in the Indonesia–Papua New Guinea border region through Culturally Responsive Teaching (CRT) by developing and validating a context-appropriate teacher readiness instrument for indigenous communities. The instrument was specified as a multidimensional model encompassing pedagogical knowledge, efficacy, school contextual support, culturally responsive planning and materials, culturally responsive assessment, and community collaboration. A layered, cross-sectional validation was conducted: expert judgment for content validity, target-user assessment for face validity/readability, a limited pilot (approximately 30 respondents), and confirmatory factor analysis (CFA) on the main sample; measurement invariance (MI) across gender, years of service, and certification was tested sequentially. Content validity met predefined standards: all items achieved I-CVI ≥ .78 and S-CVI/Ave = .917; qualitative feedback prompted the alignment of terminology and local examples without altering construct coverage. Internal reliability was adequate (α and ω ≥ .70). CFA indicated acceptable fit; most loadings were ≥ .50; CR ≥ .70; AVE ≥ .50; and discriminant validity was satisfied. Measurement invariance was established up to the scalar level for gender and certification, and up to the metric level for years of service; comparisons of latent means by years of service therefore require a partial scalar approach based on the problematic indicators. A known-groups test showed a practically meaningful difference between certified and non-certified teachers (Cohen’s d ≈ 0.63; p < .05). Overall, the instrument is culturally adapted and empirically validated, enabling program evaluation and targeted professional development toward inclusive, culturally responsive science education.
Keywords:
Construct Validity Culturally responsive teaching Measurement invariance ReliabilityReferences
Allison-Burbank, J. D., Conn, A., & Vandever, D. (2023). Interpreting Diné Epistemologies and Decolonization to Improve Language and Literacy Instruction for Diné Children. Language Speech and Hearing Services in Schools, 54(3), 707–715. https://doi.org/10.1044/2023_lshss-22-00147 DOI: https://doi.org/10.1044/2023_LSHSS-22-00147
Andrew, & Johnson. (2022). Culturally Responsive Teaching in Higher Education. International Journal of Equity and Social Justice in Higher Education. https://doi.org/10.56816/2771-1803.1008 DOI: https://doi.org/10.56816/2771-1803.1008
Arlianto, A., Prahoro, A. P., & Oktavia, A. (2024). Intercultural competence measurement tools for Indonesian students: Adaptation, testing construct validity, and measurement invariance with the MIMIC model. Jurnal Psikologi UNDIP, 23(1), 1–24. https://doi.org/10.14710/jp.23.1.1-24 DOI: https://doi.org/10.14710/jp.23.1.1-24
Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). The Guilford Press.
Chen, F. F. (2007). Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834 DOI: https://doi.org/10.1080/10705510701301834
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5 DOI: https://doi.org/10.1207/S15328007SEM0902_5
Cummings, J. (2020). Review for “Trajectories of peer victimization in elementary school children: Associations with changes in internalizing, externalizing, social competence, and school climate. Wiley. https://doi.org/10.1002/jcop.22365/v1/review1 DOI: https://doi.org/10.1002/JCOP.22365/v1/review1
Darling-Hammond, L., Flook, L., Cook-Harvey, C., Barron, B., & Osher, D. (2020). Implications for educational practice of the science of learning and development. Applied Developmental Science, 24(2), 97–140. https://doi.org/10.1080/10888691.2018.1537791 DOI: https://doi.org/10.1080/10888691.2018.1537791
Datta, R. (2018). Traditional storytelling: an effective Indigenous research methodology and its implications for environmental research. AlterNative, 14(1), 35–44. https://doi.org/10.1177/1177180117741351 DOI: https://doi.org/10.1177/1177180117741351
Fornell, C., & Larcker, D. F. (1981). Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104 DOI: https://doi.org/10.1177/002224378101800104
Gay, G. (2018). Culturally responsive teaching: Theory, research, and practice. New York: Teachers College Press.
Greenfader, C. M. (2022). Latinx Family Engagement in Early Elementary School: A National Study. In AERA. https://doi.org/10.3102/ip.22.1891383 DOI: https://doi.org/10.3102/IP.22.1891383
Hair, J. F., Black, W. J., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis. Englewood Cliff, Prentice Hall.
Hammond, Z. (2015). Culturally Responsive Teaching and The Brain. SAGE Publications.
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135. https://doi.org/10.1007/s11747-014-0403-8 DOI: https://doi.org/10.1007/s11747-014-0403-8
Hernandez, A. (2022). Closing the Achievement Gap in the Classroom Through Culturally Relevant Pedagogy. Journal of Education and Learning, 11(2), 1. https://doi.org/10.5539/jel.v11n2p1 DOI: https://doi.org/10.5539/jel.v11n2p1
Hu, X., Xu, Z., Neshyba, M. V, Geng, Z., & Turner, R. K. (2021). A multi-dimensional model: implications for preparing pre-service teachers for culturally responsive teaching. Asia-Pacific Journal of Teacher Education, 49(3), 282–299. https://doi.org/10.1080/1359866X.2020.1753169 DOI: https://doi.org/10.1080/1359866X.2020.1753169
Hung, H.-F., Yen, C., Yao, T., & Lin, S. (2023). Exploring How Place-Based Education Indigenous Curriculum Influence Students. In Learning Motivation in Science (pp. 191–215). Springer International Publishing. https://doi.org/10.1007/978-3-031-30506-1_11 DOI: https://doi.org/10.1007/978-3-031-30506-1_11
Joseph, D. H., Keene, C., Castagno, A. E., Dass, P. M., & Macias, C. (2024). Methodological Complexity: A Both/and Approach to Address Tool Validity and Reliability for Assessment of Cultural Responsiveness in Indigenous Serving Schools. AERA Open, 10. https://doi.org/10.1177/23328584241232958 DOI: https://doi.org/10.1177/23328584241232958
Kline, R. B. (2016). Principles and practice of structural equation modeling (4th ed.). The Guilford Press.
List, A., Campos Oaxaca, G. S., Du, H., Lee, H. Y., & Lyu, B. (2024). Critical culturalized comprehension: Exploring culture as learners thinking about texts. Educational Psychologist, 59(1), 1–19. https://doi.org/10.1080/00461520.2023.2266028 DOI: https://doi.org/10.1080/00461520.2023.2266028
Little, T. D. (2013). Longitudinal structural equation modeling. The Guilford Press.
Llopart, M., & Esteban-Guitart, M. (2018). Funds of knowledge in 21st century societies: inclusive educational practices for under-represented students. A literature review. Journal of Curriculum Studies, 50(2), 145–161. https://doi.org/10.1080/00220272.2016.1247913 DOI: https://doi.org/10.1080/00220272.2016.1247913
Lynn, M. R. (1986). Determination and Quantification Of Content Validity. Nursing Research, 35(6). Retrieved from https://journals.lww.com/nursingresearchonline/fulltext/1986/11000/determination_and_quantification_of_content.17.aspx DOI: https://doi.org/10.1097/00006199-198611000-00017
Manasia, L., Ianos, M. G., & Chicioreanu, T. D. (2020). Pre-service teacher preparedness for fostering education for sustainable development: An empirical analysis of central dimensions of teaching readiness. Sustainability (Switzerland), 12(1). https://doi.org/10.3390/SU12010166 DOI: https://doi.org/10.3390/su12010166
Mcneish, D. (2017). Psychological methods: Thanks coefficient Alpha, we’ll take it from here. Psychological Methods, 1–22. https://doi.org/10.1037/met0000144 DOI: https://doi.org/10.1037/met0000144
Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(ue 9), 741–749. https://doi.org/10.1037/0003-066X.50.9.741 DOI: https://doi.org/10.1037//0003-066X.50.9.741
Panggabean, M. S., & Himawan, K. K. (2016). The Development of Indonesian Teacher Competence Questionnaire. Journal of Educational, Health and Community Psychology, 5(2), 1–15. https://doi.org/10.12928/JEHCP.V5I2.5134 DOI: https://doi.org/10.12928/jehcp.v5i2.5134
Paris, D. (2012). Culturally Sustaining Pedagogy. Educational Researcher, 41(3), 93–97. https://doi.org/10.3102/0013189x12441244 DOI: https://doi.org/10.3102/0013189X12441244
Pevec-Zimmer, S., Juang, L. P., & Schachner, M. K. (2024). Promoting awareness and self-efficacy for culturally responsive teaching of pre-service teachers through the identity project–a mixed methods study. Identity: International Journal of Theory and Research, 24(4), 288–306. https://doi.org/10.1080/15283488.2024.2344086 DOI: https://doi.org/10.1080/15283488.2024.2344086
Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? critique and recommendations. Research in Nursing & Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147 DOI: https://doi.org/10.1002/nur.20147
Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Journal Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004 DOI: https://doi.org/10.1016/j.dr.2016.06.004
Razfar, A., & Nasir, A. (2019). Repositioning English Learners’ Funds of Knowledge for Scientific Practices. Theory Into Practice, 58(3), 226–235. https://doi.org/10.1080/00405841.2019.1599231 DOI: https://doi.org/10.1080/00405841.2019.1599231
Ryder, C., Mackean, T., Coombs, J., Williams, H., Hunter, K., Holland, A. J. A., & Ivers, R. (2020). Indigenous Research Methodology -- Weaving a Research Interface. International Journal of Social Research Methodology, 23(3), 255–267. https://doi.org/10.1080/13645579.2019.1669923 DOI: https://doi.org/10.1080/13645579.2019.1669923
Snow, K. C., Hays, D. G., Caliwagan, G., Ford, D. J., Mariotti, D., Mwendwa, J. M., & Scott, W. (2016). Guiding principles for indigenous research practices. Action Research, 14(4). https://doi.org/10.1177/1476750315622542 DOI: https://doi.org/10.1177/1476750315622542
Sotero, M. C., Alves, Â. G. C., Arandas, J. K. G., & Medeiros, M. F. T. (2020). Local and scientific knowledge in the school context: Characterization and content of published works. Journal of Ethnobiology and Ethnomedicine, 16(1). https://doi.org/10.1186/s13002-020-00373-5 DOI: https://doi.org/10.1186/s13002-020-00373-5
Vandenberg, R. J., & Lance, C. E. (2000). A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research. Organizational Research Methods, 3(1), 4–70. https://doi.org/10.1177/109442810031002 DOI: https://doi.org/10.1177/109442810031002
Villegas, A. M., & Lucas, T. (2007). The Culturally Responsive Teacher. Educational Leadership.
Wang, T., Wang, T., Olivier, D. F., & Chen, P. (2020). Creating individual and organizational readiness for change: conceptualization of system readiness for change in school education. International Journal of Leadership in Education, 1–25. https://doi.org/10.1080/13603124.2020.1818131 DOI: https://doi.org/10.1080/13603124.2020.1818131
Windchief, S., & Cummins, J. D. (2021). Considering Indigenous Research Methodologies: Bicultural Accountability and the Protection of Community Held Knowledge. Qualitative Inquiry. https://doi.org/10.1177/10778004211021803 DOI: https://doi.org/10.1177/10778004211021803
Yektiningtyas, W., Wompere, R. N. N., Kobepa, N., & Sunarsih, T. A. (2023). Engaging students to write procedure texts through the culturally-relevant activity of bark painting. JOALL (Journal of Applied Linguistics and Literature), 8(1), 41–58. https://doi.org/10.33369/joall.v8i1.22577 DOI: https://doi.org/10.33369/joall.v8i1.22577
License
Copyright (c) 2025 Aisyah Ali, Akhmad Kadir, Ria Ristiani
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
