Development of An Integrated Assessment Instrument to Measure Students’ Critical Thinking and Chemical Literacy Skills for Rate of Reaction Topic
DOI:
10.29303/jppipa.v10i10.9069Published:
2024-10-30Issue:
Vol. 10 No. 10 (2024): OctoberKeywords:
Chemical literacy, Critical thinking, Integrated Assessment InstrumentResearch Articles
Downloads
How to Cite
Downloads
Metrics
Abstract
Critical thinking is one of the 21st-century skills needed. Understanding chemical literacy can encourage students to be able to think more critically. Given the importance of critical thinking and chemical literacy in chemistry learning, there is a need for an assessment instrument that can measure both abilities. Based on this, the integrated assessment instrument was developed to determine the characteristics and feasibility of the integrated assessment instrument that can measure students' critical thinking skills and chemical literacy on reaction rate materials. The sample in this study is 154 students from two high schools in Makassar City. The feasibility and characteristics of the integrated assessment instrument were analyzed using the Rasch model with the Partial Credit Model-1 Logistic Parameter (PCM-1PL) approach. The results of the analysis show that the 10 items developed are valid and have a high reliability value. The integrated assessment instrument has the characteristics of fit with the model, and the difficulty level of the items is classified as good. The results of this study show that the integrated assessment instrument can be used as a good instrument to measure students' critical thinking skills and chemical literacy on reaction rate materials
References
Aiken, L.R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131-142. http://doi.org/10.1177/0013164485451012.
Al-Shirawia, N., & Tashtoush, M. (2023). Differential item functioning analysis of an emotional intelligence scale for human resources management at Sohar University. Information Sciences Letters, 12(11), 2937–2952. https://www.naturalspublishing.com/Article.asp?ArtcID=27843.
Beavers, A. S., Lounsbury, J. W., Richards, J. K., Huck, S. W., Skolits, G. J., & Esquivel, S. L. (2013). Practical considerations for using exploratory factor analysis in educational research. Practical Assessment, Research and Evaluation, 18(6), 1-13. https://doi.org/10.7275/qv2q-rk76.
Boone, W. J., Yale, M. S., & Staver, J. R. (2014). Rasch analysis in the human sciences. Londoncoste: Springer.
Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research and Evaluation, 10(7), 1-9. https://doi.org/10.7275/jyj1-4868.
Daryono, R. W., Hariyanto, V. L., Usman, H., & Sutarto, S. (2020). Factor analysis: Competency framework for measuring student achievements of architectural engineering education in Indonesia. Research and Evaluation in Education, 6(2), 98-108. https://doi.org/10.21831/reid.v6i2.32743.
Davies, M. (2013). Critical thinking and the disciplines reconsidered. Higher Education Research and Development, 32(4), 529-544. https://doi.org/10.1080/07294360.2012.697878.
Dori, Y. J., Rodrigues, S., & Schanze, S. (2013). How to promote chemistry learning through the use of ICT. Teaching Chemistry – A Studybook, 213-240. https://doi.org/10.1007/978-94-6209-140-5_8.
Ennis, R. H. (1987). A taxonomy of critical thinking disposition and abilities. In J. B. Baron & R. J. Sternberg (Eds.), Teaching thinking skills: Theory and practice. New York: W. H. Freeman.
Facione, P. A. (1990). Critical Thinking : A Statement of expert consensus for purposes of educational assessment and instruction executive summary the Delphi report. The California Academic Press, 423(c), 1-21.
Hambleton, R. K., & Swaminathan, H. (1985). Item response theory principles and applications. MA: Kluwer Nijhoff Publishing.
Koballa, T., Gräber, W., Coleman, D. C., & Kemp, A. C. (2000). Prospective gymnasium teachers’ conceptions of chemistry learning and teaching. International Journal of Science Education, 22(2), 209-224. https://doi.org/10.1080/095006900289967
Koulaidis, V., & Dimopoulos, C. (2003). An analysis of the discursive transitions across different modalities of the pedagogic discourse. International Journal of Learning, 10, 3263-3274.
Kriswantoro, Kartowagiran, B., & Rohaeti, E. (2021). A critical thinking assessment model integrated with science process skills on chemistry for senior high school. European Journal of Educational Research, 10(1), 285-298. https://doi.org/10.12973/EU-JER.10.1.285.
Leech, N. L., Barrett, K. C., & Morgan, G. A. (2015). IBM SPSS for intermediate statistics: Use and interpretation (5th ed.). New York and London: Routledge.
OECD. (2023). PISA 2022 results (volume II); Learning during and from disruption. OECD. https://doi.org/10.1787/a97db61c-en.
Pandra, V., Kartowagiran, B., & Sugiman. (2021). Mathematics test development by item response theory approach and its measrument on elementary school students. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 12(5), 464-483. https://doi.org/10.17762/turcomat.v12i5.994.
Pett, M. A., Lackey, N. R., & Sullivan, J. J. (2003). Making sense of factor analysis: The use of factor analysis for instrument development in health care research. Thousand Oak, California: Sage Publication, Inc.
Reckase, M. D. (1979). Unifactor latent trait models applied to multifactor tests: Results and implications. Journal of Educational Statistics, 4(3), 207-230. https://doi.org/10.3102/10769986004003207.
Retnawati, H. (2014). Teori respon butir dan penerapannya; Untuk peneliti, praktisi pengukuran dan pengujian, mahasiswa pascasarjana. Yogyakarta: Nuha Medika.
Sadhu, S., & Laksono, E. W. (2018). Development and validation of an integrated assessment for measuring critical thinking and chemical literacy in chemical equilibrium. International Journal of Instruction, 11(3), 557–572. https://doi.org/10.12973/iji.2018.11338a.
Sari, S., Safitri, I., & Farida, I. (2019). Design of educational games oriented to chemical literacy on petroleum material. Journal of Physics: Conference Series. 1402(5), 1-6. https://iopscience.iop.org/article/10.1088/1742-6596/1402/5/055032/meta.
Sarigoz, O. (2012). Assessment of the high school students’ critical thinking skills. Procedia - Social and Behavioral Sciences, 46, 5315-5319. https://doi.org/10.1016/j.sbspro.2012.06.430.
Shwartz, Y., Ben-Zvi, R., & Hofstein, A. (2006). The use of scientific literacy taxonomy for assessing the development of chemical literacy among high-school students. Chemistry Education Research and Practice, 7(4), 203-225. https://doi.org/10.1039/B6RP90011A.
Suardana, I. N., Redhana, I. W., Sudiatmika, A. A. I. A. R., & Selamat, I. N. (2018). Students’ critical thinking skills in chemistry learning using local culture-based 7E learning cycle model. International Journal of Instruction, 11(2), 399-412. https://doi.org/10.12973/iji.2018.11227a.
Sumarni, W., Sudarmin, S., Wiyanto, W., & Supartono, S. (2016). Preliminary analysis of assessment instrument design to reveal science generic skill and chemistry literacy. International Journal of Evaluation and Research in Education (IJERE), 5(4), 331-340. https://doi.org/10.11591/ijere.v5i4.5961.
Thiagarajan, S., Semmel, D. S., & Semmel, M. I. (1947). Instructional Development for Training Teachers of Exceptional Children A Sourcebook. Bloomington, Indiana: Indiana University.
Yandriani, Rery, R. U., & Erna, M. (2021). Developing and validating the assessment instruments to measure students’ analytical thinking ability and chemical literacy on colligative properties. Journal of Physics: Conference Series, 1788(1), 1-11. https://doi.org/10.1088/1742-6596/1788/1/012027.
Yanto, B. E., Subali, B., & Suyanto, S. (2019). Measurement instrument of scientific reasoning test for biology education students. International Journal of Instruction, 12(1), 1383-1398. https://doi.org/10.29333/iji.2019.12188a.
Yilmaz, K., Altinkurt, Y., & Cokluk, O. (2011). Developing the educational belief scale: The validity and reliability study. Educational Science: Theory and Practice, 11(1), 343-350. Retrieved from https://files.eric.ed.gov/fulltext/EJ919905.pdf.
Author Biographies
Nurlaila Widyanarti Ariefiani, Universitas Negeri Yogyakarta
Endang Widjajanti Laksono, Universitas Negeri Yogyakarta
License
Copyright (c) 2024 Nurlaila Widyanarti Ariefiani, Endang Widjajanti Laksono
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
