Authentic Assessment Instrument on Redox Reactions to Assess Students’ Cognitive Skills
DOI:
10.29303/jppipa.v10i10.8791Published:
2024-10-25Issue:
Vol. 10 No. 10 (2024): OctoberKeywords:
Assessment Instruments, Authentic Assessment, Higher Order Thinking Skills, Redox ReactionsResearch Articles
Downloads
How to Cite
Downloads
Metrics
Abstract
Authentic assessment is an assessment approach that enable students to demonstrate in-depth understanding and solve complex problem using systematic thinking skills, but teachers find it difficult to develop due to limited knowledge and time. The aim of this research is to produce an authentic assessment instrument for redox reaction materials; determine the characteristics, quality, and feasibility. The instrument development model used was a combination of Oriondo & Dallo-Antonio with Cohen Swerdlik. The development stages were assessment planning, instrument construction, and product testing. The research subjects were 155 of 10th-grade students from three public high schools in Bukittinggi, selected using random sampling technique. Data collection techniques were tests and non-test, the instruments were open ended questions and validation sheets. The authentic assessment instrument developed criteria are: (1) can assess students’ higher order thinking skills; (2) integrate knowledge with skills and various scientific disciplines; (3) develop 21st century competencies; and (4) involve real or everyday life contexts for cognitive aspect. The trial results were analyzed using the PCM 1-PL approach at IRT using Winstep and Parscale program. The characteristics of the item were stated fit because it met the acceptance requirements for MNSQ, ZSTD, and PT-Measure Correlation and the difficulty is in a relatively good level. The reliability of the instrument was classified as good, with test reliability of 0.72 and item reliability of 0.96.
References
Adu-Gyamfi, K., & Ampiah, J. G. (2019). Students’ alternative conceptions associated with application of redox reactions in everyday life. Asian Education Studies, 4(1), 29. https://doi.org/10.20849/aes.v4i1.590
Ambiyar, Efendi, R., Irawati, Y., Waskito, & Suryadimal. (2020). Effectiveness e-authentic assessment in computer network course. Journal of Physics: Conference Series, 1481(1). https://doi.org/10.1088/1742-6596/1481/1/012131
Baker, F. B., & Kim, S.-H. (2017). The Basics of Item Response Theory Using R. Springer. https://doi.org/10.1007/978-3-319-54205-8
Bartlett, M. S. (1951). The effect of standardization on a χ2 approximation in factor analysis. In Source: Biometrika (Vol. 38, Issue 3). https://doi.org/10.2307/2332580
Brentari, E., & Golia, S. (2007). Unidimensionality in the Rasch Model: How to detect and interpret. Statistica, 253–261. https://doi.org/https://doi.org/10.6092/issn.1973-2201/3508
Bushkofsky, N. (2016). Developing authentic summative assessments that correlate to the Next Generation Science Standards for a middle school science classroom. Graduate Research Papers. 110. https://scholarworks.uni.edu/grp/11.
Chiang, W.-W., Chiu, M.-H., Chung, S.-L., & Liu, C.-K. (2014). Survey of High School Students’ Understanding of Oxidation-Reduction Reaction. Journal of Baltic Science Education. http://oaji.net/articles/2015/987-1450980905.pdf
Cohen, R. Jay., & Swerdlik, M. E. . (2018). Psychological Testing and Assessment : an introduction to tests and measurement (9th ed.). McGraw-Hill Education.
Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10. https://doi.org/10.7275/jyj1-4868
DeMars, C. (2010). Item Response Theory: Understanding Statistic Measurement (N. Beretvas & P. Leavy, Eds.). Oxford University Press.
Ekawati, D. (2012). The implementation of authentic assessment in Vocational High School 1 Kuala Cenaku. 1st English Language and Literature International Conference. https://jurnal.unimus.ac.id/index.php/ELLIC/article/view/2415
Fuady, I., Priyansyah, R. N., Ernawati, E., & Prasanti, D. (2023). Validity and Reliability Tests on the Nomophobia Instrument with the Rasch Model. Indigenous: Jurnal Ilmiah Psikologi, 7(3), 276–287. https://doi.org/10.23917/indigenous.v7i3.19152
Galdin, M., & Laurencelle, L. (2010). Assessing parameter invariance in item response theory’s logistic two item parameter model: A Monte Carlo investigation. Tutorials in Quantitative Methods for Psychology, 6(2), 39–51. https://doi.org/10.20982/tqmp.06.2.p039
Gulikers, J. T. M., Bastiaens, T. J., & Kirschner, P. A. (2004). A five-dimensional framework for authentic assessment. Educational Technology Research and Development, 52(3), 67–87. https://doi.org/10.1007/BF02504676
Hadinugrahaningsih, T., Rahmawat, Y., & Suryani, E. (2022). An analysis of preservice chemistry teachers’ misconceptions of reduction-oxidation reaction concepts. Journal of Technology and Science Education, 12(2), 448–465. https://doi.org/10.3926/jotse.1566
Hambleton, R. K. ., Swaminathan, Hariharan., & Rogers, H. Jane. (1991). Fundamentals of Item Response Theory (Vol. 2). SAGE Publications, Inc.
Hancock, L. M., & Hollamby, M. J. (2020). Assessing the practical skills of undergraduates: The evolution of a station-based practical exam. Journal of Chemical Education, 97(4), 972–979. https://doi.org/10.1021/acs.jchemed.9b00733
Hanifah, M., & Irambona, A. (2019). Authentic assessment: Evaluation and its application in science learning. Psychology, Evaluation, and Technology in Educational Research, 1(2), 81. https://doi.org/10.33292/petier.v1i2.4
Hasan, R., & Cerimagic, S. (2021). Authentic assessment during Covid-19: an Australian postgraduate computing degree program example. Journal of Learning Development in Higher Education, 22. https://doi.org/10.47408/jldhe.vi22.690
Iskandar, D., & Senam, S. (2015). Studi kemampuan guru kimia SMA lulusan UNY dalam mengembangkan soal UAS berbasis HOTS. Jurnal Inovasi Pendidikan IPA, 1(1), 65–72. https://doi.org/10.21831/jipi.v1i1.4533
Ismiati, I., Nahadi, N., & Halimatul, H. S. (2019). Analysis of the need to development an authentic assessment instrument on buffer material. Journal of Physics: Conference Series, 1157(4). https://doi.org/10.1088/1742-6596/1157/4/042044
Kalkbrenner, M. T. (2021). A practical guide to instrument development and score validation in the social science: The MEASURE approach. Practical Assessment, Research, and Evaluation, 26, 1–18. https://doi.org/10.7275/svg4-e671
Kartowagiran, B., & Jaedun, A. (2016). Model asesmen autentik untuk menilai hasil belajar siswa Sekolah Menengah Pertama (SMP): Implementasi asesmen autentik di SMP. Jurnal Penelitian Dan Evaluasi Pendidikan, 20(2), 131–141. https://doi.org/10.21831/pep.v20i2.10063
Lau, P. N., Chua, Y. T., Teow, Y., & Xue, X. (2020). Implementing alternative assessment strategies in chemistry amidst COVID-19: Tensions and reflections. Education Sciences, 10(11), 1–15. https://doi.org/10.3390/educsci10110323
McCowan, R. J., & McCowan, S. C. (1999). Item Analysis for Criterion-Referenced Tests. Center for Development of Human Services. http://www.bsc-cdhs.org
Meijer, R. R., & Tendeiro, J. N. (2017). Unidimensional item response theory. In The Wiley Handbook of Psychometric Testing: A Multidisciplinary Reference on Survey, Scale and Test Development (Vols. 1–2, pp. 413–443). Wiley Blackwell. https://doi.org/10.1002/9781118489772.ch15
Monseur, C., Baye, A., Lafontaine, D., & Quittre, V. (2011). PISA test format assessment and the local independence assumption. IERI Monograph Series: Issues and Methodologies in Large-Scale Assessments, 4. https://orbi.uliege.be/bitstream/2268/103137/1/IERI_Monograph_Volume04_Chapter_6.pdf
Nguyen, T. H., Han, H. R., Kim, M. T., & Chan, K. S. (2014). An introduction to item response theory for patient-reported outcome measurement. In Patient (Vol. 7, Issue 1, pp. 23–35). Adis International Ltd. https://doi.org/10.1007/s40271-013-0041-0
Nuriana, D. (2018). Kendala guru dalam memberikan penilaian sikap siswa pada proses pembelajaran Berdasarkan Kurikulum 2013. Madrosatuna: Journal of Islamic Elementary School, 2(2), 51–62. https://doi.org/10.21070/madrosatuna.v2i2.1970
Nurmawati, N., Driana, E., & Ernawati, E. (2021). Pemahaman guru kimia sekolah menengah atas tentang penilaian kemampuan berpikir tingkat tinggi dan implementasinya. Edusains, 12(2), 233–242. https://doi.org/10.15408/es.v12i2.13613
Oriondo, L. L., & Dallo-Antonio, E. M. (1984). Evaluating Educational Outcomes (Tests, Measurement and Evaluation). Rex Book Store.
Pratama, M. A., Supahar, Lestari, D. P., Sari, W. K., Putri, T. S. Y., & Adiatmah, V. A. K. (2020). Data literacy assessment instrument for preparing 21 Cs literacy: Preliminary study. Journal of Physics: Conference Series, 1440(1). https://doi.org/10.1088/1742-6596/1440/1/012085
Salirawati, D. (2021). Authentic assessment in the pandemic period. Journal of The Indonesian Society of Integrated Chemistry, 13(1), 21–31. https://doi.org/10.22437/jisic.v13i1.11716
Shrestha, N. (2021). Factor analysis as a tool for survey analysis. American Journal of Applied Mathematics and Statistics, 9(1), 4–11. https://doi.org/10.12691/ajams-9-1-2
Stowe, R. L., & Cooper, M. M. (2019). Assessment in chemistry education. Israel Journal of Chemistry, 59(6), 598–607. https://doi.org/10.1002/ijch.201900024
Suastra, W., & Ristiati, N. P. (2017). Problems faced by teachers in designing and implementing authentic Assessment in science teaching. International Research Journal of Engineering, 3, 27–36. https://doi.org/10.21744/irjeis.v3i4.496
Sudiana, I. K., Sastrawidana, I. D. K., & Antari, N. P. S. (2018). Kendala guru dalam penyelenggaraan penilaian sikap. Jurnal Pendidikan Kimia Undiksha, 2(2), 9–74. https://doi.org/10.23887/jjpk.v2i2.21169
Sumintono, B., & Widhiarso, W. (2013). Aplikasi Model Rasch untuk Penelitian Ilmu-Ilmu Sosial (B. Trim, Ed.; Revisi). Trim Komunikata Publishing House.
Sund, P. (2016). Science teachers’ mission impossible?: a qualitative study of obstacles in assessing students’ practical abilities. International Journal of Science Education, 38(14), 2220–2238. https://doi.org/10.1080/09500693.2016.1232500
Sutadji, E., Susilo, H., Wibawa, A. P., Jabari, N. A. M., & Rohmad, S. N. (2021). Adaptation strategy of authentic assessment in online learning during the covid-19 pandemic. Journal of Physics: Conference Series, 1810(1). https://doi.org/10.1088/1742-6596/1810/1/012059
Suyanta, S., Muharram, M., Mulbar, U., Rauf, B., Agung, M., Ganefri, G., Ponto, H., Sila, I. N., Wahid, A., Parenreng, J. M., Yasdin, Y., Astuti, S. R. D., Puspita Sari, A. R., & Tyas, R. A. (2020). Educational LPTK, non-educational LPTK, and non-LPTK students’ intention to become teacher. Universal Journal of Educational Research, 8(12), 6676–6683. https://doi.org/10.13189/ujer.2020.081232
Thorpe, G. L., & Favia, A. (2012). Data Analysis Using Item Response Theory Methodology: An Introduction to Selected Programs and Applications. Psychology Faculty Scholarship, 20, 1-33 http://digitalcommons.library.umaine.edu/psy_facpub/20
Villarroel, V., Bloxham, S., Bruna, D., Bruna, C., & Herrera-Seda, C. (2018). Authentic assessment: creating a blueprint for course design. Assessment and Evaluation in Higher Education, 43(5), 840–854. https://doi.org/10.1080/02602938.2017.1412396
Wahyuni, L. G. E., Dewi, N. L. P. E. S., & Paramartha, A. A. G. Y. (2021). Authentic Assessment Practice Teachers’ Perceived Knowledge. Advances in Social Science, Education and Humanities Research, 540, 316–323. https://doi.org/10.2991/assehr.k.210407.258
Widana, I. W. (2017). Higher order thinking skills assessment (HOTS). Journal of Indonesian Student Assessment and Evaluation, 3(1), 32–44. https://journal.unj.ac.id/unj/index.php/jisae/article/view/4859/3601
Wood, J. (2017, November 12). Logistic IRT Models. QuantDev Penn State University. https://quantdev.ssri.psu.edu/sites/qdev/files/IRT_tutorial_FA17_2.html
Wulandari, A. D., Pramana Situmorang, R., & Dewi, L. (2018). Evaluasi pelaksanaan penilaian autentik pada pembelajaran IPA terhadap hasil belajar peserta didik kelas VIII SMP Negeri 3 Salatiga. Jurnal Pendidikan Sains (JPS), 06(01), 34–46. http://jurnal.unimus.ac.id/index.php/JPKIMIA
Yang, F. M., & Kao, S. T. (2014). Item response theory for measurement validity. Shanghai Arvhives of Psychiatry, 26(3). https://doi.org/10.3969/j.issn.1002-0829.2014.03.010
Author Biographies
Qurratu 'Ainillana, Universitas Negeri Yogyakarta
Isana Supiah Yosephine Louise, Universitas Negeri Yogyakarta
License
Copyright (c) 2024 Qurratu 'Ainillana, Isana Supiah Yosephine Louise
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
