Authentic Assessment Instrument on Redox Reactions to Assess Students’ Cognitive Skills

Authors

Qurratu 'Ainillana , Isana Supiah Yosephine Louise

DOI:

10.29303/jppipa.v10i10.8791

Published:

2024-10-25

Issue:

Vol. 10 No. 10 (2024): October : In Progress

Keywords:

Assessment Instruments, Authentic Assessment, Higher Order Thinking Skills, Redox Reactions

Research Articles

Downloads

How to Cite

'Ainillana, Q., & Louise, I. S. Y. (2024). Authentic Assessment Instrument on Redox Reactions to Assess Students’ Cognitive Skills. Jurnal Penelitian Pendidikan IPA, 10(10), 7437–7446. https://doi.org/10.29303/jppipa.v10i10.8791
Crossref
Scopus
Google Scholar
Europe PMC

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Abstract

Authentic assessment is an assessment approach that enable students to demonstrate in-depth understanding and solve complex problem using systematic thinking skills, but teachers find it difficult to develop due to limited knowledge and time. The aim of this research is to produce an authentic assessment instrument for redox reaction materials; determine the characteristics, quality, and feasibility. The instrument development model used was a combination of Oriondo & Dallo-Antonio with Cohen Swerdlik. The development stages were assessment planning, instrument construction, and product testing. The research subjects were 155 of 10th-grade students from three public high schools in Bukittinggi, selected using random sampling technique. Data collection techniques were tests and non-test, the instruments were open ended questions and validation sheets. The authentic assessment instrument developed criteria are: (1) can assess students’ higher order thinking skills; (2) integrate knowledge with skills and various scientific disciplines; (3) develop 21st century competencies; and (4) involve real or everyday life contexts for cognitive aspect. The trial results were analyzed using the PCM 1-PL approach at IRT using Winstep and Parscale program. The characteristics of the item were stated fit because it met the acceptance requirements for MNSQ, ZSTD, and PT-Measure Correlation and the difficulty is in a relatively good level. The reliability of the instrument was classified as good, with test reliability of 0.72 and item reliability of 0.96.

References

Adu-Gyamfi, K., & Ampiah, J. G. (2019). Students’ alternative conceptions associated with application of redox reactions in everyday life. Asian Education Studies, 4(1), 29. https://doi.org/10.20849/aes.v4i1.590

Ambiyar, Efendi, R., Irawati, Y., Waskito, & Suryadimal. (2020). Effectiveness e-authentic assessment in computer network course. Journal of Physics: Conference Series, 1481(1). https://doi.org/10.1088/1742-6596/1481/1/012131

Baker, F. B., & Kim, S.-H. (2017). The Basics of Item Response Theory Using R. Springer. https://doi.org/10.1007/978-3-319-54205-8

Bartlett, M. S. (1951). The effect of standardization on a χ2 approximation in factor analysis. In Source: Biometrika (Vol. 38, Issue 3). https://doi.org/10.2307/2332580

Brentari, E., & Golia, S. (2007). Unidimensionality in the Rasch Model: How to detect and interpret. Statistica, 253–261. https://doi.org/https://doi.org/10.6092/issn.1973-2201/3508

Bushkofsky, N. (2016). Developing authentic summative assessments that correlate to the Next Generation Science Standards for a middle school science classroom. Graduate Research Papers. 110. https://scholarworks.uni.edu/grp/11.

Chiang, W.-W., Chiu, M.-H., Chung, S.-L., & Liu, C.-K. (2014). Survey of High School Students’ Understanding of Oxidation-Reduction Reaction. Journal of Baltic Science Education. http://oaji.net/articles/2015/987-1450980905.pdf

Cohen, R. Jay., & Swerdlik, M. E. . (2018). Psychological Testing and Assessment : an introduction to tests and measurement (9th ed.). McGraw-Hill Education.

Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10. https://doi.org/10.7275/jyj1-4868

DeMars, C. (2010). Item Response Theory: Understanding Statistic Measurement (N. Beretvas & P. Leavy, Eds.). Oxford University Press.

Ekawati, D. (2012). The implementation of authentic assessment in Vocational High School 1 Kuala Cenaku. 1st English Language and Literature International Conference. https://jurnal.unimus.ac.id/index.php/ELLIC/article/view/2415

Fuady, I., Priyansyah, R. N., Ernawati, E., & Prasanti, D. (2023). Validity and Reliability Tests on the Nomophobia Instrument with the Rasch Model. Indigenous: Jurnal Ilmiah Psikologi, 7(3), 276–287. https://doi.org/10.23917/indigenous.v7i3.19152

Galdin, M., & Laurencelle, L. (2010). Assessing parameter invariance in item response theory’s logistic two item parameter model: A Monte Carlo investigation. Tutorials in Quantitative Methods for Psychology, 6(2), 39–51. https://doi.org/10.20982/tqmp.06.2.p039

Gulikers, J. T. M., Bastiaens, T. J., & Kirschner, P. A. (2004). A five-dimensional framework for authentic assessment. Educational Technology Research and Development, 52(3), 67–87. https://doi.org/10.1007/BF02504676

Hadinugrahaningsih, T., Rahmawat, Y., & Suryani, E. (2022). An analysis of preservice chemistry teachers’ misconceptions of reduction-oxidation reaction concepts. Journal of Technology and Science Education, 12(2), 448–465. https://doi.org/10.3926/jotse.1566

Hambleton, R. K. ., Swaminathan, Hariharan., & Rogers, H. Jane. (1991). Fundamentals of Item Response Theory (Vol. 2). SAGE Publications, Inc.

Hancock, L. M., & Hollamby, M. J. (2020). Assessing the practical skills of undergraduates: The evolution of a station-based practical exam. Journal of Chemical Education, 97(4), 972–979. https://doi.org/10.1021/acs.jchemed.9b00733

Hanifah, M., & Irambona, A. (2019). Authentic assessment: Evaluation and its application in science learning. Psychology, Evaluation, and Technology in Educational Research, 1(2), 81. https://doi.org/10.33292/petier.v1i2.4

Hasan, R., & Cerimagic, S. (2021). Authentic assessment during Covid-19: an Australian postgraduate computing degree program example. Journal of Learning Development in Higher Education, 22. https://doi.org/10.47408/jldhe.vi22.690

Iskandar, D., & Senam, S. (2015). Studi kemampuan guru kimia SMA lulusan UNY dalam mengembangkan soal UAS berbasis HOTS. Jurnal Inovasi Pendidikan IPA, 1(1), 65–72. https://doi.org/10.21831/jipi.v1i1.4533

Ismiati, I., Nahadi, N., & Halimatul, H. S. (2019). Analysis of the need to development an authentic assessment instrument on buffer material. Journal of Physics: Conference Series, 1157(4). https://doi.org/10.1088/1742-6596/1157/4/042044

Kalkbrenner, M. T. (2021). A practical guide to instrument development and score validation in the social science: The MEASURE approach. Practical Assessment, Research, and Evaluation, 26, 1–18. https://doi.org/10.7275/svg4-e671

Kartowagiran, B., & Jaedun, A. (2016). Model asesmen autentik untuk menilai hasil belajar siswa Sekolah Menengah Pertama (SMP): Implementasi asesmen autentik di SMP. Jurnal Penelitian Dan Evaluasi Pendidikan, 20(2), 131–141. https://doi.org/10.21831/pep.v20i2.10063

Lau, P. N., Chua, Y. T., Teow, Y., & Xue, X. (2020). Implementing alternative assessment strategies in chemistry amidst COVID-19: Tensions and reflections. Education Sciences, 10(11), 1–15. https://doi.org/10.3390/educsci10110323

McCowan, R. J., & McCowan, S. C. (1999). Item Analysis for Criterion-Referenced Tests. Center for Development of Human Services. http://www.bsc-cdhs.org

Meijer, R. R., & Tendeiro, J. N. (2017). Unidimensional item response theory. In The Wiley Handbook of Psychometric Testing: A Multidisciplinary Reference on Survey, Scale and Test Development (Vols. 1–2, pp. 413–443). Wiley Blackwell. https://doi.org/10.1002/9781118489772.ch15

Monseur, C., Baye, A., Lafontaine, D., & Quittre, V. (2011). PISA test format assessment and the local independence assumption. IERI Monograph Series: Issues and Methodologies in Large-Scale Assessments, 4. https://orbi.uliege.be/bitstream/2268/103137/1/IERI_Monograph_Volume04_Chapter_6.pdf

Nguyen, T. H., Han, H. R., Kim, M. T., & Chan, K. S. (2014). An introduction to item response theory for patient-reported outcome measurement. In Patient (Vol. 7, Issue 1, pp. 23–35). Adis International Ltd. https://doi.org/10.1007/s40271-013-0041-0

Nuriana, D. (2018). Kendala guru dalam memberikan penilaian sikap siswa pada proses pembelajaran Berdasarkan Kurikulum 2013. Madrosatuna: Journal of Islamic Elementary School, 2(2), 51–62. https://doi.org/10.21070/madrosatuna.v2i2.1970

Nurmawati, N., Driana, E., & Ernawati, E. (2021). Pemahaman guru kimia sekolah menengah atas tentang penilaian kemampuan berpikir tingkat tinggi dan implementasinya. Edusains, 12(2), 233–242. https://doi.org/10.15408/es.v12i2.13613

Oriondo, L. L., & Dallo-Antonio, E. M. (1984). Evaluating Educational Outcomes (Tests, Measurement and Evaluation). Rex Book Store.

Pratama, M. A., Supahar, Lestari, D. P., Sari, W. K., Putri, T. S. Y., & Adiatmah, V. A. K. (2020). Data literacy assessment instrument for preparing 21 Cs literacy: Preliminary study. Journal of Physics: Conference Series, 1440(1). https://doi.org/10.1088/1742-6596/1440/1/012085

Salirawati, D. (2021). Authentic assessment in the pandemic period. Journal of The Indonesian Society of Integrated Chemistry, 13(1), 21–31. https://doi.org/10.22437/jisic.v13i1.11716

Shrestha, N. (2021). Factor analysis as a tool for survey analysis. American Journal of Applied Mathematics and Statistics, 9(1), 4–11. https://doi.org/10.12691/ajams-9-1-2

Stowe, R. L., & Cooper, M. M. (2019). Assessment in chemistry education. Israel Journal of Chemistry, 59(6), 598–607. https://doi.org/10.1002/ijch.201900024

Suastra, W., & Ristiati, N. P. (2017). Problems faced by teachers in designing and implementing authentic Assessment in science teaching. International Research Journal of Engineering, 3, 27–36. https://doi.org/10.21744/irjeis.v3i4.496

Sudiana, I. K., Sastrawidana, I. D. K., & Antari, N. P. S. (2018). Kendala guru dalam penyelenggaraan penilaian sikap. Jurnal Pendidikan Kimia Undiksha, 2(2), 9–74. https://doi.org/10.23887/jjpk.v2i2.21169

Sumintono, B., & Widhiarso, W. (2013). Aplikasi Model Rasch untuk Penelitian Ilmu-Ilmu Sosial (B. Trim, Ed.; Revisi). Trim Komunikata Publishing House.

Sund, P. (2016). Science teachers’ mission impossible?: a qualitative study of obstacles in assessing students’ practical abilities. International Journal of Science Education, 38(14), 2220–2238. https://doi.org/10.1080/09500693.2016.1232500

Sutadji, E., Susilo, H., Wibawa, A. P., Jabari, N. A. M., & Rohmad, S. N. (2021). Adaptation strategy of authentic assessment in online learning during the covid-19 pandemic. Journal of Physics: Conference Series, 1810(1). https://doi.org/10.1088/1742-6596/1810/1/012059

Suyanta, S., Muharram, M., Mulbar, U., Rauf, B., Agung, M., Ganefri, G., Ponto, H., Sila, I. N., Wahid, A., Parenreng, J. M., Yasdin, Y., Astuti, S. R. D., Puspita Sari, A. R., & Tyas, R. A. (2020). Educational LPTK, non-educational LPTK, and non-LPTK students’ intention to become teacher. Universal Journal of Educational Research, 8(12), 6676–6683. https://doi.org/10.13189/ujer.2020.081232

Thorpe, G. L., & Favia, A. (2012). Data Analysis Using Item Response Theory Methodology: An Introduction to Selected Programs and Applications. Psychology Faculty Scholarship, 20, 1-33 http://digitalcommons.library.umaine.edu/psy_facpub/20

Villarroel, V., Bloxham, S., Bruna, D., Bruna, C., & Herrera-Seda, C. (2018). Authentic assessment: creating a blueprint for course design. Assessment and Evaluation in Higher Education, 43(5), 840–854. https://doi.org/10.1080/02602938.2017.1412396

Wahyuni, L. G. E., Dewi, N. L. P. E. S., & Paramartha, A. A. G. Y. (2021). Authentic Assessment Practice Teachers’ Perceived Knowledge. Advances in Social Science, Education and Humanities Research, 540, 316–323. https://doi.org/10.2991/assehr.k.210407.258

Widana, I. W. (2017). Higher order thinking skills assessment (HOTS). Journal of Indonesian Student Assessment and Evaluation, 3(1), 32–44. https://journal.unj.ac.id/unj/index.php/jisae/article/view/4859/3601

Wood, J. (2017, November 12). Logistic IRT Models. QuantDev Penn State University. https://quantdev.ssri.psu.edu/sites/qdev/files/IRT_tutorial_FA17_2.html

Wulandari, A. D., Pramana Situmorang, R., & Dewi, L. (2018). Evaluasi pelaksanaan penilaian autentik pada pembelajaran IPA terhadap hasil belajar peserta didik kelas VIII SMP Negeri 3 Salatiga. Jurnal Pendidikan Sains (JPS), 06(01), 34–46. http://jurnal.unimus.ac.id/index.php/JPKIMIA

Yang, F. M., & Kao, S. T. (2014). Item response theory for measurement validity. Shanghai Arvhives of Psychiatry, 26(3). https://doi.org/10.3969/j.issn.1002-0829.2014.03.010

Author Biographies

Qurratu 'Ainillana, Universitas Negeri Yogyakarta

Isana Supiah Yosephine Louise, Universitas Negeri Yogyakarta

License

Copyright (c) 2024 Qurratu 'Ainillana, Isana Supiah Yosephine Louise

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).