Development of Problem-Solving Ability Assessment Instrument in Chemical Calculation Concept
DOI:
10.29303/jppipa.v11i8.11990Published:
2025-08-25Downloads
Abstract
Measuring students' abilities through assessment instruments correctly is very useful so that teachers can guide students effectively. The development of assessment instruments often does not follow formal and scientific preparation steps, so that valid instruments are needed and measurements of problem-solving abilities can produce accurate and correct measurements. Problem solving is a complex activity involving broad objectives in the form of understanding problems, developing strategies, implementing strategies and interpreting results. This study aims to develop an assessment instrument for problem solving skills and to determine the characteristics of the problems solving skills assessment instrument in the concept of chemical calculations. This study uses a 4D development model consisting of the define, design, develop and disseminate stages. The test subjects in this study were 210 high school students. The results of the study showed that: The assessment instrument developed was in the form of 13 descriptive questions arranged based on indicators of problems solving skills; The assessment instrument fits the Rasch PCM 1-PL model in the range of 0.84 logit - 1.16 logit (valid), the reliability estimate is 0.62 reliable category and the level of difficulty of the questions - 0.38 logit to 1.00 logit (good category).
Keywords:
Assessment instrument Chemical calculation Problem solvingReferences
Adom, D., Adu-Mensah, J., & Dake, D. A. (2020). Test, measurement, and evaluation: Understanding and use of the concepts in education. International Journal of Evaluation and Research in Education (IJERE), 9(1), 109. https://doi.org/10.11591/ijere.v9i1.20457
Agustini, Rery, R. U., & Anwar, L. (2021). The Development and Validity of CPS-Based Assessment Instrument for Critical Thinking Ability on Stoichiometry Materials. Journal of Physics: Conference Series, 1788(1), 012026. https://doi.org/10.1088/1742-6596/1788/1/012026
Alkan, F. (2021). Problem Solving in Chemistry: Example of Neutralization Titrations. MIER Journal of Educational Studies Trends and Practices, 306–328. https://doi.org/10.52634/mier/2021/v11/i2/1955
Amelia, O., & Listyarini, R. V. (2022). Test Instrument to Measure Student’s Level of Chemical Literacy in Macromolecules Topic. JPI (Jurnal Pendidikan Indonesia), 11(3), 480–491. https://doi.org/10.23887/jpiundiksha.v11i3.39560
Ananda, L. R., Rahmawati, Y., & Khairi, F. (2023). Critical thinking skills of Chemistry students by integrating design thinking with STEAM-PjBL. Journal of Technology and Science Education, 13(1), 352. https://doi.org/10.3926/jotse.1938
Anisah, D. C., Nasrudin, H., & Sukarmin. (2025). Profile of Critical Thinking Skills of Phase F Learning in Chemistry Subjects Acid-Base Material. Jurnal Penelitian Pendidikan IPA, 11(1), 17–27. https://doi.org/10.29303/jppipa.v11i1.9842
Arsiana, K. E. A., Yudiana, K., & Antara, P. A. (2022). Pengembangan Instrumen Penilaian Higher Order Thinking Skill (Hots) pada Pembelajaran Tema 8 (Bumiku) di Kelas VI Sekolah Dasar Gugus Iii Kecamatan Gerokgak. Journal for Lesson and Learning Studies, 5(2), 267–273. https://doi.org/10.23887/jlls.v5i2.52798
Aryadoust, V., Tan, H. A. H., & Ng, L. Y. (2019). A Scientometric Review of Rasch Measurement: The Rise and Progress of a Specialty. Frontiers in Psychology, 10, 2197. https://doi.org/10.3389/fpsyg.2019.02197
Astarina, R., Yerizon, Bentri, A., & Zainil, M. (2024). Development of Interactive Learning Media Assisted by Google Sites in Building Materials for Elementary Schools Grade V. Jurnal Penelitian Pendidikan IPA, 10(SpecialIssue), 226–233. https://doi.org/10.29303/jppipa.v10iSpecialIssue.8555
Axelsson, M., Kottorp, A., Carlson, E., Gudmundsson, P., Kumlien, C., & Jakobsson, J. (2022). Translation and validation of the Swedish version of the IPECC-SET 9 item version. Journal of Interprofessional Care, 36(6), 900–907. https://doi.org/10.1080/13561820.2022.2034762
Aybek, E. C., & Demirtasli, R. N. (2017). Computerized Adaptive Test (CAT) Applications and Item Response Theory Models for Polytomous Items. International Journal of Research In Education And Science, 475–475. https://doi.org/10.21890/ijres.327907
Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch Analysis in the Human Sciences. Springer Netherlands. https://doi.org/10.1007/978-94-007-6857-4
Cavallo, A., Sanasi, S., Ghezzi, A., & Rangone, A. (2021). Competitive intelligence and strategy formulation: Connecting the dots. Competitiveness Review: An International Business Journal, 31(2), 250–275. https://doi.org/10.1108/CR-01-2020-0009
Chen, C., Twycross, J., & Garibaldi, J. M. (2017). A new accuracy measure based on bounded relative error for time series forecasting. Plos One, 12(3), e0174202. https://doi.org/10.1371/journal.pone.0174202
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024). Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations. Asia Pacific Journal of Management, 41(2), 745–783. https://doi.org/10.1007/s10490-023-09871-y
Darmawan, A., Asa, B. N., Kurniawan, F., Nukhba, R., Albab, U., & Parno, P. (2020). Pengembangan Instrumen Tes Pemecahan Masalah Bagi Mahasiswa Jurusan Fisika Pada Materi Dinamika Partikel. Jurnal Pendidikan Fisika dan Keilmuan (JPFK), 6(1), 55. https://doi.org/10.25273/jpfk.v6i1.5579
Daulay, K. R., & Ruhaimah, I. (2019). Polya theory to improve problem-solving skills. Journal of Physics: Conference Series, 1188, 012070. https://doi.org/10.1088/1742-6596/1188/1/012070
Febrianti, T. S., Fatimah, S., & Afgani Dahlan, J. (2024). Identifying Learning Obstacles in Pre-Service Mathematics Teachers’ Understanding of Circle Concepts: A Preliminary Study within A Didactical Design Research Framework. Jurnal Pendidikan MIPA, 25(1), 419–439. https://doi.org/10.23960/jpmipa/v25i1.pp419-439
Hubbart, J. A. (2023). Organizational Change: The Challenge of Change Aversion. Administrative Sciences, 13(7), 162. https://doi.org/10.3390/admsci13070162
Ibarra-Sáiz, M. S., Rodríguez-Gómez, G., & Boud, D. (2021). The quality of assessment tasks as a determinant of learning. Assessment & Evaluation in Higher Education, 46(6), 943–955. https://doi.org/10.1080/02602938.2020.1828268
Kwangmuang, P., Jarutkamolpong, S., Sangboonraung, W., & Daungtod, S. (2021). The development of learning innovation to enhance higher order thinking skills for students in Thailand junior high schools. Heliyon, 7(6), e07309. https://doi.org/10.1016/j.heliyon.2021.e07309
Laliyo, L. A. R., Utina, R., Husain, R., Umar, M. K., Katili, M. R., & Panigoro, C. (2023). Evaluating students’ ability in constructing scientific explanations on chemical phenomena. Eurasia Journal of Mathematics, Science and Technology Education, 19(9), em2328. https://doi.org/10.29333/ejmste/13524
Ling, Y., Zhou, L., Zhang, B., & Ren, H. (2024). Developing middle school students’ problem-solving ability through interdisciplinary project-based learning. Education for Chemical Engineers, 46, 43–53. https://doi.org/10.1016/j.ece.2023.11.001
Marar, S., Hamza, M. A., Ayyash, M., & Abu-Shaheen, A. (2023). Development and validation of an instrument to assess the knowledge and perceptions of predatory journals. Heliyon, 9(11), e22270. https://doi.org/10.1016/j.heliyon.2023.e22270
Muhsin, L. B., & Laksono, E. W. (2023). Development of integrated Assessment to Measure student’s Analytical Thinking Skills and Scientific Attitudes for Chemical Equilibrium Topic. Jurnal Penelitian Pendidikan IPA, 9(2), 556–562. https://doi.org/10.29303/jppipa.v9i2.2191
Ofianto, O., & Suhartono, S. (2015). An assessment model of historical thinking skills by means of the RASCH model. REID (Research and Evaluation in Education), 1(1), 73–83. https://doi.org/10.21831/reid.v1i1.4899
Purwandari, I. D., Rahayu, S., & Dasna, I. W. (2022). Inquiry Learning Model in Chemistry Learning: A Review. JRPK: Jurnal Riset Pendidikan Kimia, 12(1), 38–46. https://doi.org/10.21009/JRPK.121.06
Robinson, M., Johnson, A. M., Walton, D. M., & MacDermid, J. C. (2019). A comparison of the polytomous Rasch analysis output of RUMM2030 and R (ltm/eRm/TAM/lordif). BMC Medical Research Methodology, 19(1), 36. https://doi.org/10.1186/s12874-019-0680-5
Rohmah, M., & Sutiarso, S. (2017). Analysis Problem Solving in Mathematical Using Theory Newman. EURASIA Journal of Mathematics, Science and Technology Education, 14(2). https://doi.org/10.12973/ejmste/80630
Setyaedhi, H. S. (2024). Comparative Test of Cronbach’s Alpha Reliability Coefficient, Kr-20, Kr-21, And Split-Half Method. Journal of Education Research and Evaluation, 8(1), 47–57. https://doi.org/10.23887/jere.v8i1.68164
Setyawarno, D. (2017). Penggunaan AplikasiSoftware Iteman (Item and Test Analysis) untuk Analisis Butir Soal Pilihan Ganda Berdasarkan Teori Tes Klasik. Jurnal Ilmu Fisika dan Pembelajarannya (JIFP), 1(1), 11–21. https://doi.org/10.19109/jifp.v1i1.866
Shirali, G., Shekari, M., & Angali, K. A. (2018). Assessing Reliability and Validity of an Instrument for Measuring Resilience Safety Culture in Sociotechnical Systems. Safety and Health at Work, 9(3), 296–307. https://doi.org/10.1016/j.shaw.2017.07.010
Sinaga, B., Sitorus, J., & Situmeang, T. (2023). The influence of students’ problem-solving understanding and results of students’ mathematics learning. Frontiers in Education, 8, 1088556. https://doi.org/10.3389/feduc.2023.1088556
Stefana, A., Damiani, S., Granziol, U., Provenzani, U., Solmi, M., Youngstrom, E. A., & Fusar-Poli, P. (2025). Psychological, psychiatric, and behavioral sciences measurement scales: Best practice guidelines for their development and validation. Frontiers in Psychology, 15, 1494261. https://doi.org/10.3389/fpsyg.2024.1494261
Surif, J., Ibrahim, N. H., & Dalim, S. F. (2014). Problem Solving: Algorithms and Conceptual and Open-ended Problems in Chemistry. Procedia - Social and Behavioral Sciences, 116, 4955–4963. https://doi.org/10.1016/j.sbspro.2014.01.1055
Taber, K. S. (2018). The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education. Research in Science Education, 48(6), 1273–1296. https://doi.org/10.1007/s11165-016-9602-2
Tesio, L., Caronni, A., Kumbhare, D., & Scarano, S. (2024). Interpreting results from Rasch analysis 1. The “most likely” measures coming from the model. Disability and Rehabilitation, 46(3), 591–603. https://doi.org/10.1080/09638288.2023.2169771
Tyas, A. S., Senam, Wiyarsi, A., & Laksono, E. W. (2020). Chemistry teaching self-efficacy: A scale development. Journal of Physics: Conference Series, 1440(1), 012005. https://doi.org/10.1088/1742-6596/1440/1/012005
Wi̇caksono, A. G. C., & Korom, E. (2022). Review of problem-solving measurement: An assessment developed in the Indonesian context. Participatory Educational Research, 9(1), 116–136. https://doi.org/10.17275/per.22.7.9.1
Zakariya, Y. F. (2022). Cronbach’s alpha in mathematics education research: Its appropriateness, overuse, and alternatives in estimating scale reliability. Frontiers in Psychology, 13, 1074430. https://doi.org/10.3389/fpsyg.2022.1074430
License
Copyright (c) 2025 Sri Rubiati, Isana Supiah Yosephine Louise
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
