Analysis of Item Characteristics of Natural Sciences National Examinations for Junior High School Based on the Classical Test Theory Approach
DOI:
10.29303/jppipa.v9i10.3698Published:
2023-10-25Downloads
Abstract
This study aims to analyze the characteristics of the items based on the classical test theory approach. This research is exploratory research with a quantitative approach. The data used in this study were data from the 2015 Science Subject National Examination for Junior High School in Daerah Istimewa Yogyakarta (DIY) province. The samples taken in this study were 9054 students. Test takers are grouped into high groups and low groups based on the total score obtained. Estimation of item parameters using Excel and QUEST. The results of the analysis show that based on the classical test theory approach, the average item difficulty level ) in the high group is in the easy category, while in the low group, it is in the medium category, the average item differential index ( ) shows that the test ability to distinguish students with high abilities and low abilities in both the high and low groups is in the unfavorable category; and the reliability coefficient of the test (Ï) in the high group has high reliability, and the low group has perfect reliability
Keywords:
Classical test theory Item characteristics National examinations Natural scienceReferences
Aiken, L. R. (1997). Psychological testing and assessment (9th ed.). Allyn and Bacon.
Aldyza, N., & Andani, D. (2018). Analisis Tingkat Kesukaran Butir Soal Ujian Nasional (UN) Ipa Smp Tahun Ajaran 2014/2015 Di Kabupaten Aceh Tenggara. Jurnal Pendidikan Almuslim, 6(1). Retrieved from http://jfkip.umuslim.ac.id/index.php/jupa/article/view/330
Ali, A., & Istiyono, E. (2022). An analysis of item response theory using program R. Al-Jabar : Jurnal Pendidikan Matematika, 13(1), 109–123. https://doi.org/10.24042/ajpm.v13i1.11252
Allen, M. J., & Yen, W. M. (1979). Introduction to measurement theory (L. S. Wrightsman (ed.)). Brooks/Cole Publishing Company.
Anastasi, A., & Urbina, S. (1997). Psychological testing (7th ed). Prentice Hall.
Anggoro, B. S., Agustina, S., Komala, R., Komarudin, K., Jermsittiparsert, K., & Widyastuti, W. (2019). An Analysis of Students’ Learning Style, Mathematical Disposition, and Mathematical Anxiety toward Metacognitive Reconstruction in Mathematics Learning Process Abstract. Al-Jabar : Jurnal Pendidikan Matematika, 10(2), 187–200. https://doi.org/10.24042/ajpm.v10i2.3541
Ardi, A., Hervi, F., & Mudjiran, M. (2023). Validity and Reliability Questionnaire of Students’ Critical Thinking Skills in General Biology Course. Jurnal Penelitian Pendidikan IPA, 9(3), 1436–1444. https://doi.org/10.29303/jppipa.v9i3.2761
Cohen, C., & Swerdlik. (2009). Psychology testing and assessment: An introduction to test and measurement (7th ed.). McGraw-Hill.
Crocker, L. M., & Algina, J. (1986). Introduction to classical and modern test theory. Holt, Rine Hart, and Winston.
Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Lawrence Erlbaum Associates Publishers.
Etobro, A. B., & Fabinu, O. E. (2017). Students’ perceptions of difficult concepts in biology in senior secondary schools in Lagos state. Global Journal of Educational Research, 16(2), 139. https://doi.org/10.4314/gjedr.v16i2.8
Fan, X. (1998). Item response theory and classical test theory: An empirical comparison of their item/person statistics. Educational and Psychological Measurement, 58(3), 357–381. https://doi.org/10.1177/0013164498058003001
French, C. L. A. (2001). Review of Classical Methods of Item Analysis. Paper Presented in Annual Meeting of the Southweast Educational Research Association.
Hambleton, R. K Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. Sage.
Hambleton, Ronald K Swaminathan, H. (1985). Item response theory. Kluwer Inc.
Hambleton, R. K., Robin, F., & Xing, D. (2000). Item response models for the analysis of educational and psychological test data. In Handbook of applied multivariate statistics and mathematical modeling, 553-581. Retrieved from https://doi.org/10.1016/B978-012691360-6/50020-3
Hu, Z., Lin, L., Wang, Y., & Li, J. (2021). The Integration of Classical Testing Theory and Item Response Theory. Psychology, 12, 1397–1409. https://doi.org/10.4236/psych.2021.129088
Hussin, W. N. T. W., Harun, J., & Shukor, N. A. (2018). Problem Based Learning to Enhance Students Critical Thinking Skill via Online Tools. Asian Social Science, 15(1), 14. https://doi.org/10.5539/ass.v15n1p14
Jailani, J., & Almukarramah, A. (2020). Upaya Peningkatan Kualitas Pembelajaran Biologi Melalui Pembelajaran Bermakna Dengan Menggunakan Peta Konsep. Jurnal Biology Education, 8(2), 122–130. https://doi.org/10.32672/jbe.v8i2.2371
Kaplan, R. M., & Saccuzzo, D. P. (2009). Psychological testing: Principles, applications and issues (7th ed.). Nelson Education.
Lawrence, M. . (2019). Question to ask when evaluating test. Practical Assessment, Research, and Education, 4. https://doi.org/10.7275/5c28-0n19
Lord, F. . (1980). Applications of item response theory to practical testing problems (1st ed). Erlbaum.
Mardapi, D. (2012). Pengukuran, Penilaian, dan Evaluasi Pendidikan. Nuha Litera.
Mehrens, W., & Lehmann, I. (1973). Measurement and evaluation in education and psychology. Hold, Rinehart and Winston Inc.
Murphy, K. R., & Davidshofer, C. O. (2005). Psychological testing principles and applications (Pearson (ed.); 6th ed). Education.
Nitko, A. J. (1996). Educational assesment of students (2nd ed). Merill an imprint of Prentince Hall Englewood Cliffs.
Retnawati, H. (2016). Validitas reliabilitas dan karakteristik butir. Parama Publishing.
Retnawati, H., Kartowagiran, B., Arlinwibowo, J., & Sulistyaningsih, E. (2017). Why are the mathematics national examination items difficult and what is teachers’ strategy to overcome it? International Journal of Instruction, 10(3), 257–276. https://doi.org/10.12973/iji.2017.10317a
Sugiyono. (2011). Metode Penelitian Kuantitatif Kualitatif dan R&D (1st ed.). Alfabeta.
Widiatmo, T., Jufri, A. W., & Jamaluddin, J. (2019). Analysis of Validation of Instruments to Measure Student’s Critical Thinking Ability and Science Literation. Jurnal Penelitian Pendidikan IPA, 5(2), 212–218. https://doi.org/10.29303/jppipa.v5i2.272
License
Copyright (c) 2023 Mariana, Djaffar Lessy, Dinar Riaddin, Muhammad Rizal Hardiansyah, Corneli Pary
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
