Implementation of Evaluation of Kirkpatrick Model in Statistics Course Based on Case Method at the Department of Building Engineering

Authors

Zulkifli Matondang , Harun Sitompul , Kinanti Wijaya

DOI:

10.29303/jppipa.v9i5.3371

Published:

2023-05-31

Issue:

Vol. 9 No. 5 (2023): May

Keywords:

Evaluation, Kirkpatrick model, Lectures, Performance assessment

Research Articles

Downloads

How to Cite

Matondang, Z. ., Sitompul, H. ., & Wijaya, K. . (2023). Implementation of Evaluation of Kirkpatrick Model in Statistics Course Based on Case Method at the Department of Building Engineering. Jurnal Penelitian Pendidikan IPA, 9(5), 2677–2685. https://doi.org/10.29303/jppipa.v9i5.3371
Crossref
Scopus
Google Scholar
Europe PMC

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Abstract

This study aims to obtain an overview of the implementation of Kirkpatrick's evaluation in case-based statistics courses based on Case Method at the Department of Building Engineering. Case-based lectures train students to solve problems in the field of statistics by applying higher-order thinking such as: finding solutions to problems, thinking critically, logically, reflectively, metacognitively and creatively. The evaluation of the Kirkpatrick model is carried out through four levels, and each level is assessed using a different tool. The implementation of Kirkpatrick's evaluation consists of 4 levels, namely: reaction, learning, behavior, and impact. This research method is descriptive qualitative research. The research sample is 56 students majoring in Engineering Building Engineering, State University of Medan. The research data was collected using a questionnaire, assessment and documentation. The questionnaire used has gone through reliability testing with Crombach's Alpha. The assessment was conducted to obtain student performance in the form of learning processes and behavior change. Documentation is obtained through the resulting lecture products. The results showed that Kirkpatrick's evaluation model in statistics course lectures was very effective in revealing the quality of learning. At the reaction evaluation level, students gave a positive response with satisfactory qualifications to case-based statistics lectures. The results of the evaluation at the learning level obtained the difference in learning outcomes on students' thinking abilities of 7.59 with a significance of 0.010. The results of the evaluation at the behavioral level, students have various competencies obtained such as: instrument preparation, instrument analysis, research data processing, SPSS application and interpretation of SPSS analysis results. The results of the evaluation at the impact level are that students are able to compile instruments, obtain and process data used to compose a final project. Based on the criteria for the success of Kirkpatrick's evaluation performance, the implementation of case-based statistics lectures was very successful. Kirkpatrick's evaluation model is able to describe evaluation results that cover all aspects of lectures so that it is worthy of being recommended as an evaluation model for lectures

References

Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214–221. https://doi.org/10.1016/j.sapharm.2018.03.066

Almutairi, T. S., & Shraid, N. S. (2021). Teacher evaluation by different internal evaluators: Head of departments, teachers themselves, peers and students. International Journal of Evaluation and Research in Education (IJERE), 10(2), 588. https://doi.org/10.11591/ijere.v10i2.20838

Alsalamah, A., & Callinan, C. (2021). The Kirkpatrick model for training evaluation: bibliometric analysis after 60 years (1959–2020). Industrial and Commercial Training, 54(1), 36–63. https://doi.org/10.1108/ICT-12-2020-0115

Anggraeni, L. (2020). Penerapan Metode Studi Kasus Dalam Upaya Meningkatkan Kemampuan Berpikir Kritis Mahasiswa pada Matakuliah Hubungan Internasional. Media Komunikasi FPIPS, 10(2), 23. https://doi.org/10.23887/mkfis.v10i2.462.

Bhatia, M., Stewart, A. E., Wallace, A., Kumar, A., & Malhotra, A. (2021). Evaluation of an In-Situ Neonatal Resuscitation Simulation Program Using the New World Kirkpatrick Model. Clinical Simulation in Nursing, 50, 27–37. https://doi.org/10.1016/j.ecns.2020.09.006

Bijani, M., Rostami, K., Momennasab, M., & Yektatalab, S. (2018). Evaluating the Effectiveness of a Continuing Education Program for Prevention of Occupational Exposure to Needle Stick Injuriesin Nursing Staff Based on Kirkpatrick’s Model. Journal of the National Medical Association, 110(5). https://doi.org/10.1016/j.jnma.2017.11.002.

Buriak, S. E., & Ayars, C. L. (2019). Evaluation of a drug and alcohol safety education program in aviation using interrupted time series and the Kirkpatrick framework. Evaluation and Program Planning, 73, 62–70. https://doi.org/10.1016/j.evalprogplan.2018.11.003

Cahapay, M. (2021). Kirkpatrick model: Its limitations as used in higher education evaluation. International Journal of Assessment Tools in Education, 8(1), 135–144. https://doi.org/10.21449/ijate.856143

Dewi, L. R., & Kartowagiran, B. (2018). An evaluation of internship program by using Kirkpatrick evaluation model. REID (Research and Evaluation in Education), 4(2), 155–163. https://doi.org/10.21831/reid.v4i2.22495

Febriana, R. (2021). Evaluasi pembelajaran. Bumi Aksara.

Gracieux, F. Y. (2019). The Asian Sarcoma Consortium Sarcoma Preceptorship Program: A Program Evaluation Study Utilizing the Kirkpatrick Model (Level 1 and 2). Annals of Oncology, 30(9). https://doi.org/10.1093/annonc/mdz433.005

Hanifa, R. (2018). EFL Published Materials: An Evaluation of English Textbooks for Junior High School in Indonesia. Advances InLanguage and Literary Studies, 9(2), 166. https://doi.org/10.7575/aiac.alls.v.9n.2p.166

Hidayat, R., Alam, B. P., Lutvaidah, U., & Santosa, P. P. P. (2023). Implementasi Evaluasi Model Kirkpatrick Pada Program Pelatihan Penggunaan Eyd V SMK Broadcasting Mahardika. Abdi Jurnal Publikasi, 1(5), 436–441. Retrieved from https://jurnal.portalpublikasi.id/index.php/AJP/article/view/173

Hsu, W., & Chen, P.-W. (2021). The influences of service quality and individual characteristics on vocational training effectiveness. Sustainability, 13(23), 13207. https://doi.org/10.3390/su132313207

Irwantoro, N., & Suryana, Y. (2016). Kompetensi pedagogik. Genta Group Production.

Izza, A. Z., Falah, M., & Susilawati, S. (2020). Studi literatur: problematika evaluasi pembelajaran dalam mencapai tujuan pendidikan di era merdeka belajar. Konferensi Ilmiah Pendidikan Universitas Pekalongan 2020, 1, 10–15. Retrieved from https://proceeding.unikal.ac.id/index.php/kip

Laili, S. N., Sudarti, S., & Supriadi, B. (2023). The Effect of Physics Learning Based on Case Method on Skills in Inferences Problems Temperature and Health. Journal of Science and Science Education, 4(1), 50–54. https://doi.org/10.29303/jossed.v4i1.2556

Mahirah. (2017). Evaluasi Belajar Peserta Didik (Siswa). Idaarah: Jurnal Manajemen Pendidikan, 1(2). https://doi.org/10.24252/idaarah.v1i2.4269

Mahmoodi, M., Rashtchi, M., & Abbasian, G. R. (2019). Evaluation of in-service teacher training program in iran: Focus on the Kirkpatrick model. Education and Self Development, 14(4), 20–38. https://doi.org/10.26907/esd14.4.03.

Mulyanto, B. S., Sadono, T., Koeswanti, H. D., Dasar, S., Wonodoyo, N., Tengah, J., Kristen, U., Wacana, S., & Tengah, J. (2020). Evaluation of Critical Thinking Ability with Discovery Lerning Using Blended Learning Approach in Primary School. Journal of Educational Research and Evaluation, 9(2), 78–84. https://doi.org/10.15294/jere.v9i2.46135.

Nurhayati, Y. (2018). Penerapan Model Kirkpatrick untuk Evaluasi Program Diklat Subtantif Materi Perencanaan Pembelajaran di Wilayah Kerja Provinsi Kepulauan Riau. Andragogi Jurnal Diklat Teknis, VI(2), 170–187. https://doi.org/10.36052/andragogi.v6i2.63

Peralbo-Uzquiano, M., Fernández-Abella, R., Durán-Bouza, M., Brenlla-Blanco, J.-C., & Cotos-Yáñez, J.-M. (2020). Evaluation of the effects of a virtual intervention programme on cognitive flexibility, inhibitory control and basic math skills in childhood education. Computers & Education, 159, 104006. https://doi.org/10.1016/j.compedu.2020.104006

Riadi, A. (2017). Problematika Sistem Evaluasi Pembelajaran. Ittihad Jurnal Kopertais Wilayah XI Kalimantan, 15(27), 11. Retrieved from http://jurnal.uin-antasari.ac.id/index.php/ittihad/article/viewFile/1593/1162

Ritonga, R., Saepudin, A., & Wahyudin, U. (2019). Penerapan model evaluasi kirkpatrick empat level dalam mengevaluasi program Diklat di Balai Besar Pelatihan Pertanian (BBPP) Lembang. Jurnal Pendidikan Nonformal, 14(1), 12–21. https://doi.org/10.17977/um041v14i1p12-21

Rosidah, C., & Pramulia, P. (2021). Team Based Project dan Case Method Sebagai Strategi Pengembangan Keterampilan Mengembangkan Pembelajaran Mahasiswa. MENDIDIK: Jurnal Kajian Pendidikan Dan Pengajaran, 7(2), 245–251. https://doi.org/10.30653/003.202172.196

Sakthi, T., & Moshi, A. A. M. (2021). Effectiveness measurement study on entrepreneurship awareness camp for technical education students using Kirkpatrick’s model. Materials Today: Proceedings, 45(2), 1609–1613. https://doi.org/10.1016/j.matpr.2020.08.419

Savul, S., Ikram, A., Khan, M. A., & Khan, M. A. (2021). Evaluation of Infection Prevention and Control Training Workshops using Kirkpatrick’s Model. International Journal of Infectious Diseases, 112, 76–80. https://doi.org/10.1016/j.ijid.2021.09.005

Sofia, N., Ritonga, M., Arita, S., Syahrul, S., Shalihah, M. A., Dewi, I. P., & Sofya, R. (2023). Peningkatan Keterampilan Berpikir Kritis Melalui Pengembangan E-Modul Perpajakan Berbasis Case Method. Jurnal Ecogen, 6(1), 54–63. https://doi.org/10.24036/jmpe.v6i1.14185

Tempelaar, D. (2019). Assessment & Evaluation in Higher Education Supporting the Less-Adaptive Student: TheRole of Learning Analytics, Formative Assessment and Blended lLarning. Assessment and Evaluation in Higher Education, 45(4). https://doi.org/10.1080/02602938.2019.1677855.

Wu, W.-H., Kao, H.-Y., Wu, S.-H., & Wei, C.-W. (2019). Development and Evaluation of Affective Domain Using Student’s Feedback in Entrepreneurial Massive Open Online Courses. Frontiers in Psychology, 10(May). https://doi.org/10.3389/fpsyg.2019.01109

Zielinska-Tomczak, L., Przymuszała, P., Tomczak, S., Krzyśko-Pieczka, I., Marciniak, R., & Cerbin-Koczorowska, M. (2021). How Do Dieticians on Instagram Teach? The Potential of the Kirkpatrick Model in the Evaluation of the Effectiveness of Nutritional Education in Social Media. Nutrients, 13(6). https://doi.org/10.3390/nu13062005

Author Biographies

Zulkifli Matondang, Universitas Negeri Medan

Harun Sitompul, Universitas Negeri Medan

Kinanti Wijaya, Universitas Negeri Medan

License

Copyright (c) 2023 Yudhistira Anggraini

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).