A Case Study in West Nusa Tenggara for Automated Feedback of Performance Assessment on Science Practicum to Measure Science Process Skills in University

Authors

Sudirman , Agus Ramdani , Aris Doyan , Yunita Arian Sani Anwar , Joni Rokhmat , AA. Sukarso

DOI:

10.29303/jppipa.v9i12.6370

Published:

2023-12-25

Issue:

Vol. 9 No. 12 (2023): December

Keywords:

Performance Assessment, Science Practicum, Automated Feedback, Science Process Skills

Research Articles

Downloads

How to Cite

Sudirman, S., Ramdani, A. ., Doyan, A. ., Anwar, Y. A. S. ., Rokhmat, J. ., & Sukarso, A. . (2023). A Case Study in West Nusa Tenggara for Automated Feedback of Performance Assessment on Science Practicum to Measure Science Process Skills in University . Jurnal Penelitian Pendidikan IPA, 9(12), 11903–11910. https://doi.org/10.29303/jppipa.v9i12.6370
Crossref
Scopus
Google Scholar
Europe PMC

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Abstract

This study examines respondent and university type responses to science process skills instruments integrated with automated feedback on science practicum performance assessments at 2 state college and 2 private college in West Nusa Tenggara Province. A Kruskal-Wallis test was performed utilizing case study and cluster random sampling. Data was collected using online survey, interviews, and direct observations. Three hundred seventy-six university students and teachers from four universities were studied. Since there was no standard instrument, science process skills performance was not assessed. The assessment results show no statistically significant difference (p > 0.05) between state and private college in measuring science process skills integrated with real-time feedback on science practicum. This suggests that neither university has conducted such an assessment. No significant difference in responses between university students and lecturers regarding the measurement of science process skills on performance assessments integrated with real-time feedback in science practicum (p > 0.05), implying that university students and lecturers have the same experience. This study advises developing science process skills measurement on performance assessment for real-time science practicum feedback.

References

Alharbi, B. (2022). Saudi Teachers’ Knowledge of Critical Thinking Skills and Their Attitudes Towards Improving Saudi Students’ Critical Thinking Skills. Problems of Education in the 21st Century, 80(3), 395–407. https://doi.org/10.33225/pec/22.80.395

Bensley, D. A., Masciocchi, C. M., & Rowan, K. A. (2021). A Comprehensive Assessment of Explicit Critical Thinking Instruction on Recognition of Thinking Errors and Psychological Misconceptions. Scholarship of Teaching and Learning in Psychology, 7(2), 107–122. https://doi.org/10.1037/stl0000188

Boone, W. J. (2016). Rasch analysis for instrument development: Why,when,and how? CBE Life Sciences Education, 15(4). https://doi.org/10.1187/cbe.16-04-0148

Chafiq, N., Talbi, M., & Ghazouani, M. (2018). Design and implementation of a risk management tool: A case study of the moodle platform. International Journal of Advanced Computer Science and Applications, 9(8), 458–461. https://doi.org/10.14569/ijacsa.2018.090858

Csapó, B., & Molnár, G. (2019). Online diagnostic assessment in support of personalized teaching and learning: The eDia system. Frontiers in Psychology, 10(JULY). https://doi.org/10.3389/fpsyg.2019.01522

Dhina, M. A., Hadisoebroto, G., Mubaroq, S. R., & Gustiana, I. (2021). Implementation of digital performance assessment to measure pharmacy physics laboratory skills. Momentum: Physics Education Journal, 5(1), 65–72. https://doi.org/10.21067/mpej.v5i1.5146

Harsch, C., Seyferth, S., & Larenas, S. V. (2021). Evaluating a collaborative and responsive project to develop language assessment literacy. Language Learning in Higher Education, 11(2), 311–342. https://doi.org/10.1515/cercles-2021-2020

Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487

Hume, A., & Coll, R. K. (2009). Assessment of learning, for learning, and as learning: New Zealand case studies. Assessment in Education: Principles, Policy and Practice, 16(3), 269–290. https://doi.org/10.1080/09695940903319661

Kruit, P. M., Oostdam, R. J., van den Berg, E., & Schuitema, J. A. (2018). Assessing students’ ability in performing scientific inquiry: instruments for measuring science skills in primary education. Research in Science and Technological Education, 36(4), 413–439. https://doi.org/10.1080/02635143.2017.1421530

Leber, J., Renkl, A., Nückles, M., & Wäschle, K. (2018). When the type of assessment counteracts teaching for understanding. Learning: Research and Practice, 4(2), 161–179. https://doi.org/10.1080/23735082.2017.1285422

Liu, H., Liu, Z., Lai, Y., & Li, L. (2021). Factors Influencing Collaborative Innovation Project Performance: The Case of China. Sustainability, 13(13), 7380. https://doi.org/10.3390/su13137380

Montenegroâ€rueda, M., Luqueâ€de la Rosa, A., Sánchezâ€serrano, J. L. S., & Fernándezâ€cerero, J. (2021). Assessment in higher education during the covidâ€19 pandemic: A systematic review. Sustainability (Switzerland), 13(19). https://doi.org/10.3390/su131910509

Phungsuk, R., Viriyavejakul, C., & Ratanaolarn, T. (2017). Development of a problem-based learning model via a virtual learning environment. Kasetsart Journal of Social Sciences, 38(3), 297–306. https://doi.org/10.1016/j.kjss.2017.01.001

Poce, A., Amenduni, F., Re, M. R., & De Medio, C. (2019). Automatic Assessment of University Teachers’ Critical Thinking Levels. International Journal of Advanced Corporate Learning (IJAC), 12(3), 46. https://doi.org/10.3991/ijac.v12i3.11259

Popovic, N., Popovic, T., Dragovic, I. R., & Cmiljanic, O. (2018). A Moodle-based blended learning solution for physiology education in Montenegro: A case study. Advances in Physiology Education, 42(1), 111–117. https://doi.org/10.1152/ADVAN.00155.2017

Riantini, N. L. R., Suastra, I. W., & Budi Adnyana, P. (2018). Development of science practicum performance assessment in junior high school. SHS Web of Conferences, 42, 00090. https://doi.org/10.1051/shsconf/20184200090

Ronau, R. N., Rakes, C. R., & Niess, M. L. (2011). Educational technology, teacher knowledge, and classroom impact: A research handbook on frameworks and approaches. Educational Technology, Teacher Knowledge, and Classroom Impact: A Research Handbook on Frameworks and Approaches, 1–409. https://doi.org/10.4018/978-1-60960-750-0

Saleh, M., & Salama, R. M. (2018). Recommendations for building adaptive cognition-based e-Learning. International Journal of Advanced Computer Science and Applications, 9(8), 385–393. https://doi.org/10.14569/ijacsa.2018.090850

Saqr, M., Fors, U., & Tedre, M. (2017). How learning analytics can early predict under-achieving students in a blended medical education course. Medical Teacher, 39(7), 757–767. https://doi.org/10.1080/0142159X.2017.1309376

Sudirman, S. (2020). Pengembangan Aplikasi Untuk Pemantauan Dan Evaluasi Pendidikan Anak Usia Dini. INFOTECH : Jurnal Informatika & Teknologi, 1(2), 107–115. https://doi.org/10.37373/infotech.v1i2.61

Sudirman, S. (2021). Online System on Monitoring and Feedback for Education. JISA(Jurnal Informatika Dan Sains), 4(1), 73–79. https://doi.org/10.31326/jisa.v4i1.900

Sudirman, S., Sarjan, M., Rokhmat, J., & Fauzi, I. (2022). Penilaian Pendidikan IPA secara Realtime dan Terintegrasi dengan Artificial Intelligence : Perspektif Filsafat. Jurnal Ilmiah Profesi Pendidikan, 7(4b), 2658–2668.

Sudirman, S., Sarjan, M., Rokhmat, J., Hamidi, H., Muliadi, A., Azizi, A., Fauzi, I., Yamin, M., Muttaqin, M. Z. H., Rasyidi, M., Ardiansyah, B., Khery, Y., & Rahmatiah, R. (2022). Praktik Penilaian Guru Pendidikan Sains antara Keyakinan atau Pengetahuan Guru? Perspektif Filsafat. Jurnal Ilmiah Profesi Pendidikan, 7(3c), 2018–2025. https://doi.org/10.29303/jipp.v7i3c.889

Sun, D., Ouyang, F., Li, Y., & Zhu, C. (2021). Comparing learners’ knowledge, behaviors, and attitudes between two instructional modes of computer programming in secondary education. International Journal of STEM Education, 8(1), 1–15. https://doi.org/10.1186/s40594-021-00311-1

Tai, J., Ajjawi, R., Boud, D., Dawson, P., & Panadero, E. (2018). Developing evaluative judgement : enabling students to make decisions about the quality of work Content courtesy of Springer Nature , terms of use apply . Rights reserved . Content courtesy of Springer Nature , terms of use apply . Rights reserved . 467–481.

Tseng, J. J. (2016). Developing an instrument for assessing technological pedagogical content knowledge as perceived by EFL students. Computer Assisted Language Learning, 29(2), 302–315. https://doi.org/10.1080/09588221.2014.941369

Valero, G., & Cárdenas, P. (2017). Formative and summative assessment in veterinary pathology and other courses at a mexican veterinary college. Journal of Veterinary Medical Education, 44(2), 331–337. https://doi.org/10.3138/jvme.1015-169R

Walters, S. R., Silva, P., & Nikolai, J. (2017). Teaching, learning, and assessment: Insights into students’ motivation to learn. Qualitative Report, 22(4), 1151–1168. https://doi.org/10.46743/2160-3715/2017.2777

Wiethe-Körprich, M., & Bley, S. (2017). Prospective educators as consumers of empirical research: An authentic assessment approach to make their competencies visible. Empirical Research in Vocational Education and Training, 9(1). https://doi.org/10.1186/s40461-017-0052-5

Yan, E. M. Y. (2022). Using Online Peer Assessment Activities to Enhance Team Collaboration in Two Undergraduate Courses. Innovative Teaching and Learning, 4(1), 59–73. https://doi.org/10.4208/itl.20220104

Yan, Z. (2020). Self-assessment in the process of self-regulated learning and its relationship with academic achievement. Assessment and Evaluation in Higher Education, 45(2), 224–238. https://doi.org/10.1080/02602938.2019.1629390

Zhang, L., & Li, P. (2022). Problem-Based mHealth Literacy Scale (PB-mHLS): Development and Validation. JMIR MHealth and UHealth, 10(4), 1–15. https://doi.org/10.2196/31459

Zhao, D., Chis, A., Muntean, G.-M., & Muntean, C. H. (2018). a Large-Scale Pilot Study on Game-Based Learning and Blended Learning Methodologies in Undergraduate Programming Courses. EDULEARN18 Proceedings, 1(July), 3716–3724. https://doi.org/10.21125/edulearn.2018.0948

Zhao, H., Li, Y., Wang, X., Kan, Y., Xu, S., & Duan, H. (2022). Inter-brain neural mechanism underlying turn-based interaction under acute stress in women: a hyperscanning study using functional near-infrared spectroscopy. Social Cognitive and Affective Neuroscience, 17(9), 850–863. https://doi.org/10.1093/scan/nsac005

Zheng, J., Xing, W., & Zhu, G. (2019). Examining sequential patterns of self- and socially shared regulation of STEM learning in a CSCL environment. Computers and Education, 136(August), 34–48. https://doi.org/10.1016/j.compedu.2019.03.005

Author Biographies

Sudirman, Universitas Qamarul Huda Badaruddin Bagu

Agus Ramdani, University of Mataram

Aris Doyan, University of Mataram

Yunita Arian Sani Anwar, University of Mataram

Joni Rokhmat, University of Mataram

AA. Sukarso, University of Mataram

License

Copyright (c) 2023 Sudirman, Agus Ramdani, Aris Doyan, Yunita Arian Sani Anwar, Joni Rokhmat, AA. Sukarso

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).