Application of the Observational Rating Scale to PGMI Student Activity in Science Analysis Discussion
DOI:
10.29303/jppipa.v12i5.13581Published:
2026-06-07Downloads
Abstract
This study aims to develop, validate, and examine the practicality of a rating-scale–based observation instrument designed to assess the activeness of PGMI students during science question analysis discussions. A quantitative descriptive approach was employed, involving 40 fifth-semester PGMI students. The instrument was developed based on learning activity theory and a multidimensional student engagement framework, consisting of 9 indicators and 27 items rated on a 1–4 scale. Content validity was evaluated by three experts using Aiken’s V index. At the same time, instrument practicality was assessed by five trained observers acting as instrument users through a user satisfaction questionnaire based on a 1–5 Likert scale. The results indicated very high content validity, with an average Aiken’s V value of 0.97, and excellent practicality, reflected by a mean user satisfaction score of 4.36 out of 5. The application of the instrument revealed that student activeness fell into the high category, with an average activity score of 89.70 (SD = 11.22), and 90% of students were classified as active to very active. These findings demonstrate that the developed observation instrument is valid and practical for evaluating student activity in discussion-based learning, particularly within teacher education contexts.
Keywords:
Discussion-based learning Observation instrument PGMI students Rating scale Student engagementReferences
Aiken, L. R. (1985). Three Coefficients for Analyzing the Reliability and Validity of Ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/10.1177/0013164485451012 DOI: https://doi.org/10.1177/0013164485451012
Alshammari, S., & Alrashidi, O. (2024). The Effect of Students’ Engagement on Their Learning Achievement in EFL Online Courses: International Journal of Online Pedagogy and Course Design, 14, 1–18. https://doi.org/10.4018/IJOPCD.357875 DOI: https://doi.org/10.4018/IJOPCD.357875
Ariyanti, I., Fikrie, F., & Hariyono, D. (2022). Students’ Engagement dalam Proses Pembelajaran Daring Melalui Lesson Study pada Mata Kuliah Kalkulus Integral. Jurnal Cendekia: Jurnal Pendidikan Matematika, 6(1), 824–836. https://doi.org/10.31004/cendekia.v6i1.1287 DOI: https://doi.org/10.31004/cendekia.v6i1.1287
Assefa, Y., Tilwani, S. A., Moges, B. T., & Majeed, H. (2025). Unpacking Student Engagement and Its Mediating Role in Predicting the Relationship between Self-Determination and Academic Satisfaction Among Undergraduate Students in Higher Education. Social Sciences & Humanities Open, 12, 101797. https://doi.org/10.1016/j.ssaho.2025.101797 DOI: https://doi.org/10.1016/j.ssaho.2025.101797
Bergdahl, N., Bond, M., Sjöberg, J., Dougherty, M., & Oxley, E. (2024). Unpacking Student Engagement in Higher Education Learning Analytics: A Systematic Review. International Journal of Educational Technology in Higher Education, 21(1), 63. https://doi.org/10.1186/s41239-024-00493-y DOI: https://doi.org/10.1186/s41239-024-00493-y
Berlin, I., Nugroho, A., Patonah, S., & Hayat, M. (2025). Profile of Learning Outcomes and Student Activity in Learning Natural Sciences at SMPN 2 Karangawen. Jurnal Penelitian Pendidikan IPA, 11(1), 112–118. https://doi.org/10.29303/jppipa.v11i1.9808 DOI: https://doi.org/10.29303/jppipa.v11i1.9808
Bowden, J. L.-H., Tickle, L., & Naumann, K. (2021). The Four Pillars of Tertiary Student Engagement and Success: A Holistic Measurement Approach. Studies in Higher Education, 46(6), 1207–1224. https://doi.org/10.1080/03075079.2019.1672647 DOI: https://doi.org/10.1080/03075079.2019.1672647
Buntins, K., Kerres, M., & Heinemann, A. (2021). A Scoping Review of Research Instruments for Measuring Student Engagement: In Need for Convergence. International Journal of Educational Research Open, 2, 100099. https://doi.org/10.1016/j.ijedro.2021.100099 DOI: https://doi.org/10.1016/j.ijedro.2021.100099
Destiny, E., & Lator, C. (2022). Curriculum Design and Student Social Engagement in Human Kinetics Programmes: Empirical Evidence from Nigerian Universities. International Journal of Multidisciplinary Research and Growth Evaluation, 3, 897–909. https://doi.org/10.54660/.IJMRGE.2022.3.6.897-909 DOI: https://doi.org/10.54660/.IJMRGE.2022.3.6.897-909
Dhama, K., Sharun, K., Gugjoo, M. B., Tiwari, R., Alagawany, M., Yatoo, M. I., … Farag, M. R.. (2023). A Comprehensive Review on Chemical Profile and Pharmacological Activities of Ocimum basilicum. Food Reviews International, 39(1), 119–147. https://doi.org/10.1080/87559129.2021.1900230 DOI: https://doi.org/10.1080/87559129.2021.1900230
Fahruddin, F., Nurgiansah, T., Setiawan, V., & Saefudin, A. (2024). Quantitative Measures of Engagement in History Classes: Analyzing the Efficacy of Interactive Pedagogies. SAR Journal - Science and Research, 241–248. https://doi.org/10.18421/SAR73-10 DOI: https://doi.org/10.18421/SAR73-10
Fatih, M., Alfi, C., & Muqtafa, M. (2024). Science Learning Game (SLG) Based on Augmented Reality Enhances Science Literacy and Critical Thinking Students Skills. Jurnal Penelitian Pendidikan IPA, 10(2), 973–981. https://doi.org/10.29303/jppipa.v10i2.6107 DOI: https://doi.org/10.29303/jppipa.v10i2.6107
Godsk, M., & Møller, K. (2024). Engaging Students in Higher Education with Educational Technology. Education and Information Technologies, 30, 2941–2976. https://doi.org/10.1007/s10639-024-12901-x DOI: https://doi.org/10.1007/s10639-024-12901-x
Hastomo, T., & Septiyana, L. (2022). The Investigation of Students’ Engagement in Online Class During Pandemic Covid-19. Jurnal Penelitian Ilmu Pendidikan, 15(2). https://doi.org/10.21831/jpipfip.v15i2.49512 DOI: https://doi.org/10.21831/jpipfip.v15i2.49512
Heilporn, G., Lakhal, S., & Bélisle, M. (2021). An Examination of Teachers’ Strategies to Foster Student Engagement in Blended Learning in Higher Education. International Journal of Educational Technology in Higher Education, 18(1), 25. https://doi.org/10.1186/s41239-021-00260-3 DOI: https://doi.org/10.1186/s41239-021-00260-3
Heilporn, G., Raynault, A., & Frenette, É. (2024). Student Engagement in a Higher Education Course: A Multidimensional Scale for Different Course Modalities. Social Sciences & Humanities Open, 9, 100794. https://doi.org/10.1016/j.ssaho.2023.100794 DOI: https://doi.org/10.1016/j.ssaho.2023.100794
Hendrowati, T., Badrun, M., Siswoyo, S., & Istiani, A. (2025). The Impact of Hybrid Learning on Student Engagement and Academic Performance in Post-Pandemic Science Education. Jurnal Penelitian Pendidikan IPA, 11(4), 154–165. https://doi.org/10.29303/jppipa.v11i4.10701 DOI: https://doi.org/10.29303/jppipa.v11i4.10701
Irdalisa, I., Akbar, B., Marjan, T., Maesaroh, M., & Kartikawati, E. (2024). Ricosre Model with Question Formulation Technique (QFT): Enhancing Students’ Higher Order Thinking Skills (HOTS) and Science LiteracyRicosre Model With Question Formulation Technique (QFT): Enhancing Students’ Higher Order Thinking Skills (HOTS) and Science. Jurnal Penelitian Pendidikan IPA, 10(3), 1175–1178. https://doi.org/10.29303/jppipa.v10i3.6764 DOI: https://doi.org/10.29303/jppipa.v10i3.6764
Jia, Y., Spagnolo, A., Barrett, N., Murphy, A., Basto, P., Rothpletz-Puglia, P., & Luther, S. (2024). Validation of a Peer Observation and Evaluation Tool for Online Teaching in the U.S. Educational Technology Research and Development, 73. https://doi.org/10.1007/s11423-024-10428-z DOI: https://doi.org/10.1007/s11423-024-10428-z
Johar, N. A., Kew, S., Tasir, Z., & Koh, E. (2023). Learning Analytics on Student Engagement to Enhance Students’ Learning Performance: A Systematic Review. Sustainability, 15, 7849. https://doi.org/10.3390/su15107849 DOI: https://doi.org/10.3390/su15107849
Ketonen, L., & Nieminen, J. (2023). Supporting Student Teachers’ Reflection Through Assessment: The Case of Reflective Podcasts. Teaching and Teacher Education. https://doi.org/10.1016/j.tate.2023.104039 DOI: https://doi.org/10.1016/j.tate.2023.104039
Kim, S., Westine, C., Wu, T., & Maher, D. (2022). Validation of the Higher Education Student Engagement Scale in use for Program Evaluation. Journal of College Student Retention: Research, Theory & Practice, 26, 769–793. https://doi.org/10.1177/15210251221120908 DOI: https://doi.org/10.1177/15210251221120908
Kohake, K. (2024). Systematic Observation to Measure Teaching Quality in Different Contexts: Insights from Science Lessons, Physical Education Lessons, and Sports Training Using the Classroom Assessment Scoring System. Frontiers in Education, 9. https://doi.org/10.3389/feduc.2024.1437996 DOI: https://doi.org/10.3389/feduc.2024.1437996
Laranjeira, M., & Teixeira, M. (2024). Relationships between Engagement, Achievement and Well-Being: Validation of the Engagement in Higher Education Scale. Studies in Higher Education, 50, 1–15. https://doi.org/10.1080/03075079.2024.2354903 DOI: https://doi.org/10.1080/03075079.2024.2354903
Lestari, H., Rahmawati, Y., & Usman, H. (2024). STEM-PjBL Learning Model to Enhance Critical Thinking Skills of Students on Magnets, Electricity, and TechnologySTEM-PjBL Learning Model to Enhance Critical Thinking Skills of Students on Magnets, Electricity, and Technology. Jurnal Penelitian Pendidikan IPA(8), 10(8), 6027–6037. https://doi.org/10.29303/jppipa.v10i8.8153 DOI: https://doi.org/10.29303/jppipa.v10i8.8153
Papageorgiou, E., Wong, J., Liu, Q., Khalil, M., & Cabo, A. (2025). A Systematic Review on Student Engagement in Undergraduate Mathematics: Conceptualization, Measurement, and Learning Outcomes. Educational Psychology Review, 37. https://doi.org/10.1007/s10648-025-10046-y DOI: https://doi.org/10.1007/s10648-025-10046-y
Pearson, W. (2024). Affective, Behavioural, and Cognitive Engagement with Written Feedback on Second Language Writing: A Systematic Methodological Review. Frontiers in Education, 9. https://doi.org/10.3389/feduc.2024.1285954 DOI: https://doi.org/10.3389/feduc.2024.1285954
Pettersen, E., Ertesvåg, S., Pöysä, S., Vaaland, G., & Virtanen, T. (2023). Students’ Situational Engagement and Its Association with Overall Engagement: The Application of the InSitu Instrument in the Context of a Norwegian Lower Secondary School. Scandinavian Journal of Educational Research, 68, 1–14. https://doi.org/10.1080/00313831.2023.2175245 DOI: https://doi.org/10.1080/00313831.2023.2175245
Pramitasari, N., Hastuti, P. W., Tyas, R., Anjarsari, P., & Roektiningroem, E. (2025). The Influence of Inquiry Learning Models Containing STEAM to Improve the Science Process Skills. Jurnal Penelitian Pendidikan IPA, 10(12), 11109–11120. https://doi.org/10.29303/jppipa.v10i12.8985 DOI: https://doi.org/10.29303/jppipa.v10i12.8985
Qi, M., Liu, M., Yan, T., & Liu, B. (2023). Analysis of Students’ Learning Activities Based on the ICAP Framework. ICETM '22: Proceedings of the 2022 5th International Conference on Education Technology Management, 305 - 309. https://doi.org/10.1145/3582580.3582633 DOI: https://doi.org/10.1145/3582580.3582633
Safitri, W., Suyanto, S., & Prasetya, W. (2024). Influence of the STEM-Based Engineering Design Process Model on High School Students’ Creative and Critical Thinking Abilities. Jurnal Penelitian Pendidikan IPA, 10(2), 662–673. https://doi.org/10.29303/jppipa.v10i2.4765 DOI: https://doi.org/10.29303/jppipa.v10i2.4765
Sawu, M., Sukarso, A., Ayu, T., & Handayani, B. (2023). Effect of STEM Learning in Building Creative Dispositions and Creative Thinking Skills of Junior High School Students. Jurnal Penelitian Pendidikan IPA, 9(8), 6219–6229. https://doi.org/10.29303/jppipa.v9i8.4180 DOI: https://doi.org/10.29303/jppipa.v9i8.4180
Setiawan, D., Hiroyuki, A., Syamsunarno, M. R. AA., Hartady, T., Lubis, A., & Widyastuti, R. (2022). Kondisi Fertilitas Mencit Jantan yang Diberi Ekstrak Etanol Akar Alang-alang (Imperata cylindrica). Acta Veterinaria Indonesiana, 10(2), 142–147. https://doi.org/10.29244/avi.10.2.142-147 DOI: https://doi.org/10.29244/avi.10.2.142-147
Shafii, R., & Berger, J.-L. (2025). Teacher Assessment Literacy, Formative Assessment Practices, and Their Perceived Efficacy in Tanzania: A Scoping Review. Studies in Educational Evaluation, 86, 101496. https://doi.org/10.1016/j.stueduc.2025.101496 DOI: https://doi.org/10.1016/j.stueduc.2025.101496
Sharif-Nia, H., Maroco, J., She, L., Narula, S., Ma, L., Kaveh, O., & Ghahrani, N. (2024). University Student Engagement Inventory: Validation in the Indian Online Learning Context. Measurement and Evaluation in Counseling and Development, 57. https://doi.org/10.1080/07481756.2023.2301287 DOI: https://doi.org/10.1080/07481756.2023.2301287
Sholichin, M., Razak, A., Lufri, L., & Irdawati, I. (2022). Validitas dan Praktikalitas E-Modul Berbasis Mobile Learning Berbantuan 3D Page Flip Professional pada Materi Ekologi dan Perubahan Lingkungan di Kelas X SMA. Jurnal Penelitian Pendidikan IPA, 8(6), 3034–3043. https://doi.org/10.29303/jppipa.v8i6.2467 DOI: https://doi.org/10.29303/jppipa.v8i6.2467
Siddiqi, A., Shabbir, M., Abbas, M., Mahmood, A., & Salman, R. (2021). Developing and Testing Student Engagement Scale for Higher Educational Students. Journal of Applied Research in Higher Education, ahead-of-print. https://doi.org/10.1108/JARHE-11-2020-0388 DOI: https://doi.org/10.1108/JARHE-11-2020-0388
Steenkamp, G., & Brink, S. (2024). Students’ Experiences of Peer Learning in an Accounting Research Module: Discussion Forums, Peer Review and Group Work. The International Journal of Management Education, 22, 101057. https://doi.org/10.1016/j.ijme.2024.101057 DOI: https://doi.org/10.1016/j.ijme.2024.101057
Tannoubi, A., Quansah, F., Jnr, J. H., Srem-Sai, M., Bonsaksen, T., Chalghaf, N., Boussayala, G., Azaiez, C., Snani, H., & Azaiez, F. (2023). Adaptation and Validation of the Arabic Version of the University Student Engagement Inventory (A-USEI) Among Sport and Physical Education Students. Psych, 5, 320–335. https://doi.org/10.3390/psych5020022 DOI: https://doi.org/10.3390/psych5020022
Waqar, Z., Sultana, S., & Ata, M. (2025). In-Class Active Engagement Strategies to Enhance Student Participation During Lectures : A Systematic Review. Journal of Bahria University Medical and Dental College, 15, 146–158. https://doi.org/10.51985/JBUMDC2024486 DOI: https://doi.org/10.51985/JBUMDC2024486
Weriza, J., Ismail, I., Yustisia, H., Zulkifli, Z., & Asnur, L. (2025). Enhancing Student Participation through a Validated Cooperative Flipped Classroom Framework in Technology Education. Jurnal Penelitian Pendidikan IPA, 11(7), 134–141. https://doi.org/10.29303/jppipa.v11i7.11445 DOI: https://doi.org/10.29303/jppipa.v11i7.11445
Wolf, S., Jukes, M., Yoshikawa, H., Stern, J., & Kim, S. (2024). Examining the Validity of an Observational Tool of Classroom Support for Children’s Engagement in Learning. Early Childhood Education Journal, 53, 1325–1339. https://doi.org/10.1007/s10643-024-01731-8 DOI: https://doi.org/10.1007/s10643-024-01731-8
Xia, J., & Xu, C. (2024). EFL Students’ Critical Thinking in Asynchronous Online Discussions: A Perspective of Peer Facilitation. Thinking Skills and Creativity, 53, 101581. https://doi.org/10.1016/j.tsc.2024.101581 DOI: https://doi.org/10.1016/j.tsc.2024.101581
Xu, B., Stephens, J., & Lee, K. (2023). Assessing Student Engagement in Collaborative Learning: Development and Validation of New Measure in China. The Asia-Pacific Education Researcher, 33. https://doi.org/10.1007/s40299-023-00737-x DOI: https://doi.org/10.1007/s40299-023-00737-x
License
Copyright (c) 2026 Destiana Puanda Ashari, Ikhlasul Ardi Nugroho, Anita Ekantini, Uun Febriyani, Yanti Kumala Sembiring, Waode Sitti Fatimah, Annisa Rifah Rahman
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
