The Development of the ‘Mahaga’ Digital Authentic Assessment Instrument Based on the Project-Based STEM Approach to Enhance Elementary School Students’ Scientific Literacy
DOI:
10.29303/jppipa.v11i12.13551Published:
2025-12-25Downloads
Abstract
This research developed a digital authentic assessment instrument based on a project-based STEM approach to enhance scientific literacy among elementary school students. This study aimed to create an instrument that is valid, practical, and effective. The research employed a Research and Development (R&D) approach, utilizing the ADDIE model. Data were collected through observation, interviews, and tests. The product’s practicality was assessed by media, evaluation, and material experts using closed questionnaires. Its effectiveness was measured via a pretest–posttest design conducted with small and large groups of students. A t-test and N-Gain analysis were used to evaluate the improvement of learning outcomes. The validation results were strong, with scores of 97% from the content expert, 94.5% from the assessment expert, and 95.5% from the media expert, indicating that the instrument was very valid. The practicality test also yielded a very practical score of 93% from student and teacher responses. For the effectiveness test, average scores increased from a pre-test of 58.2 to a post-test of 83.2, resulting in a medium N-Gain score of 0.59. This finding indicates that the use of the ‘MAHAGA’ digital authentic assessment is highly effective. These findings affirm ‘MAHAGA’ as a valid, practical, and effective instrument, offering a significant contribution to promoting scientific literacy in elementary education. This instrument offers a promising, innovative solution to advance science education at the elementary level, equip students with essential 21st-century skills, and support the development of a more adaptive, critical, and innovative generation.
Keywords:
Scientific Literacy Digital Authentic Assessment Project-Based STEM Elementary School StudentsReferences
Abykanova, B., Nugumanova, S., Yelezhanova, S., Kabylkhamit, Z., & Sabirova, Z. (2016). The Use of Interactive Learning Technology in Institutions of Higher Learning. International Journal of Environmental & Science Education, 11(18), 12528-12539. Retrieved from https://files.eric.ed.gov/fulltext/EJ1124626.pdf
Adeoye, M. A., Wirawan, K. A. S. I., Pradnyani, M. S. S., & Septiarini, N. I. (2024). Revolutionizing Education: Unleashing the Power of the ADDIE Model for Effective Teaching and Learning. Jurnal Pendidikan Indonesia, 13(1), 202-209. https://doi.org/10.23887/jpiundiksha.v13i1.68624 DOI: https://doi.org/10.23887/jpiundiksha.v13i1.68624
Adnan, A., Mulbar, U., Sugiarti, S., & Bahri, A. (2021). Scientific Literacy Skills of Students: Problem of Biology Teaching in Junior High School in South Sulawesi, Indonesia. International Journal of Instruction, 14(3), 847–860. https://doi.org/10.29333/iji.2021.14349a DOI: https://doi.org/10.29333/iji.2021.14349a
Alonzo, D., & Teng, S. (2023). Trustworthiness of Teacher Assessment and Decision-Making: Reframing the Consistency and Accuracy Measures. International Journal of Instruction, 16(3), 1075–1094. https://doi.org/10.29333/iji.2023.16357a DOI: https://doi.org/10.29333/iji.2023.16357a
Aqeel, S. (2024). Bridging the Divide: A Review of Global Gaps in PISA Performance. World Journal of Advanced Research and Reviews, 24(1), 2745–2755. https://doi.org/10.30574/wjarr.2024.24.1.3599 DOI: https://doi.org/10.30574/wjarr.2024.24.1.3599
Awang, N. E., Hamzah, M. I., & Zulkifli, H. (2025). Barriers to Implementing Innovative Pedagogy: A Systematic Review of cHallenges and Strategic Solutions. International Journal of Learning, Teaching and Educational Research, 24(3), 679–698. https://doi.org/10.26803/ijlter.24.3.32 DOI: https://doi.org/10.26803/ijlter.24.3.32
Fernandez, G. E. A., López-Banet, L., & Ruiz-Vidal, A. (2022). Students’ performance in the Scientific Skills During Secondary Education. EURASIA Journal of Mathematics, Science and Technology Education, 18(10), 1-18. https://doi.org/10.29333/ejmste/12444 DOI: https://doi.org/10.29333/ejmste/12444
Bascopé, M., & Reiss, K. (2021). Place-Based STEM Education for Sustainability: A Path Towards Socioecological Resilience. Sustainability, 13(15), 8414. https://doi.org/10.3390/su13158414 DOI: https://doi.org/10.3390/su13158414
Benhadj, Y., Messaoudi, M. E., & Nfissi, A. (2019). Investigating the Impact of Kahoot! on Students' Engagement, Motivation, and Learning Outcomes: Ifrane Directorate as a case Study. International Journal of Advance Study and Research Work, 2(6), 2581-5997. https://doi.org/10.5281/zenodo.3250661
Bilad, M. R., Zubaidah, S., & Prayogi, S. (2024). Addressing the PISA 2022 Results: A Call for Reinvigorating Indonesia’s Education System. International Journal of Essential Competencies in Education, 3(1), 1–12. https://doi.org/10.36312/ijece.v3i1.1935 DOI: https://doi.org/10.36312/ijece.v3i1.1935
Boughaydi, M., Hassouni, T., & Erramli, H. (2025). Challenges and solutions in conducting experimental activities in science education. International Journal on Technical and Physical Problems of Engineering, 17(2), 314–323. Retrieved from https://www.iotpe.com/IJTPE/IJTPE-2025/IJTPE-Issue62-Vol17-No1-Mar2025/33-IJTPE-Issue62-Vol17-No1-Mar2025-pp321-329.pdf
Brand, B. R. (2020). Integrating science and engineering practices: Outcomes from a Collaborative Professional Development. International Journal of STEM Education, 7(13). https://doi.org/10.1186/s40594-020-00210-x DOI: https://doi.org/10.1186/s40594-020-00210-x
Brassil, C. E., & Couch, B. A. (2019). Multiple-True-False Questions Reveal More Thoroughly the Complexity of Student Thinking than Multiple-Choice Questions. International Journal of STEM Education, 6(16). https://doi.org/10.1186/s40594-019-0169-0 DOI: https://doi.org/10.1186/s40594-019-0169-0
Chengere, A. M., Bono, B. D., Zinabu, S. A., & Jilo, K. W. (2025). Enhancing Secondary School Students’ Science Process Skills Through Guided Inquiry-Based Laboratory Activities in Biology. PLoS One, 20(4). https://doi.org/10.1371/journal.pone.0320692 DOI: https://doi.org/10.1371/journal.pone.0320692
Hellín, C. J., Calles-Esteban, F., Valledor, A., Gómez, J., Otón-Tortosa, S., & Tayebi, A. (2023). Enhancing Student Motivation and Engagement Through a Gamified Learning Environment. Sustainability, 15(19), 14119. https://doi.org/10.3390/su151914119 DOI: https://doi.org/10.3390/su151914119
Dresscher, L., Alpizar-Chacon, I., & Sosnovsky, S. (2021). Generation of Assessment Questions from Textbooks Enriched With Knowledge Models. CEUR Workshop Proceedings, 2895, 1–10. Retrieved from https://ceur-ws.org/Vol-2895/paper10.pdf DOI: https://doi.org/10.1145/3395027.3419585
Figuccio, M. J., & Johnston, M. (2022). Kahoot! Predicts Exam Scores and Promotes Student Engagement. Journal of Research in Innovative Teaching & Learning, 15(2), 170–177. https://doi.org/10.1108/JRIT-07-2021-0051 DOI: https://doi.org/10.1108/JRIT-07-2021-0051
García-Carmona, A. (2023). Scientific Thinking and Critical Thinking in Science Education: Two Distinct But Symbiotically Related Intellectual Processes. Science & Education, 34(2), 227–245. https://doi.org/10.1007/s11191-023-00460-5 DOI: https://doi.org/10.1007/s11191-023-00460-5
Gizaw, G. G., & Sota, S. S. (2023). Improving Science Process Skills of Students: A Review of Literature. Science Education International, 34(3), 216–224. https://doi.org/10.33828/sei.v34.i3.5 DOI: https://doi.org/10.33828/sei.v34.i3.5
Haatainen, O., & Aksela, M. (2021). Project-Based Learning in Integrated Science Education: Active Teachers’ Perceptions and Practices. LUMAT: International Journal on Math, Science and Technology Education, 9(1), 149–173. https://doi.org/10.31129/LUMAT.9.1.1392 DOI: https://doi.org/10.31129/LUMAT.9.1.1392
Halimatussa’diah, H., Sitompul, H., & Mursid, R. (2019). Project-based learning to Enhance Students' Science Process Skills. EAI Endorsed Transactions on Education, 6(21). https://doi.org/10.4108/eai.16-11-2019.2293268 DOI: https://doi.org/10.4108/eai.16-11-2019.2293268
Irwanto, I. (2023). Improving Preservice Chemistry Teachers’ Critical Thinking and Science Process Skills Using Research-Oriented Collaborative Inquiry Learning. Journal of Technology and Science Education, 13(1), 23–35. https://doi.org/10.3926/jotse.1796 DOI: https://doi.org/10.3926/jotse.1796
Ismael, A. A. A. A. (2018). The Challenges Faced by Science Teachers in Activating School Laboratories. European Journal of Academic Research, 6(6), 90-97. Retrieved from https://www.eajournals.org/wp-content/uploads/The-Challenges-Faced-by-Science-Teachers-in-Activating-School-Laboratories.pdf
Jamaris, T., M., Supriyati, M., & Saefudin, Y. S. (2019). Improving Basic Science Process Skills Through Inquiry-Based Approach in Learning Science For Early Elementary Students. Journal of Turkish Science Education, 16(2), 187–201. https://doi.org/10.12973/tused.10274a)
Kahveci, H. (2023). The positive and negative effects of teacher attitudes and behaviors on student progress. Journal of Pedagogical Research, 7(1), 290–310. https://doi.org/10.33902/JPR.202319128 DOI: https://doi.org/10.33902/JPR.202319128
Karamustafaoğlu, O., & Pektaş, H. M. (2023). Developing Students’ Creative Problem-Solving Skills with Inquiry-Based STEM Activity in an Out-of-School Learning Environment. Education and Information Technologies, 28, 7651–7669. https://doi.org/10.1007/s10639-022-11496-5 DOI: https://doi.org/10.1007/s10639-022-11496-5
Katayev, Y., Saduakas, G., Nurzhanova, S., Umirbekova, A., Ospankulov, Y., & Zokirova, S. (2023). Analysis of Teachers' Research Competencies, Scientific Process Skills and ICT Use. International Journal of Education in Mathematics, Science and Technology, 11(5), 1184–1203. https://doi.org/10.46328/ijemst.3613 DOI: https://doi.org/10.46328/ijemst.3613
Kelp, N. C., McCartney, M., Sarvary, M. A., Shaffer, J. F., & Wolyniak, M. J. (2023). Developing Science Literacy in Students and Society: Theory, Research, and Practice. Journal of Microbiology & Biology Education, 24(2). https://doi.org/10.1128/jmbe.00058-23 DOI: https://doi.org/10.1128/jmbe.00058-23
Lederman, N. G., Bartos, S. A., & Lederman, J. S. (2013). The Development, use, and Interpretation of Nature of Science Assessments. In International Handbook of Research in History, Philosophy and Science Teaching, 971–997. https://doi.org/10.1007/978-94-007-7654-8_29 DOI: https://doi.org/10.1007/978-94-007-7654-8_29
Lederman, N. G., Lederman, J. S., & Antink, A. (2013). Nature of Science and Scientific Inquiry as Contexts for the Learning of Science and Achievement of Scientific Literacy. International Journal of Education in Mathematics, Science and Technology, 1(3), 138–147. Retrieved from https://files.eric.ed.gov/fulltext/ED543992.pdf
Lee, M. Y., & Lee, J. S. (2025). Project-Based Learning as a Catalyst for Integrated STEM Education. Education Sciences, 15(7), 871. https://doi.org/10.3390/educsci15070871 DOI: https://doi.org/10.3390/educsci15070871
Li, S. (2021). Measuring Cognitive Engagement: An Overview of Measurement Instruments and Techniques. International Journal of Psychology and Educational Studies, 8(3), 63–76. https://doi.org/10.52380/ijpes.2021.8.3.239 DOI: https://doi.org/10.52380/ijpes.2021.8.3.239
Licorish, S. A., Owen, H. E., Daniel, B., & George, J. L. (2018). Students’ Perception of Kahoot!’s Influence on Teaching and Learning. Research and Practice in Technology Enhanced Learning, 13(9), 1-23. https://doi.org/10.1186/s41039-018-0078-8 DOI: https://doi.org/10.1186/s41039-018-0078-8
Ma, Y. (2023). The Effect of Inquiry-Based Practices on Scientific Literacy: The Mediating Role of Science Attitudes. International Journal of Science and Mathematics Education, 21, 2045–2066. https://doi.org/10.1007/s10763-022-10336-9 DOI: https://doi.org/10.1007/s10763-022-10336-9
Mabruroh, F., & Ashsiddiqi, M. H. (2021). Development of Authentic Assessment Instrument Based on Scientific Literacy to Measure Science Process Skills. Al-Ishlah: Jurnal Pendidikan, 13(3), 3096–3110. Retrieved from https://journal.staihubbulwathan.id/index.php/alishlah/article/view/287
Maraza-Quispe, B., Traverso-Condori, L. C., Torres-Gonzales, S. B., Reyes-Arco, R. E., Tinco-Túpac, S. T., Reyes-Villalba, E., & Carpio-Ventura, J. R. (2024). Impact of the use of Gamified Online Tools: A Study with Kahoot and Quizizz in the Educational Context. International Journal of Information and Education Technology, 14(1), 132-140. https://doi.org/10.18178/ijiet.2024.14.1.2033 DOI: https://doi.org/10.18178/ijiet.2024.14.1.2033
Muhibbuddin, M., Artika, W., & Nurmaliah, C. (2023). Improving Critical Thinking Skills Through Higher Order Thinking Skills (HOTS)-Based Science. International Journal of Instruction, 16(4), 283–296. https://doi.org/10.29333/iji.2023.16417a DOI: https://doi.org/10.29333/iji.2023.16417a
Mulyono, Y., Sapuadi, S., Yuliarti, Y., & Sohnui, S. (2024). A Framework for Building Scientific Literacy Through an Inquiry Learning Model using an Ethnoscience Approach. International Journal of Advanced and Applied Sciences, 11(8), 158–168. https://doi.org/10.21833/ijaas.2024.08.017 DOI: https://doi.org/10.21833/ijaas.2024.08.017
Nanda, R. E., Isdaryanti, B., & Wardani, S. (2024). Analysis of Basic Scientific Literacy Abilities in the Independent Curriculum to Determine the Critical Thinking Abilities and Character of Elementary Students. International Journal of Research and Review, 11(12), 257–281. https://doi.org/10.52403/ijrr.20241229 DOI: https://doi.org/10.52403/ijrr.20241229
Novianti, A. G., & Asmara, A. (2023). The Development of Digital Technology and its Impact on Indonesia’s Economic Growth. International Journal of Research and Review, 10(9), 297–319. https://doi.org/10.52403/ijrr.20230932 DOI: https://doi.org/10.52403/ijrr.20230932
Pacala, F. A. (2025). Enhancing Science Teachers’ Science Process Skills Using Technology-Driven Interdisciplinary Project-Based Learning. Technologies and Learning Tools, 107(3), 207-221. https://doi.org/10.33407/itlt.v107i3.5903 DOI: https://doi.org/10.33407/itlt.v107i3.5903
Park, J., Teo, T. W., Teo, A., Chang, J., Huang, J. S., & Koo, S. (2023). Integrating Artificial Intelligence Into Science Lessons: Teachers’ Experiences and Views. International Journal of STEM Education, 10(1). https://doi.org/10.1186/s40594-023-00454-3 DOI: https://doi.org/10.1186/s40594-023-00454-3
Pen, S., & Singh, P. (2025). A comparative analysis of traditional and interactive teaching methods in English. International Journal of Research in English, 7(1), 625–629. https://doi.org/10.33545/26648717.2025.v7.i1j.399 DOI: https://doi.org/10.33545/26648717.2025.v7.i1j.399
Picardal, M. T., & Sanchez, J. M. P. (2022). Effectiveness of contextualization in science instruction to Enhance Science Literacy in the Philippines: A Meta-Analysis. International Journal of Learning, Teaching and Educational Research, 21(1), 140–156. https://doi.org/10.26803/ijlter.21.1.9 DOI: https://doi.org/10.26803/ijlter.21.1.9
Prajoko, S., Sukmawati, I., Maris, A. F., & Wulanjani, A. N. (2023). Project-Based Learning (PjBL) Model with STEM Approach on Students’ Conceptual Understanding and Creativity. Jurnal Pendidikan IPA Indonesia, 12(3), 401-409. https://doi.org/10.15294/jpii.v12i3.42973 DOI: https://doi.org/10.15294/jpii.v12i3.42973
Ramadhan, S., Sumiharsono, R., Mardapi, D., & Prasetyo, Z. K. (2020). The Quality of Test Instruments Constructed by Teachers in Bima Regency, Indonesia. International Journal of Instruction, 13(2), 507–518. https://doi.org/10.29333/iji.2020.13235a DOI: https://doi.org/10.29333/iji.2020.13235a
Rayan, B., & Watted, A. (2024). Enhancing Education in Elementary Schools through Gamified Learning: Exploring the Impact of Kahoot! on the Learning Process. Education Sciences, 14(3), 277. https://doi.org/10.3390/educsci14030277 DOI: https://doi.org/10.3390/educsci14030277
Skalstad, I., & Munkebye, E. (2021). Young Children’s Questions about Science Topics When Situated in a Natural Outdoor Environment. International Journal of Science Education, 43(7), 1017–1035. https://doi.org/10.1080/09500693.2021.1895451 DOI: https://doi.org/10.1080/09500693.2021.1895451
Sohilait, D., Arjanto, P., Chong, S. T., & Soares, M. I. C. (2025). The Power of Gamification: How Kahoot! Transforms Motivation and Learning in Primary Science Education. International Research-Based Education Journal, 7(1), 85–97. Retrieved from https://journal2.um.ac.id/index.php/irbej/article/view/58389
Steen, J. V. D., Vleuten, C. V. D., Schilt-mol, T. V., & Brinke, D. J. (2023). Designing Formative Assessment that Improves Teaching and Learning: What can be Learned From the Design Stories of Experienced teachers? Journal of Formative Design in Learning, 7, 182–194. https://doi.org/10.1007/s41686-023-00080-w DOI: https://doi.org/10.1007/s41686-023-00080-w
Syahmani, S., et al. (2023). Exploration and Design of Etno-STEM as a Learning Source in Phytochemistry to Improve Meta-Cognitive Skills and Students’ Higher Order Thinking Skills of Environmental Problem. Journal of Wetlands Environmental Management, 11(2), 108–125. Retrieved from https://ppjp.ulm.ac.id/journal/index.php/jwem/article/view/21863
Timbasal-Nuevo, E. B. (2024). Adequacy, Utilization of Laboratory Equipment and Performance of Junior High School Science Teachers. International Journal of Fundamental and Multidisciplinary Research, 6(3), 1–32. https://doi.org/10.36948/ijfmr.2024.v06i03.21166 DOI: https://doi.org/10.36948/ijfmr.2024.v06i03.21166
Tindan, T. N., & Anaba, C. A. (2024). Scientific Hands-on Activities and Their Impact on Academic Success: A Systematic Literature Review. IOSR Journal of Research & Method in Education, 14(6), 39–47. https://doi.org/10.9790/7388-1406043947
Turiman, P., Omar, J., Daud, A. M., & Osman, K. (2012). Fostering the 21st Century Skills through Scientific Literacy and scIence Process Skills. Procedia - Social and Behavioral Sciences, 59, 110–116. https://doi.org/10.1016/j.sbspro.2012.09.253 DOI: https://doi.org/10.1016/j.sbspro.2012.09.253
Umar, U., Purwanto, M. B., & Al Firdaus, M. M. (2023). Research and Development as the Primary Alternative to Educational Research Design Frameworks. Journal of English Language and Literature (JELL), 8(01), 73-82. https://doi.org/10.37110/jell.v8i01.172 DOI: https://doi.org/10.37110/jell.v8i01.172
Videnovik, M., Vold, T., Kiønig, L., Bogdanova, A. M., & Trajkovik, V. (2023). Game-Based Learning in Computer Science Education: A Scoping Literature Review. International Journal of STEM Education, 10(1), 1-23. https://doi.org/10.1186/s40594-023-00447-2 DOI: https://doi.org/10.1186/s40594-023-00447-2
Yanto, N., Sari, N. I., & Yahya. (2025). Exploring Scientific Literacy in science classrooms: A Literature Study. Venn: Journal of Sustainable Innovation on Education, Mathematics and Natural Sciences, 4(3), 164-173. https://doi.org/10.53696/venn.v4i3.292 DOI: https://doi.org/10.53696/venn.v4i3.292
License
Copyright (c) 2025 Rita Rahmaniati, Bulkani, Amelia Dwi Astuti, Citra Amalia
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
