Implementation of Natural Language Processing Based Chatbot as a Virtual Assistant in Science Learning
DOI:
10.29303/jppipa.v11i10.12747Published:
2025-10-25Downloads
Abstract
Inadequate conceptual understanding and declining learning motivation remain major challenges in science education. To address these issues, this study implemented a Natural Language Processing (NLP)-based chatbot as a virtual assistant designed to provide adaptive feedback and personalized guidance in science learning. A mixed-methods approach was employed, integrating quantitative and qualitative phases within a quasi-experimental pretest–posttest control group design involving 240 tenth-grade students in Jakarta over eight weeks. Quantitative data from the Science Achievement Test (SAT) and Science Learning Motivation Scale (SLMS) were analyzed using an independent samples t-test, while qualitative data from interviews and learning analytics were used to explain behavioral and motivational changes. The experimental group showed a substantial improvement in conceptual understanding, increasing from a mean pretest score of 42.5 to 88.4, compared to 44.1 to 62.7 in the control group (t(238) = 11.34, p < 0.001, d = 1.56). Motivation scores also increased significantly across all dimensions (p < 0.001), particularly in self-efficacy (η²p = 0.198). Learning analytics indicated higher interaction frequencies and longer engagement times. Students reported five perceived benefits: 24/7 accessibility, personalized explanations, increased questioning confidence, support for complex concept visualization, and stronger self-driven learning motivation. Overall, the NLP-based chatbot effectively enhanced science learning outcomes and motivation.
Keywords:
Chatbot NLP Science learning Virtual assistantReferences
Abdou, D., & Jasimuddin, S. M. (2020). The use of the UTAUT model in the adoption of E-learning technologies: An empirical study in France based banks. Journal of Global Information Management, 28(4), 38–51. https://doi.org/10.4018/JGIM.2020100103
Abdullah, K., Jannah, M., Aiman, U., Hasda, S., Fadilla, Z., Taqwin, M., & Sari, M. E. (2022). Metodologi penelitian kuantitatif. Yayasan Penerbit Muhammad Zaini.
Adeniran, T. A., & Onasanya, S. A. (2024). Impact of e-learning on college of education lecturers’ knowledge of quantitative data analysis in SPSS. Technology, 4(2), 121–128. https://doi.org/10.17509/ijert.v4i2.60863
Almogren, A. S. (2022). Art education lecturers’ intention to continue using the blackboard during and after the COVID-19 pandemic: An empirical investigation into the UTAUT and TAM model. Frontiers in Psychology, 13(October), 1–19. https://doi.org/10.3389/fpsyg.2022.944335
Bolton, T., Dargahi, T., Belguith, S., Al-Rakhami, M. S., & Sodhro, A. H. (2021). On the security and privacy challenges of virtual assistants. Sensors, 21(7), 2312. https://doi.org/10.3390/s21072312
Chen, X., Xie, H., Qin, S. J., Wang, F. L., & Hou, Y. (2025). Artificial intelligence-supported student engagement research: Text mining and systematic analysis. European Journal of Education, 60(1). https://doi.org/10.1111/ejed.70008
Chinenye, D. J., Duroha, A. E., & Mcdonald, N. (2022). Development of a natural language processing-based chatbot for Shoprite shopping mall. International Journal of Engineering Applied Sciences and Technology, 7, 372–381. https://doi.org/10.33564/ijeast.2022.v07i06.044
Cooper, G. (2023). Examining science education in ChatGPT: An exploratory study of generative artificial intelligence. Journal of Science Education and Technology, 32(3), 444–452. https://doi.org/10.1007/s10956-023-10039-y
De Arriba-Pérez, F., García-Méndez, S., González-Castaño, F. J., & Costa-Montenegro, E. (2023). Automatic detection of cognitive impairment in elderly people using an entertainment chatbot with natural language processing capabilities. Journal of Ambient Intelligence and Humanized Computing, 14(12), 16283–16298. https://doi.org/10.1007/s12652-022-03849-2
Deng, X., & Yu, Z. (2023). A meta-analysis and systematic review of the effect of chatbot technology use in sustainable education. Sustainability (Switzerland), 15(4), 2940. https://doi.org/10.3390/su15042940
Gumasing, M. J. J., & Castro, F. M. F. (2023). Determining ergonomic appraisal factors affecting the learning motivation and academic performance of students during online classes. Sustainability (Switzerland), 15(3), 1970. https://doi.org/10.3390/su15031970
Haq, M. S., Samani, M., Karwanto, & Hariyati, N. (2022). Android-Based Digital Library Application Development. International Journal of Interactive Mobile Technologies, 16(11), 224–237. https://doi.org/10.3991/ijim.v16i11.32055
Hasan, M. R., Shiming, D., Islam, M. A., & Hossain, M. Z. (2020). Operational efficiency effects of blockchain technology implementation in firms: Evidence from China. Review of International Business and Strategy, 30(2), 163–181. https://doi.org/10.1108/RIBS-05-2019-0069
Haw, L. H. (2020). The development and validation of science achievement test. Journal of Education and Practice, 11(20), 103–109. https://doi.org/10.7176/JEP/11-20-12
Haw, L. H., Sharif, S. B., & Han, C. G. K. (2022). Analyzing the science achievement test: Perspective of classical test theory and Rasch analysis. International Journal of Evaluation and Research in Education, 11(4), 1714–1724. https://doi.org/10.11591/ijere.v11i4.22304
Hossan, D., Mansor, Z. D., & Jaharuddin, N. S. (2023). Research population and sampling in quantitative study. International Journal of Business and Technopreneurship, 13(3). https://doi.org/10.58915/ijbt.v13i3.263
Hsu, I. C., & Yu, J. D. (2022). A medical chatbot using machine learning and natural language understanding. Multimedia Tools and Applications, 81(17), 23777–23799. https://doi.org/10.1007/s11042-022-12820-4
Hwang, G.-J., & Chang, C.-Y. (2023). A review of opportunities and challenges of chatbots in education. Interactive Learning Environments, 31(7), 4099–4112. https://doi.org/10.1080/10494820.2021.1952615
Ishak, S. A., Hasran, U. A., & Din, R. (2023). Media Education through Digital Games: A Review on Design and Factors Influencing Learning Performance. In Education Sciences (Vol. 13, Issue 2). https://doi.org/10.3390/educsci13020102
Jara Chiriboga, S. P., Troncoso Burgos, A. L., Ruiz Avila, M. M., Cosquillo Chida, J. L., Aldas Macias, K. J., Castro Morante, Y. E., & Bernal Párraga, A. P. (2025). Artificial Intelligence and Personalized Learning in Foreign Languages: An Analysis of Chatbots and Virtual Assistants in Education. Revista Científica de Salud y Desarrollo Humano, 6(1), 882–905. https://doi.org/10.61368/r.s.d.h.v6i1.515
Khurana, D., Koli, A., Khatter, K., & Singh, S. (2023). Natural language processing: State of the art, current trends and challenges. Multimedia Tools and Applications, 82(3), 3713–3744. https://doi.org/10.1007/s11042-022-13428-4
Kim, J., Yu, S., Detrick, R., & Li, N. (2024). Exploring students’ perspectives on Generative AI-assisted academic writing. In Education and Information Technologies. https://doi.org/10.1007/s10639-024-12878-7
Kooli, C. (2023). Chatbots in education and research: A critical examination of ethical implications and solutions. Sustainability, 15(7), 5614. https://doi.org/10.3390/su15075614
Liu, P., Zhang, L., & Gulla, J. A. (2023). Pre-train, prompt, and recommendation: A comprehensive survey of language modeling paradigm adaptations in recommender systems. Transactions of the Association for Computational Linguistics, 11(1), 1553–1571. https://doi.org/10.1162/tacl_a_00594
Ma, K., Zhang, Y., & Hui, B.-H. (2024). How Does AI Affect College? The Impact of AI Usage in College Teaching on Students’ Innovative Behavior and Well-Being. Behavioral Sciences, 14(12), 1223. https://doi.org/10.3390/bs14121223
Magnone, K. M. Q., & Yezierski, E. J. (2024). Beyond convenience: A case and method for purposive sampling in chemistry teacher professional development research. Journal of Chemical Education, 101(3), 718–726. https://doi.org/10.1021/acs.jchemed.3c00217
Man, S. C., Matei, O., Faragau, T., Andreica, L., & Daraba, D. (2023). The innovative use of intelligent chatbot for sustainable health education admission process: Learned lessons and good practices. Applied Sciences, 13(4), 2415. https://doi.org/10.3390/app13042415
Mokmin, N. A. M., & Ibrahim, N. A. (2021). The evaluation of chatbot as a tool for health literacy education among undergraduate students. Education and Information Technologies, 26(5), 6033–6049. https://doi.org/10.1007/s10639-021-10542-y
Mustofa, H. A., Kola, A. J., & Owusu-Darko, I. (2025). Integration of Artificial Intelligence (ChatGPT) into Science Teaching and Learning. International Journal of Ethnoscience and Technology in Education, 2(1), 108–118. https://doi.org/10.33394/ijete.v2i1.14195
Nee, C. K., Rahman, M. H. A., Yahaya, N., Ibrahim, N. H., Razak, R. A., & Sugino, C. (2023). Exploring the Trend and Potential Distribution of Chatbot in Education: A Systematic Review. International Journal of Information and Education Technology, 13(3), 516–525. https://doi.org/10.18178/ijiet.2023.13.3.1834
Olatunde-Aiyedun, T. G. (2024). Artificial Intelligence (AI) in Education: Integration of AI into Science Education Curriculum in Nigerian Universities. International Journal of Artificial Intelligence for Digital Learning, 1(1), 1–14. https://doi.org/10.13140/RG.2.2.31699.76320
Rahayu, K. N. S. (2021). Sinergi pendidikan menyongsong masa depan indonesia di era society 5.0. Edukasi: Jurnal Pendidikan Dasar, 2(1), 87–100. https://stahnmpukuturan.ac.id/jurnal/index.php/edukasi/article/view/1395
Rahayu, N. I., Muktiarni, M., & Hidayat, Y. (2024). An Application of Statistical Testing: A Guide to Basic Parametric Statistics in Educational Research Using SPSS. ASEAN Journal of Science and Engineering, 4(3), 569–582. https://doi.org/10.17509/ajse.v4i3.76092
Ramadhana, P. A., Ardiantesia, A. P., Arini, S. S. S. L. (2024). Modernisasi Dan Krisis Identitas Bangsa Indonesia: Tantangan Dan Upaya Penguatan Nilai-Nilai Lokal. Cendekia Pendidikan, 4(4), 50–54. https://doi.org/10.99534/v4f9ym92
Rozali, C., Zein, A., & Eriana, E. S. (2024). Artificial Intelligence (AI) in the Future: Challenges and Opportunities. JITU: Jurnal Informatika Utama, 2(2), 66–71. https://doi.org/10.55903/jitu.v2i1.177
Sajja, R., Sermet, Y., Cikmaz, M., Cwiertny, D., & Demir, I. (2024). Artificial Intelligence-Enabled Intelligent Assistant for Personalized and Adaptive Learning in Higher Education. Information (Switzerland), 15(10), 596. https://doi.org/10.3390/info15100596
Sandra, R., & Hariko, R. (2025). Inferential Statistics in Guidance and Counseling Research. Kawakib: Journal of Multidisciplinary Research, 1(3), 75–85. https://doi.org/10.63738/kawakib.v1i3.21
Suryananda, T. D., & Yudhawati, R. (2021). Association of Serum KL-6 Levels on COVID-19 Severity: A Cross-Sectional Study Design with Purposive Sampling. Annals of Medicine and Surgery, 69, 102673. https://doi.org/10.1016/j.amsu.2021.102673
Wong, A. (2022). The Design of an Intelligent Chatbot with Natural Language Processing Capabilities to Support Learners. Journal of Physics: Conference Series, 2251(1), 12005. https://doi.org/10.1088/1742-6596/2251/1/012005
Wong, M. Y. (2020). University students’ perceptions of learning of moral education: a response to lifelong moral education in higher education. Teaching in Higher Education, 1–18. https://doi.org/10.1080/13562517.2020.1852201
Wu, S., & Luo, M. (2025). Selection and Resource Allocation Strategies for Chatbot Technologies in Higher Education: An Optimization Model Approach. IEEE Access, 13, 13156–13174. https://doi.org/10.1109/ACCESS.2025.3530413
Zhong, S., Zhang, K., Bagheri, M., Burken, J. G., Gu, A., Li, B., Ma, X., Marrone, B. L., Ren, Z. J., Schrier, J., Shi, W., Tan, H., Wang, T., Wang, X., Wong, B. M., Xiao, X., Yu, X., Zhu, J. J., & Zhang, H. (2021). Machine Learning: New Ideas and Tools in Environmental Science and Engineering. Environmental Science & Technology, 55(19), 12741–12754. https://doi.org/10.1021/acs.est.1c01339
Zickar, M. J., & Keith, M. G. (2025). Innovations in Sampling: Improving the Appropriateness and Quality of Samples in Organizational Research. Annual Review of Organizational Psychology and Organizational Behavior, 10, 18–37. https://doi.org/10.1146/annurev-orgpsych-120920
License
Copyright (c) 2025 Emi Sita Eriana, Risah Subariah
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
