Methods and Challenges in Evaluating Electronic Health Record Systems: A Systematic Literature Review
DOI:
10.29303/jppipa.v11i12.12673Published:
2025-12-25Downloads
Abstract
Systems due to their ability to increase the accessibility of clinical information, support data-driven decision-making, and potentially improve patient care quality and safety. However, EHR system evaluation remains highly complex due to the dynamic interaction between technical, organizational, and human factors. This article presents a systematic literature review aimed at identifying, classifying, and synthesizing EHR evaluation methods used in various healthcare contexts, while also uncovering key challenges in their implementation and assessment processes. Following PRISMA guidelines, this study examined scholarly articles published between 2013 and 2023 and indexed in reputable academic databases. The review reveals a wide variety of EHR evaluation approaches, including usability testing, system performance measurement, cost-benefit analysis, and qualitative methods such as user satisfaction surveys, in-depth interviews, and ethnographic studies. However, various challenges remain, including limited interoperability, data privacy and security issues, deficiencies in methodological rigor, clinical user resistance, and ethical dilemmas in health information management. Furthermore, the lack of a standardized evaluation framework further complicates comprehensive and ongoing assessment efforts. This study emphasizes the need to develop an integrated, multidisciplinary, and ethically sound EHR evaluation model to ensure optimal system benefits while minimizing future implementation risks.
Keywords:
Electronic health records Evaluation methods Health informatics Systematic literature reviewReferences
Abramson, E. L., McGinnis, S., Edwards, A., Maniccia, D. M., Moore, J., & Kaushal, R. (2012). Electronic Health Record Adoption and Health Information Exchange Among Hospitals in New York State. Journal of Evaluation in Clinical Practice, 18(6), 1156–1162. https://doi.org/10.1111/j.1365-2753.2011.01755.x DOI: https://doi.org/10.1111/j.1365-2753.2011.01755.x
Aliabadi, A., Sheikhtaheri, A., & Ansari, H. (2020). Electronic Health Record–Based Disease Surveillance Systems: A Systematic Literature Review on Challenges and Solutions. Journal of the American Medical Informatics Association, 27(12), 1977–1986. https://doi.org/10.1093/jamia/ocaa186 DOI: https://doi.org/10.1093/jamia/ocaa186
Allorto, N. L., & Wise, R. D. (2015). Development and Evaluation of an Integrated Electronic Data Management System in a South African Metropolitan Critical Care Service. Southern African Journal of Anaesthesia and Analgesia, 21(2), 31–35. https://doi.org/10.1080/22201181.2015.1115607 DOI: https://doi.org/10.1080/22201181.2015.1115607
Alqahtani, A., Crowder, R., & Wills, G. (2017). Barriers to the Adoption of EHR Systems in the Kingdom of Saudi Arabia: An Exploratory Study Using a Systematic Literature Review. Journal of Health Informatics in Developing Countries, 11(2). Retrieved from https://www.jhidc.org/index.php/jhidc/article/view/160
Alzoubi, H., Alzubi, R., Ramzan, N., West, D., Al-Hadhrami, T., & Alazab, M. (2019). A Review of Automatic Phenotyping Approaches Using Electronic Health Records. Electronics, 8(11), 1235. https://doi.org/10.3390/electronics8111235 DOI: https://doi.org/10.3390/electronics8111235
Ammann, E. M., Cuker, A., Carnahan, R. M., Perepu, U. S., Winiecki, S. K., Schweizer, M. L., … Beukelman, T. (2018). Chart Validation of Inpatient ICD-9-CM Administrative Diagnosis Codes for Venous Thromboembolism Among Intravenous Immune Globulin Users. Medicine, 97(38), e9960. https://doi.org/10.1097/MD.0000000000009960 DOI: https://doi.org/10.1097/MD.0000000000009960
ASGE Technology Committee, Manfredi, M. A., Chauhan, S. S., Enestvedt, B. K., Fujii-Lau, L. L., Konda, V., Hwang, J. H., Lo, S. K., Maple, J. T., Murad, F. M., Pannala, R., Woods, K. L., & Banerjee, S. (2016). Endoscopic Electronic Medical Record Systems. Gastrointestinal Endoscopy, 83(1), 29–36. https://doi.org/10.1016/j.gie.2015.09.036 DOI: https://doi.org/10.1016/j.gie.2015.09.036
Bonomi, L., & Jiang, X. (2018). Patient Ranking with Temporally Annotated Data. Journal of Biomedical Informatics, 78, 43–53. https://doi.org/10.1016/j.jbi.2017.12.007 DOI: https://doi.org/10.1016/j.jbi.2017.12.007
Burt, A., Morgan, L., Petrinic, T., Young, D., & Watkinson, P. (2017). Usability Evaluation Methods Employed to Assess Information Visualisations of Electronically Stored Patient Data for Clinical Use: A Protocol for a Systematic Review. Systematic Reviews, 6, Article 111. https://doi.org/10.1186/s13643-017-0544-1 DOI: https://doi.org/10.1186/s13643-017-0544-1
Cahill, M., Cleary, B. J., & Cullinan, S. (2025). The Influence of Electronic Health Record Design on Usability and Medication Safety: Systematic Review. BMC Health Services Research, 25(1). https://doi.org/10.1186/s12913-024-12060-2 DOI: https://doi.org/10.1186/s12913-024-12060-2
Cho, H. N., Ahn, I., Gwon, H., Kang, H. J., Kim, Y., Seo, H., … Kim, S. (2022). Heterogeneous Graph Construction and HinSAGE Learning from Electronic Medical Records. Scientific Reports, 12, Article 20933. https://doi.org/10.1038/s41598-022-25693-2 DOI: https://doi.org/10.1038/s41598-022-25693-2
Cillessen, F. H. J. M., Robbé, P. F. D. V., & Biermans, M. C. J. (2017). A Hospital-Wide Transition from Paper to Digital Problem-Oriented Clinical Notes: A Descriptive History and Cross-Sectional Survey of Use, Usability, and Satisfaction. Applied Clinical Informatics, 8(2), 502–514. https://doi.org/10.4338/ACI-2016-08-RA-0137 DOI: https://doi.org/10.4338/ACI-2016-08-RA-0137
Cook, L. A., Sachs, J., & Weiskopf, N. G. (2022). The Quality of Social Determinants Data in the Electronic Health Record: A Systematic Review. Journal of the American Medical Informatics Association, 29(1), 187–196. https://doi.org/10.1093/jamia/ocab199 DOI: https://doi.org/10.1093/jamia/ocab199
Cui, S., Wei, G., Zhou, L., Zhao, E., Wang, T., & Ma, F. (2023). Predicting Line of Therapy Transition via Similar Patient Augmentation. Journal of Biomedical Informatics, 147, 104511. https://doi.org/10.1016/j.jbi.2023.104511 DOI: https://doi.org/10.1016/j.jbi.2023.104511
Dart, A., Singer, A., Chanchlani, R., Ferguson, T., Tangri, N., & Zappitelli, M. (2023). Evaluation of Administrative Case Definitions for Hypertension in Canadian Children. Scientific Reports, 13, Article 33401. https://doi.org/10.1038/s41598-023-33401-x DOI: https://doi.org/10.1038/s41598-023-33401-x
Deignan, J. L., Chung, W. K., Kearney, H. M., Monaghan, K. G., Rehder, C. W., & Chao, E. C. (2019). Points to Consider in the Reevaluation and Reanalysis of Genomic Test Results: A Statement of the American College of Medical Genetics and Genomics (ACMG). Genetics in Medicine, 21(6), 1267–1270. https://doi.org/10.1038/s41436 DOI: https://doi.org/10.1038/s41436-019-0478-1
Dewanto, D., Santosa, T. A., Ratih, A., Asrizal, A., & Hardeli, H. (2024). The Influence of the STEM-Based Guided Inquiry Model on Students’ Creative Thinking Skills in Science Learning: A Meta-Analysis Study. Jurnal Penelitian Pendidikan IPA, 10(3), 88–95. https://doi.org/10.29303/jppipa.v10i3.6777 DOI: https://doi.org/10.29303/jppipa.v10i3.6777
Elfira, I., & Santosa, T. A. (2023). Literature Study: Utilization of the PjBL Model in Science Education to Improve Creativity and Critical Thinking Skills. Jurnal Penelitian Pendidikan IPA, 9(1), 133–143. https://doi.org/10.29303/jppipa.v9i1.2555 DOI: https://doi.org/10.29303/jppipa.v9i1.2555
Ettaloui, N., Arezki, S., & Gadi, T. (2024). Blockchain-Based Electronic Health Record: Systematic Literature Review. Human Behavior and Emerging Technologies, 2024(1). https://doi.org/10.1155/hbe2/4734288 DOI: https://doi.org/10.1155/hbe2/4734288
Ferrara, M., Gentili, E., Murri, M. B., Zese, R., Alberti, M., Franchini, G., … Amore, M. (2023). Establishment of a Public Mental Health Database for Research Purposes in the Ferrara Province: Development and Preliminary Evaluation Study. JMIR Medical Informatics, 11, e45523. https://doi.org/10.2196/45523 DOI: https://doi.org/10.2196/45523
Freire, S. M., Teodoro, D., Wei-Kleiner, F., Sundvall, E., Karlsson, D., & Lambrix, P. (2016). Comparing the Performance of NoSQL Approaches for Managing Archetype-Based Electronic Health Record Data. PLOS ONE, 11(3), e0150069. https://doi.org/10.1371/journal.pone.0150069 DOI: https://doi.org/10.1371/journal.pone.0150069
Goldstein, B. A., Navar, A. M., Pencina, M. J., & Ioannidis, J. P. A. (2017). Opportunities and Challenges in Developing Risk Prediction Models with Electronic Health Records Data: A Systematic Review. Journal of the American Medical Informatics Association, 24(1), 198–208. https://doi.org/10.1093/jamia/ocw042 DOI: https://doi.org/10.1093/jamia/ocw042
Haque, A. K. M. B., Arifuzzaman, B. M., Siddik, S. A. N., Kalam, A., Shahjahan, T. S., Saleena, T. S., Alam, M., Islam, M. R., Ahmmed, F., & Hossain, M. J. (2022). Semantic Web in Healthcare: A Systematic Literature Review of Application, Research Gap, and Future Research Avenues. International Journal of Clinical Practice, 2022. https://doi.org/10.1155/2022/6807484 DOI: https://doi.org/10.1155/2022/6807484
Huber, A. N., Pascoe, S., Fox, M. P., Murphy, J., Phokojoe, M., Gorgens, M., … Fairall, L. (2022). Leveraging Routine Data in Impact Evaluation: Understanding Data Systems in Primary Healthcare Prior to a Matched Cluster-Randomised Evaluation of Adherence Guidelines in South Africa. South African Medical Journal, 112(10), 819–827. https://doi.org/10.7196/SAMJ.2022.v112i10.14909 DOI: https://doi.org/10.7196/SAMJ.2022.v112i10.14909
Ichsan, I., Suharyat, Y., Santosa, T. A., & Satria, E. (2023). Effectiveness of STEM-Based Learning in Teaching 21st Century Skills in Generation Z Student in Science Learning: A Meta-Analysis. Jurnal Penelitian Pendidikan IPA, 9(1), 150–166. https://doi.org/10.29303/jppipa.v9i1.2517 DOI: https://doi.org/10.29303/jppipa.v9i1.2517
Jokar, M., Sahmeddini, M. A., Zand, F., Rezaee, R., & Bashiri, A. (2023). Development and Evaluation of an Anesthesia Module for Electronic Medical Records in the Operating Room: An Applied Developmental Study. BMC Anesthesiology, 23, Article 335. https://doi.org/10.1186/s12871-023-02335-2 DOI: https://doi.org/10.1186/s12871-023-02335-2
Katurura, M. C., & Cilliers, L. (2018). Electronic Health Record System in the Public Health Care Sector of South Africa: A Systematic Literature Review. African Journal of Primary Health Care & Family Medicine, 1–8. https://doi.org/10.4102/ DOI: https://doi.org/10.4102/phcfm.v10i1.1746
Kehl, K. L., Jee, J., Pichotta, K., Paul, M. A., Trukhanov, P., Fong, C., … Weissman, J. S. (2024). Shareable Artificial Intelligence to Extract Cancer Outcomes from Electronic Health Records for Precision Oncology Research. Nature Communications, 15, Article 9787. https://doi.org/10.1038/s41467-024-54071-x DOI: https://doi.org/10.1038/s41467-024-54071-x
Kim, J. W., Kim, S., Ryu, B., Song, W., Lee, H. Y., & Yoo, S. (2021). Transforming Electronic Health Record Polysomnographic Data into the OMOP Common Data Model: A Pilot Feasibility Study. Scientific Reports, 11, Article 86564. https://doi.org/10.1038/s41598-021-86564-w DOI: https://doi.org/10.1038/s41598-021-86564-w
Koleck, T. A., Dreisbach, C., Bourne, P. E., & Bakken, S. (2019). Natural Language Processing of Symptoms Documented in Free-Text Narratives of Electronic Health Records: A Systematic Review. Journal of the American Medical Informatics Association, 26(4), 364–379. https://doi.org/10.1093/jamia/ocy173 DOI: https://doi.org/10.1093/jamia/ocy173
Kruse, C. S., Kristof, C., Jones, B., Mitchell, E., & Martinez, A. (2016). Barriers to Electronic Health Record Adoption: a Systematic Literature Review. Journal of Medical Systems, 40(12). https://doi.org/10.1007/s10916-016-0628-9 DOI: https://doi.org/10.1007/s10916-016-0628-9
Lewis, A. E., Weiskopf, N., Abrams, Z. B., Foraker, R., Lai, A. M., Payne, P. R. O., & Gupta, A. (2023). Electronic Health Record Data Quality Assessment and Tools: A Systematic Review. Journal of the American Medical Informatics Association, 30(10), 1730–1740. https://doi.org/10.1093/jamia/ocad120 DOI: https://doi.org/10.1093/jamia/ocad120
Mayer, A. H., Costa, C. A. D., & Righi, R. D. R. (2020). Electronic Health Records in a Blockchain: A Systematic Review. Health Informatics Journal, 26(2), 1273–1288. https://doi.org/10.1177/1460458219866350 DOI: https://doi.org/10.1177/1460458219866350
Meystre, S. M., Savova, G. K., Kipper-Schuler, K. C., & Hurdle, J. F. (2008). Extracting Information from Textual Documents in the Electronic Health Record: A Review of Recent Research. Yearbook of Medical Informatics, 128–144. https://doi.org/10.1055/s-0038-1638592 DOI: https://doi.org/10.1055/s-0038-1638592
Muñoyerro-Muñiz, D., Goicoechea-Salazar, J. A., García-León, F. J., Laguna-Téllez, A., Larrocha-Mata, D., & Cardero-Rivas, M. (2020). Health Record Linkage: Andalusian Health Population Database. Gaceta Sanitaria, 34(2), 105–113. https://doi.org/10.1016/j.gaceta.2019.03.003 DOI: https://doi.org/10.1016/j.gaceta.2019.03.003
Nakamura, Y., Sugawara, T., Kawanohara, H., Ohkusa, Y., Kamei, M., & Oishi, K. (2015). Evaluation of Estimated Number of Influenza Patients from National Sentinel Surveillance Using the National Database of Electronic Medical Claims. Japanese Journal of Infectious Diseases, 68(1), 27–29. https://doi.org/10.7883/yoken.JJID.2014.092 DOI: https://doi.org/10.7883/yoken.JJID.2014.092
Nash, D. M., Ivers, N. M., Young, J., Jaakkimainen, R. L., Garg, A. X., & Tu, K. (2017). Improving Care for Patients with or at Risk for Chronic Kidney Disease Using Electronic Medical Record Interventions: A Pragmatic Cluster-Randomized Trial Protocol. Canadian Journal of Kidney Health and Disease, 4, 2054358117699833. https://doi.org/10.1177/2054358117699833 DOI: https://doi.org/10.1177/2054358117699833
Negro-Calduch, E., Azzopardi-Muscat, N., Krishnamurthy, R. S., & Novillo-Ortiz, D. (2021). Technological Progress in Electronic Health Record System Optimization: Systematic Review of Systematic Literature Reviews. International Journal of Medical Informatics, 152, 104507. https://doi.org/10.1016/j.ijmedinf.2021.104507 DOI: https://doi.org/10.1016/j.ijmedinf.2021.104507
Pacurariu, A., Plueschke, K., McGettigan, P., Morales, D. R., Slattery, J., Vogl, D., Goedecke, T., Kurz, X., & Cave, A. (2018). Electronic Healthcare Databases in Europe: Descriptive Analysis of Characteristics and Potential for Use in Medicines Regulation. BMJ Open, 8(9), e023090. https://doi.org/10.1136/bmjopen-2018-023090 DOI: https://doi.org/10.1136/bmjopen-2018-023090
Parejo, U. T., Campaña, J. R., Vila, M. A., & Calvo-Flores, M. D. (2020). A Survey of Tag Clouds as Tools for Information Retrieval and Content Representation. Information Visualization, 20(10), 147387162096663. https://doi.org/10.1177/1473871620966638 DOI: https://doi.org/10.1177/1473871620966638
Payrovnaziri, S. N., Chen, Z., Rengifo-Moreno, P., Miller, T., Bian, J., Chen, J. H., Liu, X., & He, Z. (2020). Explainable Artificial Intelligence Models Using Real-World Electronic Health Record Data: A Systematic Scoping Review. Journal of the American Medical Informatics Association, 27(7), 1173–1185. https://doi.org/10.1093/jamia/ocaa053 DOI: https://doi.org/10.1093/jamia/ocaa053
Putra, M., Rahman, A., Ilwandri, I., Suhayat, Y., Santosa, T. A., Putra, R., & Aprilisia, S. (2023). The Effect of STEM-Based REACT Model on Students’ Critical Thinking Skills: A Meta-Analysis Study. LITERACY: International Scientific Journals of Social, Education, Humanities, 2(1), 207–217. https://doi.org/10.56910/literacy.v2i1.560 DOI: https://doi.org/10.56910/literacy.v2i1.560
Reegu, F. A., Abas, H., Gulzar, Y., Xin, Q., Alwan, A. A., Jabbari, A., Sonkamble, R. G., & Dziyauddin, R. A. (2023). Blockchain-Based Framework for Interoperable Electronic Health Records for an Improved Healthcare System. Sustainability (Switzerland), 15(8). https://doi.org/10.3390/su15086337 DOI: https://doi.org/10.3390/su15086337
Regueiro, C., Seco, I., Gutiérrez-Agüero, I., Urquizu, B., & Mansel, J. (2021). A Blockchain-Based Audit Trail Mechanism: Designand Implementation. Algorithms, 14(12), 341. https://doi.org/10.3390/a14120341 DOI: https://doi.org/10.3390/a14120341
Sander, A., & Wauer, R. (2019). Integrating Terminologies into Standard SQL: A New Approach for Research on Routine Data. Journal of Biomedical Semantics, 10, Article 9. https://doi.org/10.1186/s13326-019-0199-z DOI: https://doi.org/10.1186/s13326-019-0199-z
Santosa, T. A., Agustina, N., & Yulianti, S. (2020). Jenis Tumbuhan Liar dalam Upacara Adat Kenduri Seko di Kerinci. Pendekar: Jurnal Pendidikan Berkarakter, 3(1), 6–10. Retrieved from http://journal.ummat.ac.id/index.php/pendekar/article/view/2798
Schwartz, K. L., Wilton, A. S., Langford, B. J., Brown, K. A., Daneman, N., Garber, G., … Morris, A. M. (2019). Comparing Prescribing and Dispensing Databases to Study Antibiotic Use: A Validation Study of the Electronic Medical Record Administrative Data Linked Database (EMRALD). Journal of Antimicrobial Chemotherapy, 74(7), 2091–2097. https://doi.org/10.1093/jac/dkz033 DOI: https://doi.org/10.1093/jac/dkz033
Sezgin, E., & Özkan, S. (2013). A Systematic Literature Review on Health Recommender Systems. 2013 E-Health and Bioengineering Conference, EHB 2013. https://doi.org/10.1109/EHB.2013.6707249 DOI: https://doi.org/10.1109/EHB.2013.6707249
Shaikh, M., Vayani, A. H. M., Akram, S., & Qamar, N. (2022). Open-Source Electronic Health Record Systems: A Systematic Review of Most Recent Advances. Health Informatics Journal, 28(2). https://doi.org/10.1177/14604582221099828 DOI: https://doi.org/10.1177/14604582221099828
Shankar, R., Bundele, A., & Mukhopadhyay, A. (2025). Natural Language Processing of Electronic Health Records for Early Detection of Cognitive Decline: A Systematic Review. NPJ Digital Medicine, 8(1). https://doi.org/10.1038/s41746-025-01527-z DOI: https://doi.org/10.1038/s41746-025-01527-z
Siefridt, C., Grosjean, J., Lefebvre, T., Rollin, L., Darmoni, S., & Schuers, M. (2020). Evaluation of Automatic Annotation by a Multi-Terminological Concepts Extractor within a Corpus of Data from Family Medicine Consultations. International Journal of Medical Informatics, 133, 104009. https://doi.org/10.1016/j.ijmedinf.2019.104009 DOI: https://doi.org/10.1016/j.ijmedinf.2019.104009
Supriyadi, A., Desy, D., Suharyat, Y., Santosa, T. A., & Sofianora, A. (2023). The Effectiveness of STEM-Integrated Blended Learning on Indonesia Student Scientific Literacy: A Meta-Analysis. International Journal of Education and Literature, 2(1), 41–48. https://doi.org/10.55606/ijel.v2i1.53 DOI: https://doi.org/10.55606/ijel.v2i1.53
Tapuria, A., Porat, T., Kalra, D., Dsouza, G., Xiaohui, S., & Curcin, V. (2021). Impact of Patient Access to Their Electronic Health Record: Systematic Review. Informatics for Health and Social Care, 46(2), 192–204. https://doi.org/10.1080/17538157.2021.1879810 DOI: https://doi.org/10.1080/17538157.2021.1879810
Torab-Miandoab, A., Basiri, M., Dabbagh-Moghaddam, A., & Gholamhosseini, L. (2025). Electronic Health Record in Military Healthcare Systems: A Systematic Review. PLoS ONE, 20(2), 1–24. https://doi.org/10.1371/journal.pone.0313641 DOI: https://doi.org/10.1371/journal.pone.0313641
Torab-Miandoab, A., Samad-Soltani, T., Jodati, A., & Rezaei-Hachesu, P. (2023). Interoperability of Heterogeneous Health Information Systems: A Systematic Literature Review. BMC Medical Informatics and Decision Making, 23(1), 1–13. https://doi.org/10.1186/s12911-023-02115-5 DOI: https://doi.org/10.1186/s12911-023-02115-5
V.H., C., A.I., M.-G., & J.R., P. (2010). A Knowledge-Based Taxonomy of Critical Factors for Adopting Electronic Health Record Systems by Physicians: A Systematic Literature Review. BMC Medical Informatics and Decision Making, 10, 60. Retrieved from http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=emedx&NEWS=N&AN=20950458%5Cnhttp://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=emed9&NEWS=N&AN=20950458
Wang, D., & Zhang, S. (2024). Large Language Models in Medical and Healthcare Fields: Applications, Advances, and Challenges. Artificial Intelligence Review, 57, Article 10921. https://doi.org/10.1007/s10462-024-10921-0 DOI: https://doi.org/10.1007/s10462-024-10921-0
Winiasri, L., Santosa, T. A., Yohandri, Y., Razak, A., Festiyed, F., & Zulyusri, Z. (2023). Ethno-Biology Learning Model Based on Design Thinking to Improve Students’ Critical Thinking Skills. Jurnal Penelitian Pendidikan IPA, 9(9), 7767–7774. https://doi.org/10.29303/jppipa.v9i9.4213 DOI: https://doi.org/10.29303/jppipa.v9i9.4213
Xanthidou, O. K., Shuib, L., Xanthidis, D., & Nicholas, D. (2018). Electronic Medical Records in Greece and Oman: A Professional’s Evaluation of Structure and Value. International Journal of Environmental Research and Public Health, 15(6), 1137. https://doi.org/10.3390/ijerph15061137 DOI: https://doi.org/10.3390/ijerph15061137
Xiang, Y., Xu, J., Si, Y., Li, Z., Rasmy, L., Zhou, Y., … Wang, F. (2019). Time-Sensitive Clinical Concept Embeddings Learned from Large Electronic Health Records. BMC Medical Informatics and Decision Making, 19(Suppl 2), Article 58. https://doi.org/10.1186/s12911-019-0766-3 DOI: https://doi.org/10.1186/s12911-019-0766-3
Xiao, C., Choi, E., & Sun, J. (2018). Opportunities and Challenges in Developing Deep Learning Models Using Electronic Health Records Data: A Systematic Review. Journal of the American Medical …. Retrieved from https://academic.oup.com/jamia/article-abstract/25/10/1419/5035024 DOI: https://doi.org/10.1093/jamia/ocy068
Zang, C., Hou, Y., Lyu, D., Jin, J., Sacco, S., Chen, K., … Wang, X. (2024). Accuracy and Transportability of Machine Learning Models for Adolescent Suicide Prediction with Longitudinal Clinical Records. Translational Psychiatry, 14, Article 3034. https://doi.org/10.1038/s41398-024-03034-3 DOI: https://doi.org/10.1038/s41398-024-03034-3
Zarour, M., Alenezi, M., Ansari, M. T. J., Pandey, A. K., Ahmad, M., Agrawal, A., Kumar, R., & Khan, R. A. (2021). Ensuring Data Integrity of Healthcare Information in the Era of Digital Health. Healthcare Technology Letters, 8(3), 66–77. https://doi.org/10.1049/htl2.12008 DOI: https://doi.org/10.1049/htl2.12008
Zhang, P., Shen, S., Deng, W., Mao, S., & Wang, Y. (2022). The Construction Model of the TCM Clinical Knowledge Coding Database Based on Knowledge Organization. BioMed Research International, 2022, Article 2503779. https://doi.org/10.1155/2022/2503779 DOI: https://doi.org/10.1155/2022/2503779
Zulkifli, Z., Satria, E., Supriyadi, A., & Santosa, T. A. (2022). Meta-Analysis: The Effectiveness of the Integrated STEM Technology Pedagogical Content Knowledge Learning Model on the 21st Century Skills of High School Students in the Science Department. Psychology, Evaluation, and Technology in Educational Research, 5(1), 32–42. https://doi.org/10.33292/petier.v5i1.144 DOI: https://doi.org/10.33292/petier.v5i1.144
Zulyusri, Z., Santosa, T. A., Festiyed, F., Yerimadesi, Y., Yohandri, Y., Razak, A., & Sofianora, A. (2023). Effectiveness of STEM Learning Based on Design Thinking in Improving Critical Thinking Skills in Science Learning: A Meta-Analysis. Jurnal Penelitian Pendidikan IPA, 9(6), 112–119. https://doi.org/10.29303/jppipa.v9i6.3709 DOI: https://doi.org/10.29303/jppipa.v9i6.3709
License
Copyright (c) 2025 Ade Dita Puteri, Lira Mufti Azzahri Isnaeni

This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).






