The Framework and Types of Chemical Literacy Tests: A Systematic Review


Marfuatun , Nahadi , Galuh Yuliani , Hernani






Vol. 10 No. 6 (2024): June


Chemical literacy, Framework, PISA



How to Cite

Marfuatun, M., Nahadi, N., Yuliani, G., & Hernani, H. (2024). The Framework and Types of Chemical Literacy Tests: A Systematic Review. Jurnal Penelitian Pendidikan IPA, 10(6), 269–276.


Download data is not yet available.


Metrics Loading ...


The development of chemical literacy measurement instruments is influenced by changes and progress in frameworks, methods, and educational technologies. The study aimed to investigate the framework and test types that are utilized to measure students’ chemical literacy levels. With adherence to the PRISMA  20202, thirty-five empirical studies published between 2014  and 2023 are analyzed to find publication characteristics, chemical literacy frameworks, and test types. The finding showed that most publications were recorded in 2019, and the respondents who were involved in the research in the largest number are high school students, descriptive and experimental research are popular choices for researchers. The vast majority of studies develop chemical literacy tests using PISA and Shwartz et al frameworks and open-ended questions. Moreover, further research ought to inquire into the implementation of the chemical literacy test and integrate innovative technology of testing


Ad’hiya, E., & Laksono, E. W. (2018). Development and validation of an integrated assessment instrument to assess students’ analytical thinking skills in chemical literacy. International Journal of Instruction, 11(4), 241–256.

Ad’Hiya, E., & Laksono, E. W. (2018). Students’ analytical thinking skills and chemical literacy concerning chemical equilibrium. AIP Conference Proceedings, 2021(July 2008).

Al Sultan, A., Henson, H., & Lickteig, D. (2021). Assessing preservice elementary teachers’ conceptual understanding of scientific literacy. Teaching and Teacher Education, 102.

Alwathoni, M., Saputro, S., Ashadi, & Masykuri, M. (2020). Validation of instrument to measure chemical literacy ability in islamic senior high school students. Journal of Physics: Conference Series, 1511(1).

American Chemical Society. (2012). ACS Guidelines and Recom m endations for the Teaching of High School Chemistry. Washington, DC: The American Chemical Society. Retrieved from

Arabbani, F. K., Mulyani, S., Mahardiani, L., & Ariani, S. R. D. (2019). Analysis the quality of instrument for measuring chemical literacy abilities of high school student using Rasch model. AIP Conference Proceedings, 2194.

Baas, J., Schotten, M., Plume, A., Côté, G., & Karimi, R. (2020). Scopus as a curated, high-quality bibliometric data source for academic research in quantitative science studies. Quantitative Science Studies, 1(1), 377–386.

Bybee, R. (2015). Scientific Literacy. In R. Gunstone (Ed.), Encyclopedia of Science Education (pp. 944–947). Dordrecht: Springer Netherlands.

Bybee, R., & McCrae, B. (2011). Scientific literacy and student attitudes: perspectives from PISA 2006 science. International Journal of Science Education. International Journal of Science Education, 33(1), 7–26.

Chang, S. N., & Chiu, M. H. (2005). The development of authentic assessments to investigate ninth graders’ scientific literacy: In the case of scientific cognition concerning the concepts of chemistry and physics. International Journal of Science and Mathematics Education, 3(1), 117–140.

Cigdemoglu, C., Arslan, H. O., & Cam, A. (2017). Argumentation to foster pre-service science teachers’ knowledge, competency, and attitude on the domains of chemical literacy of acids and bases. Chemistry Education Research and Practice, 18(2), 288–303.

Cigdemoglu, Ceyhan. (2020). Flipping The Use of Science-Technology and Society Issues as Triggering Students’ Motivation and Chemical Literacy. Science Education International, 31(1), 74–83.

Cigdemoglu, Ceyhan, & Geban, O. (2015). Improving students’ chemical literacy levels on thermochemical and thermodynamics concepts through a context-based approach. Chemistry Education Research and Practice, 16(2), 302–317.

Dragoş, V., & Mih, V. (2015). Scientific Literacy in School. Procedia - Social and Behavioral Sciences, 209(July), 167–172.

Eny, H. A., & Wiyarsi, A. (2019). Students’ Chemical Literacy on Context-Based Learning: A Case of Equilibrium Topic. Journal of Physics: Conference Series, 1397(1).

Hartman, J. R., Nelson, E. A., & Kirschner, P. A. (2022). Improving student success in chemistry through cognitive science. Foundations of Chemistry, 24(2), 239–261.

Kohen, Z., Herscovitz, O., & Dori, Y. J. (2020). How to promote chemical literacy? On-line question posing and communicating with scientists. Chemistry Education Research and Practice, 21(1), 250–266.

Maienschein, J. (1998). Scientific literacy. Science, Vol. 281, p. 917. American Association for the Advancement of Science.

Mozeika, D., & Bilbokaite, R. (2010). Teaching and Learning Method for Enhancing 15-16 Years Old Students’ Knowledge as One Of Scientific Literacy Aspect in Chemistry : Results Based on Research and Approbation. The International Journal of Educational Researchers, 3(1), 1–16. Retrieved from

Muchtar, H. K., Nahadi, & Hernani. (2020). Evaluation of chemical literacy assessment instruments in solution materials. Journal of Physics: Conference Series, 1521(4).

Muntholib, Ibnu, S., Rahayu, S., Fajaroh, F., Kusairi, S., & Kuswandi, B. (2020). Chemical literacy: Performance of first year chemistry students on chemical kinetics. Indonesian Journal of Chemistry, 20(2), 468–482.

OECD. (2015). PISA 2015 Results (Volume I): Excellence and Equity in Education. Paris: PISA, OECD Publishing. IS

Osborne, J. (2023). Science, scientific literacy, and science education. In Handbook of research on science education (pp. 785–816). Routledge.

Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. The BMJ, 372.

Ploj Virtič, M. (2022). Teaching science & technology: components of scientific literacy and insight into the steps of research. International Journal of Science Education, 44(12), 1916–1931.

Polat, M. (2020). Analysis of multiple-choice versus open-ended questions in language tests according to different cognitive domain levels. Novitas-ROYAL (Research on Youth and Language), 14(2), 76–96.

Prastiwi, M. N. B., & Laksono, E. W. (2018). The ability of analytical thinking and chemistry literacy in high school students learning. Journal of Physics: Conference Series, 1097(1).

Ramirez, R. P. B., & Ganaden, M. S. (2008). Creative activities and students’ higher order thinking skills. Education Quarterly, 66(December), 22–33.

Shwartz, Y., Ben-Zvi, R., & Hofstein, A. (2006). Chemical literacy: What does this mean to scientists and school teachers? Journal of Chemical Education, 83(10), 1557–1561.

Stowe, R. L., & Cooper, M. M. (2019). Assessment in Chemistry Education. Israel Journal of Chemistry, 59(6), 598–607.

Suwahyu, F. A., & Rahayu, S. (2023). Development and Utilization of Instrument Using PISA Framework to Improve Chemistry Literacy Ability: A Systematic Review. AIP Conference Proceedings, 2569. American Institute of Physics Inc.

Talanquer, V., & Sevian, H. (2014). Chemistry in past and new science frameworks and standards: Gains, losses, and missed opportunities. Journal of Chemical Education, 91(1), 24–29.

Thummathong, R., & Thathong, K. (2016). Construction of a chemical literacy test for engineering students. Journal of Turkish Science Education, 13(3), 185–198.

Thummathong, R., & Thathong, K. (2018). Chemical literacy levels of engineering students in Northeastern Thailand. Kasetsart Journal of Social Sciences, 39(3), 478–487.

Witte, D., & Beers, K. (2003). Testing of Chemical Literacy (Chemistry in Context in the Dutch National Examinations). Chemical Education International, 4(1), 1–15. Retrieved from

Wiyarsi, A. (2020). Vocational High School Students ’ Chemic al Literacy on Context- Based Learning : A Case of Petroleum Topic. 17(1).

Author Biographies

Marfuatun, Universitas Pendidikan Indonesia

Nahadi, Universitas Pendidikan Indonesia

Galuh Yuliani, Universitas Pendidikan Indonesia

Hernani, Universitas Pendidikan Indonesia


Copyright (c) 2024 Marfuatun -

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).