Science Literacy Assessment Instrument for Additives and Addictive Substances: Development, Validation, and Rasch Model Analysis

Authors

Syarif Faisal , Ani Rusilowati , Endang Susilaningsih

DOI:

10.29303/jppipa.v9i10.4376

Published:

2023-10-25

Issue:

Vol. 9 No. 10 (2023): October

Keywords:

Bloom's revised taxonomy, Modified framework, PISA, Rasch model, Science literacy assessment instrument

Research Articles

Downloads

How to Cite

Faisal, S., Rusilowati, A. ., & Susilaningsih, E. . (2023). Science Literacy Assessment Instrument for Additives and Addictive Substances: Development, Validation, and Rasch Model Analysis . Jurnal Penelitian Pendidikan IPA, 9(10), 7826–7836. https://doi.org/10.29303/jppipa.v9i10.4376

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Abstract

Science literacy is one of the areas of basic literacy that PISA focuses on. Science literacy is essence of learning in the 21st century. The purpose of this study is to develop and validate instruments to assess science literacy in the area of additives and addictive substances. The researcher refers to the modified PISA framework and Bloom's Revised Taxonomy. The developed instrument was tested for reliability and validity using the Aiken V method and the Rasch model. The research respondents consisted of 47 students from two junior high schools: a public school and a private school that has been accredited A. The results of the analysis showed that the instrument has validity. The results of the analysis showed that of the 25 items given there were 24 valid items, the resulting Cronbach's alpha value of 0.86 showed very good criteria, it can be concluded that the instrument has high validity and good reliability. This instrument is expected to be used to measure the quality of education and science literacy of students in Indonesia.

References

Ad’hiya, E., & Laksono, E. W. (2018). Development and validation of an integrated assessment instrument to assess students’ analytical thinking skills in chemical literacy. International Journal of Instruction, 11(4), 241–256. https://doi.org/10.12973/iji.2018.11416a

Ariffin, S. R., Omar, B., Isa, A., & Sharif, S. (2010). Validity and reliability Multiple Intelligent item using Rasch measurement model. Procedia - Social and Behavioral Sciences, 9, 729–733. https://doi.org/10.1016/j.sbspro.2010.12.225

Arlianty, W. N., Febriana, B. W., Diniaty, A., & Fauzi’ah, L. (2018). Student profile in completing questions based on cognitive level of bloom’s taxonomy by Anderson and Krathwohl. AIP Conference Proceedings, 2026, 020063. https://doi.org/10.1063/1.5065023

Bahri, S., Simbolon, M., & Alhad, K. (2021). Development of Assessment Instrument of Scientific Literacy Ability for Students at Musamus University. In International Joined Conference on Social Science (ICSS 2021) (pp. 395-398). Atlantis Press. https://doi.org/10.2991/assehr.k.211130.072

Bond, T. (2015). Applying the Rasch Model. Routledge. https://doi.org/10.4324/9781315814698

Cansız, N., & Cansız, M. (2019). Evaluating Turkish science curriculum with PISA scientific literacy framework. Turkish Journal of Education, 8(3), 217–236. https://doi.org/10.19128/turje.545798

Darmana, A., Sutiani, A., Nasution, H. A., Ismanisa*, I., & Nurhaswinda, N. (2021). Analysis of Rasch Model for the Validation of Chemistry National Exam Instruments. Jurnal Pendidikan Sains Indonesia, 9(3), 329–345. https://doi.org/10.24815/jpsi.v9i3.19618

Desnita, D., Festiyed, F., Novitra, F., Ardiva, A., & Yussavel Navis, M. (2022). The Effectiveness of CTL-based Physics E-module on the Improvement of the Creative and Critical Thinking Skills of Senior High School Students. TEM Journal, 11(2), 802–810. https://doi.org/10.18421/TEM112-38

El Masri, Y. H., & Andrich, D. (2020). The Trade-Off between Model Fit, Invariance, and Validity: The Case of PISA Science Assessments. Applied Measurement in Education, 33(2), 174–188. https://doi.org/10.1080/08957347.2020.1732384

Febrina, Bustami, U., & Asnawi, M. (2019). Analysis of Reading Comprehension Questions By Using Revised Bloom ’ S Taxonomy on Higher Order. English Education Journal, 10(1), 1–15. Retrieved from https://jurnal.usk.ac.id/EEJ/article/view/13253

Gani, U. A., Bambang, R., & Umam, K. (2018). Analisis Diskriminan Untuk Mengelompokkan Negara Maju Dan Negara Berkembang Dengan Metode Fishers Discriminant Analysis of Classify Developed Countries and Developing Countries With Fisher Method. Jurnal Geuthèë: Penelitian Multidisiplin, 01(01), 1–12. https://doi.org/10.52626/jg.v1i1.6

Heuston, B. (2022). Pursuing Excellence and Equity in Education: Vol. I (PISA, pp. 637–664). OECD Publishing. https://doi.org/10.4018/978-1-7998-8649-5.ch026

Jamaluddin, J., Jufri, A. W., Ramdani, A., & Azizah, A. (2019). Profil Literasi Sains Dan Keterampilan Berpikir Kritis Pendidik Ipa Smp. Jurnal Penelitian Pendidikan IPA, 5(1). https://doi.org/10.29303/jppipa.v5i1.185

Koerber, S., & Osterhaus, C. (2019). Individual Differences in Early Scientific Thinking: Assessment, Cognitive Influences, and Their Relevance for Science Learning. Journal of Cognition and Development, 20(4), 510–533. https://doi.org/10.1080/15248372.2019.1620232

Kohar, D. (2022). Measuring the Effectiveness of the Brain-Based Learning Model on the Level of Reading Comprehension Based on Exposition Reading Structures in Junior High School. In Educational Sciences: Theory and Practice (Vol. 22, Issue 1, pp. 78–89). https://doi.org/10.12738/jestp.2022.1.0007

Lestari, H., Rahmawati, I., Siskandar, R., & Dafenta, H. (2021). Implementation of Blended Learning with A STEM Approach to Improve Student Scientific Literacy Skills During The Covid-19 Pandemic. Jurnal Penelitian Pendidikan IPA, 7(2), 224. https://doi.org/10.29303/jppipa.v7i2.654

Lotulung Mareike, S. D., & Wullur Bill, G. (2017). Teacher Directive Discourse and Active Learning in Indonesian High Schools. Journal of Modern Education Review, 7(3), 220–228. https://doi.org/10.15341/jmer(2155-7993)/03.07.2017/008

Marin, G., Sabogal, F., Marin, B. V., Otero-Sabogal, R., & Perez-Stable, E. J. (1987). Development of a Short Acculturation Scale for Hispanics. Hispanic Journal of Behavioral Sciences, 9(2), 183–205. https://doi.org/10.1177/07399863870092005

Mujahidin, G. R., Rahman, G. G. A., Wilujeng, I., & Nugroho, S. D. (2023). Profil Literasi Sains Aspek Kompetensi Peserta Didik Melalui Pembelajaran Berbasis Budaya Lokal Reyog Ponorogo. Jurnal Penelitian Pendidikan IPA, 9(2), 965–970. https://doi.org/10.29303/jppipa.v9i2.2753

Mulyanti, S., Suwahono, S., Setiowati, H., & Ningrum, L. S. (2022). Validity Analysis Using the Rasch Model in the Development of Alkane Concept Test Instruments. Jurnal Penelitian Pendidikan IPA, 8(3), 1142–1147. https://doi.org/10.29303/jppipa.v8i3.1383

Muntazhimah, M., Putri, S., & Khusna, H. (2020). Rasch Model untuk Memvalidasi Instrumen Resiliensi Matematis Mahasiswa Calon Guru Matematika. JKPM (Jurnal Kajian Pendidikan Matematika), 6(1), 65. https://doi.org/10.30998/jkpm.v6i1.8144

Oktarina, R., Fitria, Y., Ahmad, S., & Zen, Z. (2023). Development of STEM-Oriented E-Modules to Improve Science Literacy Ability of Elementary School Students. 9(1), 5460–5465. https://doi.org/10.29303/jppipa.v9i7.4503

Pratiwi, I. (2019). Efek Program Pisa Terhadap Kurikulum Di Indonesia. Jurnal Pendidikan Dan Kebudayaan, 4(1), 51–71. https://doi.org/10.24832/jpnk.v4i1.1157

Rakkapao, S., Prasitpong, S., & Arayathanitkul, K. (2016). Analysis test of understanding of vectors with the three-parameter logistic model of item response theory and item response curves technique. Physical Review Physics Education Research, 12(2), 1–10. https://doi.org/10.1103/PhysRevPhysEducRes.12.020135

Rohmah, F., Rusilowati, A., Supriyadi, S., & Widowati, T. (2023). Validitas dan reliabilitas instrumen penilaian berbasis android untuk menilai kemampuan siswa SMK dalam mendesain busana secara digital. JPPI (Jurnal Penelitian Pendidikan Indonesia), 9(2). https://doi.org/10.29210/020232131

Rusilowati, A. (2018). Asesmen Literasi Sains: Analisis Karakteristik Instrumen dan Kemampuan Siswa Menggunakan Teori Tes Modern Rasch Model. Prosiding Seminar Nasional Fisika Universitas Riau Ke-3, September, 2–15. Retrieved from https://snf.fmipa.unri.ac.id/wp-content/uploads/2019/03/0.-300B-2-15NI.pdf

Sadhu, S., & Laksono, E. W. (2018). Development and validation of an integrated assessment for measuring critical thinking and chemical literacy in chemical equilibrium. International Journal of Instruction, 11(3), 557–572. https://doi.org/10.12973/iji.2018.11338a

Sahnaz, S., & Kuswandi, P. C. (2023). Karangsari’s Starfruit Agrotourism; Blitar’s Local Pride as A Source of Biology Worksheet Apps to Enhance Students’ Science Literacy. Jurnal Penelitian Pendidikan IPA, 9(8), 5827-5833. https://doi.org/10.29303/jppipa.v9i8.3888

Setyorini, A. D., Yamtinah, S., Mahardiani, L., & Saputro, S. (2021). A Rasch analysis of item quality of the chemical literacy assessment for investigating student’s chemical literacy on chemical rate concepts. European Journal of Educational Research, 10(4), 1769–1779. https://doi.org/10.12973/EU-JER.10.4.1769

She, H. C., Stacey, K., & Schmidt, W. H. (2018). Science and Mathematics Literacy: PISA for Better School Education. International Journal of Science and Mathematics Education, 16(S1), 1–5. https://doi.org/10.1007/s10763-018-9911-1

Sukmawati, W., & Zulherman, Z. (2023). Analysis of Changes in Students’ Scientific Literacy Ability After Attending Lectures Using the RADEC Model. Jurnal Penelitian Pendidikan IPA, 9(3), 1039–1044. https://doi.org/10.29303/jppipa.v9i3.2846

Sumintono, B., & Widhiarso, W. (2015). Aplikasi Permodelan RASCH Pada Assesment Pendidikan (I). Trim Komunikata.

Suparya, I. K., I Wayan Suastra, & Putu Arnyana, I. B. (2022). Rendahnya Literasi Sains: Faktor Penyebab dan Alternatif Solusinya. Jurnal Ilmiah Pendidikan Citra Bakti, 9(1), 153–166. https://doi.org/10.38048/jipcb.v9i1.580

Susac, A., Planinic, M., Klemencic, D., & Milin Sipus, Z. (2018). Using the Rasch model to analyze the test of understanding of vectors. Physical Review Physics Education Research, 14(2), 23101. https://doi.org/10.1103/PhysRevPhysEducRes.14.023101

Susongko, P., Arfiani, Y., & Kusuma, M. (2021). Determination of gender differential item functioning in tegal-students’ scientific literacy skills with integrated science (Slisis) test using rasch model. Jurnal Pendidikan IPA Indonesia, 10(2), 270–281. https://doi.org/10.15294/jpii.v10i2.26775

Tesio, L., Caronni, A., Kumbhare, D., & Scarano, S. (2023). Interpreting results from Rasch analysis 1. The “most likely†measures coming from the model. Disability and Rehabilitation, 1–13. https://doi.org/10.1080/09638288.2023.2169771

Wati, M., Husna, A., Miriam, S., & Mahtari, S. (2018). Developing Cognitive Instruments Based on Science Literacy on Sound Materials, 274, 181–184. https://doi.org/10.2991/iccite-18.2018.41

Woudstra, A. J., Meppelink, C. S., Pander Maat, H., Oosterhaven, J., Fransen, M. P., & Dima, A. L. (2019). Validation of the short assessment of health literacy (SAHL-D) and short-form development: Rasch analysis. BMC Medical Research Methodology, 19(1), 1–10. https://doi.org/10.1186/s12874-019-0762-4

Zahara, S. R., Imanda, R., & Alvina, S. (2022). Development of Assessment Sheet for Measuring Students’ Scientific Literacy Level in the Era of Revolution 4.0. Jurnal Penelitian Pendidikan IPA, 8(3), 1096–1101. https://doi.org/10.29303/jppipa.v8i3.1169

Author Biographies

Syarif Faisal, semarang state university

Ani Rusilowati, Natural Science Education, Universitas Negeri Semarang, Indonesia

Endang Susilaningsih, Natural Science Education, Universitas Negeri Semarang, Indonesia

License

Copyright (c) 2023 Syarif Faisal, Ani Rusilowati, Endang Susilaningsih

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).