Content Validity of the Critical Thinking Skill Test Instrument on Computer Based Test (CBT) Ecology Lesson for High School Education

English

Authors

Irma Kharisma , Andi Ulfa Tenri Pada , Supriatno , Safrida , Ismul Huda

DOI:

10.29303/jppipa.v10i6.6914

Published:

2024-06-25

Issue:

Vol. 10 No. 6 (2024): June

Keywords:

Aiken formula, Critical thinking skill test, Validity coefficient

Research Articles

Downloads

How to Cite

Kharisma, I., Pada, A. U. T., Supriatno, Safrida, & Huda, I. (2024). Content Validity of the Critical Thinking Skill Test Instrument on Computer Based Test (CBT) Ecology Lesson for High School Education : English. Jurnal Penelitian Pendidikan IPA, 10(6), 3533–3540. https://doi.org/10.29303/jppipa.v10i6.6914
Crossref
Scopus
Google Scholar
Europe PMC

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Abstract

Research to measure students' Critical Thinking Skills has been widely carried out in Indonesia. However, the development of Critical Thinking Skill measuring tools in Ecology using CBT is still limited. This study is part of research and development to develop a good instrument product for measuring students' Critical Thinking Skills. The question preparation format uses a two tier multiple-choice form. This study aims to prove the content validity of the Critical Thinking Skill instrument in Ecology Subject for Senior High School. Scale using Likert model and multiple-choice model with content validity coefficient based on expert assessments with Aiken’s formula. There are three experts who assess the items' relevancy, construction, and clarity using indicators of both scale formats. The results of the expert assessments are then used to calculate the coefficient of the validity with Aiken formula. The results showed that the content validity coefficient based on expert assessment on Likert format with Aiken formula is at 0.75-1.00 for each, while using the Aiken formula.

References

Aiken, L. R. (1987). Formulas for Equating Ratings on Different Scales. Educational and Psychological Measurement, 47(1), 51–54. https://doi.org/10.1177/0013164487471007

Allen, M. J., & Yen, W. M. (2001). Introduction to measurement theory. Waveland Press.

Azwar, S. (2012). Reliabilitas dan validitas edisi 4. Pustaka Pelajar.

Cullinane, A., & Liston, M. (2011). Two-tier Multiple Choice Question: An Alternative Method of Formatif Assessment for First Year Undergraduate Biology Students. National Center for Excellence In Mathematics and Education Science Teaching and Learning (NCE-MSTL).

Elliot, D. L., & Kobayashi, S. (2019). How can PhD supervisors play a role in bridging academic cultures? Teaching in Higher Education, 24(8), 911–929. https://doi.org/10.1080/13562517.2018.1517305

Ennis, R. (2011). Critical Thinking. Inquiry: Critical Thinking Across the Disciplines, 26(2), 5–19. https://doi.org/10.5840/inquiryctnews201126215

Ennis, R. H. (n.d.). Critical thinking and subject specificity: Clarification and needed research. Educational Researcher, 18(3), 4–10. https://doi.org/10.3102/0013189x018003004

Ennis, R. H. (1985). A logical basis for measuring critical thinking skills. In Educational Leadership (Vol. 43, Issue 2, pp. 44–48).

Ennis, R. H. (1993). Critical thinking assessment. Theory Into Practice, 32(3), 179–186. https://doi.org/10.1080/00405849309543594

Gillies, R. M., Nichols, K., Burgh, G., & Haynes, M. (2012). The effects of two strategic and meta-cognitive questioning approaches on children’s explanatory behaviour, problem-solving, and learning during cooperative, inquiry-based science. International Journal of Educational Research, 53, 93–106. https://doi.org/10.1016/j.ijer.2012.02.003

Hidayah, N., Yuliana, A. T., & Hanafi, H. (2020). Theoretical Validity of Problem Focused-Coping Skill Guideline to Develop Students’ Critical Thinking Skills. Jurnal Kajian Bimbingan Dan Konseling, 5(4), 183–191. https://doi.org/10.17977/um001v5i42020p183

Istiyono, E. (2014). Pengukuran kemampuan berpikir tingkat tinggi fisika peserta didik SMA di DIY. Jurnal Sains Dan Teknologi, 5, 1. Retrieved from https://eprints.uny.ac.id/13115/

Istiyono, E., Dwandaru, W. S. B., Lede, Y. A., Rahayu, F., & Nadapdap, A. (2019). Developing IRT-Based Physics Critical Thinking Skill Test: A CAT to Answer 21st Century Challenge. International Journal of Instruction, 12(4), 267–280. https://doi.org/10.29333/iji.2019.12417a

Istiyono, E., Dwandaru, W. S. B., Permatasari, A. K., & Aristiawan. (2020). Developing computer based test to assess students’ problem-solving in physics learning. Journal of Physics: Conference Series, 1440(1), 012060. https://doi.org/10.1088/1742-6596/1440/1/012060

Istiyono, E., Mardapi, D., & Suparno, S. (2014). Pengembangan Tes Kemampuan Berpikir Tingkat Tinggi Fisika (PysTHOTS) Peserta Didik SMA. Jurnal Penelitian Dan Evaluasi Pendidikan, 18(1), 1–12. https://doi.org/10.21831/pep.v18i1.2120

Johnson, D. W., Johnson, R. T., & Smith, K. A. (2014). Cooperative Learning: Improving University Instruction by Basing Practice on Validated Theory. Journal of Excellence in College Teaching, 25(4), 85–118. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/10180297

Kennedy, M., Fisher, M., & Ennis, R. (2013). Critical Thinking: Literature Review and Needed Research. In Educational Values and Cognitive Instruction: Implications for Reform (Vol. 2, pp. 11–40).

Linn, R. L., & Gronlund, N. E. (1995). Measurement and evaluation in teaching. Macmillan.

Lissitz, R. W., & Samuelsen, K. (2007a). A Suggested Change in Terminology and Emphasis Regarding Validity and Education. Educational Researcher, 36(8), 437–448. https://doi.org/10.3102/0013189x07311286

Lissitz, R. W., & Samuelsen, K. (2007b). Further Clarification Regarding Validity and Education. Educational Researcher, 36(8), 482–484. https://doi.org/10.3102/0013189x07311612

Mundilarto. (2002). Kapita Selekta Pendidikan Fisika. FMIPA UNY.

Nunnally, J. C. (1978). An Overview of Psychological Measurement. In Clinical Diagnosis of Mental Disorders (pp. 97–146). Springer US. https://doi.org/10.1007/978-1-4684-2490-4_4

Pada, A. U. T., Kartowagiran, B., & Subali, B. (2015). Content Validity of Creative Thinking Skills Assessment. Proceeding of International Conference On Research, Implementation And Education Of Mathematics And Sciences, May, 17–19. Retrieved from https://core.ac.uk/download/pdf/33519344.pdf

Pozo-Muñoz, C., Rebolloso-Pacheco, E., & Fernández-Ramírez, B. (2000). The “Ideal Teacher”. Implications for student evaluation of teacher effectiveness. Assessment & Evaluation in Higher Education, 25(3), 253–263. https://doi.org/10.1080/02602930050135121

Putri, F. S., Istiyono, E., & Nurcahyanto, E. (2016). Pengembangan Instrumen Tes Keterampilan Berpikir Kritis Dalam Bentuk Pilihan Ganda Beralasan (Politomus) Di DIY. Unnes Physics Education Journal, 5(2). https://doi.org/10.15294/upej.v5i2.13626

Retnawati, H. (2016). Proving content validity of self-regulated learning scale (The comparison of Aiken index and expanded Gregory index). REID (Research and Evaluation in Education), 2(2), 155–164. https://doi.org/10.21831/reid.v2i2.11029

Ritonga, S., Safrida, S., Huda, I., Supriatno, & Sarong, M. A. (2020). The effect of problem-based video animation instructions to improve students’ critical thinking skills. Journal of Physics: Conference Series, 1460(1), 012107. https://doi.org/10.1088/1742-6596/1460/1/012107

Saleh, S. E. (2019). Critical Thinking as a 21 St Century Skill: Conceptions, Implementation, and Challenges in the EFL Classroom. European Journal of Foreign Language Teaching, 4(1), 1–16. https://doi.org/10.46827/ejfl.v0i0.2209

Sandoval, A. M. R., Hancock, D., Poythress, N., Edens, J. F., & Lilienfeld, S. (2000). Construct validity of the psychopathic personality inventory in a correctional sample. Journal of Personality Assessment, 74(2), 262–281. https://doi.org/10.1207/S15327752JPA7402_7

Shaaban, K. A. (2014). Assessment of critical thinking skills through reading comprehension. International Journal of Language Studies, 8(2), 117–140. Retrieved from http://proxy.libraries.smu.edu/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=cms&AN=95416342&site=ehost-live&scope=site

Smith, G. T. (2005). On construct validity: Issues of method and measurement. Psychological Assessment, 17(4), 396–408. https://doi.org/10.1037/1040-3590.17.4.396

Stanley, G., MacCann, R., Gardner, J., Reynolds, L., & Wild, I. (2009). Review of teacher assessment: Evidence of what works best and issues for development (Issue March). STORRE: Stirling Online Research Repository. Retrieved from https://www.storre.stir.ac.uk/handle/1893/32425

Syaifuddin, M., Darmayanti, R., & Rizki, N. (2022). Development Of A Two-Tier Multiple-Choice (TTMC) Diagnostic Test For Geometry Materials To Identify Misconceptions Of Middle School Students. Jurnal Silogisme : Kajian Ilmu Matematika Dan Pembelajarannya, 7(2). https://doi.org/10.24269/silogisme.v7i2.5456

Winarti, Cari, Suparmi, Sunarno, W., & Istiyono, E. (2017). Development of two tier test to assess conceptual understanding in heat and temperature. Journal of Physics: Conference Series, 795(1), 12052. https://doi.org/10.1088/1742-6596/795/1/012052

Wright, G., Lawrence, M. J., & Collopy, F. (1996). The role and validity of judgment in forecasting. International Journal of Forecasting, 12(1), 1–8. https://doi.org/10.1016/0169-2070(96)00674-7

Yanto, B. E., Subali, B., & Suyanto, S. (2019). Improving Students’ Scientific Reasoning Skills through the Three Levels of Inquiry. International Journal of Instruction, 12(4), 689–704. https://doi.org/10.29333/iji.2019.12444a

Author Biographies

Irma Kharisma, Magister of Biology Education, Syiah Kuala University

Andi Ulfa Tenri Pada, Universitas Syiah Kuala, Banda Aceh

Supriatno, Universitas Syiah Kuala, Banda Aceh

Safrida, Universitas Syiah Kuala, Banda Aceh

Ismul Huda, Universitas Syiah Kuala, Banda Aceh

License

Copyright (c) 2024 Irma Kharisma, Andi Ulfa Tenri Pada, Supriatno, Safrida, Ismul Huda

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).