Content Validity of the Critical Thinking Skill Test Instrument on Computer Based Test (CBT) Ecology Lesson for High School Education



Irma Kharisma , Andi Ulfa Tenri Pada , Supriatno , Safrida , Ismul Huda






Vol. 10 No. 6 (2024): June


Aiken formula, Critical thinking skill test, Validity coefficient

Research Articles


How to Cite

Kharisma, I., Pada, A. U. T., Supriatno, Safrida, & Huda, I. (2024). Content Validity of the Critical Thinking Skill Test Instrument on Computer Based Test (CBT) Ecology Lesson for High School Education : English. Jurnal Penelitian Pendidikan IPA, 10(6), 3533–3540.


Download data is not yet available.


Metrics Loading ...


Research to measure students' Critical Thinking Skills has been widely carried out in Indonesia. However, the development of Critical Thinking Skill measuring tools in Ecology using CBT is still limited. This study is part of research and development to develop a good instrument product for measuring students' Critical Thinking Skills. The question preparation format uses a two tier multiple-choice form. This study aims to prove the content validity of the Critical Thinking Skill instrument in Ecology Subject for Senior High School. Scale using Likert model and multiple-choice model with content validity coefficient based on expert assessments with Aiken’s formula. There are three experts who assess the items' relevancy, construction, and clarity using indicators of both scale formats. The results of the expert assessments are then used to calculate the coefficient of the validity with Aiken formula. The results showed that the content validity coefficient based on expert assessment on Likert format with Aiken formula is at 0.75-1.00 for each, while using the Aiken formula.


Aiken, L. R. (1987). Formulas for Equating Ratings on Different Scales. Educational and Psychological Measurement, 47(1), 51–54.

Allen, M. J., & Yen, W. M. (2001). Introduction to measurement theory. Waveland Press.

Azwar, S. (2012). Reliabilitas dan validitas edisi 4. Pustaka Pelajar.

Cullinane, A., & Liston, M. (2011). Two-tier Multiple Choice Question: An Alternative Method of Formatif Assessment for First Year Undergraduate Biology Students. National Center for Excellence In Mathematics and Education Science Teaching and Learning (NCE-MSTL).

Elliot, D. L., & Kobayashi, S. (2019). How can PhD supervisors play a role in bridging academic cultures? Teaching in Higher Education, 24(8), 911–929.

Ennis, R. (2011). Critical Thinking. Inquiry: Critical Thinking Across the Disciplines, 26(2), 5–19.

Ennis, R. H. (n.d.). Critical thinking and subject specificity: Clarification and needed research. Educational Researcher, 18(3), 4–10.

Ennis, R. H. (1985). A logical basis for measuring critical thinking skills. In Educational Leadership (Vol. 43, Issue 2, pp. 44–48).

Ennis, R. H. (1993). Critical thinking assessment. Theory Into Practice, 32(3), 179–186.

Gillies, R. M., Nichols, K., Burgh, G., & Haynes, M. (2012). The effects of two strategic and meta-cognitive questioning approaches on children’s explanatory behaviour, problem-solving, and learning during cooperative, inquiry-based science. International Journal of Educational Research, 53, 93–106.

Hidayah, N., Yuliana, A. T., & Hanafi, H. (2020). Theoretical Validity of Problem Focused-Coping Skill Guideline to Develop Students’ Critical Thinking Skills. Jurnal Kajian Bimbingan Dan Konseling, 5(4), 183–191.

Istiyono, E. (2014). Pengukuran kemampuan berpikir tingkat tinggi fisika peserta didik SMA di DIY. Jurnal Sains Dan Teknologi, 5, 1. Retrieved from

Istiyono, E., Dwandaru, W. S. B., Lede, Y. A., Rahayu, F., & Nadapdap, A. (2019). Developing IRT-Based Physics Critical Thinking Skill Test: A CAT to Answer 21st Century Challenge. International Journal of Instruction, 12(4), 267–280.

Istiyono, E., Dwandaru, W. S. B., Permatasari, A. K., & Aristiawan. (2020). Developing computer based test to assess students’ problem-solving in physics learning. Journal of Physics: Conference Series, 1440(1), 012060.

Istiyono, E., Mardapi, D., & Suparno, S. (2014). Pengembangan Tes Kemampuan Berpikir Tingkat Tinggi Fisika (PysTHOTS) Peserta Didik SMA. Jurnal Penelitian Dan Evaluasi Pendidikan, 18(1), 1–12.

Johnson, D. W., Johnson, R. T., & Smith, K. A. (2014). Cooperative Learning: Improving University Instruction by Basing Practice on Validated Theory. Journal of Excellence in College Teaching, 25(4), 85–118. Retrieved from

Kennedy, M., Fisher, M., & Ennis, R. (2013). Critical Thinking: Literature Review and Needed Research. In Educational Values and Cognitive Instruction: Implications for Reform (Vol. 2, pp. 11–40).

Linn, R. L., & Gronlund, N. E. (1995). Measurement and evaluation in teaching. Macmillan.

Lissitz, R. W., & Samuelsen, K. (2007a). A Suggested Change in Terminology and Emphasis Regarding Validity and Education. Educational Researcher, 36(8), 437–448.

Lissitz, R. W., & Samuelsen, K. (2007b). Further Clarification Regarding Validity and Education. Educational Researcher, 36(8), 482–484.

Mundilarto. (2002). Kapita Selekta Pendidikan Fisika. FMIPA UNY.

Nunnally, J. C. (1978). An Overview of Psychological Measurement. In Clinical Diagnosis of Mental Disorders (pp. 97–146). Springer US.

Pada, A. U. T., Kartowagiran, B., & Subali, B. (2015). Content Validity of Creative Thinking Skills Assessment. Proceeding of International Conference On Research, Implementation And Education Of Mathematics And Sciences, May, 17–19. Retrieved from

Pozo-Muñoz, C., Rebolloso-Pacheco, E., & Fernández-Ramírez, B. (2000). The “Ideal Teacher”. Implications for student evaluation of teacher effectiveness. Assessment & Evaluation in Higher Education, 25(3), 253–263.

Putri, F. S., Istiyono, E., & Nurcahyanto, E. (2016). Pengembangan Instrumen Tes Keterampilan Berpikir Kritis Dalam Bentuk Pilihan Ganda Beralasan (Politomus) Di DIY. Unnes Physics Education Journal, 5(2).

Retnawati, H. (2016). Proving content validity of self-regulated learning scale (The comparison of Aiken index and expanded Gregory index). REID (Research and Evaluation in Education), 2(2), 155–164.

Ritonga, S., Safrida, S., Huda, I., Supriatno, & Sarong, M. A. (2020). The effect of problem-based video animation instructions to improve students’ critical thinking skills. Journal of Physics: Conference Series, 1460(1), 012107.

Saleh, S. E. (2019). Critical Thinking as a 21 St Century Skill: Conceptions, Implementation, and Challenges in the EFL Classroom. European Journal of Foreign Language Teaching, 4(1), 1–16.

Sandoval, A. M. R., Hancock, D., Poythress, N., Edens, J. F., & Lilienfeld, S. (2000). Construct validity of the psychopathic personality inventory in a correctional sample. Journal of Personality Assessment, 74(2), 262–281.

Shaaban, K. A. (2014). Assessment of critical thinking skills through reading comprehension. International Journal of Language Studies, 8(2), 117–140. Retrieved from

Smith, G. T. (2005). On construct validity: Issues of method and measurement. Psychological Assessment, 17(4), 396–408.

Stanley, G., MacCann, R., Gardner, J., Reynolds, L., & Wild, I. (2009). Review of teacher assessment: Evidence of what works best and issues for development (Issue March). STORRE: Stirling Online Research Repository. Retrieved from

Syaifuddin, M., Darmayanti, R., & Rizki, N. (2022). Development Of A Two-Tier Multiple-Choice (TTMC) Diagnostic Test For Geometry Materials To Identify Misconceptions Of Middle School Students. Jurnal Silogisme : Kajian Ilmu Matematika Dan Pembelajarannya, 7(2).

Winarti, Cari, Suparmi, Sunarno, W., & Istiyono, E. (2017). Development of two tier test to assess conceptual understanding in heat and temperature. Journal of Physics: Conference Series, 795(1), 12052.

Wright, G., Lawrence, M. J., & Collopy, F. (1996). The role and validity of judgment in forecasting. International Journal of Forecasting, 12(1), 1–8.

Yanto, B. E., Subali, B., & Suyanto, S. (2019). Improving Students’ Scientific Reasoning Skills through the Three Levels of Inquiry. International Journal of Instruction, 12(4), 689–704.

Author Biographies

Irma Kharisma, Magister of Biology Education, Syiah Kuala University

Andi Ulfa Tenri Pada, Universitas Syiah Kuala, Banda Aceh

Supriatno, Universitas Syiah Kuala, Banda Aceh

Safrida, Universitas Syiah Kuala, Banda Aceh

Ismul Huda, Universitas Syiah Kuala, Banda Aceh


Copyright (c) 2024 Irma Kharisma, Andi Ulfa Tenri Pada, Supriatno, Safrida, Ismul Huda

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with Jurnal Penelitian Pendidikan IPA, agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC-BY License). This license allows authors to use all articles, data sets, graphics, and appendices in data mining applications, search engines, web sites, blogs, and other platforms by providing an appropriate reference. The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in Jurnal Penelitian Pendidikan IPA.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).