Analysis of HOTS Instrument for Prospective Physics Teacher Using Generalized Partial Credit Model


This study aims to analyze item parameters' characteristics and estimate prospective physics teachers' ability on the Higher Order Thinking Skills (HOTS) Instrument using the Generalized Partial Credit Model (GPCM). The research subjects were 251 prospective physics teacher students in two universities concerned with producing prospective teacher graduates. Two-Tier Multiple Choice (TTMC) forms with a polytomous score of four categories make up the test instrument. Data analysis includes two stages: testing assumptions and the suitability of the Politomus IRT model. The results showed that the most suitable polytomous scoring IRT model was GPCM2PL. The item parameter analysis for the HOTS Instrument test shows the discriminating power parameter (a) value for all items included in the good category, namely the interval 0.00 to 2.00. The difficulty level analysis (b) also shows the percentage of 100% of items included in the medium category because the b value of all items is in the interval (-2) to (2).


Download data is not yet available.

Author Biographies

Edi Istiyono, Universitas Negeri Yogyakarta

Graduate School, Educational Research and Evaluation program

H Haryanto, Universitas Negeri Yogyakarta

Graduate School, Educational Research and Evaluation program


Ab Kadir, M. A. (2017). What Teacher Knowledge Matters in Effectively Developing Critical Thinkers in the 21 st Century Curriculum? Thinking Skills and Creativity, 23, 79–90.
Adeyemo, S. a. (2010). Students’ Ability Level and Their Competence in Problem-Solving Task in Physics. International Journal of Educational Research and Technology, 1(December), 35–47.
Ahrari, S., Samah, B. A., Hassan, M. S. H. Bin, Wahat, N. W. A., & Zaremohzzabieh, Z. (2016). Deepening critical thinking skills through civic engagement in Malaysian higher education. Thinking Skills and Creativity, 22, 121–128.
Anderson, L. W., & Krathwohl, D. R. (2001). A Taxonomy of learning, teaching, and assessing: a evisrion of Bloom’s Taxonomy of educational objectives. Longman.
Asysyifa, D. S., . J., Wilujeng, I., & Kuswanto, H. (2019). Analysis of Students Critical Thinking Skills Using Partial Credit Models (PCM) in Physics Learning. International Journal of Educational Research Review, 4(2), 245–253.
Bano, V. O., Marambaawang, D. N., & Njoeroemana, Y. (2022). Analisis Kriteria Butir Soal Ujian Sekolah Mata Pelajaran IPA di SMP Negeri 1 Waingapu. Ideas: Jurnal Pendidikan, Sosial, Dan Budaya, 8(1), 145.
Behar-Horenstein, L. S., & Niu, L. (2011). Teaching Critical Thinking Skills In Higher Education: A Review Of The Literature. Journal of College Teaching & Learning (TLC), 8(2).
Bloom, B. S. (1972). Taxonomy of Educational Objectives: The Classification of Educational Goals, Parts 1-2. In Handbook I: Cognitive Domain. Ann.
Brookhart, S. M. (2010). How to Assess Higher-Order Thinking Skills in Your Classroom advances. In Journal of Education (Vol. 1, Issue 18). ASCD.
Conklin, W. (2012). Higher-Order Thinking Skills to Develop 21st Century Learners. In Shell Education. Shell Educational Publishing, Inc.
Cotton, K. (1997). Developing employability skills. In School Improvement Research Series (Issue 1987).
Cullinane, A., & Liston, M. (2011). Two-tier Multiple Choice Question: An Alternative Method of Formatif Assessment for First Year Undergraduate Biology Students. National Center for Excellence In Mathematics and Education Science Teaching and Learning (NCE-MSTL.
Dwyer, C. P., Hogan, M. J., & Stewart, I. (2014). An integrated critical thinking framework for the 21st century. In Thinking Skills and Creativity (Vol. 12, pp. 43–52).
Guo, J., & Woulfin, S. (2016). Twenty-First Century Creativity: An Investigation of How the Partnership for 21st Century Instructional Framework Reflects the Principles of Creativity. Roeper Review, 38(3), 153–161.
Hadi, S., Retnawati, H., Munadi, S., Apino, E., & Wulandari, N. F. (2018). The difficulties of high school students in solving higher-order thinking skills problems. Problems of Education in the 21st Century, 76(4), 520.
Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2009). Analise multivariada de dados. In Bookman. Bookman Editora.
Hambleton, R. K., Shavelson, R. J., Webb, N. M., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory (Vol. 2). Sage.
Hasan, M., Maulidyanti, H., Tahir, M. I. T., & Arisah, N. (2022). Analisis Keterampilan Berpikir Kritis Peserta Didik Melalui Kegiatan Literasi. Ideas : Jurnal Pendidikan, Sosial,Dan Budaya, 8(2), 477–486.
Hasudungan, A. N., & Kurniawan, Y. (2018). Meningkatkan Kesadaran Generasi Emas Indonesia Dalam Menghadapi Era Revolusi Industri 4.0 Melalui Inovasi Digital Platform Prosiding Seminar Nasional Multidisiplin, 1, 51–58.
Hestenes, D., Wells, M., & Swackhamer, G. (1992). Force concept inventory. The Physics Teacher, 30(3), 141–158.
Hidayati, K., & Retnawati, H. (2011). Identifying Item Bias Of Test Using The Probability Difference Indices On Polytomous Data Using Generalized Partial Credit Model.
Istiyono, E. (2017). The analysis of senior high school students’ physics HOTS in Bantul District measured using PhysReMChoTHOTS. AIP Conference Proceedings, 1868(1), 70008.
Istiyono, E. (2019). Pengembangan Tes Kemampuan Berpikir Tingkat Tinggi Fisika SMA. Jurnal Inovasi Dan Pembelajaran Fisika, 6(1), 70–81.
Istiyono, E., Dwandaru, W. S. B., Setiawan, R., & Megawati, I. (2020). Developing of computerized adaptive testing to measure physics higher order thinking skills of senior high school students and its feasibility of use. European Journal of Educational Research, 9(1), 91–101.
Istiyono, E., Mardapi, D., & Suparno, S. (2014). Pengembangan tes kemampuan berpikir tingkat tinggi fisika (pysthots) peserta didik SMA. Jurnal Penelitian Dan Evaluasi Pendidikan, 18(1), 1–12.
King, F. J., Goodson, L., & Rohani, F. (2010). Higher order thinking skills: Definition, Teaching Strategies, Assessment.
Kizlik, B. (2012). Measurement , Assessment , and Evaluation in Education. In FGS, UiTM (pp. 1–43).
Krulik, S., & Rudnick, J. A. (1999). Innovative tasks to improve critical and creative thinking skills. In D. L. V Stiff & F. R. Curcio (Eds.), Developing Mathematical Reasong in Grades K-12 (pp. 138–145). NCTM.
Liu, O. L., Lee, H. S., & Linn, M. C. (2011). An investigation of explanation multiple-choice items in science assessment. Educational Assessment, 16(3), 164–184.
Liu, S., Yang, X., Zhang, H., Wang, Y., Yoneda, T., & Li, Z. (2018). Study on teaching methods for developing higher order thinking skills for college students in flipping classroom. Proceedings - 6th International Conference of Educational Innovation Through Technology, EITT 2017, 2018-March, 254–257.
Marlina, L., Liliasari, Tjasyono, B., & Hendayana, S. (2018). Improving the critical thinking skills of junior high school students on Earth and Space Science (ESS) materials. Journal of Physics: Conference Series, 1013(1), 12063.
Nichols, P., & Sugrue, B. (1999). The Lack of Fidelity Between Cognitively Complex Constructs and Conventional Test Development Practice. Educational Measurement: Issues and Practice, 18(2), 18–29.
Prakash, R., & Litoriya, R. (2022). Pedagogical Transformation of Bloom Taxonomy’s LOTs into HOTs: An Investigation in Context with IT Education. Wireless Personal Communications, 122(1), 725–736.
Presseisen, B. Z. (1988). Thinking skills: Meanings and models. In D. A. L. Costa (Ed.), Developing minds: A resource book for teaching thinking (pp. 43–48). ASCD.
Ramos, J. L. S., Dolipas, B. B., & Villamor, B. B. (2013). Higher order thinking skills and academic performance in physics of college students: A regression analysis. International Journal of Innovative Interdisciplinary Research, 4(48–60).
Republik Indonesia. (2012). Peraturan presiden RI (perpres) No. 8 Tahun 2012 Tentang Kerangka Kualifikasi Nasional Indonesia. Indonesia.
Retnawati, H. (2011). Mengestimasi kemampuan peserta tes uraian matematika Dengan pendekatan teori respons butir Dengan penskoran politomus Dengan Generalized partial credit model. In Prosiding Semnas Penelitian Pendidikan dan Penerapan MIPA. UNY (pp. 53–62).
Retnawati, H. (2014). Teori respons butir dan penerapannya: Untuk peneliti, praktisi pengukuran dan pengujian, mahasiswa pascasarjana. In Yogyakarta: Nuha Medika. Parama. Retnawati, H.
Retnawati, H. (2016). Analisis Kuantitatif Instrumen Penelitian (Panduan Peneliti, Mahasiswa, dan Psikometrian). In Parama Publishing. Parama Publishing.
Retnawati, H., Hadi, S., Nugraha, A. C., Arlinwibowo, J., Sulistyaningsih, E., Djidu, H., Apino, E., & Iryanti, H. D. (2017). Implementing the computer-based national examination in Indonesian schools: The challenges and strategies. Problems of Education in the 21st Century, 75(6), 612–633.
Robinson, J. P. (2000). A Fact Sheet: What Are Employability Skills? In Alabama Cooperative Extension System (Vol. 1, Issue 3).
Rosmiati, R., & Satriawan, M. (2019). The ocean climate phenomenon: The challenges of earth physics lectures in Indonesia. Journal of Physics: Conference Series, 1157(3), 32038.
Salkind, N. (2013). Item Response Theory. In Encyclopedia of Measurement and Statistics. Oxford University Press.
Saprudin, S., Liliasari, S., Prihatmanto, A. S., & Setiawan, A. (2019). Pre-service physics teachers’ thinking styles and its relationship with critical thinking skills on learning interference and diffraction. Journal of Physics: Conference Series, 1157(3), 32029.
Satriawan, M., Liliasari, W., & Abdullah, A. G. (2020). Analysing of pre-service physics teachers critical thinking skills profile in ocean wave energy topic. Journal of Physics: Conference Series, 1521, 22041.
Si, C.-F., & Schumacker, R. E. (2004). Ability Estimation Under Different Item Parameterization and Scoring Models. International Journal of Testing, 4(2), 137–181.
Songer, N. B., Kelcey, B., & Gotwals, A. W. (2009). How and when does complex reasoning occur? Empirically driven development of a learning progression focused on complex reasoning about biodiversity. Journal of Research in Science Teaching, 46(6), 610–631.
Stone, C. A., & Zhang, B. (2003). Assessing Goodness of Fit of Item Response Theory Models: A Comparison of Traditional and Alternative Procedures. Journal of Educational Measurement, 40(4), 331–352.
Wells, C. S., & Purwono, U. (2009). Assesing the fit of IRT models to item response data. Makalah Pelatihan Psikometri Kerjasama Pascasarjana UNY dengan USAID.
Xiao, Y., Han, J., Koenig, K., Xiong, J., & Bao, L. (2018). Multilevel Rasch modeling of two-Tier multiple choice test: A case study using Lawson’s classroom test of scientific reasoning. Physical Review Physics Education Research, 14(2), 20104.
How to Cite
SAEPUZAMAN, Duden; ISTIYONO, Edi; HARYANTO, H. Analysis of HOTS Instrument for Prospective Physics Teacher Using Generalized Partial Credit Model. Ideas: Jurnal Pendidikan, Sosial, dan Budaya, [S.l.], v. 8, n. 4, p. 1341-1350, nov. 2022. ISSN 2656-940X. Available at: <>. Date accessed: 03 dec. 2022. doi: