Analysis of HOTS Instrument for Prospective Physics Teacher Using Generalized Partial Credit Model

Abstract

This study aims to analyze item parameters' characteristics and estimate prospective physics teachers' ability on the Higher Order Thinking Skills (HOTS) Instrument using the Generalized Partial Credit Model (GPCM). The research subjects were 251 prospective physics teacher students in two universities concerned with producing prospective teacher graduates. Two-Tier Multiple Choice (TTMC) forms with a polytomous score of four categories make up the test instrument. Data analysis includes two stages: testing assumptions and the suitability of the Politomus IRT model. The results showed that the most suitable polytomous scoring IRT model was GPCM2PL. The item parameter analysis for the HOTS Instrument test shows the discriminating power parameter (a) value for all items included in the good category, namely the interval 0.00 to 2.00. The difficulty level analysis (b) also shows the percentage of 100% of items included in the medium category because the b value of all items is in the interval (-2) to (2).

Downloads

Download data is not yet available.

Author Biographies

Edi Istiyono, Universitas Negeri Yogyakarta

Graduate School, Educational Research and Evaluation program

H Haryanto, Universitas Negeri Yogyakarta

Graduate School, Educational Research and Evaluation program

References

Ab Kadir, M. A. (2017). What Teacher Knowledge Matters in Effectively Developing Critical Thinkers in the 21 st Century Curriculum? Thinking Skills and Creativity, 23, 79–90. https://doi.org/10.1016/j.tsc.2016.10.011
Adeyemo, S. a. (2010). Students’ Ability Level and Their Competence in Problem-Solving Task in Physics. International Journal of Educational Research and Technology, 1(December), 35–47. http://www.soeagra.com/ijert/vol2/7.pdf
Ahrari, S., Samah, B. A., Hassan, M. S. H. Bin, Wahat, N. W. A., & Zaremohzzabieh, Z. (2016). Deepening critical thinking skills through civic engagement in Malaysian higher education. Thinking Skills and Creativity, 22, 121–128. https://doi.org/10.1016/j.tsc.2016.09.009
Anderson, L. W., & Krathwohl, D. R. (2001). A Taxonomy of learning, teaching, and assessing: a evisrion of Bloom’s Taxonomy of educational objectives. Longman.
Asysyifa, D. S., . J., Wilujeng, I., & Kuswanto, H. (2019). Analysis of Students Critical Thinking Skills Using Partial Credit Models (PCM) in Physics Learning. International Journal of Educational Research Review, 4(2), 245–253. https://doi.org/10.24331/ijere.518068
Bano, V. O., Marambaawang, D. N., & Njoeroemana, Y. (2022). Analisis Kriteria Butir Soal Ujian Sekolah Mata Pelajaran IPA di SMP Negeri 1 Waingapu. Ideas: Jurnal Pendidikan, Sosial, Dan Budaya, 8(1), 145. https://doi.org/10.32884/ideas.v8i1.660
Behar-Horenstein, L. S., & Niu, L. (2011). Teaching Critical Thinking Skills In Higher Education: A Review Of The Literature. Journal of College Teaching & Learning (TLC), 8(2). https://doi.org/10.19030/tlc.v8i2.3554
Bloom, B. S. (1972). Taxonomy of Educational Objectives: The Classification of Educational Goals, Parts 1-2. In Handbook I: Cognitive Domain. Ann.
Brookhart, S. M. (2010). How to Assess Higher-Order Thinking Skills in Your Classroom advances. In Journal of Education (Vol. 1, Issue 18). ASCD. www.ascd.org/memberbooks
Conklin, W. (2012). Higher-Order Thinking Skills to Develop 21st Century Learners. In Shell Education. Shell Educational Publishing, Inc.
Cotton, K. (1997). Developing employability skills. In School Improvement Research Series (Issue 1987). http://www.nwrel.org/scpd/sirs/8/0015.html
Cullinane, A., & Liston, M. (2011). Two-tier Multiple Choice Question: An Alternative Method of Formatif Assessment for First Year Undergraduate Biology Students. National Center for Excellence In Mathematics and Education Science Teaching and Learning (NCE-MSTL.
Dwyer, C. P., Hogan, M. J., & Stewart, I. (2014). An integrated critical thinking framework for the 21st century. In Thinking Skills and Creativity (Vol. 12, pp. 43–52). https://doi.org/10.1016/j.tsc.2013.12.004
Guo, J., & Woulfin, S. (2016). Twenty-First Century Creativity: An Investigation of How the Partnership for 21st Century Instructional Framework Reflects the Principles of Creativity. Roeper Review, 38(3), 153–161. https://doi.org/10.1080/02783193.2016.1183741
Hadi, S., Retnawati, H., Munadi, S., Apino, E., & Wulandari, N. F. (2018). The difficulties of high school students in solving higher-order thinking skills problems. Problems of Education in the 21st Century, 76(4), 520.
Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2009). Analise multivariada de dados. In Bookman. Bookman Editora.
Hambleton, R. K., Shavelson, R. J., Webb, N. M., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory (Vol. 2). Sage.
Hasan, M., Maulidyanti, H., Tahir, M. I. T., & Arisah, N. (2022). Analisis Keterampilan Berpikir Kritis Peserta Didik Melalui Kegiatan Literasi. Ideas : Jurnal Pendidikan, Sosial,Dan Budaya, 8(2), 477–486.
Hasudungan, A. N., & Kurniawan, Y. (2018). Meningkatkan Kesadaran Generasi Emas Indonesia Dalam Menghadapi Era Revolusi Industri 4.0 Melalui Inovasi Digital Platform www.indonesia2045.org. Prosiding Seminar Nasional Multidisiplin, 1, 51–58. https://ejournal.unwaha.ac.id/index.php/snami/article/view/263
Hestenes, D., Wells, M., & Swackhamer, G. (1992). Force concept inventory. The Physics Teacher, 30(3), 141–158. https://doi.org/10.1119/1.2343497
Hidayati, K., & Retnawati, H. (2011). Identifying Item Bias Of Test Using The Probability Difference Indices On Polytomous Data Using Generalized Partial Credit Model.
Istiyono, E. (2017). The analysis of senior high school students’ physics HOTS in Bantul District measured using PhysReMChoTHOTS. AIP Conference Proceedings, 1868(1), 70008. https://doi.org/10.1063/1.4995184
Istiyono, E. (2019). Pengembangan Tes Kemampuan Berpikir Tingkat Tinggi Fisika SMA. Jurnal Inovasi Dan Pembelajaran Fisika, 6(1), 70–81. https://doi.org/10.36706/jipf.v6i1.7817
Istiyono, E., Dwandaru, W. S. B., Setiawan, R., & Megawati, I. (2020). Developing of computerized adaptive testing to measure physics higher order thinking skills of senior high school students and its feasibility of use. European Journal of Educational Research, 9(1), 91–101. https://doi.org/10.12973/eu-jer.9.1.91
Istiyono, E., Mardapi, D., & Suparno, S. (2014). Pengembangan tes kemampuan berpikir tingkat tinggi fisika (pysthots) peserta didik SMA. Jurnal Penelitian Dan Evaluasi Pendidikan, 18(1), 1–12.
King, F. J., Goodson, L., & Rohani, F. (2010). Higher order thinking skills: Definition, Teaching Strategies, Assessment. http://goo.gl/su233T.
Kizlik, B. (2012). Measurement , Assessment , and Evaluation in Education. In FGS, UiTM (pp. 1–43). http://drjj.uitm.edu.my
Krulik, S., & Rudnick, J. A. (1999). Innovative tasks to improve critical and creative thinking skills. In D. L. V Stiff & F. R. Curcio (Eds.), Developing Mathematical Reasong in Grades K-12 (pp. 138–145). NCTM.
Liu, O. L., Lee, H. S., & Linn, M. C. (2011). An investigation of explanation multiple-choice items in science assessment. Educational Assessment, 16(3), 164–184. https://doi.org/10.1080/10627197.2011.611702
Liu, S., Yang, X., Zhang, H., Wang, Y., Yoneda, T., & Li, Z. (2018). Study on teaching methods for developing higher order thinking skills for college students in flipping classroom. Proceedings - 6th International Conference of Educational Innovation Through Technology, EITT 2017, 2018-March, 254–257. https://doi.org/10.1109/EITT.2017.69
Marlina, L., Liliasari, Tjasyono, B., & Hendayana, S. (2018). Improving the critical thinking skills of junior high school students on Earth and Space Science (ESS) materials. Journal of Physics: Conference Series, 1013(1), 12063. https://doi.org/10.1088/1742-6596/1013/1/012063
Nichols, P., & Sugrue, B. (1999). The Lack of Fidelity Between Cognitively Complex Constructs and Conventional Test Development Practice. Educational Measurement: Issues and Practice, 18(2), 18–29. https://doi.org/10.1111/j.1745-3992.1999.tb00011.x
Prakash, R., & Litoriya, R. (2022). Pedagogical Transformation of Bloom Taxonomy’s LOTs into HOTs: An Investigation in Context with IT Education. Wireless Personal Communications, 122(1), 725–736.
Presseisen, B. Z. (1988). Thinking skills: Meanings and models. In D. A. L. Costa (Ed.), Developing minds: A resource book for teaching thinking (pp. 43–48). ASCD.
Ramos, J. L. S., Dolipas, B. B., & Villamor, B. B. (2013). Higher order thinking skills and academic performance in physics of college students: A regression analysis. International Journal of Innovative Interdisciplinary Research, 4(48–60).
Republik Indonesia. (2012). Peraturan presiden RI (perpres) No. 8 Tahun 2012 Tentang Kerangka Kualifikasi Nasional Indonesia. Indonesia.
Retnawati, H. (2011). Mengestimasi kemampuan peserta tes uraian matematika Dengan pendekatan teori respons butir Dengan penskoran politomus Dengan Generalized partial credit model. In Prosiding Semnas Penelitian Pendidikan dan Penerapan MIPA. UNY (pp. 53–62).
Retnawati, H. (2014). Teori respons butir dan penerapannya: Untuk peneliti, praktisi pengukuran dan pengujian, mahasiswa pascasarjana. In Yogyakarta: Nuha Medika. Parama. Retnawati, H.
Retnawati, H. (2016). Analisis Kuantitatif Instrumen Penelitian (Panduan Peneliti, Mahasiswa, dan Psikometrian). In Parama Publishing. Parama Publishing.
Retnawati, H., Hadi, S., Nugraha, A. C., Arlinwibowo, J., Sulistyaningsih, E., Djidu, H., Apino, E., & Iryanti, H. D. (2017). Implementing the computer-based national examination in Indonesian schools: The challenges and strategies. Problems of Education in the 21st Century, 75(6), 612–633. https://doi.org/10.33225/pec/17.75.612
Robinson, J. P. (2000). A Fact Sheet: What Are Employability Skills? In Alabama Cooperative Extension System (Vol. 1, Issue 3). http://proquest.umi.com/pqdweb.
Rosmiati, R., & Satriawan, M. (2019). The ocean climate phenomenon: The challenges of earth physics lectures in Indonesia. Journal of Physics: Conference Series, 1157(3), 32038. https://doi.org/10.1088/1742-6596/1157/3/032038
Salkind, N. (2013). Item Response Theory. In Encyclopedia of Measurement and Statistics. Oxford University Press. https://doi.org/10.4135/9781412952644.n230
Saprudin, S., Liliasari, S., Prihatmanto, A. S., & Setiawan, A. (2019). Pre-service physics teachers’ thinking styles and its relationship with critical thinking skills on learning interference and diffraction. Journal of Physics: Conference Series, 1157(3), 32029. https://doi.org/10.1088/1742-6596/1157/3/032029
Satriawan, M., Liliasari, W., & Abdullah, A. G. (2020). Analysing of pre-service physics teachers critical thinking skills profile in ocean wave energy topic. Journal of Physics: Conference Series, 1521, 22041.
Si, C.-F., & Schumacker, R. E. (2004). Ability Estimation Under Different Item Parameterization and Scoring Models. International Journal of Testing, 4(2), 137–181. https://doi.org/10.1207/s15327574ijt0402_3
Songer, N. B., Kelcey, B., & Gotwals, A. W. (2009). How and when does complex reasoning occur? Empirically driven development of a learning progression focused on complex reasoning about biodiversity. Journal of Research in Science Teaching, 46(6), 610–631. https://doi.org/10.1002/tea.20313
Stone, C. A., & Zhang, B. (2003). Assessing Goodness of Fit of Item Response Theory Models: A Comparison of Traditional and Alternative Procedures. Journal of Educational Measurement, 40(4), 331–352. https://doi.org/10.1111/j.1745-3984.2003.tb01150.x
Wells, C. S., & Purwono, U. (2009). Assesing the fit of IRT models to item response data. Makalah Pelatihan Psikometri Kerjasama Pascasarjana UNY dengan USAID.
Xiao, Y., Han, J., Koenig, K., Xiong, J., & Bao, L. (2018). Multilevel Rasch modeling of two-Tier multiple choice test: A case study using Lawson’s classroom test of scientific reasoning. Physical Review Physics Education Research, 14(2), 20104. https://doi.org/10.1103/PhysRevPhysEducRes.14.020104
Published
2022-11-14
How to Cite
SAEPUZAMAN, Duden; ISTIYONO, Edi; HARYANTO, H. Analysis of HOTS Instrument for Prospective Physics Teacher Using Generalized Partial Credit Model. Ideas: Jurnal Pendidikan, Sosial, dan Budaya, [S.l.], v. 8, n. 4, p. 1341-1350, nov. 2022. ISSN 2656-940X. Available at: <https://jurnal.ideaspublishing.co.id/index.php/ideas/article/view/976>. Date accessed: 03 dec. 2022. doi: https://doi.org/10.32884/ideas.v8i4.976.