Developing Real Picture Analysis (RPA) - Based Assessment Instruments to Measure Students’ Higher-Order Thinking Skills
DOI:
https://doi.org/10.51276/edu.v6i3.1524Keywords:
4-D Model , Assessment Instrument , HOTS , Real Picture Analysis , Validity and ReliabilityAbstract
The purpose of this study is to describe the validity, reliability, discriminating power, and difficulty level of an RPA-based assessment instrument designed to measure students' higher-order thinking skills. Using the 4-D model: Define, Design, Development, and Disseminate the instrument, consisting of 30 questions, was tested on 240 Grade VIII students in several Junior High Schools in Jember during the odd semester of the 2024/2025 academic year. From the 25 essay questions tested, an average score of 81% was achieved, with all questions meeting high validity criteria, indicating that the instrument measured the intended constructs accurately. The instrument demonstrated high reliability, with a coefficient of 0.86, ensuring consistent and dependable results. Its discriminating power was strong, with 20 questions rated as very good and 5 as good in distinguishing student abilities, ensuring meaningful differences in performance. The distribution of question difficulty levels, namely 9 easy, 11 medium, and 5 hard provided a balanced challenge to assess a comprehensive range of student abilities. This study contributes to authentic assessment design by integrating real-world images to foster higher-order thinking skills and can serve as a benchmark for further research or application.
Downloads
References
Aisyah, O. N., & Sudarti. (2021). Analisis Kemampuan Multirepresentasi Verbal dan Gambar pada Mahasiswa Pendidikan Fisika dalam Memahami Konsep Reaksi Inti Matahari. Silampari Jurnal Pendidikan Ilmu Fisika, 3(1), 29–38. https://doi.org/10.31540/sjpif.v3i1.1136
Amelia, N., & Erita, S. (2024). Eksplorasi Validitas dan Reliabilitas Soal Pemahaman Konsep dalam Asesmen Pembelajaran. Jurnal Bima, 2(1), 222–232.
Amir, F., M, M., & Nur, A. A. S. (2024). Pengembangan Instrumen Tes Higher Order Thinking Skills (HOTS) Peserta Didik pada Mata Pelajaran Fisika. Jurnal Fisika dan Pembelajarannya (Phydagogic), 6(2). https://doi.org/10.31605/phy.v6i2.3653
Astrid, A., Hasanah, A., & Syafryadin. (2022). Integrating Higher Order Thinking Skills (HOTS) Into English Language Teaching for Elementary School Students: Teachers’ Perspectives and Challenges. 3L: Language, Linguistics, Literature, 28(3), 217–230. https://doi.org/10.17576/3L-2022-2803-14
Budiarso, A. S., Sutarto, & Rohmatillah, S. (2020). Analisis Kemampuan Siswa dalam Menjelaskan Fenomena IPA di Sekitar Lingkungan. Webinar Pendidikan Fisika 2020, 5(1), 27–32.
Desiriah, E., & Setyarsih, W. (2021). Tinjauan Literatur Pengembangan Instrumen Penilaian Kemampuan Berpikir Tingkat Tinggi (HOTS) Fisika di SMA. ORBITA: Jurnal Kajian, Inovasi dan Aplikasi Pendidikan Fisika, 7(1), 79. https://doi.org/10.31764/orbita.v7i1.4436
Hanif, M. (2020). The Development and Effectiveness of Motion Graphic Animation Videos to Improve Primary School Students' Sciences Learning Outcomes. International Journal of Instruction, 13(3), 247-266.
Hidayati, A. R., Fadly, W., & Ekapti, R. F. (2021). Analisis Keterampilan Berpikir Kritis Siswa pada Pembelajaran IPA Materi Bioteknologi. Jurnal Tadris IPA Indonesia, 1(1), 34–48. https://doi.org/10.21154/jtii.v1i1.68
Julianingsih, S., Rosidin, U., & Ismu Wahyudi. (2013). Pengembangan Instrumen Asesmen HOTS untuk Mengukur Dimensi Pengetahuan Ipa Siswa di SMP. Jurnal Pembelajaran Fisika, 1, 59–68.
Kokkonen, T., Lichtenberger, A., & Schalk, L. (2022). Concreteness Fading in Learning Secondary School Physics Concepts. Learning and Instruction, 77. https://doi.org/10.1016/j.learninstruc.2021.101524
Lamanepa, G. H., Maing, C. M., Mukin, M. U. J., & Naen, A. B. (2022). The Role of Visual Representation for High School Physics in Teaching of Classical Mechanics. Jurnal Penelitian & Pengembangan Pendidikan Fisika, 8(1), 105–114. https://doi.org/10.21009/1.08110
Limbach, B., & Waugh, W. (2022). Developing High-Level Thinking. Journal of Instructional Pedagogies, 125–143. https://doi.org/10.1142/9789811252617_0009
Idris, S., Muliani, M., Novita, N., Sakdiah, H., Ginting, F. W., Mellyzar, M., & Fatwa, I. (2023). Aksi Bersih Pantai dan Edukasi Peduli Lingkungan di Pantai Wisata Gampoeng Geulumpang Sulu Timue. JALIYE: Jurnal Abdimas, Loyalitas, Dan Edukasi, 2(1), 5-12.
Mayarita, L. R., Dafik, D., & Prastati, T. (2023). The Development of Environment-Based Visual Media to Enhance Learning Outcomes and Student Motivation in Science Course. International Journal of Current Science Research and Review, 06(07), 4420–4428. https://doi.org/10.47191/ijcsrr/v6-i7-56
Meryastiti, V., Rasyid Ridlo, Z., & Supeno. (2022). Identifikasi Kemampuan Berpikir Kritis pada Pembelajaran IPS Siswa SMP Negeri 1 Glenmore Kabupaten Banyuwangi. Saintifika, 24(1), 20–29.
Murwantini, S. (2022). Implementasi Keterampilan Berpikir Tingkat Tinggi (HOTS) dalam Pembelajaran. BALANGA: Jurnal Pendidikan Teknologi dan Kejuruan, 10(2), 49–54. https://doi.org/10.37304/balanga.v10i2.8090
Nacaroglu, O., Kizkapan, O., & Demir, H. (2025). Middle School Students’ Motivations and Learning Competencies in Science: Mediating Role of Digital Literacy. Psychology in the Schools, 62(5), 1475–1487.
Nikat, R. F., Loupatty, M., & Zahroh, S. H. (2021). Kajian Pendekatan Multirepresentasi dalam Konteks Pembelajaran Fisika. Jurnal Pendidikan dan Ilmu Fisika, 1(2), 45. https://doi.org/10.52434/jpif.v1i2.1449
Oktaviana, J., Sutarto, S., & Mahardika, I. K. (2014). Paket Bahan Ajar dengan Analisis Kejadian Riil dalam Foto dan Wacana Isu dalam Pembelajaran Fisika di SMA (Kajian Pada: Konsep Fluida Statis). Jurnal Pembelajaran Fisika, 3(3), 230-234.
Okyranida, I. Y., Mayanty, S., & Widiyatun, F. (2024). Analisis Butir Soal Kemampuan Berpikir Kritis Siswa SMAIT Nururrohmah Depok. Jurnal Penelitian Pembelajaran Fisika, 15(1), 73–79. https://doi.org/10.26877/jp2f.v15i1.17057
Pramesti, N. K. A., & Riastini, P. N. (2023). Professional Status: Teachers’ Difficulties in Compiling Questions Based on Higher Order Thinking Skills. International Journal of Elementary Education, 7(3), 516–523. https://doi.org/10.23887/ijee.v7i3.61625
Pursitasari, I. D., Permanasari, A., & Jaenudin, D. (2022). Pelatihan Penyusunan E-Asesmen Literasi Sains Berbasis AKM Bagi Guru IPA SMP di Kabupaten Bogor. Jurnal Pemberdayaan Masyarakat, 1(1), 26–33. https://doi.org/10.46843/jmp.v1i1.265
Putri, A. N. L., Sutarto, S., Wahyuni, D., Indrawati, I., & Wicaksono, I. (2023). Real Picture Analysis Modules: Empowering Critical Thinking in Science Education. Advances and Challenges in Science and Technology, 5, 68–83. https://doi.org/10.9734/bpi/acst/v5/6128e
Rizaldi, D. R., & Fatimah, Z. (2024). Analysis of Various Contexts of Difficulties Experienced by Students in Learning Physics. Physics Education Research Journal, 6(2), 103–108. https://doi.org/10.21580/perj.2024.6.2.14122
Tawil, M., & Tampa, A. (2024). Pelatihan Pembuatan Asesmen Portofolio Berorientasi Pembelajaran Kooperatif Bagi Guru IPA. Jurnal Altifani Penelitian dan Pengabdian kepada Masyarakat, 4(1), 85-96.
Widyaningsih, S. W., Yusuf, I., Prasetyo, Z. K., & Istiyono, E. (2021). The Development of The Hots Test of Physics Based on Modern Test Theory: Question Modeling Through E-Learning of Moodle LMS. International Journal of Instruction, 14(4), 51–68. https://doi.org/10.29333/iji.2021.1444a
Wilson, L. O. (2016). Anderson and Krathwohl Bloom’s Taxonomy Revised Understanding the New Version of Bloom’s Taxonomy. The Second Principle, 1(1), 1-8.
Zahriah, Z., Annisa, F., Ahmad, N. H. B., & Fahira, A. (2025). Design and Validation of a Diagnostic Test Instrument for Identifying Misconceptions in Basic Physics. ORBITA: Jurnal Pendidikan dan Ilmu Fisika, 11(1), 1-11. https://doi.org/10.31764/orbita.v11i1.27782
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Inas Aulia Majid, Sutarto Sutarto, Bea Hana Siswati
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
