Journal Screenshot

International Journal of Academic Research in Progressive Education and Development

Open Access Journal

ISSN: 2226-6348

A Rasch Model Analysis of the Suitability of Exam Items in DBS10042 Engineering Science

Geetha Subramaniam, Muhammad Syafiq Bin Abdul Ghafar, Intan Noor Dzalika Binti Azis

http://dx.doi.org/10.6007/IJARPED/v14-i3/25932

Open access

In educational settings, the Rasch Measurement Model is widely used to ensure that assessment instruments produce trustworthy and consistent results. This study applied the Rasch model to analyse the final examination items of the DBS10042 Engineering Science course offered at a Malaysian polytechnic. A total of 240 first-semester engineering students participated in the study. The analysis focused on item fit statistics, item difficulty, and point-measure correlations to determine how well each question aligned with students’ abilities and the intended learning outcomes. Results indicated that most items fell within acceptable fit ranges, confirming their appropriateness for assessing student performance. However, a few items exhibited misfit, suggesting issues such as ambiguity, misalignment with cognitive levels, or excessive difficulty. The study also revealed strong person-item correlations for most items, supporting their diagnostic value in differentiating student proficiency. Overall, the findings highlight the effectiveness of using the Rasch Measurement Model to ensure high quality, fair, and reliable assessments in technical and vocational education contexts.

Abdullah, H., Arsad, N., Hashim, F. H., Aziz, N. A., Amin, N., & Ali, S. H. (2012). Evaluation of Students’ Achievement in the Final Exam Questions for Microelectronic (KKKL3054) using the Rasch Model. Procedia - Social and Behavioral Sciences, 60(October), 119–123. https://doi.org/10.1016/j.sbspro.2012.09.356
Amin, S. M., Ahmad Suhaimi, S. S., & Nazuri, N. S. (2023). The Present and Future of Malaysian Technical and Vocational Education and Training (TVET). International Journal of Academic Research in Business and Social Sciences, 13(18), 107–117. https://doi.org/10.6007/ijarbss/v13-i18/19952
Azizah, N., Suseno, M., & Hayat, B. (2022). Item analysis of the rasch model items in the final semester exam indonesian language lesson. World Journal of English Language, 12(1), 15–26. https://doi.org/10.5430/wjel.v12n1p15
Azmi, T., & Salleh, D. (2021). a Review on Tvet Curriculum Practices in Malaysia. International Journal of Education, Psychology and Counseling, 6(40), 35–48. https://doi.org/10.35631/ijepc.640003
Boone, W. J. (2016). Rasch analysis for instrument development: Why,when,and how? CBE Life Sciences Education, 15(4). https://doi.org/10.1187/cbe.16-04-0148
Hadi, T. S., & Lestari, I. (2024). Application of The Rasch Model in Research Publications?: A Bibliometric Analysis. 4(May), 229–240.
Hernánez-Suarez, C. A., Gamboa-Suárez, A. A., & Suarez, O. J. (2021). Attitudes towards physics. A study with high school students from the Colombian context. Journal of Physics: Conference Series, 2118(1). https://doi.org/10.1088/1742-6596/2118/1/012019
Herrmann-Abell, C. F., Hardcastle, J., & DeBoer, G. E. (2018). Using Rasch to develop and validate an assessment of students’ progress on the energy concept. Grantee Submission.
Heryani, T. P., Sinaga, P., & Chandra, D. T. (2021). Analysis mastery of concepts physics on the topics of energy for high school students in distance learning during Covid–19. Journal of Physics: Conference Series, 2098(1). https://doi.org/10.1088/1742-6596/2098/1/012003
Hope, D., Kluth, D., Homer, M., Dewar, A., Jaap, A., & Cameron, H. (2024). items for multi-site and multi-year assessment.
Istiyono, E., Dwandaru, W. S. B., Setiawan, R., & Megawati, I. (2020). Developing of computerized adaptive testing to measure physics higher order thinking skills of senior high school students and its feasibility of use. European Journal of Educational Research, 9(1), 91–101. https://doi.org/10.12973/eu-jer.9.1.91
Khalid, I. L., Abdullah, M. N. S., & Mohd Fadzil, H. (2024). A Systematic Review: Digital Learning in STEM Education. Journal of Advanced Research in Applied Sciences and Engineering Technology, 51(1), 98–115. https://doi.org/10.37934/araset.51.1.98115
Lohgheswary, N., Diana, A. S. F. N., Preethy, A., & Lun, A. W. (2022). Analysis on numerical analysis final exam questions. International Journal of Health Sciences, April, 1165–1174. https://doi.org/10.53730/ijhs.v6ns2.5076
Lohgheswary, N., Lun, A. W., & Jedi, A. (2022). Evaluating performance of students in engineering statistics final exam questions. International Journal of Health Sciences, April, 1002–1011. https://doi.org/10.53730/ijhs.v6ns2.5073
Lohgheswary, N., Preethy, A., & Gobithaasan, R. U. (2019). Analysis on Engineering Mathematics II Final Exam Questions. International Journal of Advanced Science and Technology, 28(8s), 123–129.
Lohgheswary, N., Salmaliza, S., Lun, A. W., Jedi, A., & Nopiah, Z. M. (2022). Evaluating reliability of final exam questions via rasch model. International Journal of Health Sciences, April, 1065–1074. https://doi.org/10.53730/ijhs.v6ns2.5064
Mamat, F. A. (2023). Fokus Penilaian Alternatif (PALT) Sains Kejuruteraan. Jurnal Dunia Pendidikan, 5(1), 36–40. https://doi.org/10.55057/jdpd.2023.5.1.4
Nazry Ali, M., Ghani, W., Haiman Abdul Rahman, A., & Masrom, M. (2022). The ICT implementation in the TVET teaching and learning environment during the COVID-19 pandemic. International Journal of Advanced Research in Future Ready Learning and Education, 27(1), 43–49.
Neumann, I., Neumann, K., & Nehm, R. (2011). Evaluating instrument quality in science education: Rasch-based analyses of a nature of science test. International Journal of Science Education, 33(10), 1373–1405. https://doi.org/10.1080/09500693.2010.511297
Octaviana, R. I., Anggara, M. B., Jamilah, R., Darmana, A., & Suyanti, R. D. (2022). Analisis Item Soal Kimia SMA Menggunakan Rasch Model. Orbital: Jurnal Pendidikan Kimia, 6(1), 26–37. https://doi.org/10.19109/ojpk.v6i1.12248
Osmin, S. S., & Zainuddin, S. A. (2021). PROGRAM EDUCATIONAL OBJECTIVES ASSESSMENT FOR DIPLOMA IN INFORMATION TECHNOLOGY ( DIGITAL TECHNOLOGY ) PROGRAMME?: EMPLOYERS SURVEY. 1(1), 1–13.
Ozkan, G., & Topsakal, U. U. (2020). Determining Students’ Conceptual Understandings of Physics Concepts. Shanlax International Journal of Education, 8(3), 1–5. https://doi.org/10.34293/education.v8i3.2908
Rahim, A., & Haryanto, H. (2021). Journal of Educational Research and Evaluation Implementation of Item Response Theory (IRT) Rasch Model in Quality Analysis of Final Exam Tests in Mathematics Article Info. Journal of Educational Research and Evaluation, 10(2), 57–65. http://journal.unnes.ac.id/sju/index.php/jere
Rustam, M., Rameli, M., Mohd, A., & My, K. P.-A. (2017). Malaysian School Students’ Math Anxiety: Application of Rasch Measurement Model. January 2016.
Saleh, S. (2021). Malaysian students’ motivation towards Physics learning. European Journal of Science and Mathematics Education, 2(4), 223–232. https://doi.org/10.30935/scimath/9414
Stemler, S. E., & Naples, A. (2021). Rasch Measurement v. Item Response Theory: Knowing When to Cross the Line. Practical Assessment, Research and Evaluation, 26, 1–16. https://doi.org/10.7275/v2gd-4441
Wicaksono, A. G. C., & Korom, E. (2023). Attitudes towards science in higher education: Validation of questionnaire among science teacher candidates and engineering students in Indonesia. Heliyon, 9(9). https://doi.org/10.1016/j.heliyon.2023.e20023
Yulisharyasti, L., Nurdin, A., Aulia, N., Arfa, F. A. H., & Fadjryani. (2023). Analyzing the Quality of Measurement Instruments of Multiple Choice Questions on Class Xi Economics Material in Public High School 3 Gorontalo Through Classical Test Theory and Rasch Models. Parameter: Journal of Statistics, 3(1), 28–38. https://doi.org/10.22487/27765660.2023.v3.i1.16417
Yusop, S. R. M., Rasul, M. S., Yasin, R. M., Hashim, H. U., & Jalaludin, N. A. (2022). An Assessment Approaches and Learning Outcomes in Technical and Vocational Education: A Systematic Review Using PRISMA. Sustainability (Switzerland), 14(9). https://doi.org/10.3390/su14095225
Zafrullah, Sa’adatul Ulwiyah, & Nofriyandi. (2023). Rasch Model Analysis on Mathematics Test Instruments: Biblioshiny (1983-2023). Mathematics Research and Education Journal, 7(2), 1–13. https://doi.org/10.25299/mrej.2023.vol7(2).14550

Subramaniam, G., Ghafar, M. S. B. A., & Azis, I. N. D. B. (2025). A Rasch Model Analysis of the Suitability of Exam Items in DBS10042 Engineering Science. International Journal of Academic Research in Progressive Education and Development, 14(3), 1463–1471.