ISSN: 2226-6348
Open access
The current study aimed to examine differential item functioning (DIF) of a numerical ability test for Gulf state school students. This study examined the DIF items by gender and country using two DIF analysis methods; the Likelihood Ratio Test (LRT) and the Mantel-Haenszel (MH). The sample size was 2689 individuals throughout grades 5 and 6, and the researchers used MH with the SPSS and LRT with the BILOG-MG. The study used the classification stability coefficient kappa (?) to compare how well the two methods agreed to examine DIF. Regarding gender, LRT yielded precise results for 30% of the items, and in terms of country, for 43.3%. Also, analyzing DIF with MH found that 26.7% of items exhibited DIF based on gender and country. For gender, there was strong concordance (0.925) between the MH method and the LRT. For the country, the MH and LRT agreement was also high (0.683). The study suggested investigating the causes of test items' differential performance and comparing the DIF in two test types, paper-and-pencil and computer-based.
Abu Shindi, Y. A., & Kazem, A. M. (2018). Sex differential item functioning for Mathematics test in cognitive development program in Sultanate of Oman by Mental-Haenszel and item characteristic curve methods. International Journal of Learning and Management Systems, 6(2), 61-73.
Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19, 716–723. https://doi: 10.1109/TAC.1974.1100705
Al Ajmi, M., Mustakim, S. S., Roslan, S., & Almehrizi, R. (2023). Differential Item Functioning of Verbal Ability Test in the Gulf Multiple Mental Abilities Scale by Mental-Haenszel and Likelihood Ratio Test. International Journal of Academic Research in Business and Social Sciences, 13(1), 1038–1056.
Almaskari, H. A., Almehrizi, R. S., & Hassan, A. S. (2021). Differential item functioning of verbal ability test in Gulf multiple mental ability scale for GCC students according to gender and country. Journal of Educational and Psychological Studies, 15(1), 120-137.
Al Nafouri, L. (2015). W-J. Test of Cognitive Abilities III Standard Battery. Unpublished thesis dissertation.
Alsawalmeh, Y., & Al Ajlouni, J. (2019). The relationship between differential distractors functioning and differential item functioning in a multiple-choice mathematics test. Jordanian Journal of Educational Sciences, 15(1), 49-63.
Alzayat, F., Almehrizi, R., Arshad, A., Fathi, K., Albaili, M., Dogan, A., Asiri, A., Hadi, F., & Jassim, A. (2011). Technical report of the Gulf scale for multiple mental abilities (GMMAS). Arab Gulf University, Bahrain.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: Author.
Aryadoust, V. (2018). Using recursive partitioning Rasch trees to investigate differential item functioning in second language reading tests. Studies in Educational Evaluation, 56, 197–204. https://doi: 10.1016/j.stueduc.2018.01.003
Bichi, E., Embong, R., Talib, R., Salleh, S., & Ibrahim, A. (2019). Comparative analysis of classical test theory and item response theory using Chemistry test data. International Journal of Engineering and Advanced Technology, 8(5), 1260-1266. https://doi:10.35940/ijeat.e1179.0585c19.
Diaz, E., Brooks, G., & Johanson, G. (2021). Detecting Differential Item Functioning: Item Response Theory Methods Versus the Mantel-Haenszel Procedure. International Journal of Assessment Tools in Education, 8(2), 376–393.
https://doi:10.21449/ijate.730141.
Fidalgo, A. M., & Madeira, J. M. (2008). Generalized Mantel-Haenszel Methods for Differential Item Functioning Detection. Educational and Psychological Measurement. https://doi.org/10.1177/0013164408315265
Geramipour, M. (2020). Item-focused trees approach in differential item functioning (DIF) analysis: a case study of an EFL reading comprehension test. Journal of Modern Research in English Language Studies, 7(2), 123-147. https:/doi:
10.30479/jmrels.2019.11061.1379
Geramipour, M., & Shahmirzadi, N. (2019). A gender–related differential item functioning study of an English test. Journal of Asia TEFL, 16(2), 674.
Giray, B., Yildirim, H. (2007). The DIF analyses of PISA2003 mathematics items via likelihood ratio, Mantel-Haenszel and restricted factor analysis procedures. The report, Retrieved on Jan 4, 2010, from http:// www. Etd.lib.metu.edu.tr.
Gomez-Benito, J., Sireci, S., Padilla, J.-L., Hidalgo, M. D., & Benitez, I. (2018). Differential item functioning: Beyond validity evidence based on internal structure. Psicothema, 30(1), 104–109.
Huang, T. W., Wu, P. C., & Mok, M. M. C. (2022). Examination of Gender-Related Differential Item Functioning Through Poly-BW Indices. Frontiers in psychology, 13, 821459. https://doi.org/10.3389/fpsyg.2022.821459.
Jabrayilov, R., Emons, W., & Sijtsma, K. (2016). Comparison of Classical Test Theory and Item Response Theory in Individual Change Assessment. Applied Psychological Measurement 40. 1-14. https://doi.org/ 10.1177/0146621616664046.
Kim, S., Cohen, A., & Lin, Y. (2005). LDID: A Computer program for local dependence indices for dichotomous Items. Version 1.0.
Krabbe, P.F. (2017). The measurement of health and health status: Concepts, methods and applications from a multidisciplinary perspective. Elsevier.
Landis, J. R., Koch, G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. doi:10.2307/2529310
Magis, D., Yan, D., & Von Davier, A. A. (2017). Computerised adaptive and multistage testing with R: Using packages catR and mstR. Springer.
Nawafleh, A. (2017). The Effect of paragraphs with differential functioning of uniform on estimating paragraphs parameters and persons using a stimulated data according to the Three parameters model. Educational science studies, 44(4), 187–207.
Oalla, B., Matarneh, A. (2018). Differential performance of the items of the University level Test for the English language among the students of Mutah University. Journal of Educational and Psychological Sciences, 19(2), 449- 475.
Salman, M., & Thatha, H. (2022). The Differential Performance of the Items of the National Test to Control the Quality of Education in the Subjects of Science, Mathematics, Arabic and English for the Eighth Grade in Jordan. Jerash for Research and Studies Journal 23(2).
Sayed, M., Bakhoum, R., Moussa, M., & Mohamed, M. (2022). Detecting the differential item function of gender on the emotional balance scale using mantel Hansel method According to the assumptions of the item response theory. Journal of Research in Education and Psychology, 37(1), 361–396.
Schwarz, G. (1978). Estimating the Dimension of a Model. Annals Stat. 6, 461–464. doi: 10.1214/aos/1176345415.
Warnimont, C. S. (2010). The Relationship between Students' Performance on the Cognitive Abilities Test (CogAT) and the Fourth and Fifth Grade Reading and Math Achievement Tests in Ohio. Unpublished doctoral dissertation. Bowling Green State University.
Yildirim, H. H. (2006). The Differential Item Functioning (DIF) Analysis of Mathematics Items in The International Assessment Programs. Unpublished thesis dissertation.
Zakri, A. (2020). Identifying differential item functioning of the "EMBU" test of parental rearing styles among a sample of secondary school students. Journal of Education College, 3(186). 676–720.
In-Text Citation: (Ajmi et al., 2023)
To Cite this Article: Ajmi, M. Al, Mustakim, S. S., Roslan, S., & Almehrizi, R. (2023). Detecting the Differential Item Functioning of Numerical Ability Test in the Gulf Multiple Mental Abilities Scale by Mental-Haenszel and Likelihood Ratio Test. International Journal of Academic Research in Progressive Education and Development, 12(2), 2400–2415.
Copyright: © 2023 The Author(s)
Published by Human Resource Management Academic Research Society (www.hrmars.com)
This article is published under the Creative Commons Attribution (CC BY 4.0) license. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this license may be seen at: http://creativecommons.org/licences/by/4.0/legalcode