Journal Screenshot

International Journal of Academic Research in Progressive Education and Development

Open Access Journal

ISSN: 2226-6348

Consistent or Inconsistent? Expert-based Cognitive Model vs Student-based Response Cognitive Model of Cognitive Diagnostic Assessment in Factorisation of Algebraic Fractions

Mohd Azizi Mohd Noor, Lim Hooi Lian

http://dx.doi.org/10.6007/IJARPED/v11-i3/14696

Open access

This study aims to discuss the process of developing a Cognitive Diagnostic Assessment combination with cognitive models for assessing students' mastery of algebraic skills. It also highlights the factors considered in the development of the CDA. The integrated assessment triangle's theoretical framework and evidence-centred design is used to guide the development and validation of the hierarchical attribute method (AHM), expert-based cognitive model, student-response cognitive model, and the use of the simulation of the Hierarchical Consistency Index (HCI) to assess the consistency of the two models. It began with the critical phase of producing a high-quality CDA, where experts would define the related attributes and items based on the DSKP, textbook and related documents and a pilot test of open-ended questions distributed to students. The details of CDA's development and the construction of its components, such as cognitive models and psychometric analyses, are also discussed.

Alexendra, H. (2020). The Relationship between Perceived Helpfulness of Self-Assessment and Self-Eficacy in High School Algebra 1 Students with a Specific Learning Disability. A Dissertation Submitted to the Graduate Faculty of the University of West Georgia.
Briggs, D. C., Alonzo, A. C., Schwab, C., & Wilson, M. (2006). Diagnostic assessment with ordered multiple-choice items. Educational Assessment, 11(1), 33–63. https://doi.org/10.1207/s15326977ea1101_2
By, E., Rupp, A. A., & Jacqueline P, L. (Eds.). (2017). The Handbook of Cognition and Assessment (First). John Wiley & Sons.
Chin, H., Meng, C., Hooi, C., & Lim, L. (2021). Development and validation of online cognitive diagnostic assessment with ordered multiple ? choice items for ‘ Multiplication of Time .’ Journal of Computers in Education, 0123456789. https://doi.org/10.1007/s40692-020-00180-7
Cui, Y. (2007). The Hierarchy Consistency Index: A Person-fit Statistic for the Attribute Hierarchy Method.
Cui, Y., & Leighton, J. P. (2009). The Hierarchy Consistency Index?: Evaluating Person Fit for Cognitive Diagnostic Assessment. 46(4), 429–449.
Daud, Y., & Ayub, A. S. (2019). Student Error Analysis in Learning Algebraic Expression?: A Study in Secondary School Putrajaya. 2615–2630. https://doi.org/10.4236/ce.2019.1012189
DiBello, L. V., Roussos, L. A., & Stout, W. (2007). 31A Review of Cognitively Diagnostic Assessment and a Summary of Psychometric Models. Handbook of Statistics, 26(06), 979–1030. https://doi.org/10.1016/S0169-7161(06)26031-0
Fang, L. B., & Lian, L. H. (2015). Kesan penggunaan strategi metafora dalam pembelajaran algebra dalam kalangan pelajar menengah rendah 1. In JURNAL PENDIDIKAN SAINS & MATEMATIK MALAYSIA VOL.5 NO.2 DEC 2015 / ISSN 2232-0393 KESAN (Vol. 5, Issue 2).
Ganesen, P., Osman, S., Abu, M. S., & Kumar, J. A. (2020). The relationship between learning styles and achievement of solving algebraic problems among lower secondary school students. International Journal of Advanced Science and Technology, 29(9 Special Issue), 2563–2574.
Hoon, T. S., Singh, P., Han, C. T., & Nasir, N. (2020). An Analysis of Knowledge in STEM?: Solving Algebraic Problems. 2014.
Jupri, A., & Drijvers, P. (2016). Student Difficulties in Mathematizing Word Problems in Algebra. 12(9), 2481–2502. https://doi.org/10.12973/eurasia.2016.1299a
KPM. (2016a). Buku Penerangan Kurikulum Standard Sekolah Menengah (KSSM). In Kementerian Pendidikan Malaysia (Vol. 53, Issue 9). bahagian Pembangunan Kurikulum.
KPM. (2016b). Dokumen Standard Kurikulum dan Pentaksiran.
Sugiarti, L., and Retnawati, H. (2019). Analysis of student difficulties on algebra problem solving in junior high school Analysis of student difficulties on algebra problem solving in junior high school. Journal of Physics. https://doi.org/10.1088/1742-6596/1320/1/012103
Leighton, J. P., Gierl, M. J., & Hunka, S. M. (2004). The Attribute Hierarchy Method for Cognitive Assessment?: A Variation on Tatsuoka ’ s Rule-Space Approach. 3, 205–237.
Li, H. L., Zulnaidi, H., & Lumpur, K. (2019). Effects of The Geometer ’ s Sketchpad on Algebraic Reasoning Among Junior Private High School Students. 1(1), 1–10.
Li, L., Zhou, X., Gao, X., & Tu, D. (2020). The development and influencing factors of Kindergarteners ’ mathematics problem solving based on cognitive diagnosis assessment. 0123456789. https://doi.org/10.1007/s11858-020-01153-x
Lian, L. H., & Yew, W. T. (2012). Assessing Algebraic Solving Ability?: A Theoretical Framework. 5(6), 177–188. https://doi.org/10.5539/ies.v5n6p177
Mahlan, S. B., Aina, N., Razak, A., & Shamsuddin, M. (2017). Kesalahan Pelajar dalam Asas Matematik?: Kajian Kes Pelajar Pra- Diploma Perdagangan , UiTM Cawangan Pulau Pinang. 3(1), 179–185.
Makonye, J. P., & Stepwell, N. (2016). Eliciting Learner Errors and Misconceptions in Simplifying Rational Algebraic Expressions to Improve Teaching and Learning. International Journal of Educational Sciences, 12(1), 16–28. https://doi.org/10.1080/09751122.2016.11890408
Mat, S. F., Effendi, M., & Mohd, E. (2020). Faktor Yang Mempengaruhi Keterlibatan Pelajar Dalam Pembelajaran Matematik?: Sorotan Literatur Bersistematik ( Factors Influencing Student Engagement in Mathematics Learning?: Systematic Literature Review ). 2(3), 173–187.
Mislevy, R. J. (2011). Evidence Centered-Design for Simulation.
Mislevy, R. J., Almond, R. G., & Lukas, J. F. (2003). A Brief Introduction to Evidence-centered Design. July.
Mislevy, R. J., Haertel, G. D., & International, S. R. I. (2006). Implications of Evidence-Centered Design for Educational Testing.
NizamLeeAbdullah, LowChaiPeng, & MohdUziDollah. (2016). Pembinaan instrumen penilaian kendiri pembelajaran Algebra tingkatan empat. Jurnal Pendidikan Sains & Matematik Malaysia, 6(2), 54–68.
NurmaizatulHazirahMustaffa. (2017). Hubungan antara Kebimbangan Matematik dengan Motivasi dan Prestasi Pelajar pada subjek Matematik. 2017.
Pellegrino, J. W., Chudowsky, N., & Glaser, R. (2001). Knowing What Students Know: The Science and Design of Educational Assessment. Washington, DC: The National Academies Press. https://doi.org/10.17226/10019
Ralston, N. C., Li, M., & Taylor, C. (2018). The Development and Initial Validation of an Assessment of Algebraic Thinking for Students in the Elementary Grades. Educational Assessment, 23(3), 211–227. https://doi.org/10.1080/10627197.2018.1483191
Roberts, M. R., Alves, C. B., Chu, M., Thompson, M., Bahry, L. M., & Gotzmann, A. (2014). Testing Expert-Based Versus Student-Based Cognitive Models for a Grade 3 Diagnostic Mathematics Assessment. 173–195. https://doi.org/10.1080/08957347.2014.905787
Sh.SitiHauzimahWanOmar. (2019). PENGETAHUAN, KEMAHIRAN, SIKAP DAN MASALAH GURU DALAM MELAKSANAKAN PENTAKSIRAN BILIK DARJAH BAHASA MELAYU DI SEKOLAH RENDAH (Knowledge, Skills, Attitude and Problem of Teacher’s in Implementing Classroom Assessment Malay Language in Primary Schools). 9(Mei), 56–67.
Shanley, L. (2016). Evaluating Longitudinal Mathematics Achievement Growth: Modeling and Measurement Considerations for Assessing Academic Progress. Educational Researcher, 45(6), 347–357. https://doi.org/10.3102/0013189X16662461
Shute, V. J., Leighton, J. P., Jang, E. E., & Chu, M. W. (2016). Advances in the Science of Assessment. Educational Assessment, 21(1), 34–59.
https://doi.org/10.1080/10627197.2015.1127752
Sia, C. J. L., Lim, C. S., Chew, C. M., & Kor, L. K. (2019). Expert-Based Cognitive Model and Student-Based Cognitive Model in the Learning of “Time”: Match or Mismatch? International Journal of Science and Mathematics Education, 17(6), 1089–1107. https://doi.org/10.1007/s10763-018-9916-9
Skilling, K., Bobis, J., Martin, A. J., Anderson, J., & Way, J. (2016). What secondary teachers think and do about student engagement in mathematics. Mathematics Education Research Journal. https://doi.org/10.1007/s13394-016-0179-x
Somasundram, P., Akmar, S. N., & Eu, L. K. (2017). ALGEBRAIC THINKING IN PRIMARY SCHOOLS: AN INSTRUMENT VALIDATION USING PLS-SEM. 12–23.
Tatsuoka, K. K. (2009). COGNITIVE ASSESSMENT. An Introduction to the Rule Space Method. Routledge. Taylor & Francis Group.
Tjoe, H., & Torre, J. De. (2013a). Designing Cognitively-Based Proportional Reasoning Problems as an Application of Modern Psychological Measurement Models. 6(2), 17–26.
Tjoe, H., & Torre, J. De. (2013b). The identification and validation process of proportional reasoning attributes?: an application of a cognitive diagnosis modeling framework. https://doi.org/10.1007/s13394-013-0090-7
Toprak, T. E., & Cakir, A. (2020). Examining the L2 reading comprehension ability of adult ELLs: Developing a diagnostic test within the cognitive diagnostic assessment framework. Language Testing, 14, 1–26. https://doi.org/10.1177/0265532220941470
Wang, C., & Gierl, M. J. (2007). Investigating the Cognitive Attributes Underlying Student Performance on the SAT Critical Reading Subtest: An Application of the Attribute Hierarchy Method.
Wu, H. (2001). How to prepare students for algebra. American Educator, 25(2), 10–17.
Yaacob, A., & Maat, S. M. (2020). Pengajaran Berasaskan Video Animasi Untuk Meningkatkan Kefahaman Pelajar Terhadap Topik Algebra ( Video Animation Based Learning to Increase Students ’ Understanding on Algebra ). 2(1), 215–226.
Ying, C. L., Osman, S., Kurniati, D., Masykuri, E. S., & Kumar, J. A. (2020). Difficulties that Students Face when Learning Algebraic Problem-Solving. November. https://doi.org/10.13189/ujer.2020.081143
Zila, N., Jubri, M., Zakaria, E., Effendi, M., & Mohd, E. (2020). PENGGUNAAN TEKNIK JUBIN ALGEBRA DALAM PENGUASAAN KEMAHIRAN PENDARABAN UNGKAPAN ALGEBRA BAGI PELAJAR TINGKATAN 2 ( The Use Of Algebraic Tiles Techniques In Mastering Algebraic Multiplication Skills For Form 2 Students ). 1(3), 74–88.

In-Text Citation: (Noor & Lian, 2022)
To Cite this Article: Noor, M. A. M., & Lian, L. H. (2022). Consistent or Inconsistent? Expert-based Cognitive Model vs Student-based Response Cognitive Model of Cognitive Diagnostic Assessment in Factorisation of Algebraic Fractions. International Journal of Academic Research in Progressive Education and Development, 11(3), 220–231.