Journal Screenshot

International Journal of Academic Research in Progressive Education and Development

Open Access Journal

ISSN: 2226-6348

Data Literacy Competencies for Informed Classroom Assessment Practice: Challenges and Measures

Zuraimi Zakaria, Nor Tutiaini Ab. Wahid, Adibah Abdul Latif

http://dx.doi.org/10.6007/IJARPED/v12-i3/19320

Open access

This paper is firmly rooted in the perspective that data literacy is an indispensable competency. Its adoption leads to ethical, valid, and reliable classroom assessment practices, promoting improvements in learning outcomes. While it is recognized that teacher change and the adoption of new teaching practices can be slow and challenging, robust research findings indicate that they are indeed attainable through targeted, systematic, and concerted efforts. Therefore, the primary aim of this paper is to propose specific measures and intervention strategies to cultivate data literacy skills and foster meaningful data engagements. These proposals are rooted in empirical research findings related to data literacy, assessment literacy, data-driven decision-making (DDDM), and classroom assessments. The paper also delves into the ensuing recommendations and their implications for the educational landscape.

Abrams, L.M., Varier, D., & Mehdi, T. (2021). The intersection of school context and teachers’ data use practice: Implications for an integrated approach to capacity building. Studies in Educational Evaluation, 69, https://www.sciencedirect.com/science/article/pii/S0191491X20301164
Ab.Wahid, N. T. (2022). Developing critical thinking skills in secondary school students: the potential for strategic management through problem-posing instructional strategy. International Journal of Academic Research in Progressive Education and Development, 11(3), 1327–1335. https://doi.org/10.6007/ijarped/v11-i3/15505
Ab.Wahid, N. T., Talib, O., Sulaiman, T., & Puad, H. M. (2018). A systematic literature review on the problem-posing strategies for biology problem-posing multimedia module design. International Journal of Academic Research in Business and Social Sciences, 8, 1–13. https://doi.org/10.6007/IJARBSS/v8-i12/5150
Andersen, I.G. (2020). What went wrong? Examining teachers’ data use and instructional decision making through a bottom-up data intervention in Denmark. International Journal of Educational Research, 102. https://doi.org/10.1016/j.ijer.2020.101585
Blasio, H.D., & Francis, M. (2018). Case study: Wilderness School, Adelaide, South Australia. In G. Patrick (Eds.), Assessment for teaching (pp.266-280). Cambridge University Press.
Bolhuis, E., Voogt, J., & Schildkamp, K. (2019). The development of data use, data skills, and positive attitude towards data use in a data team intervention for teacher educators. Studies in Educational Evaluation, 60, 99-108.
Boudett, K.P., & City, E.A. (2013). Lessons from the Data Wise Project: Three habits of mind for building a collaborative culture. Harvard Education Letter, 29(3). https://www.hepg.org/hel-home/issues/29_3/helarticle/lessons-from-the-data-wise-project_567#home
Bruniges, M. (2019). The science behind the art of teaching: Evaluation as inspiration. ACER Research Conference 2019, 6-11. https://research.acer.edu.au/cgi/viewcontent.cgi?article=1363&context=research_conference
Cochran-Smith, M., & Lytle, S.L. (2001). Beyond certainty: Taking an inquiry stance on practice. In Lieberman, A. & Miller, L., Teachers caught in the action: PD that matters (pp. 45-60). New York: Teachers College Press.
Cramer, E. D., Little, M. E., & McHatton, P. A. (2014). Demystifying the data-based decision-making process. Action in Teacher Education, 36(5-6), 389-400.
Darling-Hammond, L., Hyler, M.E., & Gardner, M. (2017). Effective teacher professional development. Research Brief, https://learningpolicyinstitute.org/sites/default/files/product-files/Effective_Teacher_Professional_Development_BRIEF.pdf
DeLuca, C., LaPointe-McEwan, D., & Luhanga, U. (2016). Teacher assessment literacy: A review of international standards and measures. Educational Assessment, Evaluation and Accountability, 28, 251–272.
Diery, A., Vogel, F., Knogler, M., & Seidel, T. (2020). Evidence-based practice in higher education: Teacher educators’ attitudes, challenges and uses. Frontiers in Education, https://doi.org/10.3389/feduc.2020.00062
Dyer, K. (2014). Data literacy – what it is and how it differs from assessment literacy. Northwest Evaluation Association. https://www.nwea.org/blog/2014/data-literacy-differs-assessment-literacy/
Ebbeler, J., Poortman, C.L., Schildkamp, K., & PIeters, J.M. (2016). Effects of data use intervention on educators’ use of knowledge and skills. Studies in Educational Education, 48, 19-31. http://dx.doi.org/10.1016/j.stueduc.2015.11.002
Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113-132.
Garrison, C., Chandler, D., & Eringhaus, M. (2009). Effective classroom assessment: Linking assessment with instruction. New York: National Middle School Association.
Gelderblom, G., Schildkamp, K., Pieters, J., & Ehren, M. (2016). Data-based decision making for instructional improvement in primary education. International Journal of Educational Research, 80, 1-14.
Gill, B., Borden, B.C., & Hallgren, K. (2014). A conceptual framework for data-driven decision making. Mathematica Policy Research, file:///C:/Users/Dr%20Badrul%20Isa/Downloads/Framework_data-driven_decision_making.pdf
Griffin, P., & Francis, M. (2018). Building a development progression. In G. Patrick (Eds.), Assessment for teaching (pp.161-197). Cambridge University Press.
Hattie, J. (2009). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. Oxon, UK: Routledge.
Henderson, J., & Corry, M. (2020). Data literacy training and use for educational professionals. Journal of Research in Innovative Teaching and Learning, 12(10), Journal of Research in Innovative Teaching & Learning, 14(2), 232-244, https://doi.org/10.1108/JRIT-11-2019-0074
Karner, T., Warwas, J., Krannich, M., & Weichsler, N. (2021). How does information consistency influence prospective teachers’ decisions about task difficulty assignments? A within-subject experiment to explain data-based decision-making in heterogeneous classes. Learning and Instruction, 74, https://kops.uni-konstanz.de/handle/123456789/52750
Kaufman, T.E., Graham, C.R., Picciano, A.G., Popham, A.J., & Wiley, D. (2014). Data-driven decision making in the K-12 classroom. In M.J. Spector, D.M. Merill, J. Elen, & M.J. Bishop (Eds.), Handbook of research on educational communications and technology (4th ed, pp337-346). New York: Springer.
Kennedy-Clark, S., Galstaun, V., Reimann, P., & Handal, B. (2020). Using action research to develop data literacy in initial teacher education. The Journal of Teacher Action Research, 6(2), 4-25.
Kippers, W.B., Poortman, C.L., Schildkamp, K., & Visscher, A.J. (2018). Data literacy: What do educators learn and struggle with during a data use intervention? Studies in Educational Evaluation, 56, 21-31.
Lai, M.K., & McNaughton, S. (2016). The impact of data use professional development on student achievement. Teaching and Teacher Education, 60, 434-443.
Lasater, K., Bengtson, E., & Albiladi, W.S. (2021). Data use for equity? How data practices incite definit thinking in schools. Studies in Educational Evaluation, 69. https://doi.org/10.1016/j.stueduc.2020.100845
Lee, H., & Kim, Y. (2019). Pre-service teachers’ beliefs about teaching and learning mathematics: A meta-analysis. Educational Studies in Mathematics, 102(2), 233–259.
Li, Z., & Li, L. (2019). An Examination of Kindergarten Teachers’ Beliefs about Creative Pedagogy and Their Perceived Implementation in Teaching Practices. Thinking Skills and Creativity, 32, 17-29.https://doi.org/10.1186/2229-0443-1-3-36
Mandinach, E.B. (2012). A perfect time for data use: Using data-driven decision making to inform practice. Educational Psychologist, 47(2), 71-85.
Mandinach, E.B., & Gummer, E. (2016). What does it mean for teachers to be data literate: Laying out the skills, knowledge and dispositions. Teaching and Teacher Education, 60, 366-376, https://doi.org/10.1016/j.tate.2016.07.011
Mandinach, E.B., & Schildkamp, K. (2021). Misconceptions about data-based decision making in education: An exploration of the literature. Studies in Educational Evaluation, 69, https://www.sciencedirect.com/science/article/pii/S0191491X1930416X
Marsh, J. A. (2012). Interventions promoting educators’ use of data: Research insights and gaps. Teachers College Record, 114(11), 1–48.
Masters, G. (2018). The role of evidence in teaching and learning. Australian Council for Educational Research, retrieved from https://research.acer.edu.au/cgi/viewcontent.cgi?article=1335&context=research_conference
Mavroudi, A., Papadakis, S., & Ioannou, I. (2021). Teachers’ views regarding learning analytics usage based on the Technology Acceptance Model. TechTrends, 65, 278-287. https://doi.org/10.1007/s11528-020-00580-7
Means, B., Chen, E., DeBarger, A., & Padilla, C. (2011). Teachers' ability to use data to inform instruction: Challenges and supports. Washington, D.C.: U.S. Department of Education Office of Planning, Evaluation and Policy Development.
Michos, K., Schmitz, M., & Petko, D. (2023). Teachers’ data literacy for learning analytics: A central predictor for digital data use in upper secondary schools. Education and Information Technologies. https://doi.org/10.1007/s10639-023-11772-y
Miller, K. (2019). Data-driven decision making: A primer for beginners. Retrieved from Northeastern University Graduate Programs website, https://www.northeastern.edu/graduate/blog/data-driven-decision-making/
Ministry of Education Malaysia (2015). Garis panduan pelaksanaan Sekolah Berprestasi Tinggi (SBT) https://www.moe.gov.my/en/muat-turun/pekeliling-dan-garis-panduan/perguruan/1005-guideline-file-002627/file
Ng, S. B. (2020). Developing curriculum design for the 21st century–Balancing the need of character building and meeting other emerging needs of the future. Asia Pacific Journal on Curriculum Studies, 3(2), 1-10. https://doi.org/10.53420/apjcs.2020.4
OECD (2020). What students learn matters: Towards a 21st century curriculum. OECD Publishing: Paris. https://doi.org/10.1787/d86d4d9a-en.
OECD (2014). Data-driven innovation for growth and well-being: Interim synthesis report. OECD Publishing: Paris. https://www.oecd.org/sti/inno/data-driven-innovation-interim-synthesis.pdf
Perie, M., Marion, S., Gong, B., & Wurtzel, J. (2007). The role of interim assessments in a comprehensive assessment system. Washington, DC: The Aspen Institute.
Pink, W. T., & Hyde, A. A. (1992). Doing effective staff development. In W. T. Pink & A. A. Hyde (Eds.), Effective staff development for school change (pp. 259- 292). Norwood, NJ: Ablex Publishing Corporation.
Poortman, C.L., & Schildkamp, K. (2016). Solving student achievement problems with a data use intervention for teachers. Teaching and Teacher Education, 60, 425-433.
Popham, W.J. (2018). Assessment literacy for educators in a hurry. ASCD: Virginia.
Reeves, T.D., & Chiang, J. (2018). Online interventions to promote teacher data-driven decision making: Optimizing design to maximize impact. Studies in Educational Evaluation, 59, 256-269. https://doi.org/10.1016/j.stueduc.2018.09.006
Talib, R., Ab Ghafar, M.N., & Abu Naim, H. (2014). Assessment literacy: A catalyst to the success of School-Based Assessment in Malaysian Schools. Proceedings of the International Conference on Science, Technology and Social Sciences (ICSTSS) 2012, 197-202. https://link.springer.com/chapter/10.1007/978-981-287-077-3_23
Talib, R., Kamsah, M.Z., Ab Ghafar, M.N., Megat Zakaria, M.A.Z., & Abu Naim, H. (2013). T-Assess: Assessment literacy test for Malaysian teachers. Paper presented at the International Conference on Assessment for Higher Education Across Domains and Skills (AHEADS2013), Kuala Lumpur (17-19 December 2013).
Schildkamp, K., & Datnow, A. (2020). When data teams struggle: Learning from less successful data use efforts. Leadership and Policy in Schools. https://doi.org/10.1080/15700763.2020.1734630
Schildkamp, K., & Poortman, C. (2015). Factors influencing the functioning of data teams. Teachers College Record, 117(4), https://www.tcrecord.org
Schildkamp, K., Poortman, C., Luyten, H., & Ebbeler, J. (2017). Factors promoting and hindering data-based decision making in schools. School Effectiveness and School Improvement, 28:2, 242-258, DOI: 10.1080/09243453.2016.1256901
Staman, L., Visscher, A.J., & Luyten, H. (2014). The effects of professional development on the attitudes, knowledge and skills for data-driven decision making. Studies in Educational Evaluation, 42, 79-90.
Stiggins, R.J. (2014). Improve assessment literacy outside of schools too. Phi Delta Kappan, 96(2), 67-72.
Vanlommel, K., Van Gasse, R., Vanhoof, J., & Van Petegem, P. (2017). Teachers’ decision-making: Data based or intuition driven? International Journal of Educational Research, 83, 75–83. http://dx.doi.org/10.1016/j.ijer.2017.02.013
Sun, J., Przybylski, R., & Johnson, B. J. (2016). A review of research on teachers’ use of student data: From the perspective of school leadership. Educational Assessment, Evaluation and Accountability, 28(1), 5–33. https://doi.org/10.1007/s11092-016- 9238-9
Van der Kleij, F.M., Vermeulen, J.A., Schildkamp, K., & Eggen, T.J.H.M. (2015). Integrating data-based decision making, assessment for learning and diagnostic testing in formative assessment. Assessment in Education: Principles, Policy & Practice. http://dx.doi.org/10.1080/0969594X.2014.999024
Van Geel, M., Keuning, T., Visscher, A., & Fox, J. (2017). Changes in educators’ data literacy during a data-based decision making intervention. Teaching and Teacher Education, 64, 187-198.
Wasson, B., & Hansen, C. J. S. (2016). Data literacy and use for teaching. In P. Reimann, S. Bull, M. D. Kickmeier-Rust, R. Vatrapu, & B. Wasson (Eds.), Measuring and Visualizing Learning in the Information-Rich Classroom (pp. 56-73).
Webb, N.L. (2002). Assessment literacy in a standards-based urban education setting. Paper presented at the Annual Meeting of the American Educational Research Association, New Orleans, Louisiana, April 1-5
Woods, K., & Coles-Janess, B. (2018). Developmental assessment for students with additional needs. In G. Patrick (Eds.), Assessment for teaching (pp.247-265). Cambridge University Press.
Young, C., McNamara, G., Brown, M., & O’Hara, J. (2018). Adopting and adapting: School leaders in the age of data-informed decision making. Educational Assessment, Evaluation and Accountability, 30(2), 133–158. https://doi.org/10.1007/s11092-018-9278-4
Zakaria, Z. (2020). Teachers who reflect, teach better: Reflective practice at the heart of teachers; professional development programs. Idealogy Journal, 3(2), 215-227.
Zakaria, Z., & Latif, A.A. (2021). Teachers’ ability to interpret and use evidence to inform instruction. Prosiding Seminar Kebangsaan Majlis Dekan Pendidikan Universiti Awam Malaysia, Universiti Sains Islam Malaysia, https://oarep.usim.edu.my/jspui/handle/123456789/17949?offset=60

(Zakaria et al., 2023)
Zakaria, Z., Wahid, N. T. A., & Latif, A. A. (2023). Data Literacy Competencies for Informed Classroom Assessment Practice: Challenges and Measures. International Journal of Academic Research in Progressive Education and Development, 12(3), 2105-2102.