Journal Screenshot

International Journal of Academic Research in Progressive Education and Development

Open Access Journal

ISSN: 2226-6348

Obstacles to Effective Data-based Interventions: A Systematic Review of Teachers’ Data Literacy

Zuraimi Zakaria, Adibah Abdul Latif

http://dx.doi.org/10.6007/IJARPED/v12-i3/19221

Open access

Numerous studies have explored the implementation of data-based classroom interventions, yielding varied outcomes. While a significant body of literature highlights the positive impacts of data use and data literacy in educational settings, it is essential to examine the obstacles that impede the effectiveness of such interventions. Therefore, the objective of this systematic review is to elucidate the obstacles encountered by teachers in the process of effective data use. 15 obstacles were derived from the systematic review of ten articles that focused on data literacy, data-based interventions and data-driven decision making in education. These obstacles encompass a wide range of challenges including deficit thinking, reliance on intuition and personal judgements, dependence on a single data source, and operating within high pressure data use environment. Understanding these obstacles holds paramount importance for informing the development of professional development initiatives, educational policies and targeted programs aimed at enhancing data use and promoting data literacy.

Andersen, I.G. (2020). What went wrong? Examining teachers’ data use and instructional decision making through a bottom-up data intervention in Denmark. International Journal of Educational Research, 102. https://doi.org/10.1016/j.ijer.2020.101585
Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education, 5, 7-75.
Blasio, H.D., & Francis, M. (2018). Case study: Wilderness School, Adelaide, South Australia. In G. Patrick (Eds.), Assessment for teaching (pp.266-280). Cambridge University Press.
Bolhuis, E., Voogt, J., & Schildkamp, K. (2019). The development of data use, data skills, and positive attitude towards data use in a data team intervention for teacher educators. Studies in Educational Evaluation, 60, 99-108.
Bruniges, M. (2005). An evidence-based approach to teaching and learning. Australian Council for Educational Research (ACER) Conference Proceedings, retrieved online from http://research.acer.edu.au/research_conference_2005/15
Care, E., & Griffin, P. (2009). Assessment is for teaching. Independence, 34(2), 56-59.
Cramer, E. D., Little, M. E., & McHatton, P. A. (2014). Demystifying the data-based decision-making process. Action in Teacher Education, 36(5-6), 389-400.
DeLuca, C., LaPointe-McEwan, D., & Luhanga, U. (2016). Teacher assessment literacy: A review of international standards and measures. Educational Assessment, Evaluation and Accountability, 28, 251–272.
Diery, A., Vogel, F., Knogler, M., & Seidel, T. (2020). Evidence-based practice in higher education: Teacher educators’ attitudes, challenges and uses. Frontiers in Education, retrieved from https://doi.org/10.3389/feduc.2020.00062
Dyer, K. (2014). Data literacy–what it is and how it differs from assessment literacy. Northwest Evaluation Association. https://www.nwea.org/blog/2014/data-literacy-differs-assessment-literacy/
Ebbeler, J., Poortman, C.L., Schildkamp, K., & PIeters, J.M. (2016). Effects of data use intervention on educators’ use of knowledge and skills. Studies in Educational Education, 48, 19-31. http://dx.doi.org/10.1016/j.stueduc.2015.11.002
Gelderblom, G., Schildkamp, K., Pieters, J., & Ehren, M. (2016). Data-based decision making for instructional improvement in primary education. International Journal of Educational Research, 80, 1-14. http://dx.doi.org/10.1016/j.ijer.2016.07.004
Gill, B., Borden, B.C., & Hallgren, K. (2014). A conceptual framework for data-driven decision making. Mathematica Policy Research, retrieved from file:///C:/Users/Dr%20Badrul%20Isa/Downloads/Framework_data-driven_decision_making.pdf
Griffin, P., & Francis, M. (2018). Building a development progression. In G. Patrick (Eds.), Assessment for teaching (pp.161-197). Cambridge University Press.
Griffin, P., Murray, L., Care, E., Thomas, A., & Perri, P. (2010). Developmental Assessment: Lifting literacy through Professional Learning Teams. Assessment in Education: Principles, Policy & Practice, 17(4), 383-397.
Harvard Ed. Magazine (2012). The data wise process: Statistical significance. Retrieved from https://www.gse.harvard.edu/news/ed/12/01/data-wise-process
Henderson, J., & Corry, M. (2020). Data literacy training and use for educational professionals. Journal of Research in Innovative Teaching and Learning, 12(10), Journal of Research in Innovative Teaching & Learning | Emerald Insight
Karner, T., Warwas, J., Krannich, M., & Weichsler, N. (2021). How does information consistency influence prospective teachers’ decisions about task difficulty assignments? A within-subject experiment to explain data-based decision-making in heterogeneous classes. Learning and Instruction, 74, https://kops.uni-konstanz.de/handle/123456789/52750
Kennedy-Clark, S., Galstaun, W., Reimann, P., Martyn, T., Weight, J., & Williamson, K. (2020). Voices on data literacy in initial teacher education: Pre-service teachers’ reflections and recommendations. Australian Journal of Teacher Education, 45(7), 60-76.
Kippers, W.B., Poortman, C.L., Schildkamp, K., & Visscher, A.J. (2018). Data literacy: What do educators learn and struggle with during a data use intervention? Studies in Educational Evaluation, 56, 21-31.
Lasater, K., Bengtson, E., & Albiladi, W.S. (2021). Data use for equity? How data practices incite definit thinking in schools. Studies in Educational Evaluation, 69. https://doi.org/10.1016/j.stueduc.2020.100845
Mandinach, E.B. (2012). A perfect time for data use: Using dat-driven decision making to inform practice. Educational Psychologist, 47(2), 71-85.
Mandinach, E.B., & Gummer, E. (2016). What does it mean for teachers to be data literate: Laying out the skills, knowledge and dispositions. Teaching and Teacher Education, retrieved from https://datafordecisions.wested.org/wp-content/uploads/2016/08/2016_What-Does-it-Mean-for-Teachers-to-be-Data-Literate.pdf
Mandinach, E.B., & Jimerson, J.B. (2016). Teachers learning how to use data: A synthesis of the issues and what is known. Teaching and Teacher Education, retrieved from https://datafordecisions.wested.org/wp-content/uploads/2016/08/2016_Teachers-Learning-How-to-Use-Data.pdf
Mandinach, E.B., & Schildkamp, K. (2021). Misconceptions about data-based decision making in education: An exploration of the literature. Studies in Educational Evaluation, 69, https://www.sciencedirect.com/science/article/pii/S0191491X1930416X
Marsh, J. A. (2012). Interventions promoting educators’ use of data: Research insights and gaps. Teachers College Record, 114(11), 1–48.
Masters, G. (2018). The role of evidence in teaching and learning. Australian Council for Educational Research, retrieved from https://research.acer.edu.au/cgi/viewcontent.cgi?article=1335&context=research_conference
Mavroudi, A., Papadakis, S., & Ioannou, I. (2021). Teachers’ views regarding learning analytics usage based on the Technology Acceptance Model. TechTrends, 65, 278-287. https://doi.org/10.1007/s11528-020-00580-7
Michos, K., Schmitz, M., & Petko, D. (2023). Teachers’ data literacy for learning analytics: A central predictor for digital data use in upper secondary schools. Education and Information Technologies. https://doi.org/10.1007/s10639-023-11772-y
Nespor, J. (1987). The role of beliefs in the practice of teaching. Journal of Curriculum Studies, 19(4), 317-328. https://doi.org/10.1080/0022027870190403
Pajares, M. F. (1992). Teachers’ Beliefs and Educational Research: Cleaning Up a Messy Construct. Review of Educational Research, 62(3), 307-332. https://doi.org/10.3102/00346543062003307
Popham, W.J. (2018). Assessment literacy for educators in a hurry. ASCD: Virginia.
Reeves, T.D., & Chiang, J. (2018). Online interventions to promote teacher data-driven decision making: Optimizing design to maximize impact. Studies in Educational Evaluation, 59, 256-269. https://doi.org/10.1016/j.stueduc.2018.09.006
Schildkamp, K., & Datnow, A. (2020). When data teams struggle: Learning from less successful data use efforts. Leadership and Policy in Schools. https://doi.org/10.1080/15700763.2020.1734630
Schildkamp, K., Poortman, C., Luyten, H., & Ebbeler, J. (2016). Factors promoting and hindering data-based decision making in schools. School Effectiveness and School Improvement, 28(2), 242=258. http://dx.doi.org/10.1080/09243453.2016.1256901
Sun, J., Przybylski, R., & Johnson, B. J. (2016). A review of research on teachers’ use of student data: From the perspective of school leadership. Educational Assessment, Evaluation and Accountability, 28(1), 5–33. https://doi.org/10.1007/s11092-016- 9238-9
Tian, L., Liu, Q., & Zhang, X. (2022). Self-regulated writing strategy use when revising upon automated, peer, and teacher feedback in an online English as a foreign language writing course. Frontiers in Psychology, 13. www.frontiersin.org
Vanlommel, K., Van Gasse, R., Vanhoof, J., & Van Petegem, P. (2017). Teachers’ decision-making: Data based or intuition driven? International Journal of Educational Research, 83, 75–83. http://dx.doi.org/10.1016/j.ijer.2017.02.013
Van Geel, M., Keuning, T., Visscher, A., & Fox, J. (2017). Changes in educators’ data literacy during a data-based decision making intervention. Teaching and Teacher Education, 64, 187-198.
Wilcox, G., Conde, C.F., & Kowbel, A. (2021). Using evidence-based practice and data-based decision making in inclusive education. Education Sciences, 11 (3), 129. https://doi.org/10.3390/educsci11030129
Woods, K., & Coles-Janess, B. (2018). Developmental assessment for students with additional needs. In G. Patrick (Eds.), Assessment for Teaching (pp.247-265). Cambridge University Press.
Young, C., McNamara, G., Brown, M., & O’Hara, J. (2018). Adopting and adapting: School leaders in the age of data-informed decision making. Educational Assessment, Evaluation and Accountability, 30(2), 133–158. https://doi.org/10.1007/s11092-018-9278-4
Zakaria, Z., Care, E., & Griffin, P. (2016). Scaffolding instruction where it matters: Teachers’ shift from deficit approach to developmental model of learning. Journal of Education and Practice, 7(23), 144-152.
Zakaria, Z., & Abdul Latif, A. (2023). Assessment strategies in empowering self-regulated learning in higher education: A systematic review. In N.A. Alias, S. R. Syed Aris, & H. Hashim (Eds.), Cases on responsive and responsible learning in higher education (pp. 323-337), IGI Global. https://www.igi-global.com/chapter/assessment-strategies-in-empowering-self-regulated-learning-in-higher-education/319556

(Zakaria & Latif, 2023)
Zakaria, Z., & Latif, A. A. (2023). Obstacles to Effective Data-based Interventions: A Systematic Review of Teachers’ Data Literacy. International Journal of Academic Research in Progressive Education and Development, 12(3), 1696-1713.