ISSN: 2226-6348
Open access
Increased adoption of educational technologies, the emergence of digital classroom concepts, and the interest in big data innovations have led to a growing awareness of the potential implementation of learning analytics to support learning development in educational institutions. However, most studies have focused on the implementation of learning analytics in higher education. As a result, research evidence and studies on actual and ongoing implementation in pre-higher education are still scarce. Therefore, there is a need to understand better the implementation of learning analytics at primary and secondary from the current learning analytics literature. This systematic literature review (SLR) aimed to identify learning analytics research that focuses on implementing learning analytics at pre-higher education levels, including in pre-school, primary, or secondary school. This SLR was carried out based on the SALSA framework to determine the protocol, search, appraisal, synthesis, analysis, and reporting approaches. The findings of the SLR support the arguments that the implementation of learning analytics in school is still in its infancy, where the implementation has been observed mostly in developed countries. Most of the Implementation is aimed at descriptive analytics, focusing on the purpose of monitoring, analysis, and feedback. The literature review has shown a lack of research on the implementation of learning analytics at the primary and secondary education levels.
Abdusyakur, I. (2015). Data-based decision making in the school environment: a study on data use in Indonesian primary schools [University of Twente].
http://essay.utwente.nl/68368/
Admiraal, W., Vermeulen, J., & Bulterman-Bos, J. (2020). Teaching with learning analytics: How to connect computer-based assessment data with classroom instruction? Technology, Pedagogy and Education, 29(5), 577–592.
https://doi.org/10.1080/1475939X.2020.1825992
Avella, J. T., Kebritchi, M., Nunn, S. G., & Kanai, T. (2016). Learning Analytics in Distance Education: A Systematic Literature Review. Online Learning, 20(2), 13–29.
Blumenstein, M. (2020). Synergies of learning analytics and learning design: A systematic review of student outcomes. Journal of Learning Analytics, 7(3), 13–32. https://doi.org/10.18608/JLA.2020.73.3
Booth, A., Papaioannou, D., & Sutton, A. (2014). Systematic Approaches to a Successful Literature Review. In Journal of the Canadian Health Libraries Association / Journal de l’Association des bibliothèques de la santé du Canada (Vol. 34, Issue 1). https://doi.org/10.5596/c13-009
Brun, A., Bonnin, G., Castagnos, S., Roussanaly, A., & Boyer, A. (2019). Learning analytics made in France: the METAL project. International Journal of Information and Learning Technology, 36(4), 299–313. https://doi.org/10.1108/IJILT-02-2019-0022
Campos, F., Ahn, J., DiGiacomo, D. K., Nguyen, H., & Hays, M. (2021). Making Sense of Sense-making: Understanding How K–12 Teachers and Coaches React to Visual Analytics. Journal of Learning Analytics, 7750, 1–21. https://doi.org/10.18608/jla.2021.7113
Chatti, A. M., Lukarov, V., Thüs, H., Muslim, A., Yousef, F. A. M., Wahid, U., Greven, C., Chakrabarti, A., & Schroeder, U. (2014). Learning Analytics: Challenges and Future Research Directions. Eleed, 10(1).
Cloude, E. B., Carpenter, D., Dever, D. A., Azevedo, R., & Lester, J. (2021). Game-based learning analytics for supporting adolescents’ reflection. Journal of Learning Analytics, 8(2), 51–72. https://doi.org/10.18608/JLA.2021.7371
Dickler, R., Gobert, J., & Pedro, M. S. (2021). Using innovative methods to explore the potential of an alerting dashboard for science inquiry. Journal of Learning Analytics, 8(2), 105–122. https://doi.org/10.18608/JLA.2021.7153
Ebbeler, J., Poortman, C. L., Schildkamp, K., & Pieters, J. M. (2017). The effects of a data use intervention on educators’ satisfaction and data literacy. Educational Assessment, Evaluation and Accountability, 29(1), 83–105. https://doi.org/10.1007/s11092-016-9251-z
Emara, M., Hutchins, N., Grover, S., Snyder, C., & Biswas, G. (2021). Examining Student Regulation of Collaborative, Computational, Problem-Solving Processes in Open-Ended Learning Environments. Journal of Learning Analytics, 8(1), 49–74.
https://doi.org/10.18608/jla.2021.7230
Ferguson, R., Sharkey, M., & Mirriahi, N. (2016). Lak16 - Practitioner Track Proceedings. 25–29.
Ferguson, R. (2012). Learning analytics: Drivers, developments and challenges. International Journal of Technology Enhanced Learning, 4(5–6), 304–317.
https://doi.org/10.1504/IJTEL.2012.051816
Fernández-Soriano, F. L., López, B., Martínez-España, R., Muñoz, A., & Cantabella, M. (2019). Use of computing devices as sensors to measure their impact on primary and secondary students’ performance. Sensors (Switzerland), 19(14).
https://doi.org/10.3390/s19143226
Gartner. (2022). Descriptive Analytics. https://www.gartner.com/en/information-technology/glossary/descriptive-analytics#:~:text=Descriptive Analytics is the examination,%2C tables%2C or generated narratives.
Grover, S., Basu, S., Bienkowski, M., Eagle, M., Diana, N., & Stamper, J. (2017). A framework for using hypothesis-driven approaches to support data-driven learning analytics in measuring computational thinking in block-based programming environments. ACM Transactions on Computing Education, 17(3). https://doi.org/10.1145/3105910
Herodotou, C., Rienties, B., Boroowa, A., Zdrahal, Z., & Hlosta, M. (2019). A large-scale implementation of predictive learning analytics in higher education: the teachers’ role and perspective. In Educational Technology Research and Development (Vol. 67, Issue 5). Springer US. https://doi.org/10.1007/s11423-019-09685-0
Holstein, K., McLaren, B. M., & Aleven, V. (2019). Co-designing a real-time classroom orchestration tool to support teacher–ai complementarity. Journal of Learning Analytics, 6(2), 27–52. https://doi.org/10.18608/jla.2019.62.3
Hu, X., Cheong, C. W. L., Ding, W., & Woo, M. (2017). A systematic review of studies on predicting student learning outcomes using learning analytics. ACM International Conference Proceeding Series, December 2019, 528–529.
https://doi.org/10.1145/3027385.3029438
Ifenthaler, D., & Yau, J. Y. K. (2020). Utilising learning analytics to support study success in higher education: a systematic review. In Educational Technology Research and Development (Vol. 68, Issue 4). Springer US. https://doi.org/10.1007/s11423-020-09788-z
Khan, S. U., Bangash, S. A. K., & Khan, K. U. (2017). Learning analytics in the era of big data: A systematic literature review protocol. 2017 International Symposium on Wireless Systems and Networks, ISWSN 2017, 2018-Janua, 1–7.
https://doi.org/10.1109/ISWSN.2017.8250033
Knoop-van Campen, C. A. N., Wise, A., & Molenaar, I. (2021). The equalising effect of teacher dashboards on feedback in K-12 classrooms. Interactive Learning Environments, 0(0), 1–17. https://doi.org/10.1080/10494820.2021.1931346
Koh, E., Jonathan, C., & Tan, J. P. L. (2019). Exploring conditions for enhancing critical thinking in networked learning: Findings from a secondary school learning analytics environment. Education Sciences, 9(4). https://doi.org/10.3390/educsci9040287
Kovanovic, V., Mazziotti, C., & Lodge, J. (2021). Learning analytics for primary and secondary schools. Journal of Learning Analytics, 8(2), 1–5.
https://doi.org/10.18608/JLA.2021.7543
Kovanovic, V., Tsai, Y.-S., & Gasevic, D. (2019). Learning analytics adoption – approaches and maturity. 9th International Conference on Learning Analytics and Knowledge (LAK’19), January, 153–154.
Li, C., & Lalani, F. (2020). The COVID-19 pandemic has changed education forever. This is how. World Economic Forum. https://www.weforum.org/agenda/2020/04/coronavirus-education-global-covid19-online-digital-learning/
Macarini, L. A., Lemos dos Santos, H., Cechinel, C., Ochoa, X., Rodés, V., Pérez Casas, A., Lucas, P. P., Maya, R., Alonso, G. E., & Díaz, P. (2020). Towards the implementation of a countrywide K-12 learning analytics initiative in Uruguay. Interactive Learning Environments, 28(2), 166–190. https://doi.org/10.1080/10494820.2019.1636082
Mandinach, E. B., & Gummer, E. S. (2016). What does it mean for teachers to be data literate: Laying out the skills, knowledge, and dispositions. Teaching and Teacher Education, 60, 366–376. https://doi.org/10.1016/j.tate.2016.07.011
Martin, C. K., Nacu, D., & Pinkard, N. (2016). Revealing Opportunities for 21st Century Learning: An Approach to Interpreting User Trace Log Data. Journal of Learning Analytics, 3(2), 37–87. https://doi.org/10.18608/jla.2016.32.4
Mokhtar, S., Alshboul, J. A. Q., & Shahin, G. O. A. (2019). Towards Data-driven Education with Learning Analytics for Educator 4.0. Journal of Physics: Conference Series, 1339(1), 0–7. https://doi.org/10.1088/1742-6596/1339/1/012079
Molenaar, I., Knoop-Van Campen, C. A. N., & Hasselman, F. (2017). The effects of a learning analytics empowered technology on students’ arithmetic skill development. ACM International Conference Proceeding Series, 614–615.
https://doi.org/10.1145/3027385.3029488
Pardimin, Apriadi, Ninsiana, W., Ihsan Dacholfany, M., Kamar, K., Kamarul Shukri, M. T., Huda, M., Hananto, A. L., Muslihudin, M., Shankar, K., Kamenez, N. V., & Maseleno, A. (2018). Developing multimedia application model for basic mathematics learning. Journal of Advanced Research in Dynamical and Control Systems, 10(14), 1347–1356.
Pargman, T. C., & Mcgrath, C. (2021). Mapping the Ethics of Learning Analytics in Higher Education?: A Systematic Literature Review of Empirical Research. 7750, 1–17.
Picciano, A. G. (2012). The evolution of big data and learning analytics in american higher education. Journal of Asynchronous Learning Network, 16(3), 9–20.
https://doi.org/10.24059/olj.v16i3.267
Ponciano, J. R., Linhares, C. D. G., Melo, S. L., Lima, L. V., & Travençolo, B. A. N. (2020). Visual analysis of contact patterns in school environments. Informatics in Education, 19(3), 455–472. https://doi.org/10.15388/infedu.2020.20
Prasad, D., Totaram, R., & Usagawa, T. (2016). Development of open textbooks learning analytics system. International Review of Research in Open and Distance Learning, 17(5), 215–234. https://doi.org/10.19173/irrodl.v17i5.2541
Prieto, L. P., Dimitriadis, Y., Jong, T. De, & Gillet, D. (2021). ADA for IBL?: Lessons Learned in Aligning Learning Design and Analytics for Inquiry-Based Learning Orchestration. 8(2), 22–50.
Ramli, I. S. M., Maat, S. M., & Khalid, F. (2020). The impacts of learning analytics on primary level mathematics curriculum. Universal Journal of Educational Research, 8(5), 95–99. https://doi.org/10.13189/ujer.2020.081914
Rau, M. A. (2017). How do Students Learn to See Concepts in Visualisations? Social Learning Mechanisms with Physical and Virtual Representations. Journal of Learning Analytics, 4(2), 240–263. https://doi.org/10.18608/jla.2017.42.16
Scaradozzi, D., Cesaretti, L., Screpanti, L., & Mangina, E. (2020). Identification of the Students Learning Process During Education Robotics Activities. Frontiers in Robotics and AI, 7(March), 1–12. https://doi.org/10.3389/frobt.2020.00021
SOLAR. (2011). Learning Analytics. https://www.solaresearch.org/about/what-is-learning-analytics/
SOLAR, S. of L. A. R. (2020). Special Section on Learning Analytics for Primary and Secondary Schools-Call for Papers. https://learning-
analytics.info/index.php/JLA/announcement/view/161
Sousa, E. B. G. de, Alexandre, B., Ferreira Mello, R., Pontual Falcão, T., Vesin, B., & Gaševi?, D. (2021). Applications of Learning Analytics in High Schools: A Systematic Literature Review. Frontiers in Artificial Intelligence, 4(September), 1–14.
https://doi.org/10.3389/frai.2021.737891
Tan, J. P.-L., Koh, E., Jonathan, C. R., & Yang, S. (2017). Learner Dashboards a Double-Edged Sword? Students’ Sense-Making of a Collaborative Critical Reading and Learning Analytics Environment for Fostering 21st Century Literacies. Journal of Learning Analytics, 4(1), 117–140. https://doi.org/10.18608/jla.2017.41.7
Van Leeuwen, A., Knoop-Van Campen, C. A. N., Molenaar, I., & Rummel, N. (2021). How teacher characteristics relate to how teachers use dashboards: Results from two case studies in k–12. Journal of Learning Analytics, 8(2), 6–21.
https://doi.org/10.18608/JLA.2021.7325
Van Leeuwen, A., Rummel, N., & van Gog, T. (2019). What information should CSCL teacher dashboards provide to help teachers interpret CSCL situations? International Journal of Computer-Supported Collaborative Learning, 14(3), 261–289.
https://doi.org/10.1007/s11412-019-09299-x
Wise, A. F., & Vytasek, J. (2017). Learning Analytics Implementation Design. Handbook of Learning Analytics, 151–160. https://doi.org/10.18608/hla17.013
Yan, L., Martinez-Maldonado, R., Cordoba, B. G., Deppeler, J., Corrigan, D., Nieto, G. F., & Gasevic, D. (2021). Footprints at school: Modelling in-class social dynamics from students’ physical positioning traces. ACM International Conference Proceeding Series, April, 43–54. https://doi.org/10.1145/3448139.3448144
In-Text Citation: (Abdullah et al., 2022)
To Cite this Article: Abdullah, S. H., Puad, M. H. M., Murad, M. A. A., & Marlisah, E. (2022). Implementation of Learning Analytics in Primary and Secondary School: A Systematic Literature Review. International Journal of Academic Research in Progressive Education and Development. 11(2), 911 – 928.
Copyright: © 2022 The Author(s)
Published by Human Resource Management Academic Research Society (www.hrmars.com)
This article is published under the Creative Commons Attribution (CC BY 4.0) license. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this license may be seen at: http://creativecommons.org/licences/by/4.0/legalcode