Journal Screenshot

International Journal of Academic Research in Progressive Education and Development

Open Access Journal

ISSN: 2226-6348

Correlation between Students’ Expectations and Demographic Characteristics Toward Features of Learning Analytics System in Malaysia

Nur Raihan Che Nawi, Muhd Khaizer Omar, Nurfadhlina Mohd Sharef, Masrah Azrifah Azmi Murad, Evi Indriasari Mansor, Nurul Amelina Nasharuddin, Normalia Samian, Noreen Izza Arshad, Faaizah Shahbodin, Mohammad Hamiruce Marhaban

http://dx.doi.org/10.6007/IJARPED/v12-i2/16961

Open access

Learning analytics is the process of assessing, evaluating, and measuring student performance and the effectiveness of the teaching and learning process. This study investigates the relationship between three dimensions of learning analytics (summative, real-time, and predictive) and learning demographic characteristics (age, gender, categories of students, current semester, field of study, credit hours are taken in the current semester and CGPA). Questionnaires were distributed to 350 students enrolled in various programs at a public university in Malaysia. The study found that demographic profiles of the respondents which include age, gender, types of students, credit hours taken, concern for achievement, learning preferences, and learning motivation significantly contributed to learning analytic features. Additionally, the study revealed a strong and positive direction of learning analytic features: summative, real-time, and predictive based on the Pearson Correlation report. To comprehensively enhance the learning experience, the study recommends an extensive study related to learner profiling that considers intrinsic and extrinsic value such as assistive technology, learning performance, and motivation. The implications for other stakeholders such as teachers, learners, curriculum developers, and policymakers can be significant, as they can use learner profiling information to develop personalized learning plans, provide targeted support, design effective learning materials, and make informed education policy and funding decisions. A comprehensive understating of learner profiling and learning analytics can have far-reaching implications for various stakeholders in the education system, potentially leading to more personalized, effective, and equitable learning experiences for all learners.

Ahmed, N., & Azam, S. (2015). Faculty perception and experience of outcome-based education in Pakistan: An exploratory study. Journal of Education and Practice, 6(5), 38-44
Allen, I. E., & Seaman, J. (2014). Opening the curriculum: Open educational resources in U.S. higher education, 2014. Babson Survey Research Group.
Baker, R. S. (2019). Educational data mining and learning analytics. In J. Larusson & B. White (Eds.), Learning analytics: From research to practice (pp. 61-75). Springer.
Banta, T. W., & Palomba, C. A. (2015). Assessment essentials: Planning, implementing, and improving assessment in higher education (2nd ed.). Jossey-Bass.
Beldarrain, Y. (2006). Distance Education Trends: Integrating new technologies to foster student interaction and collaboration. Distance Education, 27(2), 139–153. https://doi.org/10.1080/01587910600789498
Biesta, G. (2010). Good education in an age of measurement: Ethics, politics, democracy. Boulder, CO: Paradigm Publishers.
Black, P., & William, D. (1998). Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan, 80(2), 139-148.
Brookhart, S. M. (2003). Developing measurement theory for classroom assessment purposes and uses. Educational Measurement: Issues and Practice, 22(4), 5-12.
Brown, N., Bock, A., May, J., & Scott, K. (2019). Graduate employability: Aligning outcomes, assessment and teaching in higher education. Teaching in Higher Education, 24(3), 280-295.
Boholano, H. (2017). Smart Social Networking: 21st Century Teaching and Learning Skills. Research in Pedagogy, 7(1), 21–29. https://doi.org/10.17810/2015.45
Chia, Y. F., & Eng, H. Y. (2021). Exploring the impact of digital divide on online learning during COVID-19 pandemic: A case study of Malaysia. Education and Information Technologies, 26(2), 2269-2289.
Collie, R. J., VaezMousavi, M., & Martin, A. J. (2021). Teaching demands, emotional exhaustion and disengagement among Australian teachers: Moderating effects of supportive leadership and mindfulness. British Journal of Educational Psychology, 91(2), 293-312.
Darling-Hammond, L., Hyler, M. E., & Gardner, M. (2017). Effective teacher professional development. Learning Policy Institute, 1-39.
Dawson, S., Joksimovic, S., Poquet, O., & Siemens, G. (2019). Increasing the Impact of Learning Analytics. Proceedings of the 9th International Conference on Learning Analytics & Knowledge, 446–455. https://doi.org/10.1145/3303772.3303784\
Dziuban, C. D., Moskal, P. D., Brophy-Ellison, J., & Shea, P. (2018). The future of learning management systems: Looking beyond the horizon. EDUCAUSE Review, 53(4), 44-62.
Elias, T. (2011). Learning analytics. Learning, 1-22. Retrieved June 9th, 2021 from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.456.7092&rep=rep1&type=pdf
Ewell, P. T. (2011). Assessment futures: Fostering institutional change. Change: The Magazine of Higher Learning, 43(1), 26-33.
Felder, R. M., & Brent, R. (2005). Understanding Student Differences. Journal of Engineering Education (Washington, D.C.), 94(1), 57–72. https://doi.org/10.1002/j.2168-9830.2005.tb00829.x
Fendri, A., & Alshammari, R. (2018). Classroom Challenges: Teachers’ Perceptions and Coping Strategies. English Language Teaching, 11(6), 126-137. https://doi.org/10.5539/elt.v11n6p126
Ferguson, R. (1998). Can distance education ever be redeemed? E-Journal of Instructional Science and Technology, 1(1), 1-11.
Ferguson, R. (2012). Learning analytics: drivers, developments and challenges. International Journal of Technology Enhanced Learning, 4(5-6), 304-317.
Field, A. (2016). Discovering Statistics Using IBM SPSS Statistics (4th Edit.). SAGE Publications Ltd.
Foucault-Welles, B., González, C., & Taylor, A. (2020). Equity in the time of coronavirus: How can we learn from this global pandemic? Journal of Information Policy, 10, 379-384.
Gasevic, D. (2017). Learning analytics: From measurement to action. Journal of Learning Analytics, 4(3), 1-3.
Gasevic, D., Kovanovic, V., Joksimovic, S., & Siemens, G. (2014). Where is research on massive open online courses headed? A data analysis of the MOOC research initiative. The International Review of Research in Open and Distributed Learning, 15(5)
Glatthorn, A. A., Boschee, F., & Whitehead, B. M. (2018). Curriculum leadership: Strategies for development and implementation. Sage Publications.
Hair, J. H., Black, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate Data Analysis. In Pearson New International Edition (Seventh Ed). Pearson Education Limited. https://doi.org/10.4324/9781351269360
Han, J., Park, J., & Kim, S. (2020). Understanding challenges in implementing flipped learning: a systematic review. Educational Technology Research and Development, 68(2), 503-528. https://doi.org/10.1007/s11423-019-09720-3
Hargreaves, A., & Shirley, D. (2018). The global fourth way: The quest for educational excellence. Corwin Press.
Heritage, M. (2010). Formative assessment: Making it happen in the classroom. Thousand Oaks, CA: Corwin.
Ifenthaler, D., & Widanapathirana, C. (2014). Development and Validation of a Learning Analytics Framework: Two Case Studies Using Support Vector Machines. Technology, Knowledge and Learning, 19(1), 221–240. https://doi.org/10.1007/s10758-014-9226-4
Jacobsen, D. A. (2017). Curriculum design: A guide to curriculum development and planning. Sage Publications.
Jaggars, S. S., Edgecombe, N., & Stacey, G. W. (2014). What we know about online course outcomes. Community College Research Center, Teachers College, Columbia University.
Jankowski, N. A., & Holas, I. B. (2019). Socrative in the flipped classroom: Impact on student achievement and attitudes towards flipped learning. Education Sciences, 9(4), 279.Jovanovic, J., Gasevic, D., Pardo, A., & Dawson, S. (2017). Guest editorial: Learning analytics for 21st-century competencies. Journal of Educational Technology & Society, 20(3), 1-3.
Johnson, L. (2014). NMC horizon report: 2014 higher education edition. New Media Consortium.
Jovanovic, J., Gasevic, D., Dawson, S., Pardo, A., & Mirriahi, N. (2017). Learning analytics in higher education–challenges and policies: A review of eight learning analytics policy documents. Australasian Journal of Educational Technology, 33(3).
Kalyani, D., & Rajasekaran, K. (2018). Innovative teaching and learning. Journal of applied and advanced research, 3(1), 23-25.
Kay, R., & Lauricella, S. (2011). Exploring the benefits and challenges of using laptop computers in higher education classrooms: A formative analysis. Canadian Journal of Learning and Technology, 37(1), 1-18.
Kim, E., & Lim, D. H. (2019). Instructor Presence in Online Courses and Students’ Perceived Learning: A Case Study of Korean Higher Education. Journal of Educational Technology & Society, 22(1), 246-258. https://www.jstor.org/stable/26924923
Kozleski, E. B., & Engelbrecht, P. (2016). Inclusive education in international contexts: The role of teacher preparation programs. Journal of Teacher Education for Sustainability, 18(2), 64-73.
Kuh, G. D., & Kinzie, J. (2008). Connecting the dots: Multi-faceted analyses of student engagement. In R. P. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 13-43). Springer
Kuo, Y.-C., Walker, A. E., Schroder, K. E. E., & Belland, B. R. (2013). Interaction, Internet self-efficacy, and self-regulated learning as predictors of student satisfaction in online education courses. The Internet and Higher Education, 18, 1-10.
Kovanovic, V., Gasevic, D., Joksimovic, S., Hatala, M., & Adesope, O. (2015). Analytics of communities of inquiry: Effects of learning technology use on cognitive presence in asynchronous online discussions. The Internet and Higher Education, 27, 74-8
Lang, C., Siemens, G., Wise, A., & Gasevic, D. (Eds.). (2017). Handbook of learning analytics. New York, NY, USA: SOLAR, Society for Learning Analytics and Research.
Larkin, H., & deMarrais, K. (2010). The complexity of curriculum integration. Journal of Curriculum Studies, 42(4), 509-528.
Lee, R. M., & Yuan, Y. S. (2018). Innovation education in China: Preparing attitudes, approaches, and intellectual environments for life in the automation economy. In Higher education in the era of the fourth industrial revolution (pp. 93-119). Palgrave Macmillan, Singapore.
Leitner, P., Khalil, M., & Ebner, M. (2017). Learning analytics in higher education—a literature review. Learning analytics: Fundaments, applications, and trends, 1-23.
Li, C., & Lalani, F. (2020). The COVID-19 pandemic has changed education forever. This is how. World Economic Forum.
Lockyer, L., Heathcote, E., & Dawson, S. (2013). Informing Pedagogical Action: Aligning Learning Analytics with Learning Design. The American Behavioral Scientist (Beverly Hills), 57(10), 1439–1459. https://doi.org/10.1177/0002764213479367
Long, P., & Siemens, G. (2011). Penetrating the fog: Analytics in learning and education. Educause Review, 46(5), 30-32.
Lu, Y., Zhang, S., Zhang, Z., Xiao, W., & Yu, S. (2017). A Framework for Learning Analytics Using Commodity Wearable Devices. Sensors (Basel, Switzerland), 17(6), 1382–. https://doi.org/10.3390/s17061382
Mahadiraja, D., & Syamsuarnis, S. (2020). Pengembangan Modul Pembelajaran Berbasis Daring pada Mata Pelajaran Instalasi Penerangan Listrik Kelas XI Teknik Instalasi Tenaga Listrik TP 2019/2020 di SMK Negeri 1 Pariaman. JTEV (Jurnal Teknik Elektro dan Vokasional), 6(1), 77-82.
Maseleno, A., Sabani, N., Huda, M., Ahmad, R., Azmi Jasmi, K., & Basiron, B. (2018). Demystifying Learning Analytics in Personalised Learning. International Journal of Engineering & Technology (Dubai), 7(3), 1124–. https://doi.org/10.14419/ijet.v7i3.9789
McMillan, J. H. (2018). Classroom assessment: Principles and practice for effective standards-based instruction (7th ed.). Pearson.
Meyers, L. S., Gamst, G. C., & Guarino, A. J. (2013). Performing data analysis using IBM SPSS (1st ed.). Wiley.
Murray, J. P., & Olcott, D. J. (2019). Using curriculum mapping and assessment data to improve learning. Corwin Press.
Ngidi, D. P., & Ndebele, N. T. (2019). Factors affecting the implementation of outcomes-based education in South African universitites. Afrixa Eduation Review, 16(2), 50-65.
Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in higher education, 31(2), 199-218.
Nopriyanti, N., & Sudira, P. (2015). Pengembangan multimedia pembelajaran interaktif kompetensi dasar pemasangan sistem penerangan dan wiring kelistrikan di SMK. Jurnal Pendidikan Vokasi, 5(2), 222–235. https://doi.org/10.21831/jpv.v5i2.6416
Nurdyasnyah, N., & Andiek, W. (2015). Inovasi teknologi pembelajaran. Retrieved April 5th, 2021 from http://eprints.umsida.ac.id/id/eprint/305
Oblinger, D. G. (2003). Boomers, Gen-Xers, and Millennials: Understanding the “New Students”. EDUCAUSE Review, 38(4), 36-45.
Ochoa, X. (2017). Multimodal learning analytics. The handbook of learning analytics, 1, 129-141.
Orlich, D. C., Harder, R. J., Callahan, R. C., & Gibson, H. W. (2017). Teaching strategies: A guide to effective instruction. Cengage Learning.
Papamitsiou, Z., & Economides, A. A. (2014). Learning Analytics and Educational Data Mining in Practice: A Systematic Literature Review of Empirical Evidence. Educational Technology & Society, 17(4), 49–64.
Pardo, A., Jovanovic, J., Dawson, S., Gaševi?, D., & Mirriahi, N. (2019). Using learning analytics to scale the provision of personalised feedback. British Journal of Educational Technology, 50(1), 128–138. https://doi.org/10.1111/bjet.12592
Popenici, S. A. D., & Kerr, S. (2017). Exploring the impact of artificial intelligence on teaching and learning in higher education. Research and Practice in Technology Enhanced Learning, 12(1), 1–13. https://doi.org/10.1186/s41039-017-0062-8
Reid, I., & Ward, R. (2015). The importance of engagement in tertiary education. In S. J. Newstead, D. H. Denton, & M. E. Dennis (Eds.), HERDSA 2015 Conference: Learning for life and work in a complex world (pp. 267-276). Higher Education Research and Development Society of Australasia.
Rodzalan, S. A., & Saat, M. M. (2015). The Perception of Critical Thinking and Problem Solving Skill among Malaysian Undergraduate Students. Procedia, Social and Behavioral Sciences, 172, 725–732. https://doi.org/10.1016/j.sbspro.2015.01.425
Salinas, J., & Villalon, J. (2020). Enhancing online teaching and learning with H5P. Journal of Educational Technology Development and Exchange, 13(1), 1-14.
Schumacher, C., & Ifenthaler, D. (2018). Features students really expect from learning analytics. Computers in Human Behavior, 78, 397–407. https://doi.org/10.1016/j.chb.2017.06.030
Scriven, M. (1972). Prospects for evaluation: Evaluator bias. Evaluation Comment, 1(2), 1-5.
Sengupta, P., & Chudgar, A. (2016). Teacher professional development in emerging economies: Learning from India. Professional Development in Education, 42(3), 365-379.
Sharef, N. M., Azmi Murad, M. A., Mansor, E. I., Nasharuddin, N. A., Omar, M. K., Samian, N., Arshad, N. I., Ismail, W., & Shahbodin, F. (2020). Learning-Analytics based Intelligent Simulator for Personalised Learning. 2020 International Conference on Advancement in Data Science, E-Learning and Information Systems (ICADEIS), 1–6. https://doi.org/10.1109/ICADEIS49811.2020.9276858
Shibani, A., Knight, S., & Buckingham Shum, S. (2020). Educator perspectives on learning analytics in classroom practice. The Internet and Higher Education, 46, 100730–. https://doi.org/10.1016/j.iheduc.2020.100730
Shum, S. B., & Ferguson, R. (2012). Social Learning Analytics. Educational Technology & Society, 15(3), 3–26.
Shroff, R. H., Vogel, D. R., Coombes, J., & Avner, J. R. (2016). Student satisfaction and perceived learning with on-line courses: Principles and examples from the SUNY Learning Network. Journal of Educational Technology & Society, 19(3), 142-154.
Siemens, G. (2008). Learning and knowing in networks: Changing roles for educators and designers. ITForum, paper 1, 1-16.
Siemens, G. (2013). Learning analytics: The emergence of a discipline. American Behavioral Scientist, 57(10), 1380-1400.
Silber?Varod, V., Eshet?Alkalai, Y., & Geri, N. (2019). Tracing research trends of 21st?century learning skills. British Journal of Educational Technology, 50(6), 3099–3118. https://doi.org/10.1111/bjet.12753
Singh, S., Srivastava, S., & Singh, S. (2020). Challenges and opportunities in higher education amidst COVID-19 pandemic. International Journal of Research in Humanities, Arts and Literature, 8(3), 198-205
Stiggins, R. (2004). New assessment beliefs for a new school mission. Phi Delta Kappan, 86(1), 22-27.
Tomlinson, C. A. (2014). Differentiated classroom: Responding to the needs of all learners. ASCD.
Tsai, Y. S., & Gasevic, D. (2017, March). Learning analytics in higher education---challenges and policies: a review of eight learning analytics policies. In Proceedings of the seventh international learning analytics & knowledge conference (pp. 233-242)
UNESCO. (2020). COVID-19 educational disruption and response. Retrieved from https://en.unesco.org/covid19/educationresponse
Van Ginkel, S., Gulikers, J., Biemans, H., Mulder, M., & Mulder, M. (2018). The effectiveness of a constructive alignment intervention in higher education: A longitudinal study. Studies in Educational Evaluation, 56, 89-99.
Verbert, K., Manouselis, N., chsler, H., & Duval, E. (2012). Dataset-Driven Research to Support Learning and Knowledge Analytics. Educational Technology & Society, 15(3), 133–148.
Viberg, O., Hatakka, M., Balter, O., & Mavroudi, A. (2018). The current landscape of learning analytics in higher education. Computers in Human Behavior, 89, 98–110. https://doi.org/10.1016/j.chb.2018.07.027
Victoroff, K. Z., & Hogan, S. (2006). Students’ perceptions of effective learning experiences in dental school: a qualitative study using a critical incident technique. Journal of Dental Education, 70(2), 124-132.
Vieira, C., Parsons, P., & Byrd, V. (2018). Visual learning analytics of educational data: A systematic literature review and research agenda. Computers and Education, 122, 119–135. https://doi.org/10.1016/j.compedu.2018.03.018
Wiles, J., & Bondi, J. C. (2019). Curriculum development: A guide to practice. Pearson.

In-Text Citation: (Che Nawi et al., 2023)
To Cite this Article: Che Nawi, N. R., Omar, M. K., Sharef, N. M., Murad, M. A. A., Mansor, E. I., Nasharuddin, N. A., Samian, N., Arshad, N. I., Shahbodin, F., & Marhaban, M. H. (2023). Correlation between Students’ Expectations and Demographic Characteristics Toward Features of Learning Analytics System in Malaysia. International Journal of Academic Research in Progressive Education and Development, 12(2), 1073–1096.