Journal Screenshot

International Journal of Academic Research in Progressive Education and Development

Open Access Journal

ISSN: 2226-6348

Artificial Intelligence Adoption in Authentic Online Assessments: A Study of Online Distance Learning Institutions

Rohaizak Omar, Zahir Osman, Ooi Li Hsien

http://dx.doi.org/10.6007/IJARPED/v14-i3/25864

Open access

This study explores the factors influencing the adoption of artificial intelligence (AI) in authentic online assessments within open and distance learning (ODL) institutions. Using the Theory of Planned Behaviour (TPB) as the underlying framework, the research examines the roles of attitude, perceived behavioural control, subjective norms, and self-efficacy in shaping educators’ intention to adopt AI, and how this intention affects actual adoption. Data were collected from 299 academic staff through an online survey, and the analysis was conducted using SmartPLS 4. The findings show that intention, perceived behavioural control, self-efficacy, and subjective norms significantly influence the adoption of AI. Among these, intention was the strongest predictor of adoption behaviour. In contrast, attitude did not have a significant effect on adoption. The study also confirmed the mediating role of intention between the independent variables and adoption behaviour. Additional analysis using PLSpredict and the cross-validated predictive ability test (CVPAT) demonstrated that the model has good predictive relevance. These findings suggest that building educators’ confidence, ensuring access to necessary tools, and fostering a supportive institutional culture are more effective in promoting AI adoption than focusing solely on positive attitudes. The study contributes to the theoretical understanding of technology adoption in education and offers practical guidance for ODL institutions aiming to implement AI-driven assessment strategies.

Ahadzadeh, A. S., Wu, S. L., & Xu, S. (2024). Exploring academic intentions for ChatGPT: A perspective from the theory of planned behavior. ASR: Chiang Mai University Journal of Social Sciences and Humanities, 11(2), 1–22. https://doi.org/10.12982/cmujasr.2024.016
Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50(2), 179–211. https://doi.org/10.1016/0749-5978(91)90020-T
Almogren, A. S., Al-Rahmi, W. M., & Dahri, N. A. (2024). Exploring factors influencing the acceptance of ChatGPT in higher education: A smart education perspective. Heliyon, 10(11), e31887. https://doi.org/10.1016/j.heliyon.2024.e31887
Arise, O. A., Muzuva, M., Kader, R., & Chohan, F. H. (2024, December). Ethical concerns of artificial intelligence in student assessments from a higher education perspective. In TFC 2024: The Focus Conference (pp. 234–254). Atlantis Press.
Au, K. A., & Enderwick, P. (2000). A cognitive model on attitude towards technology adoption. Journal of Managerial Psychology, 15(4), 266–282. https://doi.org/10.1108/02683940010330957
Chakabwata, W. (2025). Assessment in Higher Education in the Age of Artificial Intelligence: Possibilities and Constrictions in Africa. In S. Gregory (Ed.), Effective Instructional Design Informed by AI (pp. 221-248). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3693-6527-4.ch008
Chen, G., Gully, S. M., & Eden, D. (2001). Validation of a new general self-efficacy scale. Organizational Research Methods, 4(1), 62–83. https://doi.org/10.1177/109442810141004
Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159. https://doi.org/10.1037/0033-2909.112.1.155
De Cannière, M. H., De Pelsmacker, P., & Geuens, M. (2009). Relationship quality and the theory of planned behaviour models of behavioral intentions and purchase behavior. Journal of Business Research, 62(1), 82–92. https://doi.org/10.1016/j.jbusres.2008.01.006
Fu, H., Ye, B. H., & Xiang, J. (2016). Reality TV, audience travel intentions, and destination image. Tourism Management, 55, 37–48. https://doi.org/10.1016/j.tourman.2016.02.011
Gamage, K. A., Dehideniya, S. C., Xu, Z., & Tang, X. (2023). ChatGPT and higher education assessments: More opportunities than concerns? Journal of Applied Learning and Teaching, 6(2), 358–369.
Gundu, T. (2024). Strategies for e-assessments in the era of generative artificial intelligence. Electronic Journal of e-Learning, 22(7), 40–50.
Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2017). A primer on partial least squares structural equation modeling (PLS-SEM) (2nd ed.). SAGE.
Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2022). A primer on partial least squares structural equation modeling (PLS-SEM) (3rd ed.). SAGE.
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135. https://doi.org/10.1007/s11747-014-0403-8
Jin, F., Song, Z., Cheung, W. M., Lin, C. H., & Liu, T. (2024). Technological affordances in teachers’ online professional learning communities: A systematic review. Journal of Computer Assisted Learning, 40(3), 1019–1039. https://doi.org/10.1111/jcal.12935
Jin, Y., Yan, L., Echeverria, V., Gaševi?, D., & Martinez-Maldonado, R. (2025). Generative AI in higher education: A global perspective of institutional adoption policies and guidelines. Computers and Education: Artificial Intelligence, 8, 100348. https://doi.org/10.1016/j.caeai.2024.100348
Kabra, G., Ramesh, A., Akhtar, P., & Dash, M. K. (2017). Understanding behavioural intention to use information technology: Insights from humanitarian practitioners. Telematics and Informatics, 34(7), 1250–1261. https://doi.org/10.1016/j.tele.2017.05.010
Khlaif, Z. N., Ayyoub, A., Hamamra, B., Bensalem, E., Mitwally, M. A. A., Ayyoub, A., Hattab, M. K., & Shadid, F. (2024). University teachers’ views on the adoption and integration of generative AI tools for student assessment in higher education. Education Sciences, 14(10), 1090. https://doi.org/10.3390/educsci14101090
Kock, N. (2015). Common method bias in PLS-SEM: A full collinearity assessment approach. International Journal of e-Collaboration, 11(4), 1–10. https://doi.org/10.4018/ijec.2015100101
Kock, N., & Lynn, G. S. (2012). Lateral collinearity and misleading results in variance-based SEM: An illustration and recommendations. Journal of the Association for Information Systems, 13(7), 546–580. https://doi.org/10.17705/1jais.00302
Lee, C. (2022). Intention to use versus actual adoption of technology by university English language learners: What perceptions and factors matter? Computer Assisted Language Learning, 35(8), 2049–2077. https://doi.org/10.1080/09588221.2020.1857410
Li, X., Du, J., & Long, H. (2020). Mechanism for green development behavior and performance of industrial enterprises (GDBP-IE) using partial least squares structural equation modeling (PLS-SEM). International Journal of Environmental Research and Public Health, 17(22), 8450. https://doi.org/10.3390/ijerph17228450
Li, K., Li, Y., & Franklin, T. (2016). Pre-service teachers’ intention to adopt technology in their future classrooms. Journal of Educational Computing Research, 54(7), 946–966. https://doi.org/10.1177/0735633116641694
Liengaard, B. D., Sharma, P. N., Hult, G. T. M., Jensen, M. B., Sarstedt, M., Hair, J. F., & Ringle, C. M. (2021). Prediction: Coveted, yet forsaken? Introducing a cross-validated predictive ability test in partial least squares path modeling. Decision Sciences, 52(2), 362–392. https://doi.org/10.1111/deci.12367
Lin, H., & Chen, Q. (2024). Artificial intelligence (AI)-integrated educational applications and college students’ creativity and academic emotions: Students and teachers’ perceptions and attitudes. BMC Psychology, 12(1). Article 1. https://doi.org/10.1186/s40359-024-01979-0
Maistry, S. M., & Singh, U. G. (2025). Faculty perspectives on the role of ChatGPT-4.0 in higher education assessments. Journal of Education (University of KwaZulu-Natal), 98, 86–102.
Moxley, J., Sharit, J., & Czaja, S. J. (2022). The factors influencing older adults’ decisions surrounding adoption of technology: Quantitative experimental study. JMIR Aging, 5(4), e39890. https://doi.org/10.2196/39890
Nazaretsky, T., Ariely, M., Cukurova, M., & Alexandron, G. (2022). Teachers’ trust in AI-powered educational technology and a professional development program to improve it. British Journal of Educational Technology, 53(4), 914–931. https://doi.org/10.1111/bjet.13232
Owan, V. J., Abang, K. B., Idika, D. O., Etta, E. O., & Bassey, B. A. (2023). Exploring the potential of artificial intelligence tools in educational measurement and assessment. Eurasia Journal of Mathematics, Science and Technology Education, 19(8), em2307.
Ringle, C. M., & Sarstedt, M. (2016). Gain more insight from your PLS-SEM results: The importance-performance map analysis. Industrial Management & Data Systems, 116(9), 1865–1886. https://doi.org/10.1108/IMDS-10-2015-0449
Ringle, C. M., Wende, S., & Becker, J.-M. (2022). SmartPLS 4 [Computer software]. SmartPLS GmbH. https://www.smartpls.com
Rivis, A., & Sheeran, P. (2003). Descriptive norms as an additional predictor in the theory of planned behaviour: A meta-analysis. Current Psychology, 22(3), 218–233. https://doi.org/10.1007/s12144-003-1018-2
Roy, R., Babakerkhell, M. D., Mukherjee, S., Pal, D., & Funilkul, S. (2022). Evaluating the intention for the adoption of artificial intelligence-based robots in the university to educate the students. IEEE Access, 10, 125666–125678. https://doi.org/10.1109/ACCESS.2022.3225555
Sailer, M., Stadler, M., Schultz-Pernice, F., Franke, U., Schöffmann, C., Paniotova, V., Husagic, L., & Fischer, F. (2021). Technology-related teaching skills and attitudes: Validation of a scenario-based self-assessment instrument for teachers. Computers in Human Behavior, 115, 106625. https://doi.org/10.1016/j.chb.2020.106625
Sánchez-Prieto, J. C., Olmos-Migueláñez, S., & García-Peñalvo, F. J. (2017). M-learning and pre-service teachers: An assessment of the behavioral intention using an expanded TAM model. Computers in Human Behavior, 72, 644–654. https://doi.org/10.1016/j.chb.2016.09.061
Santini, F. de O., Ladeira, W. J., Sampaio, C. H., Perin, M. G., & Dolci, P. C. (2020). Propensity for technological adoption: An analysis of effect size in the banking sector. Behaviour & Information Technology, 39(12), 1341–1355. https://doi.org/10.1080/0144929X.2019.1667441
Sevnarayan, K., & Potter, M. A. (2024). Generative artificial intelligence in distance education: Transformations, challenges, and impact on academic integrity and student voice. Journal of Applied Learning and Teaching, 7(1). https://doi.org/10.37074/jalt.2024.7.1.33
Shmueli, G., Sarstedt, M., Hair, J. F., Cheah, J.-H., Ting, H., Vaithilingam, S., & Ringle, C. M. (2019). Predictive model assessment in PLS-SEM: Guidelines for using PLSpredict. European Journal of Marketing, 53(11), 2322–2347. https://doi.org/10.1108/EJM-02-2019-0189
Shmueli, G., Ray, S., Velasquez Estrada, J. M., & Chatla, S. B. (2016). The elephant in the room: Predictive performance of PLS models. Journal of Business Research, 69(10), 4552–4564. https://doi.org/10.1016/j.jbusres.2016.03.049
Singh, R., & Tewari, A. (2021). Modeling factors affecting online learning adoption: Mediating role of attitude. International Journal of Educational Management, 35(7), 1405–1420. https://doi.org/10.1108/IJEM-05-2021-0198
Tan, S. F., Din Eak, A., Ooi, L. H., & Abdullah, A. C. (2021). Relationship between learning strategies and academic performance: A comparison between accreditation of prior experiential learning (APEL) and regular entry undergraduates. Asian Association of Open Universities Journal, 16(2), 226–238. https://doi.org/10.1108/AAOUJ-08-2021-0081
Vlachopoulos, D. (2025). Authentic assessment: Bridging higher education and real-world skills through diverse methodologies. In INTED2025 Proceedings (pp. 2225–2234). IATED.
Voon, J. P., Ngui, K. S., & Agrawal, A. (2011). Determinants of willingness to purchase organic food: An exploratory study using structural equation modeling. International Food and Agribusiness Management Review, 14(1), 103–120.
Xia, Q., Weng, X., Ouyang, F., Lin, T. J., & Chiu, T. K. (2024). A scoping review on how generative artificial intelligence transforms assessment in higher education. International Journal of Educational Technology in Higher Education, 21(1), 40.
Yentür, M. M. (2023). The effect of geography teachers’ self-efficacy perceptions and attitudes toward teaching on their motivation. International Journal of Educational Research Review, 8(2), 360–367. https://doi.org/10.24331/ijere.1255100
Zhang, W., & Hou, Z. (2024). College teachers’ behavioral intention to adopt artificial intelligence assisted teaching systems. IEEE Access, 12, 152812–152824. https://doi.org/10.1109/ACCESS.2024.3445909
Zheng, X., Yin, H., & Liu, Y. (2021). Are professional learning communities beneficial for teachers? A multilevel analysis of teacher self-efficacy and commitment in China. School Effectiveness and School Improvement, 32(2), 197–217. https://doi.org/10.1080/09243453.2020.1808484

Omar, R., Osman, Z., & Hsien, O. L. (2025). Artificial Intelligence Adoption in Authentic Online Assessments: A Study of Online Distance Learning Institutions. International Journal of Academic Research in Progressive Education and Development, 14(3), 864–879.