ISSN: 2226-6348
Open access
University responses to generative artificial intelligence (GenAI) require evidence about the specific capabilities students perceive themselves to possess. This cross-sectional study examined overall, domain, and item-level self-reports among 616 undergraduates recruited through 18 universities in Shandong, China. A contextually adapted 12-item measure assessed awareness, use, evaluation, and ethics. Descriptive statistics and response distributions were interpreted alongside internal-consistency and confirmatory factor analyses. Overall literacy averaged 3.495 on a five-point scale (SD = 0.650); domain means were 3.688 for ethics, 3.477 for awareness, 3.423 for evaluation, and 3.392 for use. Cronbach’s alpha was .900 overall and .821–.874 across domains. Positive-direction responses accounted for 61.2%–64.9% on ethics items, 45.9%–48.1% on use items, and 45.5%–50.8% on evaluation items. Midpoint responses represented 37.5% for proficient academic use and 38.8% for evaluating capabilities and limitations. Item distributions thus qualified the positive overall mean by locating specific areas of more reserved self-appraisal. The findings support connecting practical application with evaluation and examining how ethical commitments translate into academic decisions. They provide contextual evidence for planning follow-up assessment, while voluntary recruitment and self-report measurement limit population and proficiency claims.
Ahmad, N. H., Hanid, M. F. A., & Zakaria, M. I. (2026). Understanding AI-supported personalised learning in research writing: A systematic review of technologies, pedagogy, and learning outcomes. International Journal of Academic Research in Progressive Education and Development, 15(2), 65–96. https://doi.org/10.6007/IJARPED/v15-i2/28013
Almassaad, A., Alajlan, H., & Alebaikan, R. (2024). Student perceptions of generative artificial intelligence: Investigating utilization, benefits, and challenges in higher education. Systems, 12(10), Article 385. https://doi.org/10.3390/systems12100385
Almatrafi, O., Johri, A., & Lee, H. (2024). A systematic review of AI literacy conceptualization, constructs, and implementation and assessment efforts (2019–2023). Computers and Education Open, 6, Article 100173. https://doi.org/10.1016/j.caeo.2024.100173
Bewersdorff, A., Nerdel, C., & Zhai, X. (2025). How AI literacy correlates with affective, behavioral, cognitive and contextual variables: A systematic review. Computers and Education: Artificial Intelligence, 9, Article 100493. https://doi.org/10.1016/j.caeai.2025.100493
Carolus, A., Koch, M. J., Straka, S., Latoschik, M. E., & Wienrich, C. (2023). MAILS – Meta AI literacy scale: Development and testing of an AI literacy questionnaire based on well-founded competency models and psychological change- and meta-competencies. Computers in Human Behavior: Artificial Humans, 1(2), Article 100014. https://doi.org/10.1016/j.chbah.2023.100014
Chan, C. K. Y. (2023). A comprehensive AI policy education framework for university teaching and learning. International Journal of Educational Technology in Higher Education, 20, Article 38. https://doi.org/10.1186/s41239-023-00408-3
Chan, C. K. Y., & Hu, W. (2023). Students’ voices on generative AI: Perceptions, benefits, and challenges in higher education. International Journal of Educational Technology in Higher Education, 20, Article 43. https://doi.org/10.1186/s41239-023-00411-8
Hornberger, M., Bewersdorff, A., Schiff, D. S., & Nerdel, C. (2025a). A multinational assessment of AI literacy among university students in Germany, the UK, and the US. Computers in Human Behavior: Artificial Humans, 4, Article 100132. https://doi.org/10.1016/j.chbah.2025.100132
Hornberger, M., Bewersdorff, A., Schiff, D. S., & Nerdel, C. (2025b). Development and validation of a short AI literacy test (AILIT-S) for university students. Computers in Human Behavior: Artificial Humans, 5, Article 100176. https://doi.org/10.1016/j.chbah.2025.100176
Jin, Y., Martinez-Maldonado, R., Gaševi?, D., & Yan, L. (2025). GLAT: The generative AI literacy assessment test. Computers and Education: Artificial Intelligence, 9, Article 100436. https://doi.org/10.1016/j.caeai.2025.100436
Laupichler, M. C., Aster, A., Schirch, J., & Raupach, T. (2022). Artificial intelligence literacy in higher and adult education: A scoping literature review. Computers and Education: Artificial Intelligence, 3, Article 100101. https://doi.org/10.1016/j.caeai.2022.100101
Lintner, T. (2024). A systematic review of AI literacy scales. npj Science of Learning, 9, Article 50. https://doi.org/10.1038/s41539-024-00264-4
Long, D., & Magerko, B. (2020). What is AI literacy? Competencies and design considerations. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (pp. 1–16). Association for Computing Machinery. https://doi.org/10.1145/3313831.3376727
Meade, A. W., & Craig, S. B. (2012). Identifying careless responses in survey data. Psychological Methods, 17(3), 437–455. https://doi.org/10.1037/a0028085
Miao, F., & Holmes, W. (2023). Guidance for generative AI in education and research. UNESCO. https://doi.org/10.54675/EWZM9535
Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021). Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence, 2, Article 100041. https://doi.org/10.1016/j.caeai.2021.100041
Ng, D. T. K., Wu, W., Leung, J. K. L., Chiu, T. K. F., & Chu, S. K. W. (2024). Design and validation of the AI literacy questionnaire: The affective, behavioural, cognitive and ethical approach. British Journal of Educational Technology, 55(3), 1082–1104. https://doi.org/10.1111/bjet.13411
O’Dea, X., Ng, D. T. K., O’Dea, M., & Shkuratskyy, V. (2026). Factors affecting university students’ generative AI literacy: Evidence and evaluation in the UK and Hong Kong contexts. Policy Futures in Education, 24(1), 13–34. https://doi.org/10.1177/14782103241287401
Ou, A. W., Khuder, B., Franzetti, S., & Negretti, R. (2024). Conceptualising and cultivating critical GAI literacy in doctoral academic writing. Journal of Second Language Writing, 66, Article 101156. https://doi.org/10.1016/j.jslw.2024.101156
Pinski, M., & Benlian, A. (2024). AI literacy for users – A comprehensive review and future research directions of learning methods, components, and effects. Computers in Human Behavior: Artificial Humans, 2(1), Article 100062. https://doi.org/10.1016/j.chbah.2024.100062
Sullivan, M., McAuley, M., Degiorgio, D., & McLaughlan, P. (2024). Improving students’ generative AI literacy: A single workshop can improve confidence and understanding. Journal of Applied Learning and Teaching, 7(2), 88–97. https://doi.org/10.37074/jalt.2024.7.2.7
Wang, B., Rau, P. L. P., & Yuan, T. (2023). Measuring user competence in using artificial intelligence: Validity and reliability of artificial intelligence literacy scale. Behaviour & Information Technology, 42(9), 1324–1337. https://doi.org/10.1080/0144929X.2022.2072768
Kang, X., & Rusdin, N. M. (2026). Self-Reported Generative AI Literacy among Undergraduates in Shandong, China: Dimensional Patterns and Educational Implications. International Journal of Academic Research in Progressive Education and Development, 15(4), 986-1002.
Copyright: © 2026 The Author(s)
Published by HRMARS (www.hrmars.com)
This article is published under the Creative Commons Attribution (CC BY 4.0) license. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this license may be seen at: http://creativecommons.org/licences/by/4.0/legalcode