ISSN: 2226-6348
Open access
This study addresses limitations of the CED?4/6 listening–speaking scales, including insufficient subskill coverage, crude scoring items, and missing quantitative anchors and scenario exemplars. Based on psychometric reliability and validity theory, we designed a high?precision assessment scale that integrates usability???acceptability???practical instructional value. The scale decomposes speaking ability into eight subdimensions: pronunciation clarity, prosodic rhythm, lexical diversity, syntactic complexity, emotional expression, cross?cultural pragmatics, technical terminology mastery, and interaction strategies. Each subdimension includes a five?level quantitative rubric with positive and negative exemplars and scenario demonstration videos. This design reinforces the operability of scoring anchors. The system incorporates a dynamic proficiency?tiering mechanism. It matches instructional plans and tailored practice resources based on real?time scores. This creates a closed?loop assessment–feedback–intervention model. We assessed scale reliability and validity using Delphi consistency tests, KMO and Bartlett’s tests, exploratory factor analysis, and Cronbach’s??. In the empirical phase, we conducted Pearson correlation, paired?sample difference tests, and hierarchical regression path analysis. These analyses confirmed that interface usability and exemplar clarity have significant positive effects on teacher trust and continued use. They also demonstrated that acceptability mediates the effect of usability on practical instructional value. Results indicate that the new scale significantly enhances inter?rater consistency and teacher adoption. It supports personalized instruction in art education across regions. These findings offer a replicable methodological paradigm for the digital and intelligent transformation of educational assessment.
Dvorski Lackovi?, I., Kurnoga, N., & Miloš Spr?i?, D. (2022). Three-factor model of Enterprise Risk Management implementation: exploratory study of non-financial companies. Risk Management, 24(2), 101-122.
De Jong, N. H. (2023). Assessing second language speaking proficiency. Annual Review of Linguistics, 9(1), 541-560.
Sabrila, R. A. P., & Apoko, T. W. (2022). The Effectiveness of Podcast on Listening Skill for Vocational School Students. IDEAS: Journal on English Language Teaching and Learning, Linguistics and Literature, 10(2), 1177-1186.
Joseph, R. (2024). Construct validity and reliability of the theory evaluation scale: A factor analysis. Journal of Social Work Education, 60(3), 295-309.
Olagundoye, O., Gibson, W., & Wagg, A. (2024). A protocol for the co-creation and usability/acceptability testing of an evidence-based, patient-centred intervention for self-management of urinary incontinence in older men. Plos one, 19(8), e0306080.
Vlachogianni, P., & Tselios, N. (2022). Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review. Journal of Research on Technology in Education, 54(3), 392-409.
Aryadoust, V. (2023). The vexing problem of validity and the future of second language assessment. Language Testing, 40(1), 8-14.
Davis, F. D., Grani?, A., & Maranguni?, N. (2024). The technology acceptance model: 30 years of TAM. Switzerland: Springer International Publishing AG.
Scanferla, W. H., Oliveira, C., Lousada, M. L., & Teixeira, L. C. (2023). The Usability and Acceptability of the mHealth “Health and Voice” for Promoting Teachers' Vocal Health. Journal of Voice.
Mardon, A. K., Wilson, D., Leake, H. B., Harvie, D., Andrade, A., Chalmers, K. J., & Moseley, G. L. (2025). The acceptability, feasibility, and usability of a virtual reality pain education and rehabilitation program for Veterans: a mixed-methods study. Frontiers in Pain Research, 6, 1535915.
Ofosu-Ampong, K. (2024). Beyond the hype: exploring faculty perceptions and acceptability of AI in teaching practices. Discover Education, 3(1), 38.
Balanyà Rebollo, J., & De Oliveira, J. M. (2024). Teachers’ evaluation of the usability of a self-assessment tool for mobile learning integration in the classroom. Education Sciences, 14(1), 1.
Vlachogianni, P., & Tselios, N. (2022). Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review. Journal of Research on Technology in Education, 54(3), 392-409.
Toolaroud, P. B., Nabovati, E., Mobayen, M., Akbari, H., Feizkhah, A., Farrahi, R., & Jeddi, F. R. (2023). Design and usability evaluation of a mobile?based?self?management application for caregivers of children with severe burns. International wound journal, 20(7), 2571-2581.
Moore, S., Costello, E., Nguyen, H. A., & Stamper, J. (2024, July). An automatic question usability evaluation toolkit. In International Conference on Artificial Intelligence in Education (pp. 31-46). Cham: Springer Nature Switzerland.
Ma, B., Liu, Q., Jiang, Z., Che, D., Qiu, K., & Shang, X. (2023). Energy-Efficient 3D Path Planning for Complex Field Scenes Using the Digital Model with Landcover and Terrain. Isprs International Journal of Geo-Information, 12(2), 82.
Musa, H. G., Fatmawati, I., Nuryakin, N., & Suyanto, M. (2024). Marketing research trends using technology acceptance model (TAM): A comprehensive review of researches (2002–2022). Cogent business & management, 11(1), 2329375.
Murray-Smith, R., Oulasvirta, A., Howes, A., Müller, J., Ikkala, A., Bachinski, M., & Klar, M. (2022). What simulation can do for HCI research. Interactions, 29(6), 48-53.
Gao, L., & Hishamuddin, A. (2025). A Driven Listening–Speaking Assessment Scale: Examining the Three-Dimensional Linkage of Usability-Acceptability-Practical Instructional Value! International Journal of Academic Research in Progressive Education and Development, 14(2), 1268–1278.
Copyright: © 2025 The Author(s)
Published by HRMARS (www.hrmars.com)
This article is published under the Creative Commons Attribution (CC BY 4.0) license. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this license may be seen at: http://creativecommons.org/licences/by/4.0/legalcode