ISSN: 2226-6348
Open access
This study asks whether human-AI interaction on writing platforms can support the deep revision and selective learning that the Production-Oriented Approach (POA) sets as its goal. Working from the POA framework of assessment-as-learning, the study analysed the revision histories of 47 non-English-major undergraduates who used Pigaiwang, an AI writing evaluation platform. Revision depth was assessed from observable textual differences between successive drafts alone, without any inference about the AI feedback students received, and coded as Elaboration, Adoption, or Inertia. Two raters coded independently and reached high agreement (Cohen’s ? = .93, with 95.7% exact agreement). In total, 87.2% of students produced no substantive elaboration, and the median score improvement was 0.50 points even though the overall gain was statistically significant, t(45) = -3.89, p < .001, Cohen’s d = 0.57. Initial use of POA target words correlated negatively with score improvement (r = -.294). Learning type showed no significant association with initial proficiency, so revision engagement appears independent of language ability. The study contributes a codable framework for selective learning, names revision-learning dissociation as the gap between behavioural revision and cognitive learning, and proposes an optimised Teacher-Student Collaborative Assessment pathway for embedding AI feedback in POA-based writing instruction.
Barkaoui, K. (2019). What can L2 writers’ pausing behavior tell us about their L2 writing processes? Studies in Second Language Acquisition, 41(3), 529-554.
Chen, J. (2025). Writing and revising in second language classrooms: The role of self-regulation in cultivating expert writers. Springer. https://doi.org/10.1007/978-981-96-1230-7
Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155-159.
Deci, E. L., & Ryan, R. M. (2000). The “what” and “why” of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry, 11(4), 227-268.
Faigley, L., & Witte, S. (1981). Analyzing revision. College Composition and Communication, 32(4), 400-414.
Flower, L., & Hayes, J. R. (1981). A cognitive process theory of writing. College Composition and Communication, 32(4), 365-387.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159-174.
Link, S., Mehrzad, M., & Rahimi, M. (2022). Impact of automated writing evaluation on teacher feedback, student revision, and writing improvement. Computer Assisted Language Learning, 35(4), 605-634.
Min, H. T. (2006). The effects of trained peer review on EFL students’ revision types and writing quality. Journal of Second Language Writing, 15(2), 118-141.
Pan, W., Mao, M., & Cheng, N. (2025). AI-enhanced production-oriented approach for feedback and assessment in EFL writing. In Proceedings of the International Conference on Computer Science and Education (pp. 74-87). Springer.
Parker, J. L., Becker, K., & Carroca, C. (2023). ChatGPT for automated writing evaluation in scholarly writing instruction. Journal of Nursing Education, 62(12), 721-727.
Ranalli, J. (2021). L2 student engagement with automated feedback on writing: Potential for learning and issues of trust. Journal of Second Language Writing, 52, 100816.
Wen, Q. (2015). Constructing the theoretical system of the Production-Oriented Approach. Foreign Language Teaching and Research, 47(4), 547-558.
Wen, Q. (2018). The production-oriented approach to teaching university students English in China. Language Teaching, 51(4), 526-540.
Zhang, Z. V., & Hyland, K. (2018). Student engagement with teacher and automated feedback on L2 writing. Assessing Writing, 36, 90-102.
Yawen, C., Ping, W. S., & Noordin, N. (2026). Learning Dissociation in AI-Mediated EFL Writing from a POA Perspective. International Journal of Academic Research in Progressive Education and Development, 15(4), 1271–1286.
Copyright: © 2026 The Author(s)
Published by HRMARS (www.hrmars.com)
This article is published under the Creative Commons Attribution (CC BY 4.0) license. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this license may be seen at: http://creativecommons.org/licences/by/4.0/legalcode