Journal Screenshot

International Journal of Academic Research in Progressive Education and Development

Open Access Journal

ISSN: 2226-6348

Learning Dissociation in AI-Mediated EFL Writing from a POA Perspective

Cao Yawen, Wong Siew Ping, Nooreen Noordin

http://dx.doi.org/10.6007/IJARPED/v15-i4/29373

Open access

This study asks whether human-AI interaction on writing platforms can support the deep revision and selective learning that the Production-Oriented Approach (POA) sets as its goal. Working from the POA framework of assessment-as-learning, the study analysed the revision histories of 47 non-English-major undergraduates who used Pigaiwang, an AI writing evaluation platform. Revision depth was assessed from observable textual differences between successive drafts alone, without any inference about the AI feedback students received, and coded as Elaboration, Adoption, or Inertia. Two raters coded independently and reached high agreement (Cohen’s ? = .93, with 95.7% exact agreement). In total, 87.2% of students produced no substantive elaboration, and the median score improvement was 0.50 points even though the overall gain was statistically significant, t(45) = -3.89, p < .001, Cohen’s d = 0.57. Initial use of POA target words correlated negatively with score improvement (r = -.294). Learning type showed no significant association with initial proficiency, so revision engagement appears independent of language ability. The study contributes a codable framework for selective learning, names revision-learning dissociation as the gap between behavioural revision and cognitive learning, and proposes an optimised Teacher-Student Collaborative Assessment pathway for embedding AI feedback in POA-based writing instruction.

Barkaoui, K. (2019). What can L2 writers’ pausing behavior tell us about their L2 writing processes? Studies in Second Language Acquisition, 41(3), 529-554.
Chen, J. (2025). Writing and revising in second language classrooms: The role of self-regulation in cultivating expert writers. Springer. https://doi.org/10.1007/978-981-96-1230-7
Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155-159.
Deci, E. L., & Ryan, R. M. (2000). The “what” and “why” of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry, 11(4), 227-268.
Faigley, L., & Witte, S. (1981). Analyzing revision. College Composition and Communication, 32(4), 400-414.
Flower, L., & Hayes, J. R. (1981). A cognitive process theory of writing. College Composition and Communication, 32(4), 365-387.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159-174.
Link, S., Mehrzad, M., & Rahimi, M. (2022). Impact of automated writing evaluation on teacher feedback, student revision, and writing improvement. Computer Assisted Language Learning, 35(4), 605-634.
Min, H. T. (2006). The effects of trained peer review on EFL students’ revision types and writing quality. Journal of Second Language Writing, 15(2), 118-141.
Pan, W., Mao, M., & Cheng, N. (2025). AI-enhanced production-oriented approach for feedback and assessment in EFL writing. In Proceedings of the International Conference on Computer Science and Education (pp. 74-87). Springer.
Parker, J. L., Becker, K., & Carroca, C. (2023). ChatGPT for automated writing evaluation in scholarly writing instruction. Journal of Nursing Education, 62(12), 721-727.
Ranalli, J. (2021). L2 student engagement with automated feedback on writing: Potential for learning and issues of trust. Journal of Second Language Writing, 52, 100816.
Wen, Q. (2015). Constructing the theoretical system of the Production-Oriented Approach. Foreign Language Teaching and Research, 47(4), 547-558.
Wen, Q. (2018). The production-oriented approach to teaching university students English in China. Language Teaching, 51(4), 526-540.
Zhang, Z. V., & Hyland, K. (2018). Student engagement with teacher and automated feedback on L2 writing. Assessing Writing, 36, 90-102.

Yawen, C., Ping, W. S., & Noordin, N. (2026). Learning Dissociation in AI-Mediated EFL Writing from a POA Perspective. International Journal of Academic Research in Progressive Education and Development, 15(4), 1271–1286.