ISSN: 2226-6348
Open access
It is of great significance to discriminate good writing from poor writing and Coh-Metrix, a computational tool of reliability and validity, was used to find out the textual features distinguishing the proficiency of students’ timed compositions in this study. The findings indicate that indices of number of words, Flesch Reading Ease Score (0-100) and word frequency, logarithm, mean for content words (0-6) in Coh-Metrix 2.1 have an entire 25.6% predictive power for teacher evaluation of writing proficiency in this study. Coh-Metrix will provide researchers and teachers more detailed statistical information for students’ writing products, which can be used for effectively teaching second language writing; students can find out their writing strengths and weaknesses in use of textual features and thus modify their writing strategies and styles based on those retrived information.
Biber, D., Conrad, S., & Reppen, R. (1998). Corpus linguistics: Investigating language structure and use. Cambridge: Cambridge University Press.
Brace, N., Kemp, R., & Snelgar, R. (2006). SPSS for psychologists: A guide to data analysis using SPSS for windows (3rd edition). London: Palgrave.
Crossley, S. A., Greenfield, J., & McNamara, D. S. (2008). Assessing text readability using cognitively based indices. TESOL Quarterly, 42, 475-493.
Crossley, S. A., Louwerse, M. M., McCarthy, P. M., & McNamara, D. S. (2007). A linguistic analysis of simplified and authentic texts. Modern Language Journal, 91(2), 15-30.
Crossley, S. A., McCarthy, P. M., & McNamara, D. S. (2007). Discriminating between second language learning text-types. In D. Wilson & G. Sutcliffe (Eds.), Proceedings of the 20th international Florida artificial intelligence research society (pp. 205-210). Menlo Park, California: AAAI Press.
Crossley, S. A., & McNamara, D. S. (2008). Assessing second language reading texts at the intermediate level: An approximate replication of Crossley, Louwerse, McCarthy, and McNamara (2007). Language Teaching, 41, 409-429.
Crossley, S. A. & McNamara, D. S. (2009). Computational assessment of lexical differences in L1 and L2 writing. Journal of Second Language Writing, 18, 119-135.
Crossley, S. A., & McNamara, D. S. (2011). Understanding expert ratings of writing quality: Coh-Metrix analyses of first and second language writing. Int. J. Cont. Engineering Education and Life-Long Learning, Vol. 21, Nos. 2/3, 170-191.
Crossley, S. A., McNamara, D. S., Weston, J., & Sullivan, M. S. T. (2010). The development of writing quality as a function of grade level: A linguistic analysis. Technical Report. The University of Memphis.
Ellis, R. (1994). The study of second language acquisition. Oxford: Oxford University Press.
Field, A. (2005). Discovering statistics using SPSS. London: Sage.
Graesser, A. C., Gernsbacher, M. A., & Goldman, S. R. (2003). Introduction to the Handbook of discourse processes. In A.C. Graesser, M. A., Gernsbacher, M. A., & S.R. Goldman (Eds.), Handbook of discourse processes (pp. 1-24). Mahwah, NJ: Erlbaum.
Graesser, A. C., McNamara, D. S., Louwerse, M. M., & Cai, Z. (2004). Coh-Metrix: Analysis of text on cohesion and language. Behavioral Research Methods, Instruments, and Computers, 36, 193-202.
Maocheng, L. (2006). Research of Learners’ Written Discourse Coherence. Modern Foreign Language Quarterly, 29(3), 284-292.
Louwerse, M. M., McCarthy, P. M., McNamara, D. S., & Graesser, A. C. (2004). Variation in language and cohesion across written and spoken registers. In K. Forbus, D. Gentner, & T. Regier (Eds.), Proceedings of the 26th Annual Meeting of the Cognitive Science Society (pp. 843-848). Mahwah, NJ: Erlbaum.
McCarthy, P. M., Lewis, G. A., Dufty, D. F., & McNamara, D. S. (2006). Analyzing writing styles with Coh-Metrix. In Proceedings of the Florida Artificial Intelligence Research Society International Conference. FLAIRS, Melbourne, Florida.
McNamara, D. S., Crossley, S. A., & McCarthy, P. M. (2010). Linguistic Features of Writing Quality. Written Communication, 27 (1), 57-86.
McNamara, D. S., Louwerse, M. M., Cai, Z., & Graesser, A. (2008). Coh-Metrix version 2.1. Retrieved on Sept. 25, 2011 from http//:cohmetrix.memphis.edu.
McNamara, D. S., Ozuru, Y., Graesser, A. C., & Louwerse, M. (2006). Validating Coh-Metrix. In R. Sun & N. Miyake (Eds.), Proceedings of the 28th annual conference of the cognitive science society (pp. 573-578). Mahwah, NJ: Erlbaum.
Moore, J. D., & Wiemer-Hastings, P. (2003). Discourse in computational linguistics and artificial intelligence. In A. C. Graesser, M. A. Gernsbacher, and S.R. Goldman (Eds.), Handbook of discourse processes (pp.439-486). Mahwah, NJ: Erlbaum.
National Center for Educational Statistics. (2003). The nation’s report card: Writing 2002, NCES 2003-529. Retrieved from
http://nces.ed.gov/nationsreportcard/pubs/main2002/2003529.asp
National Center for Educational Statistics. (2012). The nation’s report card: Writing 2011, NCES 2012-470. Retrieved from
http://nces.ed.gov/nationsreportcard/pubs/main2011/2012470.asp
Oxford, R. (1990). Language learning strategies: What every teacher should know. NY: Newbury House/Harper & Row.
Tabachnick, B. G., & Fidell, L. S. (2001). Using multivariate statistics. Needham Heights, MA: Allyn & Bacon.
Witte, S. P., & Faigley, L. (1981). Coherence, cohesion and writing quality. College Composition and Communication, (3), 189-204.
In-Text Citation: (Hongwei & Liqin, 2013)
To Cite this Article: Hongwei, W., & Liqin, Y. (2013). A Computational Analysis of Textual Features and L2 Writing Proficiency. International Journal of Academic Research in Progressive Education and Development, 2(4), 175–190.
Copyright: © 2018 The Author(s)
Published by Human Resource Management Academic Research Society (www.hrmars.com)
This article is published under the Creative Commons Attribution (CC BY 4.0) license. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this license may be seen at: http://creativecommons.org/licences/by/4.0/legalcode