Assessing written production in L2 Mandarin Chinese: fluency and accuracy
-
Li Yang
und
Zenan Zhao
Abstract
This study utilized T-unit and character-unit indices to assess learners’ written production and evaluate their writing development in second language (L2) Chinese. Through a cross-sectional design, three L2 Chinese learner groups at different instructional levels completed a timed letter-writing task within 30 min. Guided by prior research, respective T-unit and character-unit measures were selected to assess fluency and accuracy of the collected writing data. The results showed that fluency was overall positively related to learners’ instructional level, regardless of the indices (T-unit vs. character-unit). Hence, T-units per minute and characters per minute are considered both valid tools to assess fluency in L2 Chinese writing. However, only errors per character, among the accuracy measures, was found to decline linearly with the increasing level, thus suggested to be valid for tapping accuracy development in L2 Chinese writing. Based on the findings, implications regarding the assessment of L2 Chinese texts were discussed.
References
ACTFL. 2012. ACTFL proficiency guidelines. https://www.actfl.org/sites/default/files/guidelines/ACTFLProficiencyGuidelines2012.pdf (accessed 6 August 2023).Suche in Google Scholar
An, Fuyong. 2015. Butong shuiping CFL xuexizhe zuowen liuchangxing, jufa fuzadu he zhunquexing fenxi [Analysis of fluency, grammatical complexity and accuracy of CSL writing: A study based on T-unit analysis]. Yuyan Jiaoxue yu Yanjiu [Language Teaching and Linguistic Studies] 36(3). 11–20.Suche in Google Scholar
Barrot, Jessie S. & Joan Y. Agdeppa. 2021. Complexity, accuracy, and fluency as indices of college-level L2 writers’ proficiency. Assessing Writing 47. 100510. https://doi.org/10.1016/j.asw.2020.100510.Suche in Google Scholar
Bulté, Bram & Alex Housen. 2012. Defining and operationalizing L2 complexity. In Alex Housen, Folkert Kuiken & Ineke Vedder (eds.), Dimensions of L2 performance and proficiency: Investigating complexity, accuracy and fluency in SLA, 21–46. Amsterdam/Philadelphia: John Benjamins.10.1075/lllt.32.02bulSuche in Google Scholar
Chao, YuenRen. 1968. A grammar of spoken Chinese. Berkley and Los Angeles, CA: University of California Press.Suche in Google Scholar
Chenoweth, N. Ann & John R. Hayes. 2001. Fluency in writing: Generating text in L1 and L2. Written Communication 18(1). 80–98. https://doi.org/10.1177/0741088301018001004.Suche in Google Scholar
Foster, Pauline & Gillian Wigglesworth. 2016. Capturing accuracy in second language performance: The case for a weighted clause ratio. Annual Review of Applied Linguistics 36. 98–116. https://doi.org/10.1017/s0267190515000082.Suche in Google Scholar
Gaies, Stephen J. 1980. T-unit analysis in second language research: Applications, problems and limitations. TESOL Quarterly 14(1). 53–60. https://doi.org/10.2307/3586808.Suche in Google Scholar
Housen, Alex, Folkert Kuiken & Ineke Vedder. 2012. Complexity, accuracy and fluency: Definitions, measurement and research. In Alex Housen, Folkert Kuiken & Ineke Vedder (eds.), Dimensions of L2 performance and proficiency: Investigating complexity, accuracy and fluency in SLA, 1–20. Amsterdam/Philadelphia: John Benjamins.10.1075/lllt.32.01houSuche in Google Scholar
Hunt, Kellogg W. 1965. Grammatical structures written at three grade levels. Champaign, IL: National Council of Teachers of English.Suche in Google Scholar
Jiang, Wenying. 2013. Measurements of development in L2 written production: The case of L2 Chinese. Applied Linguistics 34(1). 1–24. https://doi.org/10.1093/applin/ams019.Suche in Google Scholar
Jin, Honggang. 2007. Syntactic maturity in second language writings: A case of Chinese as a foreign language (CFL). Journal of the Chinese Language Teachers Association 42(1). 27–54.Suche in Google Scholar
Johnson, Mark D. 2017. Cognitive task complexity and L2 written syntactic complexity, accuracy, lexical complexity, and fluency: A research synthesis and meta-analysis. Journal of Second Language Writing 37. 13–38. https://doi.org/10.1016/j.jslw.2017.06.001.Suche in Google Scholar
Li, Charles N. & Sandra A. Thompson. 1976. Subject and topic: A new typology of language. In Charles N. Li (ed.), Subject and topic, 457–489. New York: Academic Press.Suche in Google Scholar
Liu, Yuehua, Tao-chung Yao, Nyan-Ping Bi, Liangyan Ge & Yaohua Shi. 2010. Integrated Chinese (Level 1 Part 1, third edition). Boston: Cheng & Tsui Company.Suche in Google Scholar
Manchón, Rosa M. (ed.). 2012. L2 writing development: Multilingual perspectives. Boston, MA: Walter de Gruyter.10.1515/9781934078303Suche in Google Scholar
Manchón, Rosa M. & Paul Kei Matsuda (eds.). 2016. Handbook of second and foreign language writing. Boston, MA: Walter de Gruyter.10.1515/9781614511335Suche in Google Scholar
Ortega, Lourdes. 2003. Syntactic complexity measures and their relationship to L2 proficiency: A research synthesis of college-level L2 writing. Applied Linguistics 24(4). 492–518. https://doi.org/10.1093/applin/24.4.492.Suche in Google Scholar
Polio, Charlene. 1997. Measures of linguistic accuracy in second language writing research. Language Learning 47. 101–143. https://doi.org/10.1111/0023-8333.31997003.Suche in Google Scholar
Polio, Charlene. 2017. Second language writing development: A research agenda. Language Teaching 50(2). 261–275. https://doi.org/10.1017/s0261444817000015.Suche in Google Scholar
Polio, Charlene & Debra Friedman. 2017. Understanding, evaluating, and conducting second language writing research. New York: Routledge.10.4324/9781315747293Suche in Google Scholar
Polio, Charlene & Ji-Hyun Park. 2016. Language development in second language writing. In Rosa M. Manchón & Paul Kei Matsuda (eds.), Handbook of second and foreign language writing, 287–306. Boston, MA: Walter de Gruyter.10.1515/9781614511335-016Suche in Google Scholar
Polio, Charlene & Mark C. Shea. 2014. An investigation into current measures of linguistic accuracy in second language writing research. Journal of Second Language Writing 26. 10–27. https://doi.org/10.1016/j.jslw.2014.09.003.Suche in Google Scholar
Storch, Neomy & Gillian Wigglesworth. 2007. Writing tasks: The effect of collaboration. In María del Pilar García Mayo (ed.), Investigating tasks in foreign language learning, 157–177. Bristol, UK: Multilingual Matters.10.21832/9781853599286-011Suche in Google Scholar
Wigglesworth, Gillian & Neomy Storch. 2009. Pair versus individual writing: Effects on fluency, complexity and accuracy. Language Testing 26(3). 445–466. https://doi.org/10.1177/0265532209104670.Suche in Google Scholar
Wolfe-Quintero, Kate, Shunji Inagaki & Hae-Young Kim. 1998. Second language development in writing: Measures of fluency, accuracy, & complexity. Honolulu, HI: Second Language Teaching & Curriculum Center, University of Hawai’i at Manoa.Suche in Google Scholar
Wu, Jifeng & Xiaofei Lu. 2021. Butong kelidu jufa fuzadu zhibiao yu xiezuo zhiliang guanxi duibi yanjiu [The relationship between syntactic complexity and L2 Chinese writing quality: Large-grained vs. fine-grained indices]. Yuyan Wenzi Yingyong [Applied Linguistics] 1. 121–131.Suche in Google Scholar
Xu, Tongqiang. 1991. Yuyi yufa chuyi [On semantic syntax]. Yuyan Jiaoxue yu Yanjiu [Language Teaching and Linguistic Studies] 12(3). 38–62.Suche in Google Scholar
Xu, Tongqiang. 2005. “Zibenwei” he yuyan yanjiu [Zi as the basic structural unit and linguistic studies]. Yuyan Jiaoxue yu Yanjiu [Language Teaching and Linguistic Studies] 26(6). 1–11.Suche in Google Scholar
Yan, Xun & Jiani Lin. 2023. Chinese character matters!: An examination of linguistic accuracy in writing performances on the HSK test. Assessing Writing 57. 100767. https://doi.org/10.1016/j.asw.2023.100767.Suche in Google Scholar
Yang, Li & Lini G. Polin. 2023. Exploring the learning benefits of collaborative writing in L2 Chinese: A product-oriented perspective. International Review of Applied Linguistics in Language Teaching 61. https://doi.org/10.1515/iral-2023-0034.Suche in Google Scholar
Yang, Li & Laura E. Valentín-Rivera (eds.). 2023. Developing writing competence in L2 Chinese classrooms: Research and application. Bristol, UK: Multilingual Matters.10.21832/9781800413047Suche in Google Scholar
Yang, Li & Zenan Zhao. 2018. Profiling L2 writing development: The case of CFL learners in intermediate classes. Chinese as a Second Language Research 7(2). 221–247. https://doi.org/10.1515/caslar-2018-0009.Suche in Google Scholar
Yiğitoğlu, Nur & Melinda Reichelt (eds.). 2019. L2 writing beyond English. Bristol, UK: Multilingual Matters.10.21832/YIGITO3125Suche in Google Scholar
Yu, Qiaona. 2020. An organic syntactic complexity measure for the Chinese language: The TC-unit. Applied Linguistics 41(1). 1–34. https://doi.org/10.1093/applin/amz064.Suche in Google Scholar
© 2024 Walter de Gruyter GmbH, Berlin/Boston
