Home The development of syntactic complexity of Chinese JFL learners based on Mean Dependency Distance and Mean Hierarchical Distance
Article
Licensed
Unlicensed Requires Authentication

The development of syntactic complexity of Chinese JFL learners based on Mean Dependency Distance and Mean Hierarchical Distance

  • Xiaomin Yang ORCID logo and Wenping Li ORCID logo EMAIL logo
Published/Copyright: December 13, 2023

Abstract

Mean dependency distance (MDD) and mean hierarchical distance (MHD) are two linguistic measures used in dependency syntax studies to investigate the syntactic features of compositions written by English as a foreign language (EFL) learners. However, their applicability and validity in differentiating proficiency levels and genre effects among Japanese as a foreign language (JFL) learners remain unknown. This study uses a longitudinal dataset that tracks 110 Chinese JFL learners over 12 months and examines their syntactic development as well as the effects of genres. The results indicate that both MDD and MHD effectively capture developmental and genre effects; moreover, both measures show significantly higher values in argumentative writing than narrative writing. However, the extent of genre effects over time is not the same in MDD and MHD. The findings provide new insights into the developmental characteristics of JFL learners’ interlanguage and may contribute to evaluating syntactic complexity and developing automatic evaluation systems.


Corresponding author: Wenping Li, School of Foreign Studies, Shanghai University of Finance and Economics, No. 777, Guoding Road, 200433 Shanghai, China, E-mail:

Award Identifier / Grant number: 19BYY202

Acknowledgments

This research is supported by the National Social Science Foundation of China under the “Empirical Research on the Development of Japanese Learners’ Productive Vocabulary Competence Based on Longitudinal Corpus” (Grant No. 19BYY202).

References

Ai, Haiyang & Xiaofei Lu. 2013. A corpus-based comparison of syntactic complexity in NNS and NS university students’ writing. In Ana DïIaz-Negrillo, Nicolas Ballier & Paul Thompson (eds.), Automatic treatment and analysis of learner corpus data, 249–264. Amsterdam: John Benjamins.10.1075/scl.59.15aiSearch in Google Scholar

Biber, Douglas, Bethany Gray & Kornwipa Poonpon. 2011. Should we use characteristics of conversation to measure grammatical complexity in L2 writing development? TESOL Quarterly 45. 5–35. https://doi.org/10.5054/tq.2011.244483.Search in Google Scholar

Biber, Douglas, Bethany Gray, Shelly Staples & Jesse Egbert. 2020. Investigating grammatical complexity in L2 English writing research: Linguistic description versus predictive measurement. Journal of English for Academic Purposes 46. 100869. https://doi.org/10.1016/j.jeap.2020.100869.Search in Google Scholar

Bulté, Bram & Alex Housen. 2012. Defining and operationalising L2 complexity. In Housen Alex Folkert Kuiken & Ineke Vedder (eds.), Dimensions of L2 Performance and Proficiency. Complexity, Accuracy and Fluency in SLA, 21–46. Amsterdam: John Benjamins.10.1075/lllt.32.02bulSearch in Google Scholar

Chen, Ruina, Sirui Deng & Haitao Liu. 2021. Syntactic complexity of different text types: From the perspective of dependency distance both linearly and hierarchically. Journal of Quantitative Linguistics 29. 1–31. https://doi.org/10.1080/09296174.2021.2005960.Search in Google Scholar

Child, James R. 1987. Language proficiency levels and the typology of texts. In Heidi Bymes & Michael Canale (eds.), Defining and Developing Proficiency: Guidelines, Implementations and Concepts, 97–106. Lincolnwood, IL: National Textbook Company.Search in Google Scholar

Child, James R. 1998. Language skill levels, textual modes, and the rating process. Foreign Language Annals 31. 381–391. https://doi.org/10.1111/j.1944-9720.1998.tb00583.x.Search in Google Scholar

Cowan, Nelson. 2001. The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and Brain Sciences 24(1). 87–114. https://doi.org/10.1017/s0140525x01003922.Search in Google Scholar

De Clercq, Bastien & Alex Housen. 2017. A cross-linguistic perspective on syntactic complexity in L2 development: Syntactic elaboration and diversity. The Modern Language Journal 101(2). 315–334. https://doi.org/10.1111/modl.12396.Search in Google Scholar

Housen, Alex & Folkert Kuiken. 2009. Complexity, accuracy, and fluency in second language acquisition. Applied Linguistics 30. 461–473. https://doi.org/10.1093/applin/amp048.Search in Google Scholar

Hua, Yingnan & Yude Bi. 2022. Research on dependency distance of Korean based on dependency tree bank. Foreign Language Research 6. 55–65.Search in Google Scholar

Hudson, Richard. 1990. English word grammar. Oxford: Basil Blackwell.Search in Google Scholar

Hudson, Richard. 2007. Language networks: The new word grammar. Oxford: Oxford University Press.10.1093/oso/9780199267309.001.0001Search in Google Scholar

Jiang, Jingyang & Haitao Liu. 2015. The effects of sentence length on dependency distance, dependency direction and the implications-based on a parallel English – Chinese dependency treebank. Language Sciences 50. 93–104. https://doi.org/10.1016/j.langsci.2015.04.002.Search in Google Scholar

Jiang, Jingyang & Jinghui Ouyang. 2017. Dependency distance: A new perspective on the syntactic development in second language acquisition Comment on “Dependency distance: A new perspective on syntactic patterns in natural languages” by Haitao Liu et al. Physics of Life Reviews 21. 209–210. https://doi.org/10.1016/j.plrev.2017.06.018.Search in Google Scholar

Jiang, Jingyang & Jinghui Ouyang. 2018. Minimization and probability distribution of dependency distance in the process of second language acquisition. In Jiang Jingyang & Haitao Liu (eds.), Quantitative Analysis of Dependency Structures, 167–190. Berlin: De Gruyter Mouton.10.1515/9783110573565-009Search in Google Scholar

Jiang, Jingyang, Peng Bi & Haitao Liu. 2019a. Syntactic complexity development in the writings of EFL learners: Insights from a dependency syntactically-annotated corpus. Journal of Second Language Writing 46. 100666. https://doi.org/10.1016/j.jslw.2019.100666.Search in Google Scholar

Jiang, Jingyang, Jinghui Ouyang & Haitao Liu. 2019b. Interlanguage: A perspective of quantitative linguistic typology. Language Sciences 74. 85–97. https://doi.org/10.1016/j.langsci.2019.04.004.Search in Google Scholar

Jiang, Jingyang, Peng Bi, Nana Xie & Haitao Liu. 2021. Phraseological complexity and low- and intermediate-level L2 learners’ writing quality. International Review of Applied Linguistics in Language Teaching 2023;61:765–90. https://doi.org/10.1515/iral-2019-0147.Search in Google Scholar

Jing, Yingqi & Haitao Liu. 2015. Mean hierarchical distance augmenting mean dependency distance. Paper presented at Proceedings of the 3rd International Conference on Dependency Linguistics, Uppsala Sweden, 24–26 August.Search in Google Scholar

Komori, Saeko, Masatoshi Sugiura & Wenping Li. 2018. Examining the applicability of the mean dependency distance (MDD) for SLA: A case study of Chinese learners of Japanese as a second language. Paper presented at Proceedings of the 4th Asia Pacific Corpus Linguistic Conference, Takamatsu Japan, 17–19 September.Search in Google Scholar

Komori, Saeko, Masatoshi Sugiura & Wenping Li. 2019a. Evaluating mean dependency distance (MDD) and mean hierarchical distance (MHD) to measure development of Japanese syntactic complexity. Paper presented at the 2019 Conference of the American Association for Applied Linguistics, Atlanta USA, 9–12 March.Search in Google Scholar

Komori, Saeko, Masatoshi Sugiura & Wenping Li. 2019b. Examining MDD and MHD as syntactic complexity measures with intermediate Japanese learner corpus data. Paper presented at Proceedings of the 5th International Conference on Dependency Linguistics, Paris France, 26–30 August.10.18653/v1/W19-7715Search in Google Scholar

Kudo, Taku & Yuji Matsumoto. 2002. Japanese dependency analysis using cascaded chunking. Paper presented at Proceedings of the 6th Conference on Natural Language Learning, Taipei China, 31 August – 1 September.10.3115/1118853.1118869Search in Google Scholar

Lecouvet, Mathieu. 2021. Non-canonical word order as a measure of syntactic complexity in advanced L2 German. International Review of Applied Linguistics in Language Teaching 61. 877–907. https://doi.org/10.1515/iral-2021-0029.Search in Google Scholar

Lei, Lei & Ju Wen. 2020. Is dependency distance experiencing a process of minimization? A diachronic study based on the State of the Union addresses. Lingua 239. 102762. https://doi.org/10.1016/j.lingua.2019.102762.Search in Google Scholar

Li, Wenping, Haitao Liu & Saeko Komori. 2022. A phase research based on syntactic dependency relations: For the phase differences of text genre. Gengo Kenkyu 162. 47–62.Search in Google Scholar

Li, Wenping, Haitao Liu & Yixin Xia. 2023. The syntactic complexity of learner languages of Japanese from the perspective of dependency distance: A case study based on the International Corpus of Japanese as a second language (I-JAS). Journal of Japanese Language Education 184. 112–126.Search in Google Scholar

Li, Wenping & Jianwei Yan. 2020. Probability distribution of dependency distance based on a treebank of Japanese EFL learners’ interlanguage. Journal of Quantitative Linguistics 28(2). 172–186. https://doi.org/10.1080/09296174.2020.1754611.Search in Google Scholar

Liu, Haitao. 2007. Probability distribution of dependency distance. Glottometrics 15. 1–12.Search in Google Scholar

Liu, Haitao. 2008. Dependency distance as a metric of language comprehension difficulty. Journal of Cognitive Science 9(2). 159–191. https://doi.org/10.17791/jcs.2008.9.2.159.Search in Google Scholar

Liu, Haitao. 2010. Dependency direction as a means of word-order typology: A method based on dependency treebanks. Lingua 120. 1567–1578. https://doi.org/10.1016/j.lingua.2009.10.001.Search in Google Scholar

Liu, Haitao. 2017. The hierarchical distribution of sentence structures. Foreign Language Teaching and Research 3. 345–352.Search in Google Scholar

Liu, Haitao & Yingqi Jing. 2016. A quantitative analysis of English hierarchical structure. Journal of Foreign Languages 39(1). 2–11.Search in Google Scholar

Liu, Haitao, Chunshan Xu & Junying Liang. 2017. Dependency distance: A new perspective on syntactic patterns in natural languages. Physics of Life Reviews 21. 171–193. https://doi.org/10.1016/j.plrev.2017.03.002.Search in Google Scholar

Liu, Xueying, Haoran Zhu & Lei Lei. 2022. Dependency distance minimization: A diachronic exploration of the effects of sentence length and dependency types. Humanities and Social Sciences Communications 9. 420. https://doi.org/10.1057/s41599-022-01447-3.Search in Google Scholar

Lu, Xiaofei. 2011. A corpus-based evaluation of syntactic complexity measures as indices of college-level ESL writers’ language development. TESOL Quarterly 45. 36–62. https://doi.org/10.5054/tq.2011.240859.Search in Google Scholar

Martinez, Ana Cristina Lahuerta. 2018. Analysis of syntactic complexity in secondary education EFL writers at different proficiency levels. Assessing Writing 35. 1–11. https://doi.org/10.1016/j.asw.2017.11.002.Search in Google Scholar

Mazgutova, Diana & Judit Kormos. 2015. Syntactic and lexical development in an intensive English for academic purposes programme. Journal of Second Language Writing 29. 3–15. https://doi.org/10.1016/j.jslw.2015.06.004.Search in Google Scholar

Nivre, Joakim. 2006. Inductive dependency parsing. Dordrecht: Spring.10.1007/1-4020-4889-0Search in Google Scholar

Norris, John M. & Lourdes Ortega. 2009. Towards an organic approach to investigating CAF in instructed SLA: The case of complexity. Applied Linguistics 30(4). 555–578. https://doi.org/10.1093/applin/amp044.Search in Google Scholar

Ortega, Lourdes. 2003. Syntactic complexity measures and their relationship to L2 proficiency: A research synthesis of college-level L2 writing. Applied Linguistics 24(4). 492–518. https://doi.org/10.1093/applin/24.4.492.Search in Google Scholar

Ouyang, Jinghui & Jingyang Jiang. 2017. Can the probability distribution of dependency distance measure language proficiency of second language learners? Journal of Quantitative Linguistics 25(4). 295–313.10.1080/09296174.2017.1373991Search in Google Scholar

Ouyang, Jinghui, Jingyang Jiang & Haitao Liu. 2022. Dependency distance measures in assessing L2 writing proficiency. Assessing Writing 51. 100603. https://doi.org/10.1016/j.asw.2021.100603.Search in Google Scholar

Qi, Haifeng & Jianling Liao. 2019. An investigation into Chinese linguistic development in L2 narrative and argumentative writing. Chinese Teaching in the World 33(4). 563–576.Search in Google Scholar

Qin, Wenjuan & Paola Uccelli. 2016. Same language, different functions: A cross-genre analysis of Chinese EFL learners’ writing performance. Journal of Second Language Writing 33. 3–17. https://doi.org/10.1016/j.jslw.2016.06.001.Search in Google Scholar

Qin, Xiaoqing & Qiufan Wen. 2007. EFL writing of college English majors in China: A developmental perspective. Beijing: China Social Science Press.Search in Google Scholar

Romano, Jeanine, Jeffrey D. Kromrey, Jesse Coraggio & Jeff Skowronek. 2006. Appropriate statistics for ordinal level data: Should we really be using t-test and Cohens’ d for evaluating group differences on the NSSE and other surveys? In Annual meeting of the Florida Association of Institutional Research, 1–33.Search in Google Scholar

Shen, Jinhua & Gui Bao. 2010. Effects of EFL proficiency and genre on the T unit length of EFL learners’ essays. Journal of Nanjing Tech University (Social Science Edition) 4. 73–76.Search in Google Scholar

Taguchi, Naoko, William Crawford & Danielle Z. Wetzel. 2013. What linguistic features are indicative of writing quality? A case of argumentative essays in a college composition program. TESOL Quarterly 47(2). 420–430. https://doi.org/10.1002/tesq.91.Search in Google Scholar

Tesnière, Lucien. 1959. Eléments de la syntaxe structurale. Paris: Klincksieck.Search in Google Scholar

Verspoor, Marjolijn H., Kees de Bot & Wander Lowie. 2011. A dynamic approach to second language development: Methods and techniques. Amsterdam: John Benjamin.10.1075/lllt.29Search in Google Scholar

Verspoor, Marjolijn, Wander Lowie, Hui P. Chan & Louisa Vahtrick. 2017. Linguistic complexity in second language development: Variability and variation at advanced stages. Recherches en didactique des langues et des cultures 14. 1–27. https://doi.org/10.4000/rdlc.1450.Search in Google Scholar

Vyatkina, Nina. 2013. Specific syntactic complexity: Developmental profiling of individuals based on an annotated learner corpus. The Modern Language Journal 97. 11–30. https://doi.org/10.1111/j.1540-4781.2012.01421.x.Search in Google Scholar

Wolfe-Quintero, Kate, Shunji Inagaki & Hae-Young Kim. 1998. Second language development in writing: Measures of fluency, accuracy, and complexity. Honolulu: University of Hawaii, Second Language Teaching & Curriculum Center.Search in Google Scholar

Yang, Weiwei, Xiaofei Lu & Sara Cushing Weigle. 2015. Different topics, different discourse: Relationships among writing topic, measures of syntactic complexity, and judgments of writing quality. Journal of Second Language Writing 28. 53–67. https://doi.org/10.1016/j.jslw.2015.02.002.Search in Google Scholar

Yoon, Hyung-Jo & Charlene Polio. 2017. The linguistic development of students of English as a second language in two written genres. TESOL Quarterly 51. 275–301. https://doi.org/10.1002/tesq.296.Search in Google Scholar

Zheng, Yongyan. 2018. The multidimensional development of advanced learners’ linguistic complexity. Foreign Language Teaching and Research 2. 218–229.Search in Google Scholar

Zheng, Yongyan & Yuli Feng. 2017. A dynamic systems study on Chinese EFL learners’ syntactic and lexical complexity development. Modern Foreign Languages 1. 57–68.Search in Google Scholar

Received: 2023-01-14
Accepted: 2023-11-27
Published Online: 2023-12-13
Published in Print: 2024-03-25

© 2023 Walter de Gruyter GmbH, Berlin/Boston

Downloaded on 11.9.2025 from https://www.degruyterbrill.com/document/doi/10.1515/iral-2023-0010/html
Scroll to top button