Home Exploring the state of research on motivation in second language learning: a review and a reliability generalization meta-analysis
Article
Licensed
Unlicensed Requires Authentication

Exploring the state of research on motivation in second language learning: a review and a reliability generalization meta-analysis

  • Vahid Aryadoust ORCID logo EMAIL logo , Yu Xuan Natalie Soo and Jiayu Zhai ORCID logo
Published/Copyright: February 3, 2023

Abstract

We present a thematic review and analysis of the variables affecting language learning motivation (LLM) (2008–2022). The second-language motivational self-system (L2MSS) model was found to be the most applied construct in measuring LLM. Complex systems theory was also another method gaining prominence in LLM research to explain the interactions between micro- and macro-structures surrounding the learner in influencing motivation. Other factors such as socioeconomic status, dialogism and anagnorisis were also identified as variables relating to LLM. For instance, research on dialogism and dialogue has indicated the role of conversation in shaping identity, motivation, and meaning for learners. However, our review found that much of the focus in LLM research has been on the L2MSS learning or teaching experience, while daily living has been largely neglected. We further conducted a reliability generalization meta-analysis. Our analysis found an average reliability of 0.84 (CI = 0.816–0.856), with 34% of reliability coefficients falling below the lower bound of CI. A meta-regression analysis revealed that 16% of the variance in the reliability coefficients was predicted by the number of items in the instruments. Questionnaires with an internal consistency below the lower bound of 0.816 had an average of 4.14 items, while the rest had an average of 5.71 items. We further found significant publication bias. Based on our findings, we suggest areas for future research in LLM.


Corresponding author: Vahid Aryadoust, National Institute of Education, Nanyang Technological University, 1 Nanyang Walk, Singapore, 637616, Singapore, E-mail:

Award Identifier / Grant number: Undergraduate Research on CAmpus (URECA) Programme

References

Al-Hoorie, Ali H. 2018. The L2 motivational self system: A meta-analysis. Studies in Second Language Learning and Teaching 8(4). 721–754. https://doi.org/10.14746/ssllt.2018.8.4.2.Search in Google Scholar

Borenstein, Michael, Larry V. Hedges, Julian P. T. Higgins & Hannah R. Rothstein. 2013. Introduction to meta-analysis. West Sussex, UK: John Wiley & Sons.Search in Google Scholar

Bornmann, Lutz, Rüdiger Mutz & Hans-Dieter Daniel. 2010. A reliability-generalization study of journal peer reviews: A multilevel meta-analysis of inter-rater reliability and its determinants. PLoS One 5(12). e14331. https://doi.org/10.1371/journal.pone.0014331.Search in Google Scholar

Calafato, Raees & Fei Tang. 2019. Multilingualism and gender in the UAE: A look at the motivational selves of Emirati teenagers. System 84. 133–144. https://doi.org/10.1016/j.system.2019.06.006.Search in Google Scholar

Calafato, Raees. 2021. “I’m a salesman and my client is China”: Language learning motivation, multicultural attitudes, and multilingualism among university students in Kazakhstan and Uzbekistan. System 103. 102645. https://doi.org/10.1016/j.system.2021.102645.Search in Google Scholar

Castro, Eduardo. 2018. Complex adaptive systems, language advising, and motivation: A longitudinal case study with a Brazilian student of English. System 74. 138–148. https://doi.org/10.1016/j.system.2018.03.004.Search in Google Scholar

Claro, Jennifer. 2020. Identification with external and internal referents: Integrativeness and the ideal L2 self. In Ali H. Al-Hoorie & Peter D. MacIntyre (eds.), Contemporary language motivation theory: 60 years since Gardner and Lambert (1959), 233–261. Bristol, UK: Multilingual Matters.10.21832/9781788925211-016Search in Google Scholar

Csizér, Kata & Csaba Kálmán. 2019. A study of retrospective and concurrent foreign language learning experiences: A comparative interview study in Hungary. Studies in Second Language Learning and Teaching 9(1). 225–246. https://doi.org/10.14746/ssllt.2019.9.1.10.Search in Google Scholar

DeVito, Nicholas J. & Ben Goldacre. 2019. Catalogue of bias: Publication bias. BMJ Evidence-Based Medicine 24. 53–54. https://doi.org/10.1136/bmjebm-2018-111107.Search in Google Scholar

Dörnyei, Zoltán & Ema Ushioda. 2011. Teaching and researching motivation, 2nd edn. New York, NY: Routledge.Search in Google Scholar

Dörnyei, Zoltán, Christine Muir & Zana Ibrahim. 2014. Directed motivational currents: Energising language learning by creating intense motivational pathways. In David Lasagabaster, Aintzane Doiz & Juan Manuel Sierra (eds.), Motivation and foreign language learning: From theory to practice, 9–29. Amsterdam, the Netherlands: John Benjamins.10.1075/lllt.40.01dorSearch in Google Scholar

Dörnyei, Zoltán. 2005. The psychology of the language learner: Individual differences in second language acquisition. New York, NY: Routledge.Search in Google Scholar

Dörnyei, Zoltán. 2009. The L2 motivational self system. In Zoltán Dörnyei & Ema Ushioda (eds.), Motivation, language identity and the L2 self, 9–42. Bristol, UK: Multilingual Matters.10.21832/9781847691293-003Search in Google Scholar

Dörnyei, Zoltán. 2014. The psychology of the language learner. New York, NY: Routledge.10.4324/9781410613349Search in Google Scholar

Dörnyei, Zoltán. 2020. Foreword. In Ali H. Al-Hoorie & Peter D. MacIntyre (eds.), Contemporary language motivation theory: 60 years since Gardner and Lambert (1959), xix–xxii. Bristol, UK: Multilingual Matters.10.21832/9781788925211-003Search in Google Scholar

Egger, Matthias, George Davey Smith, Martin Schneider & Christoph Minder. 1997. Bias in meta-analysis detected by a simple, graphical test. British Medical Journal 315(7109). 629–634. https://doi.org/10.1136/bmj.315.7109.629.Search in Google Scholar

Field, Andy. 2018. Discovering statistics using IBM SPSS statistics, 5th edn. London, UK: Sage.Search in Google Scholar

Gardner, Robert C. & Wallace E. Lambert. 1972. Attitudes and motivation in second language learning. New York, NY: Newbury House.Search in Google Scholar

Gardner, Robert C. 1985. Social psychology and second language learning: The role of attitudes and motivation. London, UK: Edward Arnold.Search in Google Scholar

Gardner, Robert C. 2001. Integrative motivation and second language acquisition. In Zoltán Dörnyei & Richard Schmidt (eds.), Motivation and second language acquisition, 1–19. University of Hawai’i: Second Language Teaching and Curriculum Center.Search in Google Scholar

Gayton, Angela Mary. 2018. A context-specific approach to L2 motivation in Anglophone settings: A first step towards theory development. Language Learning Journal 46(4). 384–397. https://doi.org/10.1080/09571736.2015.1130081.Search in Google Scholar

Gearing, Nigel & Peter Roger. 2019. Where’s the vision? Rescuing integrativeness to understand the language learning motivation of English-speaking EFL instructors living in South Korea. System 82. 122–131. https://doi.org/10.1016/j.system.2019.03.008.Search in Google Scholar

Guilloteaux, Marie J. & Zoltán Dörnyei. 2008. Motivating language learners: A classroom-oriented investigation of the effects of motivational strategies on student motivation. TESOL Quarterly 42(1). 55–77. https://doi.org/10.1002/j.1545-7249.2008.tb00207.x.Search in Google Scholar

Harvey, Lou. 2017. Language learning motivation as ideological becoming. System 65. 69–77. https://doi.org/10.1016/j.system.2016.12.009.Search in Google Scholar

Hennebry-Leung, Mairin & Hu Amy Xiao. 2020. Examining the role of the learner and the teacher in language learning motivation. Language Teaching Research 27(1). 1–27. https://doi.org/10.1177/1362168820938810.Search in Google Scholar

Henry, Alastair. 2009. Gender differences in compulsory school pupils’ L2 self-concepts: A longitudinal study. System 37(2). 177–193. https://doi.org/10.1016/j.system.2008.11.003.Search in Google Scholar

Henson, Robin K. & Bruce Thompson. 2002. Characterizing measurement error in scores across studies: Some recommendations for conducting “reliability generalization” studies. Measurement and Evaluation in Counseling and Development 35(2). 113–127. https://doi.org/10.1080/07481756.2002.12069054.Search in Google Scholar

Higgins, Julian, Simon Thompson, Jonathan Deeks & Douglas Altman. 2002. Statistical heterogeneity in systematic reviews of clinical trials: a critical appraisal of guidelines and practice. Journal of Health Services Research & Policy 7(1). 51–61. https://doi.org/10.1258/1355819021927674.Search in Google Scholar

Huang, Hung-Tzu, Chun-Chieh Hsua & Shun-Wen Chen. 2015. Identification with social role obligations, possible selves, and L2 motivation in foreign language learning. System 51. 28–38. https://doi.org/10.1016/j.system.2015.03.003.Search in Google Scholar

Jahedizadeh, Safoura & Ali H. Al-Hoorie. 2021. Directed motivational currents: A systematic review. Studies in Second Language Learning and Teaching 11(4). 517–541. https://doi.org/10.14746/ssllt.2021.11.4.3.Search in Google Scholar

Kikuchi, Keita. 2019. Motivation and demotivation over two years: A case study of English language learners in Japan. Studies in Second Language Learning and Teaching 9(1). 157–175. https://doi.org/10.14746/ssllt.2019.9.1.7.Search in Google Scholar

Kikuchi, Keita & J. Lake. 2021. Positive psychology, positive L2 self, and L2 motivation: A longitudinal investigation. In Katarzyna Budzińska & Olga Majchrzak (eds.), Positive psychology in second and foreign language education, 79–94. Cham, Switzerland: Springer.10.1007/978-3-030-64444-4_5Search in Google Scholar

Kormos, Judit & Thom Kiddle. 2013. The role of socio-economic factors in motivation to learn English as a foreign language: The case of Chile. System 41(2). 399–412. https://doi.org/10.1016/j.system.2013.03.006.Search in Google Scholar

Lai, ChunLai & Chung-Pui Tai. 2021. Types of social media activities and Hong Kong south and Southeast Asians youth’s Chinese language learning motivation. System 97. 102432. https://doi.org/10.1016/j.system.2020.102432.Search in Google Scholar

Lamb, Martin, Kata Csizér, Alastair Henry & Stephen Ryan. 2021. The Palgrave handbook of motivation for language learning. Cham, Switzerland: Palgrave Macmillan.Search in Google Scholar

Lanvers, Ursula. 2012. ‘The Danish speak so many languages it’s really embarrassing’. The impact of L1 English on adult language students’ motivation. Innovation in Language Learning and Teaching 6(2). 157–175. https://doi.org/10.1080/17501229.2011.641970.Search in Google Scholar

Lanvers, Ursula. 2016. Lots of selves, some rebellious: Developing the self discrepancy model for language learners. System 60. 79–92. https://doi.org/10.1016/j.system.2016.05.012.Search in Google Scholar

Lee, Jang Ho & Yuen Yi Lo. 2017. An exploratory study on the relationships between attitudes toward classroom language choice, motivation, and proficiency of EFL learners. System 67. 121–131. https://doi.org/10.1016/j.system.2017.04.017.Search in Google Scholar

Liu, Yao & Amy S. Thompson. 2018. Language learning motivation in China: An exploration of the L2MSS and psychological reactance. System 72. 37–48. https://doi.org/10.1016/j.system.2017.09.025.Search in Google Scholar

Lyle, Sue. 2008. Dialogic teaching: Discussing theoretical contexts and reviewing evidence from classroom practice. Language and Education 22(3). 222–240. https://doi.org/10.1080/09500780802152499.Search in Google Scholar

MacIntyre, Peter D. 2021. Exploring applications of positive psychology in SLA. In Katarzyna Budzińska & Olga Majchrzak (eds.), Positive psychology in second and foreign language education, 3–17. Cham, Switzerland: Springer.10.1007/978-3-030-64444-4_1Search in Google Scholar

Masgoret, Anne-Marie & Robert C. Gardner. 2003. Attitudes, motivation, and second language learning: A meta-analysis of studies conducted by Gardner and associates. Language Learning 53(1). 123–163. https://doi.org/10.1111/1467-9922.00227.Search in Google Scholar

McEown, Maya Sugita, Yasuyo Sawaki & Tetsuo Harada. 2017. Foreign language learning motivation in the Japanese context: Social and political influences on self. The Modern Language Journal 101(3). 533–547. https://doi.org/10.1111/modl.12411.Search in Google Scholar

Mendoza, Anna & Huy Phung. 2019. Motivation to learn languages other than English: A critical research synthesis. Foreign Language Annals 52(1). 121–140. https://doi.org/10.1111/flan.12380.Search in Google Scholar

Miller, Brian K., Kay M. Nicols, Silvia Clark, Alison Daniels & Whitney Grant. 2018. Meta-analysis of coefficient alpha for scores on the Narcissistic Personality Inventory. PLoS One 13(12). 1–16. https://doi.org/10.1371/journal.pone.0208331.Search in Google Scholar

Muftah, Muneera & Shameem Rafik-Galea. 2013. Language learning motivation among Malaysian pre-university students. English Language Teaching 6(3). https://doi.org/10.5539/elt.v6n3p92.Search in Google Scholar

Nakamura, Toshiyuki. 2021. Motivation, imagined self, and speech genres: Bakhtinian considerations. System 99. 102525. https://doi.org/10.1016/j.system.2021.102525.Search in Google Scholar

Núñez-Núñez, Rosa María, María Rubio-Aparicio, Fulgencio Marín-Martínez, Julio Sánchez-Meca, José Antonio López-Pina & José Antonio López-López. 2022. A reliability generalization meta-analysis of the Padua Inventory-Revised (PI-R). International Journal of Clinical and Health Psychology 22(1). 100277. https://doi.org/10.1016/j.ijchp.2021.100277.Search in Google Scholar

Olkin, Ingram, Issa J. Dahabreh & Thomas A. Trikalinos. 2012. GOSH – a graphical display of study heterogeneity. Research Synthesis Methods 3(3). 214–223. https://doi.org/10.1002/jrsm.1053.Search in Google Scholar

Ouyang, Xiya & Yuewu Lin. 2020. A brief review of L2MSS: Its history and development. Studies in Linguistics and Literature 4(4). 110–121. https://doi.org/10.22158/sll.v4n4p110.Search in Google Scholar

Pan, Chunmei & Xian Zhang. 2021. A longitudinal study of foreign language anxiety and enjoyment. Language Teaching Research 8. 1–24. https://doi.org/10.1177/1362168821993341.Search in Google Scholar

Pavelescu, Liana Maria. 2019. Motivation and emotion in The EFL learning experience of Romanian adolescent students: Two contrasting cases. Studies in Second Language Learning and Teaching 9(1). 55–82. https://doi.org/10.14746/ssllt.2019.9.1.4.Search in Google Scholar

Peterson, Robert A. 1994. A meta-analysis of Cronbach’s coefficient alpha. Journal of Consumer Research 21. 381–391. https://doi.org/10.1086/209405.Search in Google Scholar

Pigott, Julian. 2019. Anagnorisis and narrative incorporation: How significant incidents affect language-learning behavior. Studies in Second Language Learning and Teaching 9(1). 177–198. https://doi.org/10.14746/ssllt.2019.9.1.8.Search in Google Scholar

Plonsky, Luke & Deirdre J. Derrick. 2016. A meta-analysis of reliability coefficients in second language research. The Modern Language Journal 100(2). 538–553. https://doi.org/10.1111/modl.12335.Search in Google Scholar

Rodriguez, Michael C. & Yukiko Maeda. 2006. Meta-analysis of coefficient alpha. Psychological Methods 11(3). 306–322. https://doi.org/10.1037/1082-989x.11.3.306.Search in Google Scholar

Scopus. 2022. What is Scopus preview? Avaliable at: https://service.elsevier.com/app/answers/detail/a_id/15534/supporthub/scopus/.Search in Google Scholar

Taber, Keith S. 2018. The use of Cronbach’s alpha when developing and reporting research instruments in science education. Research in Science Education 48. 1273–1296. https://doi.org/10.1007/s11165-016-9602-2.Search in Google Scholar

Thompson, Amy S. 2017a. Don’t tell me what to do! The anti-ought-to self and language learning motivation. System 67. 38–49. https://doi.org/10.1016/j.system.2017.04.004.Search in Google Scholar

Thompson, Amy S. 2017b. Language learning motivation in the United States: An examination of language choice and multilingualism. The Modern Language Journal 101(3). 483–500. https://doi.org/10.1111/modl.12409.Search in Google Scholar

Thompson, Amy S. & Camilla Vásquez. 2015. Exploring motivational profiles through language learning narratives. The Modern Language Journal 99(1). 158–174. https://doi.org/10.1111/modl.12187.Search in Google Scholar

Vacha-Haase, Tammi, Robin K. Henson & John C. Caruso. 2002. Reliability generalization: Moving toward improved understanding and use of score reliability. Educational and Psychological Measurement 62(4). 562–569. https://doi.org/10.1177/0013164402062004002.Search in Google Scholar

Vacha-Haase, Tammi. 1998. Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement 58. 6–20. https://doi.org/10.1177/0013164498058001002.Search in Google Scholar

Viechtbauer, Wolfgang. 2010. Conducting meta-analyses in R with the metafor package. Journal of Statistical Software 36. 1–48.10.18637/jss.v036.i03Search in Google Scholar

Villalobos-Buehner, Maria. 2018. The motivational self of the novice language learner. Language Learning in Higher Education 9(1). 203–221. https://doi.org/10.1515/cercles-2019-0013.Search in Google Scholar

Wang, Tianyi & Yongcan Liu. 2020. Dynamic L3 selves: A longitudinal study of five university L3 learners’ motivational trajectories in China. Language Learning Journal 48(2). 201–212. https://doi.org/10.1080/09571736.2017.1375549.Search in Google Scholar

Wang, Zi, Troy McConachy & Ema Ushioda. 2021. Negotiating identity tensions in multilingual learning in China: A situated perspective on language learning motivation and multilingual identity. Language Learning Journal 49(4). 420–432. https://doi.org/10.1080/09571736.2021.1915366.Search in Google Scholar

Weger, Heather D. 2013. Examining English language learning motivation of adult international learners studying abroad in the US. RELC Journal 44(1). 87–101. https://doi.org/10.1177/0033688212473272.Search in Google Scholar

Wong, Yu Ka. 2020. Effects of language proficiency on L2 motivational selves: A study of young Chinese language learners. System 88. 102181. https://doi.org/10.1016/j.system.2019.102181.Search in Google Scholar

Zheng, Chunping, Jyh-Chong Liang, Mang Li & Chin-Chung Tsai. 2018. The relationship between English language learners’ motivation and online self-regulation: A structural equation modelling approach. System 76. 144–157. https://doi.org/10.1016/j.system.2018.05.003.Search in Google Scholar


Supplementary Material

This article contains supplementary material (https://doi.org/10.1515/iral-2022-0115).


Received: 2022-06-15
Accepted: 2023-01-22
Published Online: 2023-02-03
Published in Print: 2024-06-25

© 2023 Walter de Gruyter GmbH, Berlin/Boston

Articles in the same Issue

  1. Frontmatter
  2. Research Articles
  3. Consolidating EFL content and vocabulary learning via interactive reading
  4. Understanding salient trajectories and emerging profiles in the development of Chinese learners’ motivation: a growth mixture modeling approach
  5. Multilingual pedagogies in first versus foreign language contexts: a cross-country study of language teachers
  6. Classroom assessment and learning motivation: insights from secondary school EFL classrooms
  7. Interculturality and Islam in Indonesia’s high-school EFL classrooms
  8. Collaborative writing in an EFL secondary setting: the role of task complexity
  9. Spanish heritage speakers’ processing of lexical stress
  10. Effectiveness of second language collocation instruction: a meta-analysis
  11. Understanding the Usefulness of E-Portfolios: Linking Artefacts, Reflection, and Validation
  12. Syntactic prediction in L2 learners: evidence from English disjunction processing
  13. The cognitive construction-grammar approach to teaching the Chinese Ba construction in a foreign language classroom
  14. The predictive roles of enjoyment, anxiety, willingness to communicate on students’ performance in English public speaking classes
  15. Speaking proficiency development in EFL classrooms: measuring the differential effect of TBLT and PPP teaching approaches
  16. L2 textbook input and L2 written production: a case of Korean locative postposition–verb construction
  17. What does the processing of chunks by learners of Chinese tell us? An acceptability judgment investigation
  18. Comparative analysis of written corrective feedback strategies: a linear growth modeling approach
  19. Enjoyment in language teaching: a study into EFL teachers’ subjectivities
  20. Students’ attitude and motivation towards concept mapping-based prewriting strategies
  21. Pronunciation pedagogy in English as a foreign language teacher education programs in Vietnam
  22. The role of language aptitude probed within extensive instruction experience: morphosyntactic knowledge of advanced users of L2 English
  23. The impact of different glossing conditions on the learning of EFL single words and collocations in reading
  24. Patterns of motivational beliefs among high-, medium-, and low-achieving English learners in China
  25. The effect of linguistic choices in note-taking on academic listening performance: a pedagogical translanguaging perspective
  26. A latent profile analysis of Chinese EFL learners’ enjoyment and anxiety in reading and writing: associations with imaginative capacity and story continuation writing performance
  27. Effects of monolingual and bilingual subtitles on L2 vocabulary acquisition
  28. Task complexity, task repetition, and L2 writing complexity: exploring interactions in the TBLT domain
  29. Expansion of verb-argument construction repertoires in L2 English writing
  30. Immediate versus delayed prompts, field dependence and independence cognitive style and L2 development
  31. Aural vocabulary, orthographic vocabulary, and listening comprehension
  32. The use of metadiscourse by secondary-level Chinese learners of English in examination scripts: insights from a corpus-based study
  33. Scoping review of research methodologies across language studies with deaf and hard-of-hearing multilingual learners
  34. Exploring immediate and prolonged effects of collaborative writing on young learners’ texts: L2 versus FL
  35. Discrepancy in prosodic disambiguation strategies between Chinese EFL learners and native English speakers
  36. Exploring the state of research on motivation in second language learning: a review and a reliability generalization meta-analysis
  37. Japanese complaint responses in textbook dialogues and ordinary conversations: learning objects to expand interactional repertoires
Downloaded on 20.11.2025 from https://www.degruyterbrill.com/document/doi/10.1515/iral-2022-0115/html
Scroll to top button