Predicting study success of international students
-
Michael Daller
und
Wang Yixin
Abstract
The study success of international students in Higher Education (HE) in English speaking countries has been a major concern for both the students and the host universities. However, studies on the predictive validity of established language tests, such as IELTS, are inconclusive (for an overview see Daller and Phelan 2013, Predicting international student study success. Applied Linguistics Review 4(1). 173–193). The present study explores the predictive validity of new test formats that could be used in the admissions process alongside the established tests to identify students who are at risk. In the long-term these new test formats have the potential to form the basis of a stand-alone admissions test. The formats under investigation are a gap-filling test (C-test) as test of general language proficiency and several measures of lexical richness (Guiraud, Guiraud Advanced, “D”; see also methodology). All measures were taken at the beginning of an academic year to predict the average grades at the end of the academic year (General Points Average/ GPA). In total 107 international students, mainly from China, with a wide range of subjects participated in the study. A multiple regression analysis including hierarchical models shows that the C-test and “Guiraud” have the highest predictive validity. Given the fact that these two measures can be administered quite easily in a short period of time, we conclude that they have clear advantages over IELTS in the prediction of international student’s study success.
Acknowledgement
We would like to thank the anonymous reviewers of the journal and Saskia Ayşe Daller for their valuable comments on an earlier version of this article.
Appendix. C-test
Please fill in the missing letters. You have 25 minutes in total. Roughly the second half of the word is deleted. Be aware of the inflection such as third person singular, plural, past tense, etc. Only words with correct spelling can score. There are 100 points available for the whole test, with 20 points available from each passage. Thanks for your interest in this test and your contribution will be highly appreciated.
Here are some examples to help your understanding:
I li__ to go with you.
Answer: like
I wo____ love to go with you.
Answer: would
They are teen_____.
Answer: teenagers
A. Learning to write
I was four when I started to learn to write. My grandfather started to teach me before I went to school. I remember th____ I always fo____ the cap______ letters mu___ easier t__ write th___ the sm___ letters. I reme____ that on___ we sta____ writing i___ school w__ were n__ allowed t__ use pe___, we h___ to u___ pencils un___ we bec___ really go__ at writing. I can write a few characters in Chinese now, but not very many.
B. Teenagers
It is clear that not all teenagers respond in the same way to peer group pressure. For exa_________, young peo_________ in t_______ early ye________ of seco__________ school a_______ more lik_________ to fe________ under pres__________ to we________ the sa________ clothes a_______ listen t_______ the sa________ music a_______ the re________ of t_______ peer gr________. By t________ time th________ reach middle or late adolescence, however, young people are more able to stand up against such influences.
C. Sleep room
One in three Japanese suffer from sleep disorders, which has prompted technologists to build a sound- insulated capsule – the Suimin (Sleep) Room. Users start by sit_______ up i_______ bed i_______ front o_______ a screen sho_______ a river win_______ through for_______. Soft mu________ plays i_______ the backg________, along wi______ the so_______ of wa_______ and bird________. After a f_________ relaxing min________, the lig_______ dim, t________ screen go________ blank, t___________ music fades and the bed reclines into a sleeping position.
D. Geography
The UK is located on a group of islands known as the British Isles, which lie between the Atlantic Ocean and the North Sea, northwest of France. At i_________ widest t_________ UK i_________ 300 mi_________ across a_________ 600 mi________ from No_________ to So_________. It sha_________ a sin_________ land bor_________ with the Irish Repu_________. Despite i_________ relatively sm_________ size t_________ UK boa_________ incredibly var_________ and of_________ very beau_________ scenery, fr_________ the mountains and valleys of the North and West to the rolling landscape of the South, and from downland and heath to Fens and marshland.
E. Record employment
Latest employment figures show that there are 28.2 million people in work. Work & Pensions Secretary said this showed the UK labour market has coped well so far with the current international economic uncertainty. He said: “Employment cont_________ to ri_________, with th_________ month’s fig_________ showing a rec_________ 28.2 mil_________ people i_________ work. Th_________ are 65,000 mo________ people i_________ work th_________ last qua_________ and 252,000 mo_________ than la_________ year. Alth__________ both meas_________ of unempl_________ have ri_________ slightly, th_________ are st_________ significantly lower than they were a year ago.”
References
Alderson, J. C. 2005. Diagnosing foreign language proficiency: The interface between learning and assessment. London: Bloomsbury.Suche in Google Scholar
Bacon, D. R. & B. Bean. 2006. GPA in research studies: An invaluable but neglected opportunity. Journal of Marketing Education 28(1). 35–42.10.1177/0273475305284638Suche in Google Scholar
Bellingham, L. 1993. The relationship of language proficiency to academic success for international students. New Zealand Journal of Educational Studies 30(2). 229–232.Suche in Google Scholar
Cho, Y. & B. Bridgeman. 2012. Relationship of TOEFL iBT scores to academic performance: Some evidence from American universities. Language Testing 29(3). 421–442.10.1177/0265532211430368Suche in Google Scholar
Cobb, T. 2002. The Web vocabulary profiler. Computer Software.http://www.er.uqam.ca/nobel/r21270/textools/web_vp. html (accessed 16 August 2013).Suche in Google Scholar
Cotton, F. & F. Conrow. 1998. An investigation of the predictive validity of IELTS amongst a group of international students studying at the University of Tasmania. IELTS Research Reports 1. 72–115.Suche in Google Scholar
Daller, H., J. Milton & J. Treffers-Daller. 2007. Modelling and assessing vocabulary knowledge. Cambridge: Cambridge University Press.10.1017/CBO9780511667268Suche in Google Scholar
Daller, H., R. van Hout & J. Treffers-Daller. 2003. Lexical richness in the spontaneous speech of Bilinguals. Applied Linguistics 24(2). 197–222.10.1093/applin/24.2.197Suche in Google Scholar
Daller, H. & J. Xue. 2009. English proficiency and academic success: A study of Chinese students in UK higher education. In B. Richards, H. Daller, D. Malvern, P. Meara, J. Milton & J. Treffers-Daller (eds.), Vocabulary studies in first and second language acquisition: The interface between theory and application, 79–193. Basingstoke: Palgrave MacMillan.10.1057/9780230242258Suche in Google Scholar
Daller, M. H. & D. Phelan. 2013. Predicting international student study success. Applied Linguistics Review 4(1). 173–193.10.1515/applirev-2013-0008Suche in Google Scholar
Dooey, P. & R. Oliver. 2002. An investigation into the predictive validity of the IELTS test as an indicator of future academic success. PROSPECT-ADELAIDE 17(1). 36–54.Suche in Google Scholar
Dörnyei, Z. & L. Katona. 1992. Validation of the C-test amongst Hungarian EFL learners. Language Testing 9(2). 187–206.10.1177/026553229200900206Suche in Google Scholar
Dunworth, K. 2009. An investigation into post-entry English language assessment at Australian universities. Journal of Academic Language and Learning, 3(1). A1–A13.Suche in Google Scholar
Eckes, T. & R. Grotjahn. 2006. A closer look at the construct validity of C-tests. Language Testing 23(3). 290–325.10.1191/0265532206lt330oaSuche in Google Scholar
Elder, C. 1993. Language proficiency as a predictor of performance in teacher education. Melbourne Papers in Language Testing 2(1). 72–95.Suche in Google Scholar
Elder, C & J. von Randow. 2008. Exploring the utility of a web-based English language screening tool. Language Assessment Quarterly 5(3). 173–94.10.1080/15434300802229334Suche in Google Scholar
ETS. 2016. Educational testing service. TOEFL. http://www.ets.org/toefl (accessed 2 February 2016).Suche in Google Scholar
Feast, V. 2002. The impact of IELTS scores on performance at university. International Education Journal 3(4). 70–85.Suche in Google Scholar
Ferguson, G. & E. White. 1992. A predictive validity study of IELTS – a report commissioned by UCLES: Institute of Applied Linguistics, University of Edinburgh.Suche in Google Scholar
Field, A. 2009. Discovering statistics using IBM SPSS statistics. London: Sage.Suche in Google Scholar
Gibson, C. & W. Rusek. 1992. The validity of an overall band score of 6.0 on the IELTS test as a predictor of adequate English language level appropriate for successful academic study. (Unpublished Masters of Arts (Applied Linguistics) thesis), Macquarie University, New South Wales.Suche in Google Scholar
Guiraud, P. 1954. Les caractères statistiques du vocabulaire. Paris: Presses universitaires de France.Suche in Google Scholar
Harrington, M. & T. Roche. 2014a. Identifying academically at-risk students in an English-as-a-Lingua-Franca university setting. Journal of English for Academic Purposes 15. 37–47.10.1016/j.jeap.2014.05.003Suche in Google Scholar
Harrington, M. & T. Roche. 2014b. Word recognition skill and academic success across disciplines in an ELF university setting. Association for Language Testing and Assessment of Australia and New Zealand (ALTAANZ): Papers in Language Testing 3(2). 76–99.10.58379/QPEW8104Suche in Google Scholar
Hayes, B. M. 2003. IELTS preparation in New Zealand: An investigation into the nature of the courses and evidence of washback (Doctoral dissertation). http://hdl.handle.net/10063/751Suche in Google Scholar
Hill, K., N. Storch & B. Lynch. 1999. A comparison of IELTS and TOEFL as predictors of academic success. IELTS Research Reports 2. 52–63.Suche in Google Scholar
IELTS. 2011. IELTS annual review. https://www.ielts.org/.../8330_3Y03_IELTSAnuualReview2011_web.pdf (accessed 25 October 2015).Suche in Google Scholar
IELTS. 2016. https://takeielts.britishcouncil.org/choose-ielts/who-accepts-ielts/recognising-organisations? (accessed 12 February 2016).Suche in Google Scholar
Klein-Braley, C. 1981. Empirical investigations of cloze tests: An examination of the validity of cloze tests as tests of general language proficiency in English for German university students. Duisburg: Universitaet Duisburg.Suche in Google Scholar
Klein-Braley, C. 1997. C-Tests in the context of reduced redundancy testing: An appraisal. Language Testing 14(1). 47–84.10.1177/026553229701400104Suche in Google Scholar
Kroll, B. & J. Reid. 1994. Guidelines for designing writing prompts: Clarifications, caveats, and cautions. Journal of Second Language Writing 3(3). 231–255.10.1016/1060-3743(94)90018-3Suche in Google Scholar
Laufer, B. & Z. Goldstein. 2004. Testing vocabulary knowledge: Size, strength, and computer adaptiveness. Language Learning 54(3). 399–436.10.1111/j.0023-8333.2004.00260.xSuche in Google Scholar
Little, D. & D. Singleton. 1992. The C-test as an elicitation instrument in second language research. Der C-Test. Theoretische Grundlagen und Praktische Anwendungen 1. 173–192.Suche in Google Scholar
MacWhinney, B. 2000. The CHILDES project: The database, Vol. 2. Abington: Taylor and Francis/Psychology Press.Suche in Google Scholar
Malvern, D., B. Richards, N. Chipere & P. Duran. 2004. Lexical diversity and language development: Quantification and assessment. Hampshire, England: Palgrave Macmillan.10.1057/9780230511804Suche in Google Scholar
Meuffels, B. 1992. Methods and techniques of empirical research: An introduction. Amsterdam: International Centre for the Study of Argumentation (SICSAT).Suche in Google Scholar
Mickan, P. 2003. What’s your score? An investigation into language descriptors for rating written performance. International English Language Testing System Research Reports 5. 125–157.Suche in Google Scholar
Milton, J. 2013. Measuring the contribution of vocabulary knowledge to proficiency in the four skills. In C. Bardel, C. Lindqvist & B. Laufer (eds.), L2 vocabulary acquisition, knowledge and use: New perspectives on assessment and corpus analysis Eurosla Monographs Series 2. 57–78.Suche in Google Scholar
Milton, J., H. Bell & P. Neville. 2001. IELTS practice tests. Newbury: Express publisher.Suche in Google Scholar
Moore, T. & J. Morton. 2005. Dimensions of difference: A comparison of university writing and IELTS writing. Journal of English for Academic Purposes 4(1). 43–66.10.1016/j.jeap.2004.02.001Suche in Google Scholar
Morris, L. & T. Cobb. 2004. Vocabulary profiles as predictors of the academic performance of Teaching English as a Second Language trainees. System 32(1). 75–87.10.1016/j.system.2003.05.001Suche in Google Scholar
Müller, A. 2011. Addressing the English language needs of international nursing students. Journal of Academic Language and Learning 5(2). A14-A22. http://journal.aall.org.au/index.php/jall/article/view/145.Suche in Google Scholar
Murray, N. 2010. Conceptualising the English language needs of first year university students. The International Journal of the First Year in Higher Education 1(1). 55.10.5204/intjfyhe.v1i1.19Suche in Google Scholar
Nation, P. 2015. Range programme. http://www.victoria.ac.nz/lals/about/staff/paul-nation (accessed 8 January 2015).Suche in Google Scholar
Pathirage, D. N. A., J. A. Morrow, D. L. Walpitage & G. J. Skolits. 2014. Helpfulness of ESL courses for international students studying in the United States. International Education 43(2). 25.Suche in Google Scholar
Read, J. 2000. Assessing vocabulary. Cambridge: Cambridge University Press.10.1017/CBO9780511732942Suche in Google Scholar
Roche, T. & M. Harrington. 2013. Recognition vocabulary knowledge as a predictor of academic performance in an English as a foreign language setting. Language Testing in Asia 3(1). 1–13.10.1186/2229-0443-3-12Suche in Google Scholar
Saville‐ Troike, M. 1984. What really matters in second language learning for academic achievement? TESOL Quarterly 18(2). 199–219.10.2307/3586690Suche in Google Scholar
Stæhr, L. S. 2008. Vocabulary size and the skills of listening, reading and writing. Language Learning Journal 36(2). 139–152.10.1080/09571730802389975Suche in Google Scholar
Stemmer, B. 1992. An alternative approach to C-test validation. Der C-Test. Theoretische Grundlagen und Praktische Anwendungen 1. 97–144.Suche in Google Scholar
Taylor, W. L. 1953. Cloze procedure”: A new tool for measuring readability. Journalism quarterly 30. 415–433.10.1177/107769905303000401Suche in Google Scholar
Treffers-Daller, J., P. Parslow & S. Williams. 2016. Back to basics: How measures of lexical diversity can help discriminate between CEFR levels. Applied Linguistics 37(4). 1–27.10.1093/applin/amw009Suche in Google Scholar
UAB. 2013. Universitat Autònoma de Barcelona. http://wuster.uab.es/ctestpractice/ (accessed 15 June 2013).Suche in Google Scholar
UK, G. 2013. UK government report: International education-global growth and prosperity, an accompanying analytical narrative. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/340601/bis-13-1082-international-education-accompanying-analytical-narrative-revised.pdf (accessed 16 September 2015).Suche in Google Scholar
UKCISA. 2015. UK council of international students affairs. http://institutions.ukcisa.org.uk//Info-for-universities-colleges–schools/Policy-research–statistics/Research–statistics/International-students-in-UK-HE/ (accessed 15 September 2015).Suche in Google Scholar
Uysal, H. H. 2010. A critical review of the IELTS writing test. ELT Journal 64(3). 314–320.10.1093/elt/ccp026Suche in Google Scholar
Wongtrirat, R. 2010. English language proficiency and academic achievement of international students: A meta-analysis. Ann Arbor: ERIC.Suche in Google Scholar
Yen, D. & J. Kuzma. 2009. Higher IELTS score, higher academic performance? The validity of IELTS in predicting the academic performance of Chinese students. Worcester Journal of Learning and Teaching 3. 1–7.Suche in Google Scholar
Yixin, W. & M. Daller. 2015. Predicting Chinese students’ academic achievement in the UK. Learning, Working and Communicating in a Global Context, 217.Suche in Google Scholar
Yu, Q. 2014. Various items causing IELTS test-taker’s low performance in mainland China: An international joint education program solution. Paper presented at the 2014 International Conference on Global Economy, Finance and Humanities Research (GEFHR 2014). Paris, France: Atlantis Press.10.2991/gefhr-14.2014.7Suche in Google Scholar
Yule, G. & P. Hoffman. 1990. Predicting success for international teaching assistants in a US university. TESOL Quarterly 24(2). 227–243.10.2307/3586900Suche in Google Scholar
© 2017 Walter de Gruyter GmbH, Berlin/Boston
Artikel in diesem Heft
- Frontmatter
- Ethics-related practices in Internet-based applied linguistics research
- Predicting study success of international students
- Understanding classroom participation and identity negotiation: An undergraduate student’s L2 learning experiences in an English-medium university in Hong Kong
- Understanding the NS/NNS division of labor in the creation and assessment of a Japanese university English entrance exam
- To postpone or not to postpone? Examining access policy on early foreign language learning from second language acquisition and language planning and policy perspectives
- Developing awareness and use of compliments in the Chinese homestay: A longitudinal case study
Artikel in diesem Heft
- Frontmatter
- Ethics-related practices in Internet-based applied linguistics research
- Predicting study success of international students
- Understanding classroom participation and identity negotiation: An undergraduate student’s L2 learning experiences in an English-medium university in Hong Kong
- Understanding the NS/NNS division of labor in the creation and assessment of a Japanese university English entrance exam
- To postpone or not to postpone? Examining access policy on early foreign language learning from second language acquisition and language planning and policy perspectives
- Developing awareness and use of compliments in the Chinese homestay: A longitudinal case study
