Skip to main content
Article
Licensed
Unlicensed Requires Authentication

Attention-consuming or attention-saving: an eye tracking study on punctuation in Chinese subtitling of English trailers

  • , EMAIL logo and
Published/Copyright: March 16, 2023

Abstract

Chinese subtitling of English trailers is essential for marketing foreign films in China, and there is a need to focus on audience reception. Ideal subtitles are expected to provide a necessary aid to the audience but to attract as little attention as possible. Paralinguistic factors like punctuation can influence the audience’s attention and reception. Therefore, this study aims to explore the impact of punctuation on a Chinese audience’s attention distribution between subtitles and visuals via the eye tracking technique. We recruited 62 participants and selected ten English trailers for films to be released. We prepared two parallel Chinese versions for each trailer, one using punctuation marks and the other using spaces. The participants were randomly assigned into two groups to watch the two versions respectively and filled out a questionnaire afterwards to rate their desire to watch those films. Data analyses show that, while punctuation does not have a significant impact on participants’ attitudes towards the films, the version without punctuation causes less fixation on subtitles, implying that omitting punctuation marks can ensure more attention to the visual and hence a better viewing experience.


Corresponding author: Xiao Liu, School of Translation Studies, Shandong University, Weihai, 264209, China, E-mail:

References

Bogucki, Łukasz. 2020. A relevance-theoretic approach to decision-making in subtitling. Cham: Palgrave Macmillan.10.1007/978-3-030-51803-5Search in Google Scholar

Boksem, Maarten A. S. & Ale. Smidts. 2015. Brain responses to movie trailers predict individual preferences for movies and their population-wide commercial success. Journal of Marketing Research 52(4). 482–492. https://doi.org/10.1509/jmr.13.0572.Search in Google Scholar

Caffrey, Colm. 2012. Using an eye–tracking tool to measure the effects of experimental subtitling procedures on viewer perception of subtitled AV content. In Elisa Perego (ed.), Eye tracking in audiovisual translation, 223–258. Rome: Arcane.Search in Google Scholar

Chen, Sheng-Jie. 2004. Linguistic dimensions of subtitling: Perspectives from Taiwan. Meta 49(1). 115–124. https://doi.org/10.7202/009027ar.Search in Google Scholar

Chen, Hsuan-Chih & Chi-Kong Tang. 1998. The effective visual field in reading Chinese. Reading and Writing: An Interdisciplinary Journal 10. 245–254. https://doi.org/10.1023/a:1008043900392.10.1023/A:1008043900392Search in Google Scholar

Devlin, Michael B., L. Todd Chambers & Coy Callison. 2011. Targeting mood: Using comedy or serious movie trailers. Journal of Broadcasting & Electronic Media 55(4). 581–595. https://doi.org/10.1080/08838151.2011.620668.Search in Google Scholar

Díaz Cintas, Jorge. 2012. Subtitling: Theory, practice and research. In Carmen Millán & Francesca Bartrina (eds.), The Routledge handbook of translation studies, 273–287. London: Routledge.Search in Google Scholar

Díaz Cintas, Jorge & Aline Remael. 2007. Audiovisual translation: Subtitling. London: Routledge.Search in Google Scholar

Díaz Cintas, Jorge & Aline Remael. 2021. Subtitling: Concepts and practices. London: Routledge.10.4324/9781315674278Search in Google Scholar

Ghia, Elisa. 2012. The impact of translation strategies on subtitle reading. In Elisa Perego (ed.), Eye tracking in audiovisual translation, 155–182. Roma: Aracne Editrice.Search in Google Scholar

Gottlieb, Henrik. 1994. Subtitling: Diagonal translation. Perspectives: Studies in Translatology 1. 101–121.10.1080/0907676X.1994.9961227Search in Google Scholar

Hou, Po & Roger Chung. 2016. New era of China’s film industry. Deloitte Perspective 5. 49–61.Search in Google Scholar

Inhoff, Albrecht Werner & Weimin, Liu. 1998. The perceptual span and oculomotor activity during the reading of Chinese sentences. Journal of Experimental Psychology: Human Perception and Performance 24(1). 20–34. https://doi.org/10.1037/0096-1523.24.1.20.Search in Google Scholar

Just, M. A. & P. A. Carpenter. 1980. A theory of reading: From eye fixation to comprehension. Psychological Review 87. 329–354. https://doi.org/10.1037/0033-295x.87.4.329.Search in Google Scholar

Kernan, L. 2004. Coming attractions: Reading american movie trailers. Austin: University of Texas Press.10.7560/706002Search in Google Scholar

Kerrigan, Finola. 2010. Film marketing. Burlington: Elsevier.10.4324/9780080942919Search in Google Scholar

Koolstra, Cees M., Allerd L. Peeters & Herman Spinhof. 2002. The pros and cons of dubbing and subtitling. European Journal of Communication 17(3). 325–354. https://doi.org/10.1177/0267323102017003694.Search in Google Scholar

Kruger, Jan-Louis. 2019. Eye tracking in audiovisual translation research. In Luis Pérez-González (ed.), The Routledge handbook of audiovisual translation, 350–366. London: Routledge.10.4324/9781315717166-22Search in Google Scholar

Liao, Sixin, Jan-Louis Kruger & Stephen Doherty. 2020. The impact of monolingual and bilingual subtitles on visual attention, cognitive load, and comprehension. The Journal of Specialised Translation 33. 70–89.Search in Google Scholar

Liao, Sixin, Lili, Yu, Jan-Louis Kruger & Erik D. Reichle. 2021. The impact of audio on the reading of intralingual vs. interlingual subtitles: Evidence from eye movements. Applied PsychoLinguistics 43. 237–269. https://doi.org/10.1017/s0142716421000527.Search in Google Scholar

Malenova, Evgeniya D. 2017. Subtitling practice: From translation to transcreation. Journal of Siberian Federal University 4(10). 526–536. https://doi.org/10.17516/1997-1370-0060.Search in Google Scholar

Mellinger, Christopher D. & Thomas A. Hanson. 2017. Quantitative research methods in translation and interpreting studies. London: Routledge.10.4324/9781315647845Search in Google Scholar

Moran, Siobhan. 2012. The effect of linguistic variation on subtitle reading. In Elisa Perego (ed.), Eye tracking in audiovisual translation, 183–222. Rome: Arcane.Search in Google Scholar

Pedersen, Jan. 2011. Subtitling norms for television: An exploration focussing on extralinguistic cultural references. Amsterdam: John Benjamins Publishing Company.10.1075/btl.98Search in Google Scholar

Perego, Elisa & Elisa Ghia. 2011. Subtitle consumption according to eye tracking data: An acquisitional perspective. In Laura Incalcaterra McLoughlin, Marie Biscio & Máire Áine Ní Mhainnín (eds.), Audiovisual translation subtitles and subtitling: Theory and practice, 177–196. Peter Lang: Bern.Search in Google Scholar

Perego, Elisa, Fabio Del Missier, Marco Porta & Mauro Mosconi. 2010. The cognitive effectiveness of subtitle processing. Media Psychology 13. 243–272. https://doi.org/10.1080/15213269.2010.502873.Search in Google Scholar

Rayner, Keith. 1998. Eye movements in reading and information processing: 20 years of research. Psychological Bulletin 124(3). 372–422. https://doi.org/10.1037/0033-2909.124.3.372.Search in Google Scholar

Richeri, Giuseppe. 2016. Global film market, regional problems. Global Media and China 1(4). 312–330. https://doi.org/10.1177/2059436416681576.Search in Google Scholar

Schotter, Elisabeth R. & Keith Rayner. 2012. Eye movements in reading: Implications for reading subtitles. In Elisa Perego (ed.), Eye tracking in audiovisual translation, 83–104. Rome: ARACNE.Search in Google Scholar

Song, Xu. 2018. Hollywood movies and China: Analysis of Hollywood globalization and relationship management in China’s cinema market. Global media and China 3(3). 177–194. https://doi.org/10.1177/2059436418805538.Search in Google Scholar

Szarkowska, Agnieszka & Julianna Boczkowska. 2022. Colour coding subtitles in multilingual films – A reception study. Perspectives 30(3). 520–536. https://doi.org/10.1080/0907676x.2020.1853186.Search in Google Scholar

Szarkowska, Agnieszka & Lidia Bogucka. 2019. Six-second rule revisited: An eyetracking study on the impact of speech rate and language proficiency on subtitle reading. Translation, Cognition & Behavior 2(1). 101–124. https://doi.org/10.1075/tcb.00022.sza.Search in Google Scholar

Szarkowska, Agnieszka & Olivia Gerber-Morón. 2018. Viewers can keep up with fast subtitles: Evidence from eye movements. PLoS One 13. 1–30. https://doi.org/10.1371/journal.pone.0199331.Search in Google Scholar

Warren, T., S. J. White & E. D. Reichle. 2009. Investigating the causes of wrap-up effects: Evidence from eye movements and E–Z Reader. Cognition 111(1). 132–137. https://doi.org/10.1016/j.cognition.2008.12.011.Search in Google Scholar

Wei, Rining & Jinzhi Su. 2012. The statistics of English in China: An analysis of the best available data from government sources. English Today 28(3). 10–14. https://doi.org/10.1017/s0266078412000235.Search in Google Scholar

Yan, Guoli, Jianping Xiong, Chuanli Zang, Lili Yu, Lei Cui & Xuejun Bai. 2013. Review of eye-movement measures in reading research. Advances in Psychological Science 21(4). 589–605. https://doi.org/10.3724/sp.j.1042.2013.00589.Search in Google Scholar

Yi guan fen xi. 2021. A June 2021 survey on membership of video APPs. The Paper (July 29th 2021). https://m.thepaper.cn/baijiahao_13795990 (accessed 13 August 2021).Search in Google Scholar

Yu, Haikuo. 2015. Film translation in China: Features and technical constraints of dubbing and subtitling English into Chinese. Babel 61(4). 493–510, https://doi.org/10.1075/babel.61.4.03hai.Search in Google Scholar

Yuan, Xiaohui. 2012. Politeness and audience response in Chinese–English subtitling. Peter Lang: Bern.10.3726/978-3-0353-0280-6Search in Google Scholar

Zhang, Han, Nicola C. Anderson & Kevin F. Miller. 2021. Refixation patterns of mind-wandering during real-world scene perception. Journal of Experimental Psychology: Human Perception and Performance 47(1). 36–52. https://doi.org/10.1037/xhp0000877.Search in Google Scholar

Zheng, Binghan & Hao Zhou. 2018. Revisiting processing time for metaphorical expressions: An eyetracking study on eye-voice span during sight translation. Foreign Language Teaching and Research 50(5). 744–759.Search in Google Scholar

Received: 2022-11-08
Accepted: 2023-02-26
Published Online: 2023-03-16
Published in Print: 2023-09-26

© 2023 Walter de Gruyter GmbH, Berlin/Boston

Downloaded on 19.4.2026 from https://www.degruyterbrill.com/document/doi/10.1515/multi-2022-0138/html
Scroll to top button