Gestural strategies in questions during monological discourse
-
Manon Lelandais
Abstract
This study identifies regular gestural correlates to questions produced in TED Talks. In dialogue, questions have been linked with eyebrow movement, head nods, beats, and palm-up gestures. However, it is not clear whether the same cues are found in monological discourse, where audience role and participation are constrained. We hypothesized that speakers would use gesture differently depending on question type (e.g., fronted item; declarative; verbless), syntactic status (direct; embedded; appositive), and localization in the talk (beginning; middle; end). We used videos in the TED repository, which were transcribed and annotated using ELAN for gestures and question type, syntactic status, and localization (6 h and 4 min, 1,108 questions, 17 speakers, variety: General American). We used chi-square tests to examine the relation between the proportion of gestures and question type, syntactic status, and localization. The results show that hand and head gestures are regularly produced as part of questions, but not eyebrow movement. The amount and nature of hand gestures are impacted by two variables (question type and localization), while head gestures are impacted by only one of them (syntactic status). Eyebrow movement is not impacted overall. We discuss how these gestural features map out the different discursive functions at play.
Funding source: IDEX Universite Paris Cite
Award Identifier / Grant number: IDEX UP 2021-I-053
-
Research funding: This research received a specific grant from a funding agency in the public sector: IDEX UP 2021-I-053, PI: A. Celle.
-
Data repository: Videos for all examples in this paper are available on OSF at https://osf.io/uvb3j/?view_only=fd530dcee4be4d34bb8ed7be8a411cb9.
References
Alexanderson, Simon, David House & Jonas Beskow. 2013. Extracting and analysing co-speech head gestures from motion-capture data. In Robert Eklund (ed.), Proceedings of Fonetik 2013, 1–4. Linköping: Linköping University.Suche in Google Scholar
Bernad-Mechó, Edgar & Inmaculada Fortanet-Gómez. 2019. Organizational metadiscourse across lecturing styles. In Carmen Sancho Guinda (ed.), Engagement in professional genres, 321–340. Amsterdam: John Benjamins.10.1075/pbns.301.17berSuche in Google Scholar
Biezma, Maria & Kyle Rawlins. 2017. Rhetorical questions: Severing questioning from asking. In Proceedings of SALT 27, 302–322. Washington, DC: LSA.10.3765/salt.v27i0.4155Suche in Google Scholar
Borràs-Comes, Joan, Constantijn Kaland, Pilar Prieto & Swerts Marc. 2014. Audiovisual correlates of interrogativity: A comparative analysis of Catalan and Dutch. Journal of Nonverbal Behaviour 38. 53–66. https://doi.org/10.1007/s10919-013-0162-0.Suche in Google Scholar
Breckinridge Church, Ruth & Susan Goldin-Meadow. 2017. So how does gesture function in speaking, communication, and thinking? In Ruth Breckinridge Church, Martha W. Alibali & Spencer D. Kelly (eds.), Why gesture? How the hands function in speaking, thinking, and communicating, 397–412. Amsterdam: John Benjamins.10.1075/gs.7.19chuSuche in Google Scholar
Bressem, Jana. 2021. Repetitions in gesture: A cognitive-linguistic and usage-based perspective. Berlin: De Gruyter Mouton.10.1515/9783110697902Suche in Google Scholar
Bressem, Jana & Silva H. Ladewig. 2011. Rethinking gesture phases: Articulatory features of gestural movement? Semiotica 184. 53–91. https://doi.org/10.1515/semi.2011.022.Suche in Google Scholar
Camiciottoli, Belinda C. 2008. Interaction in academic lectures vs. written text materials: The case of questions. Journal of Pragmatics 40(7). 1216–1231. https://doi.org/10.1016/j.pragma.2007.08.007.Suche in Google Scholar
Cardo, Michele & Agnès Celle. 2024. Question sequences and salience in TED talks. Anglophonia 37. https://doi.org/10.4000/12poe.Suche in Google Scholar
Chu, Mingyuan, Antje Meyer, Lucy Foulkes & Kita Sotaro. 2014. Individual differences in frequency and saliency of speech-accompanying gestures: The role of cognitive abilities and empathy. Journal of Experimental Psychology: General 143(2). 694–709. https://doi.org/10.1037/a0033861.Suche in Google Scholar
Cienki, Alan. 2022. The study of gesture in cognitive linguistics: How it could inform and inspire other research in cognitive science. WIREs Cognitive Science 13. https://doi.org/10.1002/wcs.1623.Suche in Google Scholar
Cienki, Alan. 2024. Self-focused versus dialogic features of gesturing during simultaneous interpreting. Russian Journal of Linguistics 28(2). 227–242. https://doi.org/10.22363/2687-0088-34572.Suche in Google Scholar
Compagnone, Antonio. 2015. The reconceptualization of academic discourse as a professional practice in the digital age: A critical genre analysis of TED talks. Hermes – Journal of Language Communication in Business 54. 49–69. https://doi.org/10.7146/hjlcb.v27i54.22947.Suche in Google Scholar
Cooperrider, Kensy, Natasha Abner & Susan Goldin-Meadow. 2018. The palm-up puzzle: Meanings and origins of a widespread form in gesture and sign. Frontiers in Communication 3(23). https://doi.org/10.3389/fcomm.2018.00023.Suche in Google Scholar
Crespo-Sendra, Verónica, Constantijn Kaland, Marc Swerts & Pilar Prieto. 2013. Perceiving incredulity: The role of intonation and facial gestures. Journal of Pragmatics 47(1). 1–13. https://doi.org/10.1016/j.pragma.2012.08.008.Suche in Google Scholar
Dehé, Nicole, Bettina Braun, Marieke Einfeldt, Daniela Wochner & Katharina Zahner. 2022. The prosody of rhetorical questions: A cross-linguistic view. Linguistische Berichte 269. 3–42.10.46771/9783967691757_1Suche in Google Scholar
Farkas, Donka F. 2022. Non-intrusive questions as a special type of non-canonical questions. Journal of Semantics 39(2). 295–337. https://doi.org/10.1093/jos/ffac001.Suche in Google Scholar
Ferrara, Lindsay & Gabrielle Hodge. 2018. Language as description, indication, and depiction. Frontiers in Psychology 9. https://doi.org/10.3389/fpsyg.2018.00716.Suche in Google Scholar
Flecha-García, María L. 2010. Eyebrow raises in dialogue and their relation to discourse structure, utterance function and pitch accents in English. Speech Communication 52. 542–554. https://doi.org/10.1016/j.specom.2009.12.003.Suche in Google Scholar
Frank, Jane. 1990. You call that a rhetorical question? Forms and functions of rhetorical questions in conversation. Journal of Pragmatics 14(5). 723–738. https://doi.org/10.1016/0378-2166(90)90003-V.Suche in Google Scholar
Freed, Alice F. 1994. The form and function of questions in informal dyadic conversation. Journal of Pragmatics 21(6). 621–644. https://doi.org/10.1016/0378-2166(94)90101-5.Suche in Google Scholar
Ginzburg, Jonathan. 2016. The semantics of dialogue. In Maria Aloni & Paul Dekker (eds.), The Cambridge handbook of formal semantics, 1–52. Cambridge: Cambridge University Press.10.1017/CBO9781139236157.006Suche in Google Scholar
Ginzburg, Jonathan & Andy Lücking. 2021. Requesting clarifications with speech and gestures. In Proceedings of the 1st workshop on Multimodal Semantic Representations (MMSR), 21–31. Association for Computational Linguistics.Suche in Google Scholar
Glasbergen-Plas, Aliza, Stella Gryllia & Jenny Doetjes. 2021. The prosody of French wh-in-situ questions: Echo vs. non-echo. Journal of Linguistics 57(3). 569–603. https://doi.org/10.1017/S0022226720000158.Suche in Google Scholar
Granström, Björn & David House. 2005. Audiovisual representation of prosody in expressive speech communication. Speech Communication 46(3). 473–484. https://doi.org/10.1016/j.specom.2005.02.017.Suche in Google Scholar
Hardison, Debra M. 2018. Visualizing the acoustic and gestural beats of emphasis in multimodal discourse: Theoretical and pedagogical implications. Journal of Second Language Pronunciation 4(2). 232–259. https://doi.org/10.1075/jslp.17006.har.Suche in Google Scholar
Hautli-Janisz, Annette, Katarzyna Budzynska, Conor McKillop, Brian Plüss, Valentin Gold & Chris Reed. 2022. Questions in argumentative dialogue. Journal of Pragmatics 188. 56–79. https://doi.org/10.1016/j.pragma.2021.10.029.Suche in Google Scholar
House, David, Jonas Beskow & Björn Granström. 2001. Timing and interaction of visual cues for prominence in audiovisual speech perception. In Paul Dalsgaard (ed.), Proceedings of Eurospeech 2001, 387–390. Aalborg, Denmark: ISCA.10.21437/Eurospeech.2001-61Suche in Google Scholar
Ilie, Cornelia. 1995. The validity of rhetorical questions as arguments in the courtroom: Special fields and cases. In Frans, H. (ed.), Proceedings of the 3rd international conference on argumentation, 73–88. Amsterdam: SICSAT.Suche in Google Scholar
Kendon, Adam. 2004. Gesture: Visible action as utterance. Cambridge: Cambridge University Press.10.1017/CBO9780511807572Suche in Google Scholar
Kipp, Michael, Michael Neff & Irene Albrecht. 2007. An annotation scheme for conversational gestures: How to economically capture timing and form. Language Resources and Evaluation 41. 325–339. https://doi.org/10.1007/s10579-007-9053-5.Suche in Google Scholar
Koshik, Irene. 2005. Beyond rhetorical questions: Assertive questions in everyday interaction. Amsterdam: John Benjamins.10.1075/sidag.16Suche in Google Scholar
Krifka, Manfred. 2011. Questions. In Klaus von Heusinger, Claudia Maienborn & Paul Portner (eds.), Semantics: An international handbook of natural language meaning, 2, 1742–1785. Berlin: Mouton de Gruyter.Suche in Google Scholar
Leonard, Thomas & Fred Cummins. 2010. The temporal relation between beat gestures and speech. Language & Cognitive Processes 26(10). 1457–1471. https://doi.org/10.1080/01690965.2010.500218.Suche in Google Scholar
Ludewig, Julia. 2017. TED Talks as an emergent genre. CLCWeb: Comparative Literature and Culture 19(1). 2–9. https://doi.org/10.7771/1481-4374.2946.Suche in Google Scholar
McNeill, David. 1992. Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.Suche in Google Scholar
McNeill, David. 2005. Gesture and thought. Chicago: University of Chicago Press.10.7208/chicago/9780226514642.001.0001Suche in Google Scholar
Munhall, Kevin G., Jeffery A. Jones, Daniel E. Callan, Takaaki Kuratate & Eric Vatikiotis-Bateson. 2004. Visual prosody and speech intelligibility: Head movement improves auditory speech perception. Psychological Science 15(2). 133–137. https://doi.org/10.1111/j.0963-7214.2004.01502010.x.Suche in Google Scholar
Nota, Naomi, James Trujillo & Judith Holler. 2023. Specific facial signals associate with categories of social actions conveyed through questions. PLoS One 18(7). https://doi.org/10.1371/journal.pone.0288104.Suche in Google Scholar
Prieto-Vives, Pilar, Alice Cravotta, Olga Kushch, Patrick Rohrer & Ingrid Vilà-Giménez. 2018. Deconstructing beat gestures: A labelling proposal. In K. Klessa, J. Bachan, A. Wagner, M. Karpiński & D. Śledziński (eds.), Proceedings of the 9th international conference on speech prosody, 201–205. Poznań, Poland: ISCA.10.21437/SpeechProsody.2018-41Suche in Google Scholar
Rossano, Federico. 2010. Questioning and responding in Italian. Journal of Pragmatics 42(10). 2756–2771. https://doi.org/10.1016/j.pragma.2010.04.010.Suche in Google Scholar
Schegloff, Emanuel A. 2007. Sequence organization in interaction: A primer in conversation analysis. Cambridge: Cambridge University Press.10.1017/CBO9780511791208Suche in Google Scholar
Shattuck-Hufnagel, Stefanie & Ada Ren. 2018. The prosodic characteristics of non-referential co-speech gestures in a sample of academic-lecture-style speech. Frontiers in Psychology 9. https://doi.org/10.3389/fpsyg.2018.01514.Suche in Google Scholar
Sloetjes, Han & Peter Wittenburg. 2008. Annotation by category: ELAN and ISO DCR. In Proceedings of the 6th international Conference on language Resources and evaluation. Marrakech, Morocco: European Language Resources Association (ELRA). Retrieved from: http://www.lrec-conf.org/proceedings/lrec2008/pdf/208_paper.pdf (accessed 28 April 2025).Suche in Google Scholar
Stivers, Tanya & N. J. Enfield. 2010. A coding scheme for question-response sequences in conversation. Journal of Pragmatics 42(10). 2620–2626. https://doi.org/10.1016/j.pragma.2010.04.002.Suche in Google Scholar
Stivers, Tanya, N. J. Enfield, Penelope Brown, Christina Englert, Makoto Hayashi, Trine Heinemann, Gertie Hoymann, Federico Rossano, Jan Peter de Ruiter, Kyung-Eun Yoon & Stephen C. Levinson. 2009. Universals and cultural variation in turn-taking in conversation. PNAS 106(26). https://doi.org/10.1073/pnas.0903616106.Suche in Google Scholar
Torreira, Francisco & Emma Valtersson. 2015. Phonetic and visual cues to questionhood in French conversation. Phonetica 72(1). 20–42. https://doi.org/10.1159/000381723.Suche in Google Scholar
Wells, John C. 2006. English intonation: An introduction. Cambridge: Cambridge University Press.Suche in Google Scholar
Zhang, Justine, Spirling Arthur & Cristian Danescu-Niculescu-Mizil. 2017. Asking too much? The rhetorical role of questions in political discourse. In Proceedings of empirical Methods in natural language processing 2017, 1558–1572. Copenhagen: Association for Computation Linguistics.10.18653/v1/D17-1164Suche in Google Scholar
© 2025 Walter de Gruyter GmbH, Berlin/Boston
