Abstract
A multimodal construction is said to be a conventional pairing of a complex form, comprising at least a verbal and a kinetic element, with a specific meaning or a specific function. Do we need a new constructional approach to account for such multimodal constructions? What are the challenges to account for multimodality? The aim of this contribution is to provide a precise notion ‘multimodal construction’ and, on this basis, to indicate possible pathways for future investigations. The paper opts for cautiously extending the scope of existing constructional approaches in order to include non-linguistic meaningful behavior. In particular, it is argued that even though Construction Grammar invites for treating multimodal on a par with linguistic constructions, there is a huge lack of substantial empirical support to arrive at a more detailed and data-based understanding of the nature of multimodal constructions.
Acknowledgement
I would like to thank Elisabeth Zima and Alexander Bergs – the editors of this special issue on multimodal constructions – for their helpful support. I am also grateful to the anonymous reviewers who provided helpful comments. It goes without saying that the usual disclaimer applies.
References
Armstrong, Nancy & Melissa Wagner. 2003. Field guide to gestures – how to identify and interpret virtually every gesture known to man. Philadelphia: Quirk.Search in Google Scholar
Boas, Hans C. & Alexander Ziem. In preparation. Constructing a constructicon for German. Empirical, theoretical, and methodological issues.Search in Google Scholar
Booij, Geert. 2010. Construction morphology. Oxford: Oxford University.10.1111/j.1749-818X.2010.00213.xSearch in Google Scholar
Boroditsky, Lera. 2000. Metaphoric structuring: Understanding time through spatial metaphors. Cognition 75(1). 1–28.10.1016/S0010-0277(99)00073-6Search in Google Scholar
Bybee, Joan L. 2010. Language, usage and cognition. Cambridge: Cambridge University Press.10.1017/CBO9780511750526Search in Google Scholar
Cienki, Alan. 2015. Spoken language usage events. Language and Cognition 7. 499–514.10.1017/langcog.2015.20Search in Google Scholar
Croft, William. 2001. Radical construction grammar: Syntactic theory in typological perspective. Oxford: Oxford University Press.10.1093/acprof:oso/9780198299554.001.0001Search in Google Scholar
Fabbri-Destro, Maddalena, Pietro Avanzini, Elisa De Stefani, Alessandro Innocenti, Cristina Campi & Maurizio Gentilucci. 2015. Interaction between words and symbolic gestures as revealed by N400. Brain Topography 28(4). 591–605.10.1007/s10548-014-0392-4Search in Google Scholar
Feyaerts, Kurt, Geert Brône, Paul Sambre, Bert Oben, Steven Schoonjans & Elisabeth Zima. 2014. Accounting for multimodality in construction grammar. Talk at DGKL 6, Nürnberg-Erlangen, October 2014.Search in Google Scholar
Fillmore, Charles J. 1985. Frames and the semantics of understanding. Quaderni di Semantica 6(2). 222–254.Search in Google Scholar
Fillmore, Charles J. 1988. The mechanisms of ‘Construction Grammar’. Berkeley Linguistic Society 14. 35–55.10.3765/bls.v14i0.1794Search in Google Scholar
Fillmore, Charles J., Paul Kay & Mary C. O’Connor. 1988. Regularity and idiomaticity in grammatical constructions: The case of let alone. Language 64(3). 501–38.10.2307/414531Search in Google Scholar
Fricke, Ellen. 2012. Grammatik multimodal: Wie Wörter und Gesten zusammenwirken. Berlin und Boston: de Gruyter.10.1515/9783110218893Search in Google Scholar
Fried, Mirjam & Jan-Ola Östman. 2004. Construction grammar: A thumbnail sketch. In Mirjam Fried & Jan-Ola Östman (eds.), Construction grammar in a cross-language perspective, 11–86. Amsterdam: John Benjamins.10.1075/cal.2.02friSearch in Google Scholar
Goldberg, Adele E. 1995. Constructions: A construction grammar approach to argument structure. Chicago: The University of Chicago Press.Search in Google Scholar
Goldberg, Adele E. 2003. Constructions: A new theoretical approach to language. Trends in Cognitive Sciences 7(5). 219–224.10.1016/S1364-6613(03)00080-9Search in Google Scholar
Goldberg, Adele E. 2006. Constructions at work: The nature of generalization in language. Oxford: Oxford University Press.10.1093/acprof:oso/9780199268511.001.0001Search in Google Scholar
Goldberg Adele E. 2013. Constructionist Approaches. In Hoffmann and Trousdale (eds.), The Oxford handbook of Construction Grammar, 15–31. Oxford: Oxford University Press.10.1093/oxfordhb/9780195396683.013.0002Search in Google Scholar
Hilpert, Martin. 2014. Construction Grammar and its application to English. Edinburgh: Edinburgh University Press.Search in Google Scholar
Hoffmann, Thomas. 2017. Multimodal constructs – multimodal constructions? The role of constructions in the working memory. Linguistics Vanguard 3(s1). 10.1515/lingvan-2016-0042.Search in Google Scholar
Hoffmann, Thomas & Graeme Trousdale (eds.). 2013. The Oxford handbook of Construction Grammar. Oxford: Oxford University Press.10.1093/oxfordhb/9780195396683.001.0001Search in Google Scholar
Kendon, Adam. 2004. Gesture: Visual action as utterance. New York: Cambridge University Press.10.1017/CBO9780511807572Search in Google Scholar
Lakoff, George. 1991. Cognitive versus generative linguistics: How commitments influence results. Language and Communication 1(1). 53–62.10.1016/0271-5309(91)90018-QSearch in Google Scholar
Müller, Cornelia. 1998. Redebegleitende Gesten. Kulturgeschichte – Theorie – Sprachvergleich. Berlin: Berlin Verlag Arno Spitz.Search in Google Scholar
Radden, Günter. 2006. The metaphor TIME AS SPACE across languages. In Elzbieta Górska & Günter Radden (eds.), Metonymy – metaphor collage, 99–120. Warsaw: Warsaw University Press.Search in Google Scholar
Saussure, Ferdinand de. 2006 [1916]. Course in general linguistics, Ed. By Charles Bally & Albert Sechehaye. Trans. Roy Harris. La Salle, IL: Open Court.Search in Google Scholar
Schoonjans, Steven, Geert Brône & Kurt Feyaerts. 2015. Multimodalität in der Konstruktionsgrammatik: Eine kritische Betrachtung illustriert anhand einer Gestikanalyse der Partikel einfach. In Jörg Bücker, Wolfgang Imo & Susanne Günthner, (eds.), Konstruktionsgrammatik V. Konstruktionen im Spannungsfeld von sequentiellen Mustern, kommunikativen Gattungen und Textsorten, 291–308. Tübingen: Stauffenburg.Search in Google Scholar
Steen, Francis & Mark Turner. 2013. Multimodal Construction Grammar. In Michael Borkent, Barbara Dancygier & Jennifer Hinnell (eds.), Language and the creative mind, 255–274. Stanford, CA: CSLI Publications.Search in Google Scholar
Stefanowitsch, Anatol. 2013. Collostructional analysis. In Thomas Hoffmann and Graeme Trousdale (eds.), The Oxford handbook of Construction Grammar, 290–306. Oxford: Oxford University Press.10.1093/oxfordhb/9780195396683.013.0016Search in Google Scholar
Stefanowitsch, Antatol. 2011. Konstruktionsgrammatik und Grammatiktheorie. In Alexander Lasch & Alexander Ziem (eds.), Konstruktionsgrammatik III: Aktuelle Fragen und Lösungsansätze, 13–27. Tübingen: Stauffenburg.Search in Google Scholar
Stuckenbrock, Anja. 2015. Deixis in der Face-to-face-Interaktion. Berlin & Boston: de Gruyter.10.1515/9783110307436Search in Google Scholar
Taylor, John R. 2014. Syntactic constructions as prototype categories. In Michael Tomasello (ed.), The new psychology of language: Cognitive and functional approaches to language structure, vol. 1, 16–187. New York: Routledge.Search in Google Scholar
Tomasello, Michael. 1999. The cultural origins of human cognition: An essay. Cambridge, MA: Harvard University Press.10.4159/9780674044371Search in Google Scholar
Ziem, Alexander. 2014a. Frames of understanding in text and discourse: Theoretical foundations and descriptive applications (= Human Cognitive Processing 48). Amsterdam & Philadelphia: Benjamins.10.1075/hcp.48Search in Google Scholar
Ziem, Alexander. 2014b. Konstruktionsgrammatische Konzepte eines Konstruktikons. In Alexander Lasch & Alexander Ziem (eds.), Grammatik als Netzwerk von Konstruktionen. Sprachliches Wissen im Fokus der Konstruktionsgrammatik, 15–34. Berlin & New York: de Gruyter.10.1515/9783110353693.15Search in Google Scholar
Ziem, Alexander. 2015. Probleme und Desiderata einer Social Construction Grammar. In Alexander Ziem & Alexander Lasch (eds.), Konstruktionsgrammatik IV. Konstruktionen als soziale Konventionen und kognitive Routinen, 1–22. Tübingen: Stauffenburg.Search in Google Scholar
Ziem, Alexander & Alexander Lasch. 2013. Konstruktionsgrammatik. Konzepte und Grundlagen gebrauchsbasierter Ansätze. Berlin: de Gruyter.10.1515/9783110295641Search in Google Scholar
Zima, Elisabeth. 2014. Gibt es multimodale Konstruktionen? Eine Studie zu [V(motion) in circles] und [all the way from X PREP Y]. Gesprächsforschung – Online-Zeitschrift zur verbalen Interaktion 15. 1–48.Search in Google Scholar
Zima, Elisabeth. In press. Multimodal constructional resemblance. The case of English circular motion constructions. In Francisco Ruiz de Mendoza, Alba Luzondo & Paula Pérez-Sobrino (eds.), Constructing families of constructions. Amsterdam: John Benjamins.Search in Google Scholar
© 2017 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Multimodality and construction grammar
- Multimodal constructs – multimodal constructions? The role of constructions in the working memory
- Utterance Construction Grammar (UCxG) and the variable multimodality of constructions
- Apposition: A multimodal construction? The multimodality of linguistic constructions in the light of usage-based theory
- Is there a multimodal construction based on non-deictic so in German?
- Multimodal existential constructions in German: Manual actions of giving as experiential substrate for grammatical and gestural patterns
- On the multimodality of [all the way from X PREP Y]
- Timelines and multimodal constructions: Facing new challenges
- Multimodal form-meaning pairs for blended classic joint attention
- Multimodal rhetoric: Fictive interaction strategies in political discourse
- The “Negative-Assessment-Construction” – A multimodal pattern based on a recurrent gesture?
- The shrug as marker of obviousness
- Multimodal Construction Grammar issues are Construction Grammar issues
- Do we really need a Multimodal Construction Grammar?
Articles in the same Issue
- Multimodality and construction grammar
- Multimodal constructs – multimodal constructions? The role of constructions in the working memory
- Utterance Construction Grammar (UCxG) and the variable multimodality of constructions
- Apposition: A multimodal construction? The multimodality of linguistic constructions in the light of usage-based theory
- Is there a multimodal construction based on non-deictic so in German?
- Multimodal existential constructions in German: Manual actions of giving as experiential substrate for grammatical and gestural patterns
- On the multimodality of [all the way from X PREP Y]
- Timelines and multimodal constructions: Facing new challenges
- Multimodal form-meaning pairs for blended classic joint attention
- Multimodal rhetoric: Fictive interaction strategies in political discourse
- The “Negative-Assessment-Construction” – A multimodal pattern based on a recurrent gesture?
- The shrug as marker of obviousness
- Multimodal Construction Grammar issues are Construction Grammar issues
- Do we really need a Multimodal Construction Grammar?