John Benjamins Publishing Company
Chapter 11. Exploring the boundaries of gesture-speech integration during language comprehension
Abstract
The present review explores the integrated relationship between gesture and speech during language comprehension. Taking a broad view, it presents a conceptual framework that approaches the comprehension of gesture and speech along three different dimensions: (1) components of language (semantics, pragmatics, phonetics and syntax), (2) levels of analysis (social, cognitive, and biological) and (3) timeframes of integration (online, moment-to-moment, developmental). The evidence suggests that some linguistic components (e.g., concrete semantic and pragmatic) are deeply connected to gestures, but others (e.g., abstract semantic, syntactic and phonetic) are less so. In this way, the hands help to delineate what aspects of language function as part of the body and what aspects operate independently of it.
Abstract
The present review explores the integrated relationship between gesture and speech during language comprehension. Taking a broad view, it presents a conceptual framework that approaches the comprehension of gesture and speech along three different dimensions: (1) components of language (semantics, pragmatics, phonetics and syntax), (2) levels of analysis (social, cognitive, and biological) and (3) timeframes of integration (online, moment-to-moment, developmental). The evidence suggests that some linguistic components (e.g., concrete semantic and pragmatic) are deeply connected to gestures, but others (e.g., abstract semantic, syntactic and phonetic) are less so. In this way, the hands help to delineate what aspects of language function as part of the body and what aspects operate independently of it.
Chapters in this book
- Prelim pages i
- Table of contents v
-
Introduction
- Chapter 1. Understanding gesture 3
-
Section 1. The function of gesture production for language
- Chapter 2. Representational gestures help speakers package information for speaking 15
- Chapter 3. Function and processing of gesture in the context of language 39
- Chapter 4. The asymmetric redundancy of gesture and speech 59
- Chapter 5. Gesture-speech unity 77
- Chapter 5 Supplement. Exchange on gesture-speech unity 103
-
Section 2. The function of gesture for cognition and social interaction
- Chapter 6. The function of gesture in learning and memory 129
- Chapter 7. Gestures highlight perceptual-motor representations in thinking 155
- Chapter 8. One function of gesture is to make new ideas 175
- Chapter 9. Gesture in socio-moral reasoning 197
- Chapter 10. Multi-modal communication of common ground 213
-
Part 2. The function of gesture comprehension
- Chapter 11. Exploring the boundaries of gesture-speech integration during language comprehension 243
- Chapter 12. Computational gesture research 267
- Chapter 13. Making and breaking common ground 285
- Chapter 14. The function of gesture in mathematical and scientific discourse in the classroom 317
- Chapter 15. Gesture’s role in learning interactions 331
- Chapter 16. The sound of silence 353
-
Part 3. Why gesture?
- Chapter 17. Understanding gesture as representational action 381
- Chapter 18. So how does gesture function in speaking, communication, and thinking? 397
- Author index 413
- Subject index 421
Chapters in this book
- Prelim pages i
- Table of contents v
-
Introduction
- Chapter 1. Understanding gesture 3
-
Section 1. The function of gesture production for language
- Chapter 2. Representational gestures help speakers package information for speaking 15
- Chapter 3. Function and processing of gesture in the context of language 39
- Chapter 4. The asymmetric redundancy of gesture and speech 59
- Chapter 5. Gesture-speech unity 77
- Chapter 5 Supplement. Exchange on gesture-speech unity 103
-
Section 2. The function of gesture for cognition and social interaction
- Chapter 6. The function of gesture in learning and memory 129
- Chapter 7. Gestures highlight perceptual-motor representations in thinking 155
- Chapter 8. One function of gesture is to make new ideas 175
- Chapter 9. Gesture in socio-moral reasoning 197
- Chapter 10. Multi-modal communication of common ground 213
-
Part 2. The function of gesture comprehension
- Chapter 11. Exploring the boundaries of gesture-speech integration during language comprehension 243
- Chapter 12. Computational gesture research 267
- Chapter 13. Making and breaking common ground 285
- Chapter 14. The function of gesture in mathematical and scientific discourse in the classroom 317
- Chapter 15. Gesture’s role in learning interactions 331
- Chapter 16. The sound of silence 353
-
Part 3. Why gesture?
- Chapter 17. Understanding gesture as representational action 381
- Chapter 18. So how does gesture function in speaking, communication, and thinking? 397
- Author index 413
- Subject index 421