Intermedial cognitive semiotics
-
Asunción López-Varela
Abstract
In this chapter, intermediality is explored from an interdisciplinary perspective that uses neuroscience as well as cognitive-semiotic concerns and insights from online digital communication, presenting it as a process where biophysical, technological, and interpersonal factors interact. Shared attention as well as spatial and temporal cueing – eye contact and the sonic modality – are explored from a task-oriented and social interactive dimension. The spatiotemporal impact of the mediating context is highlighted by moving from the role of visual cueing, in a brief reference to Al Davison’s autobiographical graphic novel The spiral cage, to a more detailed analysis of Annie Abrahams’ (2010) online project A fragmented relation, where cueing is dependent not just on spatial frames but also on the temporal dynamics introduced by the aural dimension recorded in an online environment. The paper tangentially touches upon the role of affect in communication.
Abstract
In this chapter, intermediality is explored from an interdisciplinary perspective that uses neuroscience as well as cognitive-semiotic concerns and insights from online digital communication, presenting it as a process where biophysical, technological, and interpersonal factors interact. Shared attention as well as spatial and temporal cueing – eye contact and the sonic modality – are explored from a task-oriented and social interactive dimension. The spatiotemporal impact of the mediating context is highlighted by moving from the role of visual cueing, in a brief reference to Al Davison’s autobiographical graphic novel The spiral cage, to a more detailed analysis of Annie Abrahams’ (2010) online project A fragmented relation, where cueing is dependent not just on spatial frames but also on the temporal dynamics introduced by the aural dimension recorded in an online environment. The paper tangentially touches upon the role of affect in communication.
Kapitel in diesem Buch
- Prelim pages i
- Table of contents v
- About the contributors vii
- Multimodality and Cognitive Linguistics 1
-
Cognitive Linguistics and multimodal metaphor
- Cross-modal resonances in creative multimodal metaphors 13
- Metaphor and symbol 27
- Woven emotions 45
- Approaching the utopia of a global brand 61
- Multimodal metaphors in political entertainment 79
-
Multimodality, Cognitive and Systemic Functional Linguistics
- The visual representation of metaphor 99
- Visual metonymy in children’s picture books 115
- The establishment of interpretative expectations in film 131
- Multimodal digital storytelling 147
-
Cognitive Linguistics and multimodal interaction
- Intermedial cognitive semiotics 167
- Multimodality in Conversational Humor 181
- Image schemas and mimetic schemas in cognitive linguistics and gesture studies 195
- Index 211
Kapitel in diesem Buch
- Prelim pages i
- Table of contents v
- About the contributors vii
- Multimodality and Cognitive Linguistics 1
-
Cognitive Linguistics and multimodal metaphor
- Cross-modal resonances in creative multimodal metaphors 13
- Metaphor and symbol 27
- Woven emotions 45
- Approaching the utopia of a global brand 61
- Multimodal metaphors in political entertainment 79
-
Multimodality, Cognitive and Systemic Functional Linguistics
- The visual representation of metaphor 99
- Visual metonymy in children’s picture books 115
- The establishment of interpretative expectations in film 131
- Multimodal digital storytelling 147
-
Cognitive Linguistics and multimodal interaction
- Intermedial cognitive semiotics 167
- Multimodality in Conversational Humor 181
- Image schemas and mimetic schemas in cognitive linguistics and gesture studies 195
- Index 211
