Multimodal digital storytelling
-
Isabel Alonso
Abstract
Digital stories are a very recent multimedia practice by which ordinary people construct short narratives on personal affairs combining voice, images and sometimes music. This paper contributes to the description of this new emergent genre from both a multimodal and a cognitive point of view, by exploring how diverse semiotic channels in digital storytelling provide different kinds of information (factual, emotional, cultural, etc.) which are finally integrated to construct the global meaning of the narrative. For this purpose, we combine Kress and Van Leeuwen’s (1996) scholarly work related to multimodal representation, with the use of some notions of the Mental Spaces and Conceptual Integration theory (Dancygier, 2008; Fauconnier & Turner, 2002). The results of this study are of interest to those concerned with the representational and communicational modes of semiotic resources in storytelling.
Abstract
Digital stories are a very recent multimedia practice by which ordinary people construct short narratives on personal affairs combining voice, images and sometimes music. This paper contributes to the description of this new emergent genre from both a multimodal and a cognitive point of view, by exploring how diverse semiotic channels in digital storytelling provide different kinds of information (factual, emotional, cultural, etc.) which are finally integrated to construct the global meaning of the narrative. For this purpose, we combine Kress and Van Leeuwen’s (1996) scholarly work related to multimodal representation, with the use of some notions of the Mental Spaces and Conceptual Integration theory (Dancygier, 2008; Fauconnier & Turner, 2002). The results of this study are of interest to those concerned with the representational and communicational modes of semiotic resources in storytelling.
Kapitel in diesem Buch
- Prelim pages i
- Table of contents v
- About the contributors vii
- Multimodality and Cognitive Linguistics 1
-
Cognitive Linguistics and multimodal metaphor
- Cross-modal resonances in creative multimodal metaphors 13
- Metaphor and symbol 27
- Woven emotions 45
- Approaching the utopia of a global brand 61
- Multimodal metaphors in political entertainment 79
-
Multimodality, Cognitive and Systemic Functional Linguistics
- The visual representation of metaphor 99
- Visual metonymy in children’s picture books 115
- The establishment of interpretative expectations in film 131
- Multimodal digital storytelling 147
-
Cognitive Linguistics and multimodal interaction
- Intermedial cognitive semiotics 167
- Multimodality in Conversational Humor 181
- Image schemas and mimetic schemas in cognitive linguistics and gesture studies 195
- Index 211
Kapitel in diesem Buch
- Prelim pages i
- Table of contents v
- About the contributors vii
- Multimodality and Cognitive Linguistics 1
-
Cognitive Linguistics and multimodal metaphor
- Cross-modal resonances in creative multimodal metaphors 13
- Metaphor and symbol 27
- Woven emotions 45
- Approaching the utopia of a global brand 61
- Multimodal metaphors in political entertainment 79
-
Multimodality, Cognitive and Systemic Functional Linguistics
- The visual representation of metaphor 99
- Visual metonymy in children’s picture books 115
- The establishment of interpretative expectations in film 131
- Multimodal digital storytelling 147
-
Cognitive Linguistics and multimodal interaction
- Intermedial cognitive semiotics 167
- Multimodality in Conversational Humor 181
- Image schemas and mimetic schemas in cognitive linguistics and gesture studies 195
- Index 211
