Presented to you through Paradigm Publishing Services

John Benjamins Publishing Company

Visit our Partner Page See all our books
Chapter
Licensed
Unlicensed Requires Authentication

Chapter 4. Multimodality

A systemic-functional semiotic perspective
  • , and

Abstract

Multimodality examines how language and other resources (e.g., images and gestures) are integrated to make meaning for communication. This chapter aims to introduce two approaches to multimodality from a systemic-functional semiotic perspective, namely social semiotics and systemic functional multimodal discourse analysis (SF-MDA), and discuss their applications in applied linguistics. Specifically, this chapter begins with an overview of the theoretical underpinnings of the two approaches, focusing on their shared functionalist origins and the origin’s theoretical and methodological implications. Next, the chapter discusses the affordance of social semiotics and SF-MDA and highlights data collection procedures and analytical processes in applied linguistic studies informed by the two approaches. Finally, critiques of the two approaches are addressed with multimodal research facilitated by eye-tracking technology.

Abstract

Multimodality examines how language and other resources (e.g., images and gestures) are integrated to make meaning for communication. This chapter aims to introduce two approaches to multimodality from a systemic-functional semiotic perspective, namely social semiotics and systemic functional multimodal discourse analysis (SF-MDA), and discuss their applications in applied linguistics. Specifically, this chapter begins with an overview of the theoretical underpinnings of the two approaches, focusing on their shared functionalist origins and the origin’s theoretical and methodological implications. Next, the chapter discusses the affordance of social semiotics and SF-MDA and highlights data collection procedures and analytical processes in applied linguistic studies informed by the two approaches. Finally, critiques of the two approaches are addressed with multimodal research facilitated by eye-tracking technology.

Chapters in this book

  1. 日本言語政策学会 / Japan Association for Language Policy. 言語政策 / Language Policy 10. 2014 i
  2. Table of contents v
  3. Chapter 1. Introduction 1
  4. Chapter 2. The Multiperspectival Approach to Applied Linguistic research 9
  5. Chapter 3. Implementing the Multiperspectival Approach (MPA) 30
  6. Chapter 4. Multimodality 49
  7. Chapter 5. Applying multimodal analysis 68
  8. Chapter 6. Conversation analysis 83
  9. Chapter 7. Doing conversation analysis 111
  10. Chapter 8. Grounded Theory 127
  11. Chapter 9. Applications of Grounded Theory in the field of Extensive Reading 149
  12. Chapter 10. Phenomenology 162
  13. Chapter 11. Phenomenology 180
  14. Chapter 12. Narrative inquiry 191
  15. Chapter 13. Narrative inquiry 206
  16. Chapter 14. Repertory grids 224
  17. Chapter 15. Repertory grids 246
  18. Chapter 16. Challenges and contributions of less frequently used methodologies 264
  19. Index 273
Less Frequently Used Research Methodologies in Applied Linguistics
This chapter is in the book Less Frequently Used Research Methodologies in Applied Linguistics
https://doi.org/10.1075/rmal.6.04che

Chapters in this book

  1. 日本言語政策学会 / Japan Association for Language Policy. 言語政策 / Language Policy 10. 2014 i
  2. Table of contents v
  3. Chapter 1. Introduction 1
  4. Chapter 2. The Multiperspectival Approach to Applied Linguistic research 9
  5. Chapter 3. Implementing the Multiperspectival Approach (MPA) 30
  6. Chapter 4. Multimodality 49
  7. Chapter 5. Applying multimodal analysis 68
  8. Chapter 6. Conversation analysis 83
  9. Chapter 7. Doing conversation analysis 111
  10. Chapter 8. Grounded Theory 127
  11. Chapter 9. Applications of Grounded Theory in the field of Extensive Reading 149
  12. Chapter 10. Phenomenology 162
  13. Chapter 11. Phenomenology 180
  14. Chapter 12. Narrative inquiry 191
  15. Chapter 13. Narrative inquiry 206
  16. Chapter 14. Repertory grids 224
  17. Chapter 15. Repertory grids 246
  18. Chapter 16. Challenges and contributions of less frequently used methodologies 264
  19. Index 273
Downloaded on 12.4.2026 from https://www.degruyterbrill.com/document/doi/10.1075/rmal.6.04che/html
Scroll to top button