Multimodal meaning-making in student presentations: the impact of explicit feedback in a German as a foreign language classroom

Dennis Lindenberg

doi:10.1515/mc-2023-0011

Article

Multimodal meaning-making in student presentations: the impact of explicit feedback in a German as a foreign language classroom

Dennis Lindenberg

Published/Copyright: October 18, 2023

Published by

Become an author with De Gruyter Brill

Submit Manuscript Author Information Explore this Subject

From the journal Multimodal Communication Volume 12 Issue 3

Abstract

This study examines the impact of teacher feedback on seven students’ presentations on social and cultural topics held in a German-as-a-foreign language classroom in Japan. Following the submission of self-recorded presentation drafts on an online learning platform, students received explicit feedback on how their spoken commentary related to the visible information on slides derived from the theoretical insights of social semiotics and systemic functional linguistics. After allocating one class to revising their work, students presented their finalized presentations, which were video recorded, cut, and prepared for analysis. Subsequently, a total of 14 sections that underwent alterations in both the draft and in-class presentation were scrutinized following a qualitative multimodal discourse analytical framework. By demonstrating the differences between two students’ early drafts and their final in-class presentations, this study shows how adding verbal language that extended a slide’s content strengthened audience engagement through interpersonal functions in language, gaze, body orientation, and gesture. Further, restructuring and inserting additional entities on the PowerPoint slide helped emphasize the talk’s ideational components. The findings of this study have implications for multiliteracies pedagogy in a foreign language context, highlighting the importance of a holistic approach that considers language and other modes as complementary aspects of communication.

Keywords: multimodal discourse analysis; student presentations; visual communication; social semiotics; multiliteracies; systemic functional linguistics

Corresponding author: Dennis Lindenberg, Graduate School of Education, Faculty of Education and Integrated Arts and Sciences, Waseda University, 1-104 Totsukamachi, Shinjuku-ku, Tokyo, 169-8050, Japan, E-mail: d.lindenberg@fuji.waseda.jp

Disclosure statement: This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Appendix

(1.2)	length of pause in seconds and tenths of seconds
word::	prolonging or stretching of the preceding sound
WORD	identified word or sentence stress
>word<	talk is compressed or rushed
<word>	talk is stretched or drawn out
ˆ	rise in

References

Bateman, John A. 2014. Text and image: A critical introduction to the visual/verbal divide. London & New York: Routledge.10.4324/9781315773971Search in Google Scholar

Brazil, David. 1997. The communicative value of intonation in English, 2nd edn. Cambridge: Cambridge University Press.Search in Google Scholar

Bucher, Hans-Juergen & Philipp Niemann. 2012. Visualizing science: The reception of PowerPoint presentations. Visual Communication 11. 283–306. https://doi.org/10.1177/1470357212446409.Search in Google Scholar

Chan, Eveline. 2011. Integrating visual and verbal meaning in multimodal text comprehension: Towards a model of intermodal relations. In Shoshana Dreyfus, Susan Hood & Maree Stenglin (eds.), Semiotic margins: Meaning in multimodalities, 144–167. London and New York: Continuum.Search in Google Scholar

Creswell, John W. & Cheryl N. Poth. 2018. Qualitative inquiry & research design: Choosing among five approaches, 4th edn. Thousand Oaks: SAGE.Search in Google Scholar

Derry, Sharon J., Roy D. Pea, Brigid Barron, Randi A. Engle, Frederick Erickson, Ricki Goldman, Rogers Hall, Timothy Koschmann, Jay L. Lemke, Miriam Gamoran Sherin & Bruce L. Sherin. 2010. Conducting video research in the learning sciences: Guidance on selection, analysis, technology, and ethics. Journal of the Learning Sciences 19. 3–53. https://doi.org/10.1080/10508400903452884.Search in Google Scholar

ELAN, Version 6.4. 2023. Nijmegen: Max Planck Institute for psycholinguistics, the language archive. https://archive.mpi.nl/tla/elan (accessed 10 April 2023).Search in Google Scholar

Feng, Dezheng William. 2021. Genre, pedagogy, and PowerPoint design: A multimodal move analysis of linguistic lecture slideshows. In Kathy Ling Lin, Isaac N. Mwinlaaru & Dennis Tay (eds.), Approaches to specialized genres: In memory of Stephen Evans, 177–197. London & New York: Routledge.Search in Google Scholar

Flint, Patricia, Tamra Dollar & Mary Amanda Steward. 2019. Hurdling over language barriers: Building relationships with adolescent newcomers through literacy advancement. Journal of Adolescent & Adult Literacy 62. 509–519. https://doi.org/10.1002/jaal.927.Search in Google Scholar

Forey, Gail & Dezheng Feng. 2016. Interpersonal meaning and audience engagement in academic presentations: A multimodal discourse analysis perspective. In Ken Hyland & Philip Shaw (eds.), The Routledge handbook of English for academic purposes, 416–430. London & New York: Routledge.Search in Google Scholar

Gray, Robert. 2021. Multimodality in the classroom presentation genre: Findings from a study of Turkish psychology undergraduate talks. System 99. 1–16. https://doi.org/10.1016/j.system.2021.102522.Search in Google Scholar

Halliday, Michael A. & Christian M. I. Matthiessen. 2013. An introduction to functional grammar, 4th edn. London & New York: Routledge.10.4324/9780203431269Search in Google Scholar

Jewitt, Carey. 2014. A multimodal lens on the school classroom. In David Machin (ed.), Visual communication, 387–404. Berlin: De Gruyter.10.1515/9783110255492.387Search in Google Scholar

Jewitt, Carey, Jeff Bezemer & Kay O’Halloran. 2016. Introducing multimodality. Oxfordshire: Taylor and Francis.10.4324/9781315638027Search in Google Scholar

Knoblauch, Hubert. 2008. The performance of knowledge: Pointing and knowledge in PowerPoint presentations. Cultural Sociology 2. 75–97. https://doi.org/10.1177/1749975507086275.Search in Google Scholar

Knoblauch, Hubert. 2013. Powerpoint, communication, and the knowledge society. New York: Cambridge University Press.10.1017/CBO9780511979149Search in Google Scholar

Knoblauch, Hubert, René Tuma & Bernt Schnettler. 2014. Video analysis and videography. In Uwe Flick (ed.), The SAGE handbook of qualitative data analysis, 435–449. New York: SAGE.10.4135/9781446282243.n30Search in Google Scholar

Kress, Gunther. 2009. Multimodality: A social semiotic approach to contemporary communication. London & New York: Routledge.Search in Google Scholar

Kress, Gunther & Theo Van Leeuwen. 2021. Reading images: The grammar of visual design, 3rd edn. London & New York: Routledge.10.4324/9781003099857Search in Google Scholar

Lee, Jean Choong Peng. 2023. Gaze and facial expression in engineering student presentations: A comparative case study of a high- and low-performing presenter. ESP Today 11. 6–30. https://doi.org/10.18485/esptoday.2023.11.1.1.Search in Google Scholar

Lemke, Jay. 1998. Multiplying meaning: Visual and verbal semiotics in scientific text. In James R. Martin & Robert Veel (eds.), Reading science: Critical and functional perspectives on discourses of science, 87–113. London & New York: Routledge.Search in Google Scholar

Lim, Fei Victor, Weimin Toh & Thi Thu Ha Nguyen. 2022. Multimodality in the English language classroom: A systematic review of literature. Linguistics and Education 69. 1–30. https://doi.org/10.1016/j.linged.2022.101048.Search in Google Scholar

Lindenberg, Dennis. 2023. Modes and intersemiotic cohesion in student presentations performed online: An SF-informed multimodal discourse analysis. English for Specific Purposes 69. 67–79. https://doi.org/10.1016/j.esp.2022.10.002.Search in Google Scholar

Mayer, Richard E. 2021. Multimedia learning, 3rd edn. Cambridge: Cambridge University Press.10.1017/9781108894333.003Search in Google Scholar

McNeill, David, Elena T. Levy & Susan D. Duncan. 2015. Gesture in discourse. In Deborah Tannen, Heidi E. Hamilton & Deborah Schiffrin (eds.), The handbook of discourse analysis, 2nd edn., 262–289. New York: John Wiley & Sons.10.1002/9781118584194.ch12Search in Google Scholar

Mills, Kathy A. & Len Unsworth. 2017. Multimodal literacy. In George Noblit (ed.), Oxford research encyclopedia of education, 1–29. Oxford: Oxford University Press.10.1093/acrefore/9780190264093.013.232Search in Google Scholar

Morell, Teresa. 2015. International conference paper presentations: A multimodal analysis to determine effectiveness. English for Specific Purposes 37. 137–150. https://doi.org/10.1016/j.esp.2014.10.002.Search in Google Scholar

New London Group. 1996. A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review 66. 60–92. https://doi.org/10.17763/haer.66.1.17370n67v22j160u.Search in Google Scholar

Norris, Sigrid. 2004. Analyzing multimodal interaction: A methodological framework. London & New York: Routledge.10.4324/9780203379493Search in Google Scholar

O’Halloran, Kay L. 2011. Multimodal discourse analysis. In Ken Hyland (ed.), Continuum companion to discourse analysis, 120–137. London: Bloomsbury Publishing.Search in Google Scholar

Rincón, July Andrea Rincon & Amparo Clavijo Olarte. 2016. Fostering EFL learners’ literacies through local inquiry in a multimodal experience. Colombian Applied Linguistics Journal 18. 67–82. https://doi.org/10.14483/calj.v18n2.10610.Search in Google Scholar

Rowley-Jolivet, Elizabeth. 2004. Different visions, different visuals: A social semiotic analysis of field-specific visual composition in scientific conference presentations. Visual Communication 3. 145–175. https://doi.org/10.1177/147035704043038.Search in Google Scholar

Rowley-Jolivet, Elizabeth. 2012. Oralising text slides in scientific conference presentations: A multimodal corpus analysis. In Alex Boulton, Shirley Carter-Thomas & Elizabeth Rowley-Jolivet (eds.), Corpus-informed research and learning in ESP: Issues and applications, 137–166. Amsterdam: John Benjamins, Amsterdam.10.1075/scl.52.06rowSearch in Google Scholar

Ruiz-Madrid, Noelia. 2021. A multimodal discourse approach to research pitches. Journal of English for Academic Purposes 52. 1–16. https://doi.org/10.1016/j.jeap.2021.101003.Search in Google Scholar

Ruiz-Madrid, Noelia & Julia Valeiras-Jurado. 2020. Developing multimodal communicative competence in emerging academic and professional genres. International Journal of English Studies 20. 27–50. https://doi.org/10.6018/ijes.401481.Search in Google Scholar

Ryshina-Pankova, Marianna. 2013. Understanding “Green Germany” through images and film: A critical literacy approach. Die Unterrichtspraxis/Teaching German 46. 163–184. https://doi.org/10.1111/tger.10139.Search in Google Scholar

Schnettler, Bernt. 2006. Orchestrating bullet lists and commentaries: A video performance analysis of computer supported presentations. In Hubert Knoblauch, Bernt Schnettler, Jürgen Raab & Hans-Georg Soeffner (eds.), Video analysis: Methodology and methods. Qualitative audiovisual data analysis in sociology, 155–168. Frankfurt am Main: Peter Lang.Search in Google Scholar

Unsworth, Len. 2006. Towards a metalanguage for multiliteracies education: Describing the meaning-making resources of language-image interaction. English Teaching: Practice and Critique 5. 55–76.Search in Google Scholar

Valeiras-Jurado, Julia. 2020. Genre-specific persuasion in oral presentations: Adaptation to the audience through multimodal persuasive strategies. International Journal of Applied Linguistics 30. 293–312. https://doi.org/10.1111/ijal.12284.Search in Google Scholar

Valeiras-Jurado, Julia & Noelia Ruiz-Madrid. 2019. Multimodal enactment of characters in conference presentations. Discourse Studies 21. 561–583. https://doi.org/10.1177/1461445619846703.Search in Google Scholar

Warner, Chantelle & Beatrice Dupuy. 2018. Moving toward multiliteracies in foreign language teaching: Past and present perspectives … and beyond. Foreign Language Annals 51. 116–128. https://doi.org/10.1111/flan.12316.Search in Google Scholar

Zareva, Alla. 2011. International graduate student PowerPoint presentation designs: A reality check. International Journal of Innovation and Learning 9. 127–144. https://doi.org/10.1504/IJIL.2011.038540.Search in Google Scholar

Zhao, Sumin & Theo Van Leeuwen. 2014. Understanding semiotic technology in university classrooms: A social semiotic approach to PowerPoint-assisted cultural studies lectures. Classroom Discourse 5. 71–90. https://doi.org/10.1080/19463014.2013.859848.Search in Google Scholar

Received: 2023-03-23

Accepted: 2023-08-31

Published Online: 2023-10-18

You are currently not able to access this content.

Articles in the same Issue

https://doi.org/10.1515/mc-2023-0011

Keywords for this article

multimodal discourse analysis; student presentations; visual communication; social semiotics; multiliteracies; systemic functional linguistics