Attention and eye movement metrics in visual world eye tracking
-
Pirita Pyykkönen-Klauck
Abstract
This chapter introduces the visual world paradigm, with the aim of identifying both the opportunities and challenges researchers are presented with when using overt visual attention as an index of the cognitive processes and mechanisms involved in a variety of language processing tasks. The chapter also provides an overview of the linking hypotheses that underlie the coordination of visual and linguistic information. Finally, the chapter discusses key properties of the eye-movement metrics used in the visual world studies – and different approaches to their analysis – in order to support sound interpretations with respect to the underlying theories of visually situated language comprehension that these studies are used to investigate.
Abstract
This chapter introduces the visual world paradigm, with the aim of identifying both the opportunities and challenges researchers are presented with when using overt visual attention as an index of the cognitive processes and mechanisms involved in a variety of language processing tasks. The chapter also provides an overview of the linking hypotheses that underlie the coordination of visual and linguistic information. Finally, the chapter discusses key properties of the eye-movement metrics used in the visual world studies – and different approaches to their analysis – in order to support sound interpretations with respect to the underlying theories of visually situated language comprehension that these studies are used to investigate.
Chapters in this book
- Prelim pages i
- Table of contents v
- Preface vii
- Towards a situated view of language 1
- Perception of the visual environment 31
- Attention and eye movement metrics in visual world eye tracking 67
- The role of syntax in sentence and referential processing 83
- Reaching sentence and reference meaning 127
- Discourse level processing 151
- Figurative language processing 185
- The role of affordances in visually situated language comprehension 205
- Characterising visual context effects 227
- Visual world studies of conversational perspective taking 261
- Visual environment and interlocutors in situated dialogue 291
- Coordinating action and language 323
- Index 357
Chapters in this book
- Prelim pages i
- Table of contents v
- Preface vii
- Towards a situated view of language 1
- Perception of the visual environment 31
- Attention and eye movement metrics in visual world eye tracking 67
- The role of syntax in sentence and referential processing 83
- Reaching sentence and reference meaning 127
- Discourse level processing 151
- Figurative language processing 185
- The role of affordances in visually situated language comprehension 205
- Characterising visual context effects 227
- Visual world studies of conversational perspective taking 261
- Visual environment and interlocutors in situated dialogue 291
- Coordinating action and language 323
- Index 357
