Chapter 9. Task design and validity evidence for assessment of L2 pragmatics in interaction
-
Soo Jung Youn
Abstract
This study examines how clear communicative goals and authentic interaction are ensured in task-based pragmatic assessment practices, particularly in designing role-play assessment tasks and developing task-appropriate rating criteria. Employing a concurrent mixed methods design, conversation analysis (CA) and multi-faceted Rasch measurement were used to investigate whether task-independent interactional features are elicited from role-play interactions and how interaction-specific rating categories function quantitatively. The CA findings indicated that various interactional organizations emerged from role-play task interactions as examinees oriented to the different degree of imposition and contextual variables embedded in the role-plays. Further, the interactional features included in the rating criteria created a substantial amount of variance in distinguishing varying degrees of pragmatic performance. The findings are discussed in terms of designing valid pragmatic assessment tasks and what features need to be included in developing rating criteria to ensure the validity evidence of task-based pragmatic assessment.
Abstract
This study examines how clear communicative goals and authentic interaction are ensured in task-based pragmatic assessment practices, particularly in designing role-play assessment tasks and developing task-appropriate rating criteria. Employing a concurrent mixed methods design, conversation analysis (CA) and multi-faceted Rasch measurement were used to investigate whether task-independent interactional features are elicited from role-play interactions and how interaction-specific rating categories function quantitatively. The CA findings indicated that various interactional organizations emerged from role-play task interactions as examinees oriented to the different degree of imposition and contextual variables embedded in the role-plays. Further, the interactional features included in the rating criteria created a substantial amount of variance in distinguishing varying degrees of pragmatic performance. The findings are discussed in terms of designing valid pragmatic assessment tasks and what features need to be included in developing rating criteria to ensure the validity evidence of task-based pragmatic assessment.
Kapitel in diesem Buch
- Prelim pages i
- Table of contents v
- Acknowledgement vii
- Series editors’ preface ix
- Chapter 1. Task-based approaches to teaching and assessing pragmatics 1
-
Part I. Teaching pragmatics through tasks
- Chapter 2. Learning of Korean honorifics through collaborative tasks 27
- Chapter 3. Effects of task supported language teaching on learners’ use and knowledge of email request mitigators 55
- Chapter 4. Task complexity effects on interaction during a collaborative persuasive writing task 83
-
Part II. Using tasks to elicit pragmatics language use
- Chapter 5. Task modality effects on Spanish learners’ interlanguage pragmatic development 113
- Chapter 6. Developing pragmatic competence through tasks in EFL contexts 137
- Chapter 7. Independently measuring cognitive complexity in task design for interlanguage pragmatics development 159
- Chapter 8. Pragmatics, tasks, and technology 191
-
Part III. Task-based assessment of pragmatics
- Chapter 9. Task design and validity evidence for assessment of L2 pragmatics in interaction 217
- Chapter 10. The effects of task type and L2 proficiency on discourse appropriacy in oral task performance 247
- Chapter 11. Assessing functional adequacy of L2 performance in a task-based approach 265
- Chapter 12. Pragmatics in task-based language assessment 287
- Bio notes 305
- Index 311
Kapitel in diesem Buch
- Prelim pages i
- Table of contents v
- Acknowledgement vii
- Series editors’ preface ix
- Chapter 1. Task-based approaches to teaching and assessing pragmatics 1
-
Part I. Teaching pragmatics through tasks
- Chapter 2. Learning of Korean honorifics through collaborative tasks 27
- Chapter 3. Effects of task supported language teaching on learners’ use and knowledge of email request mitigators 55
- Chapter 4. Task complexity effects on interaction during a collaborative persuasive writing task 83
-
Part II. Using tasks to elicit pragmatics language use
- Chapter 5. Task modality effects on Spanish learners’ interlanguage pragmatic development 113
- Chapter 6. Developing pragmatic competence through tasks in EFL contexts 137
- Chapter 7. Independently measuring cognitive complexity in task design for interlanguage pragmatics development 159
- Chapter 8. Pragmatics, tasks, and technology 191
-
Part III. Task-based assessment of pragmatics
- Chapter 9. Task design and validity evidence for assessment of L2 pragmatics in interaction 217
- Chapter 10. The effects of task type and L2 proficiency on discourse appropriacy in oral task performance 247
- Chapter 11. Assessing functional adequacy of L2 performance in a task-based approach 265
- Chapter 12. Pragmatics in task-based language assessment 287
- Bio notes 305
- Index 311