Presented to you through Paradigm Publishing Services

John Benjamins Publishing Company

Visit our Partner Page See all our books
Chapter
Licensed
Unlicensed Requires Authentication

Chapter 4. Statistical methodology for developing vertical scales for language tests

  • , , and

Abstract

This chapter is the last of the three chapters that describe the process of design and implementation of a vertical linking project for language tests based on a multi-year project for the TOEFL® Family of Assessments. The chapter focuses on the statistical methodology for developing the listening and reading vertical scales. Topics covered include the common item linking design, procedures of Item Response Theory (IRT) scaling and linking to build the vertical scales, and the method for evaluating measurement precision across language tests along the proficiency levels on the vertical scales.

Abstract

This chapter is the last of the three chapters that describe the process of design and implementation of a vertical linking project for language tests based on a multi-year project for the TOEFL® Family of Assessments. The chapter focuses on the statistical methodology for developing the listening and reading vertical scales. Topics covered include the common item linking design, procedures of Item Response Theory (IRT) scaling and linking to build the vertical scales, and the method for evaluating measurement precision across language tests along the proficiency levels on the vertical scales.

Chapters in this book

  1. Prelim pages i
  2. Table of contents v
  3. Acknowledgments vii
  4. Series editors preface ix
  5. Chapter 1. Overview of research to enhance score interpretation 1
  6. Part I. Vertical linking research for suites of language tests
  7. Chapter 2. Considerations in developing vertical scales for language tests 14
  8. Chapter 3. Assessment design issues in developing vertical scales for language tests 35
  9. Chapter 4. Statistical methodology for developing vertical scales for language tests 61
  10. Part II. Enhancing score interpretation for individual language tests
  11. Chapter 5. Scale anchoring methodology for developing revised performance level descriptors for the TOEFL iBT® test 80
  12. Chapter 6. Exploring the benefits and challenges of web-based approaches to standard setting 99
  13. Chapter 7. Mapping TOEFL® Essentials™ speaking and writing scores to the CEFR levels 120
  14. Chapter 8. Designing and executing a score concordance study to establish score mapping to proficiency levels 141
  15. Part III. Concluding commentary
  16. Chapter 9. Literacy, transparency, and (mis)interpretations in communicating with testing stakeholders 158
  17. Notes on contributors 168
  18. Index 171
Meaningful Language Test Scores
This chapter is in the book Meaningful Language Test Scores
https://doi.org/10.1075/illa.1.04gu

Chapters in this book

  1. Prelim pages i
  2. Table of contents v
  3. Acknowledgments vii
  4. Series editors preface ix
  5. Chapter 1. Overview of research to enhance score interpretation 1
  6. Part I. Vertical linking research for suites of language tests
  7. Chapter 2. Considerations in developing vertical scales for language tests 14
  8. Chapter 3. Assessment design issues in developing vertical scales for language tests 35
  9. Chapter 4. Statistical methodology for developing vertical scales for language tests 61
  10. Part II. Enhancing score interpretation for individual language tests
  11. Chapter 5. Scale anchoring methodology for developing revised performance level descriptors for the TOEFL iBT® test 80
  12. Chapter 6. Exploring the benefits and challenges of web-based approaches to standard setting 99
  13. Chapter 7. Mapping TOEFL® Essentials™ speaking and writing scores to the CEFR levels 120
  14. Chapter 8. Designing and executing a score concordance study to establish score mapping to proficiency levels 141
  15. Part III. Concluding commentary
  16. Chapter 9. Literacy, transparency, and (mis)interpretations in communicating with testing stakeholders 158
  17. Notes on contributors 168
  18. Index 171
Downloaded on 13.4.2026 from https://www.degruyterbrill.com/document/doi/10.1075/illa.1.04gu/html
Scroll to top button