Home Linguistics & Semiotics Chapter 6. Establishing a ‘new normal’
Chapter
Licensed
Unlicensed Requires Authentication

Chapter 6. Establishing a ‘new normal’

Detecting fluctuating trends in word frequency over time
  • Matt Gee , Andrew Kehoe and Antoinette Renouf
View more publications by John Benjamins Publishing Company
Crossing Boundaries through Corpora
This chapter is in the book Crossing Boundaries through Corpora

Abstract

In this chapter we introduce statistical methods and associated visualisations for the analysis of lexical change on a monthly basis in a 1.8-billion word news corpus spanning over 30 years. In previous work (Kehoe et al. 2022) we found examples of word frequency change in a data-driven manner by applying existing statistical tests. An ongoing limitation is that, as our diachronic corpus grows, so too does the possibility of a word exhibiting multiple frequency changes in different directions. This chapter reframes the problem as one of time-series segmentation, dividing the frequency history of a word into timespans exhibiting consistent upward or downward change. We then determine reasons for such changes by applying horizon graph visualisations to collocates.

Abstract

In this chapter we introduce statistical methods and associated visualisations for the analysis of lexical change on a monthly basis in a 1.8-billion word news corpus spanning over 30 years. In previous work (Kehoe et al. 2022) we found examples of word frequency change in a data-driven manner by applying existing statistical tests. An ongoing limitation is that, as our diachronic corpus grows, so too does the possibility of a word exhibiting multiple frequency changes in different directions. This chapter reframes the problem as one of time-series segmentation, dividing the frequency history of a word into timespans exhibiting consistent upward or downward change. We then determine reasons for such changes by applying horizon graph visualisations to collocates.

Downloaded on 12.9.2025 from https://www.degruyterbrill.com/document/doi/10.1075/scl.119.06gee/html
Scroll to top button