Term distance, frequency and collocations
-
Lars G. Johnsen
Abstract
In this paper I study two co-occurrence measures, local to a particular corpus, for constructing collocations or relevance relations between words or terms. One is a distance measure, while the other uses different co-occurrence windows, one contained in the other. Both are discussed with respect to the common method of comparing co-occurrence measures within a particular corpus to those of a reference corpus. A practical consequence of these measures is that they may relieve the burden of computing a reference statistic, which may incur a high computational cost. We also believe that distance, as a measure in itself, has a theoretical interest. Being different from frequency, it may add something new to collocation analysis.
Abstract
In this paper I study two co-occurrence measures, local to a particular corpus, for constructing collocations or relevance relations between words or terms. One is a distance measure, while the other uses different co-occurrence windows, one contained in the other. Both are discussed with respect to the common method of comparing co-occurrence measures within a particular corpus to those of a reference corpus. A practical consequence of these measures is that they may relieve the burden of computing a reference statistic, which may incur a high computational cost. We also believe that distance, as a measure in itself, has a theoretical interest. Being different from frequency, it may add something new to collocation analysis.
Kapitel in diesem Buch
- Prelim pages i
- Table of contents v
- Introduction 1
- Part I. Theory and models 7
- On the impact of the initial phrase length on the position of enclitics in Old Czech 9
- Term distance, frequency and collocations 21
- A method for the comparison of general sequences via type-token ratio 37
- Quantitative analysis of syllable properties in Croatian, Serbian, Russian, and Ukrainian 55
- N -grams of grammatical functions and their significant order in the Japanese clause 69
- Linking the dependents 93
- Grammar efficiency and the One-Meaning–One-Form Principle 109
- Distribution and characteristics of commonly used words across different texts in Japanese 121
- Part II. Empirical studies 135
- The perils of big data 137
- From distinguishability to informativity 145
- A Modern Greek readability tool 163
- Phonological properties as predictors of text success 177
- Calculating the victory chances 195
- Topological mapping for visualisation of high-dimensional historical linguistic data 209
- Book genre and author’s gender recognition based on titles 225
- Quantitative analysis of bibliographic corpora 239
- Analysis of English text genre classification based on dependency types 257
- In memory of Gabriel Altmann 271
- Index 277
Kapitel in diesem Buch
- Prelim pages i
- Table of contents v
- Introduction 1
- Part I. Theory and models 7
- On the impact of the initial phrase length on the position of enclitics in Old Czech 9
- Term distance, frequency and collocations 21
- A method for the comparison of general sequences via type-token ratio 37
- Quantitative analysis of syllable properties in Croatian, Serbian, Russian, and Ukrainian 55
- N -grams of grammatical functions and their significant order in the Japanese clause 69
- Linking the dependents 93
- Grammar efficiency and the One-Meaning–One-Form Principle 109
- Distribution and characteristics of commonly used words across different texts in Japanese 121
- Part II. Empirical studies 135
- The perils of big data 137
- From distinguishability to informativity 145
- A Modern Greek readability tool 163
- Phonological properties as predictors of text success 177
- Calculating the victory chances 195
- Topological mapping for visualisation of high-dimensional historical linguistic data 209
- Book genre and author’s gender recognition based on titles 225
- Quantitative analysis of bibliographic corpora 239
- Analysis of English text genre classification based on dependency types 257
- In memory of Gabriel Altmann 271
- Index 277
