Supervised Distance Matrices
-
Katherine S. Pollard
and Mark J. van der Laan
We introduce a novel statistical concept, called a supervised distance matrix, which quantifies pairwise similarity between variables in terms of their association with an outcome. Supervised distance matrices are derived in two stages. First, the observed data is transformed based on particular working models for association. Examples of transformations include residuals or influence curves from regression models. In the second stage, a choice of distance measure is used to compute all pairwise distances between variables in the transformed data. We present consistent estimators of the resulting distance matrix, including an inverse probability of censoring weighted estimator for use with right-censored outcomes. Supervised distance matrices can be used with standard (unsupervised) clustering algorithms to identify groups of similarly predictive variables and to discover subpopulations of related samples. This approach is illustrated using simulations and an analysis of gene expression data with a censored survival outcome. The proposed methods are widely applicable in genomics and other fields where high-dimensional data is collected on each subject.
©2011 Walter de Gruyter GmbH & Co. KG, Berlin/Boston
Articles in the same Issue
- Article
- Self-Organizing Maps with Statistical Phase Synchronization (SOMPS) for Analyzing Cell Cycle-Specific Gene Expression Data
- Coalescent Time Distributions in Trees of Arbitrary Size
- Quantifying the Association between Gene Expressions and DNA-Markers by Penalized Canonical Correlation Analysis
- Nonparametric Functional Mapping of Quantitative Trait Loci Underlying Programmed Cell Death
- Accommodating Uncertainty in a Tree Set for Function Estimation
- Drifting Markov Models with Polynomial Drift and Applications to DNA Sequences
- Comparing the Characteristics of Gene Expression Profiles Derived by Univariate and Multivariate Classification Methods
- Calculating Confidence Intervals for Prediction Error in Microarray Classification Using Resampling
- Structure Learning in Nested Effects Models
- Correcting the Estimated Level of Differential Expression for Gene Selection Bias: Application to a Microarray Study
- Adapting Prediction Error Estimates for Biased Complexity Selection in High-Dimensional Bootstrap Samples
- Adaptive Choice of the Number of Bootstrap Samples in Large Scale Multiple Testing
- Re-Cracking the Nucleosome Positioning Code
- Semi-Parametric Differential Expression Analysis via Partial Mixture Estimation
- A SNP Streak Model for the Identification of Genetic Regions Identical-by-descent
- Detecting Two-Locus Gene-Gene Effects Using Monotonisation of the Penetrance Matrix
- Modeling DNA Methylation in a Population of Cancer Cells
- Phenotyping Genetic Diseases Using an Extension of µ-Scores for Multivariate Data
- The Estimator of the Optimal Measure of Allelic Association: Mean, Variance and Probability Distribution When the Sample Size Tends to Infinity
- Predicting Protein Concentrations with ELISA Microarray Assays, Monotonic Splines and Monte Carlo Simulation
- A Comparison of Normalization Techniques for MicroRNA Microarray Data
- Collapsing SNP Genotypes in Case-Control Genome-Wide Association Studies Increases the Type I Error Rate and Power
- Estimating Number of Clusters Based on a General Similarity Matrix with Application to Microarray Data
- Data Distribution of Short Oligonucleotide Expression Arrays and Its Application to the Construction of a Generalized Intellectual Framework
- Approximately Sufficient Statistics and Bayesian Computation
- A Composite-Conditional-Likelihood Approach for Gene Mapping Based on Linkage Disequilibrium in Windows of Marker Loci
- Statistical Methods in Integrative Analysis for Gene Regulatory Modules
- Reducing Spatial Flaws in Oligonucleotide Arrays by Using Neighborhood Information
- Pattern Classification of Phylogeny Signals
- A Unification of Multivariate Methods for Meta-Analysis of Genetic Association Studies
- Importance Sampling for the Infinite Sites Model
- Supervised Distance Matrices
- Addressing the Shortcomings of Three Recent Bayesian Methods for Detecting Interspecific Recombination in DNA Sequence Alignments
- A Sparse PLS for Variable Selection when Integrating Omics Data
- Software Communication
- TRAB: Testing Whether Mutation Frequencies Are Above an Unknown Background
Articles in the same Issue
- Article
- Self-Organizing Maps with Statistical Phase Synchronization (SOMPS) for Analyzing Cell Cycle-Specific Gene Expression Data
- Coalescent Time Distributions in Trees of Arbitrary Size
- Quantifying the Association between Gene Expressions and DNA-Markers by Penalized Canonical Correlation Analysis
- Nonparametric Functional Mapping of Quantitative Trait Loci Underlying Programmed Cell Death
- Accommodating Uncertainty in a Tree Set for Function Estimation
- Drifting Markov Models with Polynomial Drift and Applications to DNA Sequences
- Comparing the Characteristics of Gene Expression Profiles Derived by Univariate and Multivariate Classification Methods
- Calculating Confidence Intervals for Prediction Error in Microarray Classification Using Resampling
- Structure Learning in Nested Effects Models
- Correcting the Estimated Level of Differential Expression for Gene Selection Bias: Application to a Microarray Study
- Adapting Prediction Error Estimates for Biased Complexity Selection in High-Dimensional Bootstrap Samples
- Adaptive Choice of the Number of Bootstrap Samples in Large Scale Multiple Testing
- Re-Cracking the Nucleosome Positioning Code
- Semi-Parametric Differential Expression Analysis via Partial Mixture Estimation
- A SNP Streak Model for the Identification of Genetic Regions Identical-by-descent
- Detecting Two-Locus Gene-Gene Effects Using Monotonisation of the Penetrance Matrix
- Modeling DNA Methylation in a Population of Cancer Cells
- Phenotyping Genetic Diseases Using an Extension of µ-Scores for Multivariate Data
- The Estimator of the Optimal Measure of Allelic Association: Mean, Variance and Probability Distribution When the Sample Size Tends to Infinity
- Predicting Protein Concentrations with ELISA Microarray Assays, Monotonic Splines and Monte Carlo Simulation
- A Comparison of Normalization Techniques for MicroRNA Microarray Data
- Collapsing SNP Genotypes in Case-Control Genome-Wide Association Studies Increases the Type I Error Rate and Power
- Estimating Number of Clusters Based on a General Similarity Matrix with Application to Microarray Data
- Data Distribution of Short Oligonucleotide Expression Arrays and Its Application to the Construction of a Generalized Intellectual Framework
- Approximately Sufficient Statistics and Bayesian Computation
- A Composite-Conditional-Likelihood Approach for Gene Mapping Based on Linkage Disequilibrium in Windows of Marker Loci
- Statistical Methods in Integrative Analysis for Gene Regulatory Modules
- Reducing Spatial Flaws in Oligonucleotide Arrays by Using Neighborhood Information
- Pattern Classification of Phylogeny Signals
- A Unification of Multivariate Methods for Meta-Analysis of Genetic Association Studies
- Importance Sampling for the Infinite Sites Model
- Supervised Distance Matrices
- Addressing the Shortcomings of Three Recent Bayesian Methods for Detecting Interspecific Recombination in DNA Sequence Alignments
- A Sparse PLS for Variable Selection when Integrating Omics Data
- Software Communication
- TRAB: Testing Whether Mutation Frequencies Are Above an Unknown Background