Comparing the Characteristics of Gene Expression Profiles Derived by Univariate and Multivariate Classification Methods
-
Manuela Zucknick
, Sylvia Richardson und Euan A Stronach
One application of gene expression arrays is to derive molecular profiles, i.e., sets of genes, which discriminate well between two classes of samples, for example between tumour types. Users are confronted with a multitude of classification methods of varying complexity that can be applied to this task. To help decide which method to use in a given situation, we compare important characteristics of a range of classification methods, including simple univariate filtering, penalised likelihood methods and the random forest.Classification accuracy is an important characteristic, but the biological interpretability of molecular profiles is also important. This implies both parsimony and stability, in the sense that profiles should not vary much when there are slight changes in the training data. We perform a random resampling study to compare these characteristics between the methods and across a range of profile sizes. We measure stability by adopting the Jaccard index to assess the similarity of resampled molecular profiles.We carry out a case study on five well-established cancer microarray data sets, for two of which we have the benefit of being able to validate the results in an independent data set. The study shows that those methods which produce parsimonious profiles generally result in better prediction accuracy than methods which don't include variable selection. For very small profile sizes, the sparse penalised likelihood methods tend to result in more stable profiles than univariate filtering while maintaining similar predictive performance.
©2011 Walter de Gruyter GmbH & Co. KG, Berlin/Boston
Artikel in diesem Heft
- Article
- Self-Organizing Maps with Statistical Phase Synchronization (SOMPS) for Analyzing Cell Cycle-Specific Gene Expression Data
- Coalescent Time Distributions in Trees of Arbitrary Size
- Quantifying the Association between Gene Expressions and DNA-Markers by Penalized Canonical Correlation Analysis
- Nonparametric Functional Mapping of Quantitative Trait Loci Underlying Programmed Cell Death
- Accommodating Uncertainty in a Tree Set for Function Estimation
- Drifting Markov Models with Polynomial Drift and Applications to DNA Sequences
- Comparing the Characteristics of Gene Expression Profiles Derived by Univariate and Multivariate Classification Methods
- Calculating Confidence Intervals for Prediction Error in Microarray Classification Using Resampling
- Structure Learning in Nested Effects Models
- Correcting the Estimated Level of Differential Expression for Gene Selection Bias: Application to a Microarray Study
- Adapting Prediction Error Estimates for Biased Complexity Selection in High-Dimensional Bootstrap Samples
- Adaptive Choice of the Number of Bootstrap Samples in Large Scale Multiple Testing
- Re-Cracking the Nucleosome Positioning Code
- Semi-Parametric Differential Expression Analysis via Partial Mixture Estimation
- A SNP Streak Model for the Identification of Genetic Regions Identical-by-descent
- Detecting Two-Locus Gene-Gene Effects Using Monotonisation of the Penetrance Matrix
- Modeling DNA Methylation in a Population of Cancer Cells
- Phenotyping Genetic Diseases Using an Extension of µ-Scores for Multivariate Data
- The Estimator of the Optimal Measure of Allelic Association: Mean, Variance and Probability Distribution When the Sample Size Tends to Infinity
- Predicting Protein Concentrations with ELISA Microarray Assays, Monotonic Splines and Monte Carlo Simulation
- A Comparison of Normalization Techniques for MicroRNA Microarray Data
- Collapsing SNP Genotypes in Case-Control Genome-Wide Association Studies Increases the Type I Error Rate and Power
- Estimating Number of Clusters Based on a General Similarity Matrix with Application to Microarray Data
- Data Distribution of Short Oligonucleotide Expression Arrays and Its Application to the Construction of a Generalized Intellectual Framework
- Approximately Sufficient Statistics and Bayesian Computation
- A Composite-Conditional-Likelihood Approach for Gene Mapping Based on Linkage Disequilibrium in Windows of Marker Loci
- Statistical Methods in Integrative Analysis for Gene Regulatory Modules
- Reducing Spatial Flaws in Oligonucleotide Arrays by Using Neighborhood Information
- Pattern Classification of Phylogeny Signals
- A Unification of Multivariate Methods for Meta-Analysis of Genetic Association Studies
- Importance Sampling for the Infinite Sites Model
- Supervised Distance Matrices
- Addressing the Shortcomings of Three Recent Bayesian Methods for Detecting Interspecific Recombination in DNA Sequence Alignments
- A Sparse PLS for Variable Selection when Integrating Omics Data
- Software Communication
- TRAB: Testing Whether Mutation Frequencies Are Above an Unknown Background
Artikel in diesem Heft
- Article
- Self-Organizing Maps with Statistical Phase Synchronization (SOMPS) for Analyzing Cell Cycle-Specific Gene Expression Data
- Coalescent Time Distributions in Trees of Arbitrary Size
- Quantifying the Association between Gene Expressions and DNA-Markers by Penalized Canonical Correlation Analysis
- Nonparametric Functional Mapping of Quantitative Trait Loci Underlying Programmed Cell Death
- Accommodating Uncertainty in a Tree Set for Function Estimation
- Drifting Markov Models with Polynomial Drift and Applications to DNA Sequences
- Comparing the Characteristics of Gene Expression Profiles Derived by Univariate and Multivariate Classification Methods
- Calculating Confidence Intervals for Prediction Error in Microarray Classification Using Resampling
- Structure Learning in Nested Effects Models
- Correcting the Estimated Level of Differential Expression for Gene Selection Bias: Application to a Microarray Study
- Adapting Prediction Error Estimates for Biased Complexity Selection in High-Dimensional Bootstrap Samples
- Adaptive Choice of the Number of Bootstrap Samples in Large Scale Multiple Testing
- Re-Cracking the Nucleosome Positioning Code
- Semi-Parametric Differential Expression Analysis via Partial Mixture Estimation
- A SNP Streak Model for the Identification of Genetic Regions Identical-by-descent
- Detecting Two-Locus Gene-Gene Effects Using Monotonisation of the Penetrance Matrix
- Modeling DNA Methylation in a Population of Cancer Cells
- Phenotyping Genetic Diseases Using an Extension of µ-Scores for Multivariate Data
- The Estimator of the Optimal Measure of Allelic Association: Mean, Variance and Probability Distribution When the Sample Size Tends to Infinity
- Predicting Protein Concentrations with ELISA Microarray Assays, Monotonic Splines and Monte Carlo Simulation
- A Comparison of Normalization Techniques for MicroRNA Microarray Data
- Collapsing SNP Genotypes in Case-Control Genome-Wide Association Studies Increases the Type I Error Rate and Power
- Estimating Number of Clusters Based on a General Similarity Matrix with Application to Microarray Data
- Data Distribution of Short Oligonucleotide Expression Arrays and Its Application to the Construction of a Generalized Intellectual Framework
- Approximately Sufficient Statistics and Bayesian Computation
- A Composite-Conditional-Likelihood Approach for Gene Mapping Based on Linkage Disequilibrium in Windows of Marker Loci
- Statistical Methods in Integrative Analysis for Gene Regulatory Modules
- Reducing Spatial Flaws in Oligonucleotide Arrays by Using Neighborhood Information
- Pattern Classification of Phylogeny Signals
- A Unification of Multivariate Methods for Meta-Analysis of Genetic Association Studies
- Importance Sampling for the Infinite Sites Model
- Supervised Distance Matrices
- Addressing the Shortcomings of Three Recent Bayesian Methods for Detecting Interspecific Recombination in DNA Sequence Alignments
- A Sparse PLS for Variable Selection when Integrating Omics Data
- Software Communication
- TRAB: Testing Whether Mutation Frequencies Are Above an Unknown Background