Article
Licensed
Unlicensed
Requires Authentication
Empirical Bayes and Resampling Based Multiple Testing Procedure Controlling Tail Probability of the Proportion of False Positives.
-
Mark J. van der Laan
Published/Copyright:
October 7, 2005
Simultaneously testing a collection of null hypotheses about a data generating distribution based on a sample of independent and identically distributed observations is a fundamental and important statistical problem involving many applications. In this article we propose a new re-sampling based multiple testing procedure asymptotically controlling the probability that the proportion of false positives among the set of rejections exceeds q at level alpha, where q and alpha are user supplied numbers. The procedure involves 1) specifying a conditional distribution for a guessed set of true null hypotheses, given the data, which asymptotically is degenerate at the true set of null hypotheses, and 2) specifying a generally valid null distribution for the vector of test-statistics proposed in Pollard & van der Laan (2003), and generalized in our subsequent article Dudoit, van der Laan, & Pollard (2004), van der Laan, Dudoit, & Pollard (2004), and van der Laan, Dudoit, & Pollard (2004b). Ingredient 1) is established by fitting the empirical Bayes two component mixture model (Efron (2001b)) to the data to obtain an upper bound for marginal posterior probabilities of the null being true, given the data. We establish the finite sample rational behind our proposal, and prove that this new multiple testing procedure asymptotically controls the wished tail probability for the proportion of false positives under general data generating distributions. In addition, we provide simulation studies establishing that this method is generally more powerful in finite samples than our previously proposed augmentation multiple testing procedure (van der Laan, Dudoit, & Pollard (2004b)) and competing procedures from the literature. Finally, we illustrate our methodology with a data analysis.
Keywords: Asymptotic control; augmentation; Empirical Bayes mixture model; false discovery rate; multiple testing; null distribution; proportion of false positives; Type I error rate.
Published Online: 2005-10-7
©2011 Walter de Gruyter GmbH & Co. KG, Berlin/Boston
You are currently not able to access this content.
You are currently not able to access this content.
Articles in the same Issue
- Article
- Estimating Motifs Under Order Restrictions
- Reproducible Research: A Bioinformatics Case Study
- Generalized Rank Tests for Replicated Microarray Data
- Stepwise Normalization of Two-Channel Spotted Microarrays
- Comparing Automatic and Manual Image Processing in FLARE Assay Analysis for Colon Carcinogenesis
- Pixel-level Signal Modelling with Spatial Correlation for Two-Colour Microarrays
- Empirical Bayes Microarray ANOVA and Grouping Cell Lines by Equal Expression Levels
- Multiple Testing and Data Adaptive Regression: An Application to HIV-1 Sequence Data.
- Early Diagnostic Marker Panel Determination for Microarray Based Clinical Studies
- Prediction of Missing Values in Microarray and Use of Mixed Models to Evaluate the Predictors
- Combined Association and Linkage Analysis for General Pedigrees and Genetic Models
- Incorporating Biological Information as a Prior in an Empirical Bayes Approach to Analyzing Microarray Data
- The Relative Inefficiency of Sequence Weights Approaches in Determining a Nucleotide Position Weight Matrix
- A Simple Loglinear Model for Haplotype Effects in a Case-Control Study Involving Two Unphased Genotypes
- Extension of the SIMLA Package for Generating Pedigrees with Complex Inheritance Patterns: Environmental Covariates, Gene-Gene and Gene-Environment Interaction
- Error Distribution for Gene Expression Data
- A General Framework for Weighted Gene Co-Expression Network Analysis
- Statistical Inference in Evolutionary Models of DNA Sequences via the EM Algorithm
- Comparing Bacterial DNA Microarray Fingerprints
- Continuous Covariates in Genetic Association Studies of Case-Parent Triads: Gene and Gene-Environment Interaction Effects, Population Stratification, and Power Analysis
- Robust Remote Homology Detection by Feature Based Profile Hidden Markov Models
- Empirical Bayes Estimation of a Sparse Vector of Gene Expression Changes
- Hierarchical Inverse Gaussian Models and Multiple Testing: Application to Gene Expression Data
- FADO: A Statistical Method to Detect Favored or Avoided Distances between Occurrences of Motifs using the Hawkes' Model
- Prediction of Genomewide Conserved Epitope Profiles of HIV-1: Classifier Choice and Peptide Representation
- Fold-Change Estimation of Differentially Expressed Genes using Mixture Mixed-Model
- Test on the Structure of Biological Sequences via Chaos Game Representation
- Reverse Engineering Galactose Regulation in Yeast through Model Selection
- Empirical Bayes and Resampling Based Multiple Testing Procedure Controlling Tail Probability of the Proportion of False Positives.
- Weighted Analysis of Paired Microarray Experiments
- A Probabilistic Approach to Large-Scale Association Scans: A Semi-Bayesian Method to Detect Disease-Predisposing Alleles
- A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional Genomics
- Structured Antedependence Models for Functional Mapping of Multiple Longitudinal Traits
- Correlation Between Gene Expression Levels and Limitations of the Empirical Bayes Methodology for Finding Differentially Expressed Genes
- Bayesian Statistical Studies of the Ramachandran Distribution
- On Reference Designs For Microarray Experiments
- Computing Asymptotic Power and Sample Size for Case-Control Genetic Association Studies in the Presence of Phenotype and/or Genotype Misclassification Errors
Keywords for this article
Asymptotic control;
augmentation;
Empirical Bayes mixture model;
false discovery rate;
multiple testing;
null distribution;
proportion of false positives;
Type I error rate.
Articles in the same Issue
- Article
- Estimating Motifs Under Order Restrictions
- Reproducible Research: A Bioinformatics Case Study
- Generalized Rank Tests for Replicated Microarray Data
- Stepwise Normalization of Two-Channel Spotted Microarrays
- Comparing Automatic and Manual Image Processing in FLARE Assay Analysis for Colon Carcinogenesis
- Pixel-level Signal Modelling with Spatial Correlation for Two-Colour Microarrays
- Empirical Bayes Microarray ANOVA and Grouping Cell Lines by Equal Expression Levels
- Multiple Testing and Data Adaptive Regression: An Application to HIV-1 Sequence Data.
- Early Diagnostic Marker Panel Determination for Microarray Based Clinical Studies
- Prediction of Missing Values in Microarray and Use of Mixed Models to Evaluate the Predictors
- Combined Association and Linkage Analysis for General Pedigrees and Genetic Models
- Incorporating Biological Information as a Prior in an Empirical Bayes Approach to Analyzing Microarray Data
- The Relative Inefficiency of Sequence Weights Approaches in Determining a Nucleotide Position Weight Matrix
- A Simple Loglinear Model for Haplotype Effects in a Case-Control Study Involving Two Unphased Genotypes
- Extension of the SIMLA Package for Generating Pedigrees with Complex Inheritance Patterns: Environmental Covariates, Gene-Gene and Gene-Environment Interaction
- Error Distribution for Gene Expression Data
- A General Framework for Weighted Gene Co-Expression Network Analysis
- Statistical Inference in Evolutionary Models of DNA Sequences via the EM Algorithm
- Comparing Bacterial DNA Microarray Fingerprints
- Continuous Covariates in Genetic Association Studies of Case-Parent Triads: Gene and Gene-Environment Interaction Effects, Population Stratification, and Power Analysis
- Robust Remote Homology Detection by Feature Based Profile Hidden Markov Models
- Empirical Bayes Estimation of a Sparse Vector of Gene Expression Changes
- Hierarchical Inverse Gaussian Models and Multiple Testing: Application to Gene Expression Data
- FADO: A Statistical Method to Detect Favored or Avoided Distances between Occurrences of Motifs using the Hawkes' Model
- Prediction of Genomewide Conserved Epitope Profiles of HIV-1: Classifier Choice and Peptide Representation
- Fold-Change Estimation of Differentially Expressed Genes using Mixture Mixed-Model
- Test on the Structure of Biological Sequences via Chaos Game Representation
- Reverse Engineering Galactose Regulation in Yeast through Model Selection
- Empirical Bayes and Resampling Based Multiple Testing Procedure Controlling Tail Probability of the Proportion of False Positives.
- Weighted Analysis of Paired Microarray Experiments
- A Probabilistic Approach to Large-Scale Association Scans: A Semi-Bayesian Method to Detect Disease-Predisposing Alleles
- A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional Genomics
- Structured Antedependence Models for Functional Mapping of Multiple Longitudinal Traits
- Correlation Between Gene Expression Levels and Limitations of the Empirical Bayes Methodology for Finding Differentially Expressed Genes
- Bayesian Statistical Studies of the Ramachandran Distribution
- On Reference Designs For Microarray Experiments
- Computing Asymptotic Power and Sample Size for Case-Control Genetic Association Studies in the Presence of Phenotype and/or Genotype Misclassification Errors
