Artikel
Lizenziert
Nicht lizenziert
Erfordert eine Authentifizierung
The Joint Null Criterion for Multiple Hypothesis Tests
-
Jeffrey T Leek
Veröffentlicht/Copyright:
1. Juni 2011
Simultaneously performing many hypothesis tests is a problem commonly encountered in high-dimensional biology. In this setting, a large set of p-values is calculated from many related features measured simultaneously. Classical statistics provides a criterion for defining what a “correct” p-value is when performing a single hypothesis test. We show here that even when each p-value is marginally correct under this single hypothesis criterion, it may be the case that the joint behavior of the entire set of p-values is problematic. On the other hand, there are cases where each p-value is marginally incorrect, yet the joint distribution of the set of p-values is satisfactory. Here, we propose a criterion defining a well behaved set of simultaneously calculated p-values that provides precise control of common error rates and we introduce diagnostic procedures for assessing whether the criterion is satisfied with simulations. Multiple testing p-values that satisfy our new criterion avoid potentially large study specific errors, but also satisfy the usual assumptions for strong control of false discovery rates and family-wise error rates. We utilize the new criterion and proposed diagnostics to investigate two common issues in high-dimensional multiple testing for genomics: dependent multiple hypothesis tests and pooled versus test-specific null distributions.
Published Online: 2011-6-1
©2011 Walter de Gruyter GmbH & Co. KG, Berlin/Boston
Sie haben derzeit keinen Zugang zu diesem Inhalt.
Sie haben derzeit keinen Zugang zu diesem Inhalt.
Artikel in diesem Heft
- Invited Editorial
- Measurement of Evidence and Evidence of Measurement
- Article
- Fully Moderated T-statistic for Small Sample Size Gene Expression Arrays
- Determining Coding CpG Islands by Identifying Regions Significant for Pattern Statistics on Markov Chains
- Assessing Modularity Using a Random Matrix Theory Approach
- Choice of Summary Statistic Weights in Approximate Bayesian Computation
- Genetic Linkage Analysis in the Presence of Germline Mosaicism
- Fitting Boolean Networks from Steady State Perturbation Data
- Adaptive Elastic-Net Sparse Principal Component Analysis for Pathway Association Testing
- Bayesian Learning from Marginal Data in Bionetwork Models
- Unsupervised Classification for Tiling Arrays: ChIP-chip and Transcriptome
- Multiple Testing in Candidate Gene Situations: A Comparison of Classical, Discrete, and Resampling-Based Procedures
- Modeling Read Counts for CNV Detection in Exome Sequencing Data
- Multiscale Characterization of Signaling Network Dynamics through Features
- A Calibrated Multiclass Extension of AdaBoost
- False Discovery Rate Estimation for Stability Selection: Application to Genome-Wide Association Studies
- A Markov-Chain Model for the Analysis of High-Resolution Enzymatically 18O-Labeled Mass Spectra
- Repeated Measures Semiparametric Regression Using Targeted Maximum Likelihood Methodology with Application to Transcription Factor Activity Discovery
- Learning Monotonic Genotype-Phenotype Maps
- A Comparison of Multifactor Dimensionality Reduction and L1-Penalized Regression to Identify Gene-Gene Interactions in Genetic Association Studies
- Accuracy and Computational Efficiency of a Graphical Modeling Approach to Linkage Disequilibrium Estimation
- Learning from Past Treatments and Their Outcome Improves Prediction of In Vivo Response to Anti-HIV Therapy
- A Three Component Latent Class Model for Robust Semiparametric Gene Discovery
- Log-Linear Modelling of Protein Dipeptide Structure Reveals Interesting Patterns of Side-Chain-Backbone Interactions
- A Robust Statistical Method to Detect Null Alleles in Microsatellite and SNP Datasets in Both Panmictic and Inbred Populations
- Large Sample Approximations of Probabilities of Correct Evolutionary Tree Estimation and Biases of Maximum Likelihood Estimation
- Interval Estimation of Familial Correlations from Pedigrees
- Information Metrics in Genetic Epidemiology
- Linear Combination Test for Hierarchical Gene Set Analysis
- Exploratory Analysis of Multiple Omics Datasets Using the Adjusted RV Coefficient
- Application of the Lasso to Expression Quantitative Trait Loci Mapping
- A Variance-Components Model for Distance-Matrix Phylogenetic Reconstruction
- Imputation Estimators Partially Correct for Model Misspecification
- On the Statistical Properties of SGoF Multitesting Method
- Meta-Analysis of Family-Based and Case-Control Genetic Association Studies that Use the Same Cases
- A Non-Parametric Method for Detecting Specificity Determining Sites in Protein Sequence Alignments
- Performance of Matrix Representation with Parsimony for Inferring Species from Gene Trees
- Disequilibrium Coefficient: A Bayesian Perspective
- Analyzing Time-Course Microarray Data Using Functional Data Analysis - A Review
- The NBP Negative Binomial Model for Assessing Differential Gene Expression from RNA-Seq
- Inferring Gene Networks using Robust Statistical Techniques
- A Two-Stage Poisson Model for Testing RNA-Seq Data
- Quantifying the Relative Contribution of the Heterozygous Class to QTL Detection Power
- The Joint Null Criterion for Multiple Hypothesis Tests
- Multiple Imputation of Missing Phenotype Data for QTL Mapping
- Sparse Canonical Covariance Analysis for High-throughput Data
- Comparison of Clinical Subgroup aCGH Profiles through Pseudolikelihood Ratio Tests
- Random Forests for Genetic Association Studies
- Deviance Information Criteria for Model Selection in Approximate Bayesian Computation
- High-Dimensional Regression and Variable Selection Using CAR Scores
- Surveying the Manifold Divergence of an Entire Protein Class for Statistical Clues to Underlying Biochemical Mechanisms
- Smoothing Gene Expression Data with Network Information Improves Consistency of Regulated Genes
- Entropy Based Genetic Association Tests and Gene-Gene Interaction Tests
- Weighted Lasso with Data Integration
- MA-SNP -- A New Genotype Calling Method for Oligonucleotide SNP Arrays Modeling the Batch Effect with a Normal Mixture Model
- A Modified Maximum Contrast Method for Unequal Sample Sizes in Pharmacogenomic Studies
Schlagwörter für diesen Artikel
false discovery rate;
multiple testing dependence;
pooled null statistics
Artikel in diesem Heft
- Invited Editorial
- Measurement of Evidence and Evidence of Measurement
- Article
- Fully Moderated T-statistic for Small Sample Size Gene Expression Arrays
- Determining Coding CpG Islands by Identifying Regions Significant for Pattern Statistics on Markov Chains
- Assessing Modularity Using a Random Matrix Theory Approach
- Choice of Summary Statistic Weights in Approximate Bayesian Computation
- Genetic Linkage Analysis in the Presence of Germline Mosaicism
- Fitting Boolean Networks from Steady State Perturbation Data
- Adaptive Elastic-Net Sparse Principal Component Analysis for Pathway Association Testing
- Bayesian Learning from Marginal Data in Bionetwork Models
- Unsupervised Classification for Tiling Arrays: ChIP-chip and Transcriptome
- Multiple Testing in Candidate Gene Situations: A Comparison of Classical, Discrete, and Resampling-Based Procedures
- Modeling Read Counts for CNV Detection in Exome Sequencing Data
- Multiscale Characterization of Signaling Network Dynamics through Features
- A Calibrated Multiclass Extension of AdaBoost
- False Discovery Rate Estimation for Stability Selection: Application to Genome-Wide Association Studies
- A Markov-Chain Model for the Analysis of High-Resolution Enzymatically 18O-Labeled Mass Spectra
- Repeated Measures Semiparametric Regression Using Targeted Maximum Likelihood Methodology with Application to Transcription Factor Activity Discovery
- Learning Monotonic Genotype-Phenotype Maps
- A Comparison of Multifactor Dimensionality Reduction and L1-Penalized Regression to Identify Gene-Gene Interactions in Genetic Association Studies
- Accuracy and Computational Efficiency of a Graphical Modeling Approach to Linkage Disequilibrium Estimation
- Learning from Past Treatments and Their Outcome Improves Prediction of In Vivo Response to Anti-HIV Therapy
- A Three Component Latent Class Model for Robust Semiparametric Gene Discovery
- Log-Linear Modelling of Protein Dipeptide Structure Reveals Interesting Patterns of Side-Chain-Backbone Interactions
- A Robust Statistical Method to Detect Null Alleles in Microsatellite and SNP Datasets in Both Panmictic and Inbred Populations
- Large Sample Approximations of Probabilities of Correct Evolutionary Tree Estimation and Biases of Maximum Likelihood Estimation
- Interval Estimation of Familial Correlations from Pedigrees
- Information Metrics in Genetic Epidemiology
- Linear Combination Test for Hierarchical Gene Set Analysis
- Exploratory Analysis of Multiple Omics Datasets Using the Adjusted RV Coefficient
- Application of the Lasso to Expression Quantitative Trait Loci Mapping
- A Variance-Components Model for Distance-Matrix Phylogenetic Reconstruction
- Imputation Estimators Partially Correct for Model Misspecification
- On the Statistical Properties of SGoF Multitesting Method
- Meta-Analysis of Family-Based and Case-Control Genetic Association Studies that Use the Same Cases
- A Non-Parametric Method for Detecting Specificity Determining Sites in Protein Sequence Alignments
- Performance of Matrix Representation with Parsimony for Inferring Species from Gene Trees
- Disequilibrium Coefficient: A Bayesian Perspective
- Analyzing Time-Course Microarray Data Using Functional Data Analysis - A Review
- The NBP Negative Binomial Model for Assessing Differential Gene Expression from RNA-Seq
- Inferring Gene Networks using Robust Statistical Techniques
- A Two-Stage Poisson Model for Testing RNA-Seq Data
- Quantifying the Relative Contribution of the Heterozygous Class to QTL Detection Power
- The Joint Null Criterion for Multiple Hypothesis Tests
- Multiple Imputation of Missing Phenotype Data for QTL Mapping
- Sparse Canonical Covariance Analysis for High-throughput Data
- Comparison of Clinical Subgroup aCGH Profiles through Pseudolikelihood Ratio Tests
- Random Forests for Genetic Association Studies
- Deviance Information Criteria for Model Selection in Approximate Bayesian Computation
- High-Dimensional Regression and Variable Selection Using CAR Scores
- Surveying the Manifold Divergence of an Entire Protein Class for Statistical Clues to Underlying Biochemical Mechanisms
- Smoothing Gene Expression Data with Network Information Improves Consistency of Regulated Genes
- Entropy Based Genetic Association Tests and Gene-Gene Interaction Tests
- Weighted Lasso with Data Integration
- MA-SNP -- A New Genotype Calling Method for Oligonucleotide SNP Arrays Modeling the Batch Effect with a Normal Mixture Model
- A Modified Maximum Contrast Method for Unequal Sample Sizes in Pharmacogenomic Studies
