Home Business & Economics Oracle inequalities for multi-fold cross validation
Article
Licensed
Unlicensed Requires Authentication

Oracle inequalities for multi-fold cross validation

  • Aad W. van der Vaart , Sandrine Dudoit and Mark J. van der Laan
Published/Copyright: September 25, 2009
Become an author with De Gruyter Brill

We consider choosing an estimator or model from a given class by cross validation consisting of holding a nonneglible fraction of the observations out as a test set. We derive bounds that show that the risk of the resulting procedure is (up to a constant) smaller than the risk of an oracle plus an error which typically grows logarithmically with the number of estimators in the class. We extend the results to penalized cross validation in order to control unbounded loss functions. Applications include regression with squared and absolute deviation loss and classification under Tsybakov’s condition.

:
Received: 2004-March-11
Accepted: 2006-September-6
Published Online: 2009-09-25
Published in Print: 2006-12

© Oldenbourg Wissenschaftsverlag

Downloaded on 20.2.2026 from https://www.degruyterbrill.com/document/doi/10.1524/stnd.2006.24.3.351/html
Scroll to top button