Material Detail

Pointwise Tracking the Optimal Regression Function

Pointwise Tracking the Optimal Regression Function

This video was recorded at Video Journal of Machine Learning Abstracts - Volume 3. This paper examines the possibility of a "reject option" in the context of least squares regression. It is shown that using rejection it is theoretically possible to learn "selective" regressors that can ϵ-pointwise track the best regressor in hindsight from the same hypothesis class, while rejecting only a bounded portion of the domain. Moreover, the rejected volume vanishes with the training set size, under certain conditions. We then develop efficient and exact implementation of these selective regressors for the case of linear regression. Empirical evaluation over a suite of real-world datasets corroborates the theoretical analysis and indicates that our selective regressors can provide substantial advantage by reducing estimation error.


  • User Rating
  • Comments
  • Learning Exercises
  • Bookmark Collections
  • Course ePortfolios
  • Accessibility Info

More about this material


Log in to participate in the discussions or sign up if you are not already a MERLOT member.