The Highly Adaptive Lasso Estimator

Citations Over TimeTop 10% of 2016 papers

Abstract

Estimation of a regression functions is a common goal of statistical learning. We propose a novel nonparametric regression estimator that, in contrast to many existing methods, does not rely on local smoothness assumptions nor is it constructed using local smoothing techniques. Instead, our estimator respects global smoothness constraints by virtue of falling in a class of right-hand continuous functions with left-hand limits that have variation norm bounded by a constant. Using empirical process theory, we establish a fast minimal rate of convergence of our proposed estimator and illustrate how such an estimator can be constructed using standard software. In simulations, we show that the finite-sample performance of our estimator is competitive with other popular machine learning techniques across a variety of data generating mechanisms. We also illustrate competitive performance in real data examples using several publicly available data sets.

Related Papers

• → Smoothing a Time Series by Segments of the Data Range(2015)9 cited
• → Optimal smoothness results and approximation techniques for real-time VBR video traffic smoothing(2002)6 cited
• → Nonparametric Profile Monitoring(2011)1 cited
• → Nonparametric Methods for Measurement of Height Growth(1986)
• Three-dimensional Scanner in the Use of Smoothness about Automobile Manufacturing(2011)