A Starting Note: A Historical Perspective in Lasso

Abstract

we provide history of lasso, and see new ventures and talk about key concept of debiased lasso. Lasso provided a good fit through sparse regression but did not deliver standard errors. The debiased lasso delivers.

Keywords

• machine learning
• supervised learning
• nodewise

References

1. Belloni, A. and D. Chen, and V. Chernozhukov, and C. Hansen (2012). Sparse models and methods for optimal instruments with an application to eminent domain. Econometrica, 80, 2369-2429.
2. Belloni, A. and V. Chernozhukov, and C. Hansen (2014). Inference on treatment effects after selection among high dimensional controls. Review of Economic Studies, 81, 608-650.
3. Callot, L. and M. Caner, and O. Onder, E. Ulasan (2021). A nodewise regression approach to estimating large portfolios. Journal of Business and Economic Statistics, Forthcoming.
4. Caner, M. (2009). Lasso-type GMM estimation. Econometric Theory, 25, 270-290.
5. Caner, M. and A.B. Kock (2018). Asymptotically honest confidence regions for high dimensional parameters by the desparsified conservative lasso. Journal of Econometrics, 203, 143-168.
6. Caner, M. and X. Han, and Y. Lee (2018). Adaptive elastic net GMM estimation with many invalid moment conditions: Simultaneous model and moment selection. Journal of Business and Economic Statistics, 36, 24-46.
7. Knight, K. and W. Fu (2000). Asymptotics for lasso-type estimators. Annals of Statistics, 28, 1356-1378.
8. Knight, K. (2008). Shrinkage estimation for nearly singular designs. Econometric Theory, 24, 323-337.

9. Leeb, H. and B. Potscher (2003). The finite sample distribution of post-model selection estimators and uniform versus nonuniform approximations. Econometric Theory 19, 100-142.
10. Leeb, H. and B. Potscher (2005). Model selection and inference: facts and fiction. Econometric Theory, 21, 21-59.
11. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society Series B, 58,267-288.
12. Van de Geer, S. and P. Buhlmann, and Y. Ritov, and R. Dezeure (2014). On asymptotically optimal confidence regions and tests for high dimensional models. Annals of Statistics, 42, 1166-1202.
13. Zou, H. (2006). The adaptive lasso and its oracle properties. Journal of the American Statistical Association, 101, 1418-1429.