A novel regularization method for estimation and variable selection in multi-index models |
| |
Authors: | Peng Zeng Yu Zhu |
| |
Institution: | 1. Department of Mathematics and Statistics, Auburn University, Auburn, Alabama, USA;2. Department of Statistics, Purdue University, West Lafayette, Indiana, USA;3. Center for Statistical Science, Department of Industrial Engineering, Tsinghua University, Beijing, China |
| |
Abstract: | Multi-index models have attracted much attention recently as an approach to circumvent the curse of dimensionality when modeling high-dimensional data. This paper proposes a novel regularization method, called MAVE-glasso, for simultaneous parameter estimation and variable selection in multi-index models. The advantages of the proposed method include transformation invariance, automatic variable selection, automatic removal of noninformative observations, and row-wise shrinkage. An efficient row-wise coordinate descent algorithm is proposed to calculate the estimates. Simulation and real examples are used to demonstrate the excellent performance of MAVE-glasso. |
| |
Keywords: | Generalized lasso MAVE row-wise coordinate descent row-wise shrinkage |
|
|