Dimension reduction boosting

L₂Boosting is an effective method for constructing model. In the case of high-dimensional setting, Bühlmann and Yu (2003 Bühlmann, P., Yu, B. (2003). Boosting with the L₂-loss: regression and classification. J. Amer. Stat. Assoc. 98:324–339.Taylor &; Francis Online], Web of Science ®] , Google Scholar]) proposed the componentwise L₂Boosting, but componentwise L₂Boosting can only fit a special limited model. In this paper, by combining a boosting and sufficient dimension reduction method, e.g., sliced inverse regression (SIR), we propose a new method for regression, called dimension reduction boosting (DRBoosting). Compared with L₂Boosting, the computation of DRBoosting is less intensive and its prediction is better, especially for high-dimensional data. Simulations confirm the advantage of the new method.