首页 | 本学科首页   官方微博 | 高级检索  
     检索      


Correlated variables in regression: Clustering and sparse estimation
Authors:Peter Bühlmann  Philipp Rütimann  Sara van de Geer  Cun-Hui Zhang
Institution:1. Seminar for Statistics, ETH Zurich, Switzerland;2. Department of Statistics, Rutgers University, United States
Abstract:We consider estimation in a high-dimensional linear model with strongly correlated variables. We propose to cluster the variables first and do subsequent sparse estimation such as the Lasso for cluster-representatives or the group Lasso based on the structure from the clusters. Regarding the first step, we present a novel and bottom-up agglomerative clustering algorithm based on canonical correlations, and we show that it finds an optimal solution and is statistically consistent. We also present some theoretical arguments that canonical correlation based clustering leads to a better-posed compatibility constant for the design matrix which ensures identifiability and an oracle inequality for the group Lasso. Furthermore, we discuss circumstances where cluster-representatives and using the Lasso as subsequent estimator leads to improved results for prediction and detection of variables. We complement the theoretical analysis with various empirical results.
Keywords:Canonical correlation  Group Lasso  Hierarchical clustering  High-dimensional inference  Lasso  Oracle inequality  Variable screening  Variable selection
本文献已被 ScienceDirect 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号