Sparse partial least squares regression for simultaneous dimension reduction and variable selection

Summary.  Partial least squares regression has been an alternative to ordinary least squares for handling multicollinearity in several areas of scientific research since the 1960s. It has recently gained much attention in the analysis of high dimensional genomic data. We show that known asymptotic consistency of the partial least squares estimator for a univariate response does not hold with the very large p and small n paradigm. We derive a similar result for a multivariate response regression with partial least squares. We then propose a sparse partial least squares formulation which aims simultaneously to achieve good predictive performance and variable selection by producing sparse linear combinations of the original predictors. We provide an efficient implementation of sparse partial least squares regression and compare it with well-known variable selection and dimension reduction approaches via simulation experiments. We illustrate the practical utility of sparse partial least squares regression in a joint analysis of gene expression and genomewide binding data.     

Nonlinear regression modeling via the lasso-type regularization

We consider the problem of constructing nonlinear regression models with Gaussian basis functions, using lasso regularization. Regularization with a lasso penalty is an advantageous in that it estimates some coefficients in linear regression models to be exactly zero. We propose imposing a weighted lasso penalty on a nonlinear regression model and thereby selecting the number of basis functions effectively. In order to select tuning parameters in the regularization method, we use a deviance information criterion proposed by Spiegelhalter et al. (2002), calculating the effective number of parameters by Gibbs sampling. Simulation results demonstrate that our methodology performs well in various situations.     

Estimation of covariance matrix via the sparse Cholesky factor with lasso

In this paper, we discuss a parsimonious approach to estimation of high-dimensional covariance matrices via the modified Cholesky decomposition with lasso. Two different methods are proposed. They are the equi-angular and equi-sparse methods. We use simulation to compare the performance of the proposed methods with others available in the literature, including the sample covariance matrix, the banding method, and the L₁-penalized normal loglikelihood method. We then apply the proposed methods to a portfolio selection problem using 80 series of daily stock returns. To facilitate the use of lasso in high-dimensional time series analysis, we develop the dynamic weighted lasso (DWL) algorithm that extends the LARS-lasso algorithm. In particular, the proposed algorithm can efficiently update the lasso solution as new data become available. It can also add or remove explanatory variables. The entire solution path of the L₁-penalized normal loglikelihood method is also constructed.     

并行工程产品开发过程定量化建模与计划制订

由于现有的一些并行工程定量化模型中修改设计微循环的细节特征描述得还不够充分 ,本文提出了一种新的基于产品 -工艺设计活动对网络的定量化模型来描述并行工程产品开发过程 ,并且给出了产品 -工艺设计活动对平均持续时间与产品或工艺设计活动资源占用率的计算方法 .在此基础上 ,将并行工程产品开发过程的计划制订问题建模成一个有资源约束的项目调度问题 .与其它此类问题不同的是 ,在本文中 ,分配给产品开发项目的各类资源的数量不是事先给定的 ,而是与最优产品开发计划一起获得的 ,所以这是一个资源分配与计划制订的集成优化问题 .本文提出了一种新的基于分枝定界的算法来解决此问题并引入一个启发式规则来提高算法的搜索效率     

论加强公共行政改革中的契约思想

依法行政,建设法治政府,责任政府是中国行政改革的必然趋势。一个基本原则就是政府与民众地位的平等性,政府在行使公共权利的过程中与民众是一种平等的交换关系民众纳税和遵从,政府管理公共事务,而不是治者与被治者的上下尊卑关系,而中国政府在行政改革过程中欠缺的就是这种平等的契约思想。     

Recent developments in high dimensional covariance estimation and its related issues,a review

In this paper we review some of recent developments in high dimensional data analysis, especially in the estimation of covariance and precision matrix, asymptotic results on the eigenstructure in the principal components analysis, and some relevant issues such as test on the equality of two covariance matrices, determination of the number of principal components, and detection of hubs in a complex network.     

Nonlinear voxel-based modelling of the haemodynamic response in fMRI

A common assumption for data analysis in functional magnetic resonance imaging is that the response signal can be modelled as the convolution of a haemodynamic response (HDR) kernel with a stimulus reference function. Early approaches modelled spatially constant HDR kernels, but more recently spatially varying models have been proposed. However, convolution limits the flexibility of these models and their ability to capture spatial variation. Here, a range of (nonlinear) parametric curves are fitted by least squares minimisation directly to individual voxel HDRs (i.e., without using convolution). A ‘constrained gamma curve’ is proposed as an efficient form for fitting the HDR at each individual voxel. This curve allows for spatial variation in the delay of the HDR, but places a global constraint on the temporal spread. The approach of directly fitting individual parameters of HDR shape is demonstrated to lead to an improved fit of response estimates.     

广东农村成人教育发展研究

要增强农村的发展后劲，必须正视和提高人力资本存量，最快捷的办法是发展农村成人教育；广东农村成人教育发展现状喜忧参半，不能适应广东农村经济发展的要求。在分析制约广东农村成人教育发展因素的基础上，提出更新观念、城乡统等、创新教育的发展措施。     

响应变量缺失下半参数变系数EV模型的约束统计推断

文章研究了半参数变系数EV模型在线性约束条件下的估计和检验问题,当响应变量缺失、非参数部分协变量带有测量误差时,利用局部纠偏的Profile最小二乘估计、Lagrange乘子方法和借补技术构造了回归模型参数分量两类纠偏约束估计量。此外,为了检验线性约束条件,构造了借补的Profile Lagrange乘子检验统计量,并通过蒙特卡洛数值模拟验证估计量和检验统计量的有效性。     

Estimation of the binomial parameter,using an apriori hypothesis about its value

We study estimation of the parameter p of a r.v. x ～ Bin(p,n) using the prior hypothesis that p equals a prepecified value P_o when we entertain the possibility that P_o is not the right value of p, which then could be any value in (0.1). We apply notions of Hodges and Lehmann (1952), Bickel (1984) and Berger (1982) to obtain (biased) estimators which do well under the hypothesis that p = p_o at a small price in maximum risk. A number of examples and comparisons are discussed at the end of the paper.