Restricted minimax estimation in semiparametric linear models

Abstract

In this article we develop the minimax estimation approach of general linear models to the semiparametric linear models when the parameters are simultaneously constrained by an ellipsoid and linear restrictions. Combining sample information and prior constraints the minimax estimator is obtained and compared with partially least square estimator by theoretical and simulation methods.     

On Optimality of Bayesian Wavelet Estimators

Abstract.  We investigate the asymptotic optimality of several Bayesian wavelet estimators, namely, posterior mean, posterior median and Bayes Factor, where the prior imposed on wavelet coefficients is a mixture of a mass function at zero and a Gaussian density. We show that in terms of the mean squared error, for the properly chosen hyperparameters of the prior, all the three resulting Bayesian wavelet estimators achieve optimal minimax rates within any prescribed Besov space     for p  ≥ 2. For 1 ≤  p  < 2, the Bayes Factor is still optimal for (2 s +2)/(2 s +1) ≤  p  < 2 and always outperforms the posterior mean and the posterior median that can achieve only the best possible rates for linear estimators in this case.     

Deconvolution with supersmooth distributions

Nonparametric deconvolution problems require one to recover an unknown density when the data are contaminated with errors. Optimal global rates of convergence are found under the weighted L_p-loss (1 ≤ p ≤ ∞). It appears that the optimal rates of convergence are extremely low for supersmooth error distributions. To resolve this difficulty, we examine how high the noise level can be for deconvolution to be feasible, and for the deconvolution estimate to be as good as the ordinary density estimate. It is shown that if the noise level is not too high, nonparametric Gaussian deconvolution can still be practical. Several simulation studies are also presented.     

On the construction of optimal experimental designs: a penalty approach

Tn optimal experimental design theory there are well-known situations, in which additional constraints are implied to the design set. These constraints destroy in general the simplex structure of the set of feasible points of the design set. Thus the available iteration procedures for the unrestricted case are no longer applicable.

In this paper a penalty approach is suggested which transforms the restricted problem to the unrestricted case and allows the application of well-known algorithms such as the Fedorov-Wynn-type or the projected gradient procedure.     

Minimax property of stein's estimator

Stein's estimator and some other estimators of the mean of a K-variate normal distribution are known to dominate the maximum likelihood estimator under quadratic loss for K > 3, and are therefore minimax. In this paper it is shown that the minimax property of Stein's rule is preserved with respect to a generalized loss function.     

运用核Fisher鉴别分析和MPM分类器的入侵检测

为了提高分类器的正确率和减少训练时间,将特征提取技术与分类算法结合,提出了一种基于核Fisher鉴别分析和最小极大概率机算法的入侵检测算法。利用核Fisher鉴别分析技术提取关键特征,运用最小极大概率机对提取特征后的数据进行分类,采用离线数据集KDDCUP99进行实验。实验结果表明,该算法是可行和有效的,使分类性能和训练时间都得到了提高。     

Another look at Huber's estimator: A new minimax estimator in regression with stochastically bounded noise

Huber's estimator has had a long lasting impact, particularly on robust statistics. It is well known that under certain conditions, Huber's estimator is asymptotically minimax. A moderate generalization in rederiving Huber's estimator shows that Huber's estimator is not the only choice. We develop an alternative asymptotic minimax estimator and name it regression with stochastically bounded noise (RSBN). Simulations demonstrate that RSBN is slightly better in performance, although it is unclear how to justify such an improvement theoretically. We propose two numerical solutions: an iterative numerical solution, which is extremely easy to implement and is based on the proximal point method; and a solution by applying state-of-the-art nonlinear optimization software packages, e.g., SNOPT. Contribution: the generalization of the variational approach is interesting and should be useful in deriving other asymptotic minimax estimators in other problems.     

Modified minimax estimation of regression coefficients

Working with the linear regression model (1.1) and having the extraneous information (1.2) about regression coefficients the problem exists how to build estimators (1.3) with the risk (1.4) which enable to utilize the known information in order to reduce their risk as compared with the risk (1.6) of the LSE (1.5). Solution of this problem is known for the positive definite matrix T, namely in form for estimators (1.8) and (1.10).First, it is shown that the proposed estimators (2.6),(2.9) and (2.16) based on psedoinversions of the matrix L represent the solution of the problem of the positive semidefinite matrix T=L'L.Further, the problem of interpretability of estimators in the sense of the inequality (3.1) exists; it is shown that all mentioned estimators are at least partially interpretable in the sense of requirements (3.2) or (3.10).     

投资组合均值-方差模型和极小极大模型的实证比较

本文针对传统的Markowitz均值-方差(MV)模型和Young(1998)提出的极小极大(Minimax)模型进行了实证比较研究。我们将2001年上证30指数的实际数据分成两部分,一部分作为样本数据进行优化组合分析,另一部分作为非样本数据进行模拟投资,检验绩效。结果发现:在同样的样本数据下,由两种模型的解描绘的风险-收益率有效前沿图非常相似;将两组模型的最优解分别进行模拟投资,Minimax模型的结果明显优于MV模型。本文的实证结果检验了Minimax模型的理论结论,表明其在实际投资中具有良好的可操作性和实用价值。