Bayes and empirical Bayes shrinkage estimation of regression coefficients

For a moderate or large number of regression coefficients, shrinkage estimates towards an overall mean are obtained by Bayes and empirical Bayes methods. For a special case, the Bayes and empirical Bayes shrinking weights are shown to be asymptotically equivalent as the amount of shrinkage goes to zero. Based on comparisons between Bayes and empirical Bayes solutions, a modification of the empirical Bayes shrinking weights designed to guard against unreasonable overshrinking is suggested. A numerical example is given.     

Shrinkage ridge regression in partial linear models

ABSTRACT

In this paper, shrinkage ridge estimator and its positive part are defined for the regression coefficient vector in a partial linear model. The differencing approach is used to enjoy the ease of parameter estimation after removing the non parametric part of the model. The exact risk expressions in addition to biases are derived for the estimators under study and the region of optimality of each estimator is exactly determined. The performance of the estimators is evaluated by simulated as well as real data sets.     

Bayesian shrinkage estimates for regression coefficients in m populations

For a linear regression model over m populations with separate regression coefficients but a common error variance, a Bayesian model is employed to obtain regression coefficient estimates which are shrunk toward an overall value. The formulation uses Normal priors on the coefficients and diffuse priors on the grand mean vectors, the error variance, and the between-to-error variance ratios. The posterior density of the parameters which were given diffuse priors is obtained. From this the posterior means and variances of regression coefficients and the predictive mean and variance of a future observation are obtained directly by numerical integration in the balanced case, and with the aid of series expansions in the approximately balanced case. An example is presented and worked out for the case of one predictor variable. The method is an extension of Box & Tiao's Bayesian estimation of means in the balanced one-way random effects model.     

Empirical bayes shrinkage estimation of reliability in the exponential distribution

In this paper we propose two empirical Bayes shrinkage estimators for the reliability of the exponential distribution and study their properties. Under the uniform prior distribution and the inverted gamma prior distribution these estimators are developed and compared with a preliminary test estimator and with a shrinkage testimator in terms of mean squared error. The proposed empirical Bayes shrinkage estimator under the inverted gamma prior distribution is shown to be preferable to the preliminary test estimator and the shrinkage testimator when the prior value of mean life is clsoe to the true mean life.     

A note on a modified double stage shrinkage estimator

A modified double stage shrinkage estimator has been proposed for the single parameter θ of a distribution function _Fθ. It is shown to be locally better in comparison to the usual double stage shrinkage estimator in the sense of smaller mean squared error in a certain neighbourhood of prior estimate θ_o of θ.     

Using Lasso RCCA for cross-language information retrieval

ABSTRACT

Restricted canonical correlation analysis and the lasso shrinkage method were paired together for canonical correlation analysis with non-negativity restrictions on datasets, where a sample size is much smaller than the number of variables. The method was implemented in an alternating least-squares algorithm and applied to cross-language information retrieval on a dataset with aligned documents in eight languages. A set of experiments was ran to evaluate the method and compare it to other methods in the field.     

A multiparameter extension of two stage modified shrinkage estimator

A multiparameter extension is made to modified two stage shrinkage estimator proposed by Handa andKambo (1990), For aparticular class of shrinkage estimator, the local optimality of the extended modified estimator is shown over the two stage shrinkage estimator defined by Bhattacharya and Prakasa Rao(1990) in terms of quadratic loss.     

Regression model with elliptically contoured errors

For the regression model y=X β+ε where the errors follow the elliptically contoured distribution, we consider the least squares, restricted least squares, preliminary test, Stein-type shrinkage and positive-rule shrinkage estimators for the regression parameters, β.

We compare the quadratic risks of the estimators to determine the relative dominance properties of the five estimators.     

A robust test for asymptotic independence of bivariate extremes

We show that the existing tests for asymptotic independence are sensitive to outliers. A robust test is proposed. The new test is made stable under contamination through a shrinkage scheme. Simulations show that the new test performs well in the presence of contaminated data while maintaining good properties when there is no contamination. An application to real data shows the added value of our new robust approach.