Limit expressions for the risk of james-stein estimators

Limit expressions (as the dimension p ← ∞ ) are derived for the relative risk of the James-Stein estimator and its positive-part version. The limit is simple to evaluate, and gives the amount of improvement in risk that is possible. The technique used is to bound the risk, both above and below. with bounds that converge to the same limit. For the James-Stein estimator these bounds are simple to calculate, and are quite accurate even for moderate dimensions.     

Difference-based Methods for Truncating the Singular Value Decomposition

Given a noisy time series (or signal), one may wish to remove the noise from the observed series. Assuming that the noise-free series lies in some low-dimensional subspace of rank r, a common approach is to embed the noisy time series into a Hankel trajectory matrix. The singular value decomposition is then used to deconstruct the Hankel matrix into a sum of rank-one components. We wish to demonstrate that there may be some potential in using difference-based methods of the observed series in order to provide guidance regarding the separation of the noise from the signal, and to estimate the rank of the low-dimensional subspace in which the true signal is assumed to lie.     

On sharper bounds for the risk of james-stein estimators

Two sampling strategies for estimation of population mean in overlapping clusters have been proposed, In the first strategy clusters are selected with egual probabilities, whereas in the second case selection probabilities are taken proportional to cluster size. The sampling efficiency of the latter is expected to be more in comparison to the former.     

A lower bound for the bayes risk in the sequential case

A lower bound for the Bayes risk in the sequential case is given under the regularity conditions. A related result to the minimax risk is also discussed. Further. some examples are given for the exponential and Poisson distributions.     

On the bias and variance of some proportion estimators

Providing certain parameters are known, almost any linear map from R^P to R¹ can be adjusted to yield a consistent and unbiased estimator in the context of estimating the mixing proportion θ on the basis of an unclassified sample of observations taken from a mixture of two p-dimensional distributions in proportions θ and 1-θ. Attention is focused on an estimator proposed recently, θ, which has minimum variance over all such linear maps. Unfortunately, the form of θ depends on the means of the component distributions and the covariance matrix of the mixture distribution. The effect of using appropriate sample estimates for these unknown parameters in forming θ is investigated by deriving the asymptotic mean and variance of the resulting estimator. The relative efficiency of this estimator under normality is derived. Also, a study is undertaken of the performance of a similar type of estimator appropriate in the context where an observed data vector is not an observation from either one or the other onent distributions, but is recorded as an integrated measurement over a surface area which is a mixture of two categories whose characteristics have different statistical distributions.The asymptotic bias in this case is compared with some available practical results.     

On the stability of maximum-likelihood estimators of orthogonal parameters

If two parameters ψ and λ, are orthogonal, λψ, the maximum-likelihood estimate of λ for given ψ, varies only slowly with ψ in the neighbourhood of the overall maximum-likelihood point. The same is true if ψλ is replaced by a nonlinear function h(ψλ). The detailed form of the variation of ψλ with ψ is studied, and a basis suggested for choosing a particular function h(ψλ) that shows the dependence in the least informative fashion.     

A comparison of stepwise common singular spectrum analysis and horizontal multi-channel singular spectrum analysis

The problem of forecasting a time series by using information provided by a second time series is considered. Two multivariate extensions of Singular Spectrum Analysis (SSA) are compared in terms of forecast error: Horizontal Multi-channel SSA and Stepwise Common SSA. Different signal structures, defined in terms of trend, period, amplitude and phase, are investigated. In broad terms we find that neither Horizontal Multichannel SSA nor Stepwise Common SSA is best in all cases. Horizontal MSSA is outperformed particularly in cases where different trends are considered.     

On the unbiasedness of iterated gls estimators

We Formulate sufficienct conditions for the existonce of the expectation of iterated generalized expectation of the iterated generalized least squares estimator, which consequently guarantee its unbiasedness, The analysis is applied to the maximum likelihood estimator in the general linear model with normal disturbances, where a set of assumptions ensures convergence of the iteration as well as unbiasedness.     

On equivalence of fractional factorial designs based on singular value decomposition

The singular value decomposition of a real matrix always exists and is essentially unique. Based on the singular value decomposition of the design matrices of two general 2-level fractional factorial designs, new necessary and sufficient conditions for the determination of combinatorial equivalence or non-equivalence of the corresponding designs are derived. Equivalent fractional factorial designs have identical statistical properties for estimation of factorial contrasts and for model fitting. Non-equivalent designs, however, may have the same statistical properties under one particular model but different properties under a different model. Results extend to designs with factors at larger number of levels.     

Detecting the Dimensionality for Principal Components Model

A crucial issue for principal components analysis (PCA) is to determine the number of principal components to capture the variability of usually high-dimensional data. In this article the dimension detection for PCA is formulated as a variable selection problem for regressions. The adaptive LASSO is used for the variable selection in this application. Simulations demonstrate that this approach is more accurate than existing methods in some cases and competitive in some others. The performance of this model is also illustrated using a real example.     

On the stability of some replication variance estimators in the linear case

Application of the balanced repeated replication method of variance estimation can become cumbersome as well as expensive when the number of replicates involved is large. While a number of replication methods of variance estimation requiring a reduced number of replicates have been proposed, the corresponding reduction in computational effort is accompanied by a loss in precision. In this article, this loss in precision is evaluated in the linear case. The results obtained may be useful in practice in balancing precision against computational cost.     

On second-order admissibilities of the estimators of gamma shape vector

Simultaneous estimation problem of gamma shape vector is considered.First, it is shown that the maximum likelihood estimator (MLE), the bias corrected MLE, and the conditional MLE of shape vector are second-order inadmissible. Second, these estimators are improved up to the second order. Finally, we identify whether these improved estimators are second-order admissible or not. Simulation studies are also given.     

Fitting polynomial trend to time series by the method of Buys-Ballot estimators

The statistical properties of two closed-form estimators of the parameters of the quadratic time trend model are derived. The estimators are based on the derived variables from Buys-Ballot table. The estimators are derived by assuming that error term is identically and independently distributed. However, the validity of this assumption is sometimes difficult to verify. We also study, through simulations, the impact of misspecifying the error distribution on the estimation and prediction accuracy in the quadratic time trend model. It is shown that the estimators are inconsistent in the presence of misspecification. T methods are illustrated with real-life examples.     

Valid Bayesian Estimation of the Cointegrating Error Correction Model

Two methods of identifying cointegrating vectors are commonly used: linear restrictions and the nonlinear method of Johansen's maximum likelihood procedure. That the linear method can produce invalid estimates while the Johansen approach always produces valid estimates has been recognized in several recent articles. Because all Bayesian studies to date have used linear restrictions, this article presents a Bayesian method for obtaining estimates of cointegrating vectors that will always be valid. In addition, it also presents an approach for evaluating the validity of linear restrictions.     

A consistent estimator for the supremum of the projection index based on sliced inverse regression

To seek the nonlinear structure hidden in data points of high-dimension, a transformation related to projection pursuit method and a projection index were proposed by Li (1989, 1990 ). In this paper, we present a consistent estimator of the supremum of the projection index based sliced inverse regression technique. This estimator also suggests a method to obtain approximately the most interesting projection in the general case.     

An explicit formula for the risk of James-Stein estimators

Expressions for the risk of a Stein estimator and its principal derivatives involve a well-defined. but nonevaluated. expectation term. Stein (1966) has suggested a second-order approximation. In this paper we present an alternative exact expression.     

Improving the estimators of the parameters of a probit regression model: A ridge regression approach

This paper considered the estimation of the regression parameters of a general probit regression model. Accordingly, we proposed five ridge regression (RR) estimators for the probit regression models for estimating the parameters (β)$(\beta )$ when the weighted design matrix is ill-conditioned and it is suspected that the parameter β$\beta$ may belong to a linear subspace defined by Hβ=h$H\beta =h$. Asymptotic properties of the estimators are studied with respect to quadratic biases, MSE matrices and quadratic risks. The regions of optimality of the proposed estimators are determined based on the quadratic risks. Some relative efficiency tables and risk graphs are provided to illustrate the numerical comparison of the estimators. We conclude that when q≥3$q\ge 3$, one would uses PRRRE; otherwise one uses PTRRE with some optimum size α$\alpha$. We also discuss the performance of the proposed estimators compare to the alternative ridge regression method due to Liu (1993).     

On the Distribution of Matrix Quadratic Forms

A characterization of the distribution of the multivariate quadratic form given by X A X′, where X is a p × n normally distributed matrix and A is an n × n symmetric real matrix, is presented. We show that the distribution of the quadratic form is the same as the distribution of a weighted sum of non central Wishart distributed matrices. This is applied to derive the distribution of the sample covariance between the rows of X when the expectation is the same for every column and is estimated with the regular mean.