An asymptotic expansion of Wishart distribution when the population eigenvalues are infinitely dispersed

Takemura and Sheena [A. Takemura, Y. Sheena, Distribution of eigenvalues and eigenvectors of Wishart matrix when the population eigenvalues are infinitely dispersed and its application to minimax estimation of covariance matrix, J. Multivariate Anal. 94 (2005) 271–299] derived the asymptotic joint distribution of the eigenvalues and the eigenvectors of a Wishart matrix when the population eigenvalues become infinitely dispersed. They also showed necessary conditions for an estimator of the population covariance matrix to be tail minimax for typical loss functions by calculating the asymptotic risk of the estimator. In this paper, we further examine those distributions and risks by means of an asymptotic expansion. We obtain the asymptotic expansion of the distribution function of relevant elements of the sample eigenvalues and eigenvectors. We also derive the asymptotic expansion of the risk function of a scale and orthogonally equivariant estimator with respect to Stein’s loss. As an application, we prove non-minimaxity of Stein’s and Haff’s estimators, which has been an open problem for a long time.     

Efficiency of a Class of Unbiased Estimators for the Invariant Distribution Function of a Diffusion Process

We consider the problem of the estimation of the invariant distribution function of an ergodic diffusion process when the drift coefficient is unknown. The empirical distribution function is a natural estimator which is unbiased, uniformly consistent and efficient in different metrics. Here we study the properties of optimality for another kind of estimator recently proposed. We consider a class of unbiased estimators and we show that they are also efficient in the sense that their asymptotic risk, defined as the integrated mean square error, attains the same asymptotic minimax lower bound of the empirical distribution function.     

Approximate minimax estimation in linear regression: theoretical results

We consider to ordinary linear regression model where the parameter vector ß is constrained to a given ellipsoid. It will be shown that within the class of linear statistics for ß where exists a (sub-)sequence of approximate minimax estimators converging to an exact minimax estimator. This result is valid for an arbitrary quadratic loss function.     

Robust M-estimators of scale: Minimax bias versus maximal variance

In the location-scale estimation problem, we study robustness properties of M-estimators of the scale parameter under unknown ?-contamination of a fixed symmetric unimodal error distribution F₀. Within a general class of M-estimators, the estimator with minimax asymptotic bias is shown to lie within the subclass of α-interquantile ranges of the empirical distribution symmetrized about the sample median. Our main result is that as ? → 0, the limiting minimax asymptotic bias estimator is sometimes (e.g., when F_o is Cauchy), but not always, the median absolute deviation about the median. It is also shown that contamination in the neighbourhood of a discontinuity of the influence function of a minimax bias estimator can sometimes inflate the asymptotic variance beyond that achieved by placing all the ?-contamination at infinity. This effect is quantified by a new notion of asymptotic efficiency that takes into account the effect of infinitesimal contamination of the parametric model for the error distribution.     

Bhattacharyya-Type Information Inequality for the Bayes Risk

Lower bounds for the Bayes risk are obtained. The bounds improve the Brown-Gajek bound and the asymptotic expression is derived. As an application of the bound, lower bounds for the local minimax and Bayes prediction risk are also given.     

Minimax strategies in survey sampling

The risk of a sampling strategy is a function on the parameter space, which is the set of all vectors composed of possible values of the variable of interest. It seems natural to ask for a minimax strategy, minimizing the maximal risk. So far answers have been provided for completely symmetric parameter spaces. Results available for more general spaces refer to sample size 1 or to large sample sizes allowing for asymptotic approximation. In the present paper we consider arbitrary sample sizes, derive a lower bound for the maximal risk under very weak conditions and obtain minimax strategies for a large class of parameter spaces. Our results do not apply to parameter spaces with strong deviations from symmetry. For such spaces a minimax strategy will prescribe to consider only a small number of samples and takes a non-random and purposive character, which is in accordance with the common practice of completely sampling a stratum of large units.     

Reference prior bayes estimator for bivariate normal covariance matrix with risk comparison

The explicit form of the reference prior bayes estimator due to Yang and Ber-ger (1994) for bivariate normal covariance matrix under entropy loss is given in terms of Legendre polynomials when degrees of freedom is even and in terms of hypergeometric functions in general case. The finite series expression of the density function of the ratio of latent roots of bivariate Wishart matrix is obtained and the exact risk is compared with those of James-Stein minimax estimator and other orthogonally equivariant estimators. It is found numerically that the reference prior bayes estimator has the smallest risk among the class of equivariant estimators compared, when the ratio of the largest to the smallest population latent roots of covariance matrix lies in the middle of the interval [1, ∞]. It has larger risk than that of James-Stein minimax estimator when the ratio is large. Moreover it has larger risk than that of MLE when, for instance, degrees of freedom is 20 and the ratio lies between 4 and 8.     

Locally robust correlation coefficients

Robustness of correlation coefficients is studied in the framework of testing for independence, robustness being measured by the minimum asymptotic power over a suitable class of local alternatives. A minimax result is derived; the robust correlation coefficient is computed from suitably transformed and truncated observations. Moreover, the related approach of Huber (1977) is analyzed, and inadmissibility of his minimax solution is shown.     

Robust M- and L-Estimators of Scale Parameter

We consider first the class of M-estimators of scale that are location-scale equivariant and Fisher consistent at the error distribution of the shrinking contamination neighborhood and derive an expression for the maximal asymptotic mean-squared-error, for a suitably regular score function, followed by a lower bound on it. We next show that the minimax asymptotic mean-squzred-error is attained at an M-estimator of scale with the truncated MLE score function which, when specialized to the Standard Normal error distribution has the form of Huber's Proposal 2. The latter minimax property is also shown to hold for α-trimmed variance as an L-estimator of scale.     

On MISE of a Non linear Wavelet Estimator of the Regression Function Based on Biased Data under Strong Mixing

In this paper, we consider the adaptation of the non linear wavelet-based estimator of the regression function for the biased data setup under strong mixing. We provide an asymptotic sharp bound for the mean integrated squared error (MISE) of the estimator, that is nearly optimal in the minimax sense over a large range of Besov function classes.     

Lower Bounds on Integrated Risk,Subject to Inequality Constraints

Statistical decision theory can sometimes be used to find, via a least favourable prior distribution, a statistical procedure that attains the minimax risk. This theory also provides, using an ‘unfavourable prior distribution’, a very useful lower bound on the minimax risk. In the late 1980s, Kempthorne showed how, using a least favourable prior distribution, a specified integrated risk can sometimes be minimised, subject to an inequality constraint on a different risk. Specifically, he was concerned with the solution of a minimax‐Bayes compromise problem (‘compromise decision theory’). Using an unfavourable prior distribution, Kabaila & Tuck ( 2008 ), provided a very useful lower bound on an integrated risk, subject to an inequality constraint on a different risk. We extend this result to the case of multiple inequality constraints on specified risk functions and integrated risks. We also describe a new and very effective method for the computation of an unfavourable prior distribution that leads to a very useful lower bound. This method is simply to maximize the lower bound directly with respect to the unfavourable prior distribution. Not only does this method result in a relatively tight lower bound, it is also fast because it avoids the repeated computation of the global maximum of a function with multiple local maxima. The advantages of this computational method are illustrated using the problems of bounding the performance of a point estimator of (i) the multivariate normal mean and (ii) the univariate normal mean.     

Bias bound for the minimax estimator

The bias bound function of an estimator is an important quantity in order to perform globally robust inference. We show how to evaluate the exact bias bound for the minimax estimator of the location parameter for a wide class of unimodal symmetric location and scale family. We show, by an example, how to obtain an upper bound of the bias bound for a unimodal asymmetric location and scale family. We provide the exact bias bound of the minimum distance/disparity estimators under a contamination neighborhood generated from the same distance.     

Whither jackknifing in stein-rule estimation

In multi-parameter ( multivariate ) estimation, the Stein rule provides minimax and admissible estimators , compromising generally on their unbiasedness. On the other hand, the primary aim of jack-knifing is to reduce the bias of an estimator ( without necessarily compromising on its efficacy ), and, at the same time, jackknifing provides an estimator of the sampling variance of the estimator as well. In shrinkage estimation ( where minimization of a suitably defined risk function is the basic goal ), one may wonder how far the bias-reduction objective of jackknifing incorporates the dual objective of minimaxity ( or admissibility ) and estimating the risk of the estimator ? A critical appraisal of this basic role of jackknifing in shrinkage estimation is made here. Restricted, semi-restricted and the usual versions of jackknifed shrinkage estimates are considered and their performance characteristics are studied . It is shown that for Pitman-type ( local ) alternatives, usually, jackkntfing fails to provide a consistent estimator of the ( asymptotic ) risk of the shrinkage estimator, and a degenerate asymptotic situation arises for the usual fixed alternative case.     

Development and comparative study of two near-exact approximations to the distribution of the product of an odd number of independent Beta random variables

Using the concept of near-exact approximation to a distribution we developed two different near-exact approximations to the distribution of the product of an odd number of particular independent Beta random variables (r.v.'s). One of them is a particular generalized near-integer Gamma (GNIG) distribution and the other is a mixture of two GNIG distributions. These near-exact distributions are mostly adequate to be used as a basis for approximations of distributions of several statistics used in multivariate analysis. By factoring the characteristic function (c.f.) of the logarithm of the product of the Beta r.v.'s, and then replacing a suitably chosen factor of that c.f. by an adequate asymptotic result it is possible to obtain what we call a near-exact c.f., which gives rise to the near-exact approximation to the exact distribution. Depending on the asymptotic result used to replace the chosen parts of the c.f., one may obtain different near-exact approximations. Moments from the two near-exact approximations developed are compared with the exact ones. The two approximations are also compared with each other, namely in terms of moments and quantiles.     

Another look at Huber's estimator: A new minimax estimator in regression with stochastically bounded noise

Huber's estimator has had a long lasting impact, particularly on robust statistics. It is well known that under certain conditions, Huber's estimator is asymptotically minimax. A moderate generalization in rederiving Huber's estimator shows that Huber's estimator is not the only choice. We develop an alternative asymptotic minimax estimator and name it regression with stochastically bounded noise (RSBN). Simulations demonstrate that RSBN is slightly better in performance, although it is unclear how to justify such an improvement theoretically. We propose two numerical solutions: an iterative numerical solution, which is extremely easy to implement and is based on the proximal point method; and a solution by applying state-of-the-art nonlinear optimization software packages, e.g., SNOPT. Contribution: the generalization of the variational approach is interesting and should be useful in deriving other asymptotic minimax estimators in other problems.     

A Study of Blockwise Wavelet Estimates Via Lower Bounds for a Spike Function

Abstract.  A blockwise shrinkage is a popular adaptive procedure for non-parametric series estimates. It possesses an impressive range of asymptotic properties, and there is a vast pool of blocks and shrinkage procedures used. Traditionally these estimates are studied via upper bounds on their risks. This article suggests the study of these adaptive estimates via non-asymptotic lower bounds established for a spike underlying function that plays a pivotal role in the wavelet and minimax statistics. While upper-bound inequalities help the statistician to find sufficient conditions for a desirable estimation, the non-asymptotic lower bounds yield necessary conditions and shed a new light on the popular method of adaptation. The suggested method complements and knits together two traditional techniques used in the analysis of adaptive estimates: a numerical study and an asymptotic minimax inference.     

Sequential shrinkage estimation of independent normal means with unkown variances

The Paper considers estimation of the p(> 3)-variate normal mean when the variance-covariance matrix is diagonal with unknown diagonal elements. A class of James-Stein estimators is developed, and is compared with the sample mean under an empirical minimax stopping rule. Asymptotic risk expansions are provided for both the sequential sample mean and the sequential James-Stein estimators. It is shown that the James-Stein estimators dominate the sample mean in a certain asymptotic sense.     

A lower bound for the bayes risk in the sequential case

A lower bound for the Bayes risk in the sequential case is given under the regularity conditions. A related result to the minimax risk is also discussed. Further. some examples are given for the exponential and Poisson distributions.     

Near-exact distributions for the sphericity likelihood ratio test statistic

In this paper three near-exact distributions are developed for the sphericity test statistic. The exact probability density function of this statistic is usually represented through the use of the Meijer G function, which renders the computation of quantiles impossible even for a moderately large number of variables. The main purpose of this paper is to obtain near-exact distributions that lie closer to the exact distribution than the asymptotic distributions while, at the same time, correspond to density and cumulative distribution functions practical to use, allowing for an easy determination of quantiles. In addition to this, two asymptotic distributions that lie closer to the exact distribution than the existing ones were developed. Two measures are considered to evaluate the proximity between the exact and the asymptotic and near-exact distributions developed. As a reference we use the saddlepoint approximations developed by Butler et al. [1993. Saddlepoint approximations for tests of block independence, sphericity and equal variances and covariances. J. Roy. Statist. Soc., Ser. B 55, 171–183] as well as the asymptotic distribution proposed by Box.