Confidence sets based on the positive part James–Stein estimator with the asymptotically constant coverage probability

The asymptotic expansions for the coverage probability of a confidence set centred at the James–Stein estimator presented in our previous publications show that this probability depends on the non-centrality parameter τ² (the sum of the squares of the means of normal distributions). In this paper we establish how these expansions can be used for a construction of confidence region with constant confidence level, which is asymptotically (the same formula for both case τ→0 and τ→∞) equal to some fixed value 1?α. We establish the shrinkage rate for the confidence region according to the growth of the dimension p and also the value of τ for which we observe quick decreasing of the coverage probability to the nominal level 1?α. When p→∞ this value of τ increases as O(p^1/4). The accuracy of the results obtained is shown by the Monte-Carlo statistical simulations.     

A comparison of estimators for the proportion in the tail of a normal distribution

Three estimators of the proportion in a tail of the normal distribution are compared using the criteria of mean squared error and mean absolute error. The estimators that we compare are the maximum likelihood estimator, the minimum variance unbiased estimator, and an intuitive estimator that is frequently used in practice. The intuitive estimator is similar to the MLE but uses the usual unbiased estimator of σ² rather than the MLE of σ². We show that the intuitive estimator has low efficiency, and for this reason it is not recommended. For very smallp and for largep the MVUE has the highest efficiency. The MLE is best for moderate values ofp.     

The limiting distribution of a test for multivariate structure

We define a chi-squared statistic for p-dimensional data as follows. First, we transform the data to remove the correlations between the p variables. Then, we discretize each variable into groups of equal size and compute the cell counts in the resulting p-way contingency table. Our statistic is just the usual chi-squared statistic for testing independence in a contingency table. Because the cells have been chosen in a data-dependent manner, this statistic does not have the usual limiting distribution. We derive the limiting joint distribution of the cell counts and the limiting distribution of the chi-squared statistic when the data is sampled from a multivariate normal distribution. The chi-squared statistic is useful in detecting hidden structure in raw data or residuals. It can also be used as a test for multivariate normality.     

Stein type confidence interval of the disturbance variance in a linear regression model with multivariate student-t distributed errors

This paper considers the interval estimation of the disturbance variance in a linear regression model with multivariate Student-t errors. The distribution function of the Stein type estimator under multivariate Student-t errors is derived, and the coverage probability of the Stein type confidence interval which is constructed under the normality assumption is numerically calculated under the multivariate Student-t distribution. It is shown that the coverage probability of the Stein type confidence interval is sometimes much smaller than the nominal level, and that it is larger than that of the usual confidence interval in almost all cases. For the case when it is known that errors have a multivariate Student-t distribution, sufficient conditions under which the Stein type confidence interval improves on the usual confidence interval are given, and the coverage probability of the stein type confidence interval is numerically evaluated.     

On admissible estimation for parametric functions in linear models

This paper deals with the linear model Ey∈K, Cov y∈V. The question is investigated when a parametric function (a,y) is an admissible or inadmissible estimator of some parametric function (p,Ey). It is also discussed when a linear mapping C:K→K has the property that (a,cy) is an admissible estimator of ((Ey),a) for all a∈K. Finall the question is raised how inadmissible estimators (a,y) can be replaced by admissible estimators superior to (a,y).     

On the admissibility of the maximum-likelihood estimator of the binomial variance

This paper addresses the admissibility of the maximum-likelihood estimator (MLE) of the variance of a binomial distribution with parameters n and p under squared-error loss. We show that the MLE is admissible for n ≤ 5 and inadmissible for n≥ 6.     

Admissible linear estimators of the multivariate normal mean without extra information

Suppose y is normally distributed with mean IRⁿ and covariance σ²V, where σ²>0 and V>0 is known. The n. s. conditions that a linear estimator Ay+a of μ be admissible in the class of all estimators of μ which depend only on y are derived. In particular, the usual estimator δ₀(y)=y is admissible in this class. The results are applied to the normal linear model and the admissibilities of many well-known linear estimators are demonstrated.     

Expansions of the coverage probabilities of prediction region based on a shrinkage estimator

An expansion formula for the coverage probability of prediction region based on a shrinkage estimator proposed by Joshi [Joshi, V. M. (1967). Inadmissibility of the usual confidence sets for the mean of a multivariate normal population. Ann. Math. Statist., 38, 1868–1875.] is obtained. Its error bound is evaluated in terms of a function of an unknown parameter. Applying this result, three types of asymptotic expansions are derived. These expansions show inadmissibility of the usual prediction region.     

Characterization of Admissible Linear Estimators in Multivariate Linear Model with Respect to Inequality Constraints under Matrix Loss Function

In this article, we study the characterization of admissible linear estimators in a multivariate linear model with inequality constraint, under a matrix loss function. In the homogeneous class, we present several equivalent, necessary and sufficient conditions for a linear estimator of estimable functions to be admissible. In the inhomogeneous class, we find that the necessary and sufficient conditions depend on the rank of the matrix in the constraint. When the rank is greater than one, the necessary and sufficient conditions are obtained. When the rank is equal to one, we have necessary conditions and sufficient conditions separately. We also obtain the necessary and sufficient conditions for a linear estimator of inestimable function to be admissible in both classes.     

An alternate version of the conceptual predictive statistic based on a symmetrized discrepancy measure

The conceptual predictive statistic, C_p, is a widely used criterion for model selection in linear regression. C_p serves as an estimator of a discrepancy, a measure that reflects the disparity between the generating model and a fitted candidate model. This discrepancy, based on scaled squared error loss, is asymmetric: an alternate measure is obtained by reversing the roles of the two models in the definition of the measure. We propose a variant of the C_p statistic based on estimating a symmetrized version of the discrepancy targeted by C_p. We claim that the resulting criterion provides better protection against overfitting than C_p, since the symmetric discrepancy is more sensitive towards detecting overspecification than its asymmetric counterpart. We illustrate our claim by presenting simulation results. Finally, we demonstrate the practical utility of the new criterion by discussing a modeling application based on data collected in a cardiac rehabilitation program at University of Iowa Hospitals and Clinics.     

Optimal sequential estimation procedures of a function of a probability of success under LINEX loss

In this paper, we investigate the problem of estimating a function g(p), where p is the probability of success in a sequential sample of independent identically Bernoulli distributed random variables. As a loss associated with estimation we introduce a generalized LINEX loss function. We construct a sequential procedure possessing some asymptotically optimal properties in the case when p tends to zero. In this approach to the problem, the conditions are given, under which the stopping time is asymptotically efficient and normal, and the corresponding sequential estimator is asymptotically normal. The procedure constructed guarantees that its sequential risk is asymptotically equal to a prescribed constant.     

Second-order properties of intraclass correlation estimators for a symmetric normal distribution

Consider the problem of estimating the intraclass correlation coefficient of a symmetric normal distribution under the squared error loss function. The general admissibility of the standard estimators of the intraclass correlation coefficient is hard to check due to their complicated sampling distributions. We follow the asymptotic decision-theoretic approach of Ghosh and Sinha (1981) and prove that the three standard intraclass correlation estimators (the maximum-likelihood estimator, the method-of-moments estimator and the first-order unbiased estimator) are second-order admissible for all p ≥ 2, p being the dimension of the distribution.     

The X2-goodness-of-fit tests with moment type estimators

In the x²-goodness-of-fit test the underlying null hypothesis usually involves unknown parameters. In this article we study the asymptotic distribution of the Pearson statistic when the unknown parameters are estimated by a moment type estimator based on the ungrouped data. As is expected the usual Pearson statistic is no longer asymptotically x²-distributed in this situation. We propose a statistic [Qcirc] which under certain regularity conditions is asymptotically x²-distributed. We also propose a statistic Q? for the goodness-of-fit test when the class boundaries are random. The asymptotic powers of [Qcirc] and [Qcirc]? tests are discussed.     

Likelihood Based Inference in Non-linear Regression Models Using the p* and R* Approach

We develop second order asymptotic results for likelihood-based inference in Gaussian non-linear regression models. We provide an approximation to the conditional density of the maximum likelihood estimator given an approximate ancillary statistic (the affine ancillary). From this approximation, we derive a statistic to test an hypothesis on one component of the parameter. This test statistic is an adjustment of the signed log-likelihood ratio statistic. The distributional approximations (for the maximum likelihood estimator and for the test statistic) are of second order in large deviation regions.     

A Note on the Estimation of Binomial Probabilities

I am concerned with the admissibility under quadratic loss of certain estimators of binomial probabilities. The minimum variance unbiased estimator is shown to be admissible for Pr(X = 0) and Pr(X = n), but it is inadmissible for Pr(X = k), where 0 < k < n. An example is given of an admissible maximum likelihood estimator (MLE). It is conjectured that the MLE is always admissible.     

Improved estimation of the mean vector for student-t model

Improved James-Stein type estimation of the mean vector μ of a multovaroate Student-t population of dimension p with ν degrees of freedom is considered. In addition to the sample data, uncertain prior information on the value of the mean vector, in the form of a null hypothesis, is used for the estiamtion. The usual maximum liklihood estimator((mle) of μ is obtained and a test statistic for testing H₀:μ=μ₀ is derived. Based on the mle of μ and the tes statistic the preliminary test estimator (PTE), Stein-type shrinkage estimator (SE) and positive-rule shrinkage esiimator (PRSE) are defined. The bias and the quadratic risk of the estimators are evaiuated. The relative performances of the estimators are mvestigated by analyzing the risks under different condltlons It is observed that the FRSE dommates over he other three estimators, regardless of the vaiidity of the null hypothesis and the value ν.     

Rates of convergence of Lp-estimators for a density with an infinity cusp

We study the asymptotics of L_p-estimators, p>0, as estimates of a parameter of location for data coming for a symmetric density with an infinity cusp at the center of symmetry of the distribution. In this situation, the data are more concentrated around the parameter of location than in usual cases. The maximum-likelihood estimator is not defined. The rates of convergence of the L_p-estimators in this situation depend on p and on the shape of the density. For some densities and small values of p, the L_p-estimator converges with a fast rate of convergence.     

A Martingale-based bootstrap inference with censored data

In this paper, me shall investigate a bootstrap method hasd on a martingale representation of the relevant statistic for inference to a class of functionals of the survival distribution. The method is similar in spirit to Efron's (1981) bootstrap, and thus in the present paper will be referred to as “martingale-based bootstrap” The method was derived from Lin,Wei and Ying (1993), who appiied the method in checking the Cox model with cumulative sums of martingale-based residuals. It is shown that this martingale-based bootstrap gives a correct first-order asymptotic approximation to the distribution function of the corresponding functional of the Kaplan-Meier estimator. As a consequence, confidence intervals constructed by the martingale-based bootstrap have asymptotially correct coverage probability. Our simulation study indicats that the martingale-based bootst strap method for a small and moderate sample sizes can be uniformly better than the usual bootstrap method in estimating the sampling distribution for a mean function and a point probability in survival analysis.     

Empirical likelihood inference for probability density functions under association

In this paper, we consider to apply the empirical likelihood method to a probability density function under an associated sample. It is shown that the empirical likelihood ratio statistic is asymptotically χ²-type distributed under some mild conditions. The result is used to construct empirical likelihood-based confidence intervals on the probability density function.     

Confidence intervals centred on bootstrap smoothed estimators

Bootstrap smoothed (bagged) parameter estimators have been proposed as an improvement on estimators found after preliminary data‐based model selection. A result of Efron in 2014 is a very convenient and widely applicable formula for a delta method approximation to the standard deviation of the bootstrap smoothed estimator. This approximation provides an easily computed guide to the accuracy of this estimator. In addition, Efron considered a confidence interval centred on the bootstrap smoothed estimator, with width proportional to the estimate of this approximation to the standard deviation. We evaluate this confidence interval in the scenario of two nested linear regression models, the full model and a simpler model, and a preliminary test of the null hypothesis that the simpler model is correct. We derive computationally convenient expressions for the ideal bootstrap smoothed estimator and the coverage probability and expected length of this confidence interval. In terms of coverage probability, this confidence interval outperforms the post‐model‐selection confidence interval with the same nominal coverage and based on the same preliminary test. We also compare the performance of the confidence interval centred on the bootstrap smoothed estimator, in terms of expected length, to the usual confidence interval, with the same minimum coverage probability, based on the full model.