Estimating the variance of a normal population by utilizing the information in a sample from a second related normal population

A class of estimators of the variance σ₁ ² of a normal population is introduced, by utilization the information in a sample from a second normal population with different mean and variance σ₂ ², under the restriction that σ₁ ²?≤?σ₂ ². Simulation results indicate that some members of this class are more efficient than the usual minimum variance unbiased estimator (MVUE) of σ₁ ², Stein estimator and Mehta and Gurland estimator. The case of known and unknown means are considered.     

Variances of UMVU Estimators for Means and Variances After Using a Normalizing Transformation

Suppose that the function f is of recursive type and the random variable X is normally distributed with mean μ and variance α². We set C = f(x). Neyman & Scott (1960) and Hoyle (1968) gave the UMVU estimators for the mean E(C) and for the variance Var(C) from independent and identically distributed random variables X₁,…, X_n(n ≧ 2) having a normal distribution with mean μ and variance σ², respectively. Shimizu & Iwase (1981) gave the variance of the UMVU estimator for E(C). In this paper, the variance of the UMVU estimator for Var(C) is given.     

On admissible estimation for parametric functions in linear models

This paper deals with the linear model Ey∈K, Cov y∈V. The question is investigated when a parametric function (a,y) is an admissible or inadmissible estimator of some parametric function (p,Ey). It is also discussed when a linear mapping C:K→K has the property that (a,cy) is an admissible estimator of ((Ey),a) for all a∈K. Finall the question is raised how inadmissible estimators (a,y) can be replaced by admissible estimators superior to (a,y).     

Minimax estimation of a lower-bounded scale parameter of a gamma distribution for scale-invariant squared-error loss

Let X have a gamma distribution with known shape parameter θr;aL and unknown scale parameter θ. Suppose it is known that θ ≥ a for some known a > 0. An admissible minimax estimator for scale-invariant squared-error loss is presented. This estimator is the pointwise limit of a sequence of Bayes estimators. Further, the class of truncated linear estimators C = {θ_ρ|θ_ρ(x) = max(a, ρ), ρ > 0} is studied. It is shown that each θ_ρ is inadmissible and that exactly one of them is minimax. Finally, it is shown that Katz's [Ann. Math. Statist., 32, 136–142 (1961)] estimator of θ is not minimax for our loss function. Some further properties of and comparisons among these estimators are also presented.     

Estimation of the common mean of two univariate normal populations

The problem of estimating the common mean μ of two univariate normal populations with unknown and unequal variances is considered from a decision-theoretic point of view. We restrict our attention to an appropriate class C and its three subclasses C_0C1C2of un-biased estimates of μ. We consider the usual estimate μ⁰ of μ which is the weighted linear combination of the sample means with weights as reciprocals of the sample variances. Its admissibility in C₀ and extended admissibility in C is proved. Admissible estimates in C₁ and C₂are also obtained.The loss is always assumed to be squared error. The question of admissibility of μ⁰ in the class of all estimators is still open.     

Small-sample behavior of weighted least squares in experimental design applications

In experimental design applications unbiased estimators s_i ² of the variances σ_i ² are possible. These estimators may be used in Weighted Least Squares (WLS) when estimating the parameters β. The resulting small-sample behavior is investigated in a Monte Carlo experiment. This experiment shows that an asymptotically valid covariance formula can be used if s_i ² is based on, say, at least 5 observations. The WLS estimator based on estimators s_i ² gives more accurate estimators of β, provided the σ_i ² differ by a factor, say, 10.     

ROBUST RIDGE REGRESSION BASED ON AN M-ESTIMATOR

Consider the linear regression model y =β₀1 +Xβ+ in the usual notation. It is argued that the class of ordinary ridge estimators obtained by shrinking the least squares estimator by the matrix (X¹X + kI)^-1X'X is sensitive to outliers in the ^variable. To overcome this problem, we propose a new class of ridge-type M-estimators, obtained by shrinking an M-estimator (instead of the least squares estimator) by the same matrix. Since the optimal value of the ridge parameter k is unknown, we suggest a procedure for choosing it adaptively. In a reasonably large scale simulation study with a particular M-estimator, we found that if the conditions are such that the M-estimator is more efficient than the least squares estimator then the corresponding ridge-type M-estimator proposed here is better, in terms of a Mean Squared Error criteria, than the ordinary ridge estimator with k chosen suitably. An example illustrates that the estimators proposed here are less sensitive to outliers in the y-variable than ordinary ridge estimators.     

A remark on estimating the mean of a normal distribution with known coefficient of variation

Let X₁, X₂, …, X_n be iid N(μ, aμ²) (a>0) random variables with an unknown mean μ>0 and known coefficient of variation (CV) √a. The estimation of μ is revisited and it is shown that a modified version of an unbiased estimator of μ [cf. Khan RA. A note on estimating the mean of a normal distribution with known CV. J Am Stat Assoc. 1968;63:1039–1041] is more efficient. A certain linear minimum mean square estimator of Gleser and Healy [Estimating the mean of a normal distribution with known CV. J Am Stat Assoc. 1976;71:977–981] is also modified and improved. These improved estimators are being compared with the maximum likelihood estimator under squared-error loss function. Based on asymptotic consideration, a large sample confidence interval is also mentioned.     

Improved estimation of the mean vector for student-t model

Improved James-Stein type estimation of the mean vector μ of a multovaroate Student-t population of dimension p with ν degrees of freedom is considered. In addition to the sample data, uncertain prior information on the value of the mean vector, in the form of a null hypothesis, is used for the estiamtion. The usual maximum liklihood estimator((mle) of μ is obtained and a test statistic for testing H₀:μ=μ₀ is derived. Based on the mle of μ and the tes statistic the preliminary test estimator (PTE), Stein-type shrinkage estimator (SE) and positive-rule shrinkage esiimator (PRSE) are defined. The bias and the quadratic risk of the estimators are evaiuated. The relative performances of the estimators are mvestigated by analyzing the risks under different condltlons It is observed that the FRSE dommates over he other three estimators, regardless of the vaiidity of the null hypothesis and the value ν.     

A note on james-stein and bayes empiricl bayes estimators

In an empirical Bayes decision problem, a simple class of estimators is constructed that dominate the James-Stein

estimator, A prior distribution A is placed on a restricted (normal) class G of priors to produce a Bayes empirical Bayes estimator, The Bayes empirical Bayes estimator is smooth, admissible, and asymptotically optimal. For certain A rate of convergence to minimum Bayes risk is 0(n^-1)uniformly on G. The results of a Monte Carlo study are presented to demonstrate the favorable risk bebhavior of the Bayes estimator In comparison with other competitors including the James-Stein estimator.     

A test of the mean square error criterion for linear admissible estimators

A test for choosing between a linear admissible estimator and the least squares estimator (LSE) is developed. A characterization of linear admissible estimators useful for comparing estimators is presented and necessary and sufficient conditions for superiority of a linear admissible estimator over the LS estimetor is derived for the test. The test is based on the MSE matrix superiority, but also new resl?!ts concerning covariance matrix comparisons of linear estimators are derived. Further,shown that the test of Toro - Vizcarrondo and Wailace applies iioi only the restricted least squares estimators but also to certain estimators outside this class.     

A comparison of estimators for the proportion in the tail of a normal distribution

Three estimators of the proportion in a tail of the normal distribution are compared using the criteria of mean squared error and mean absolute error. The estimators that we compare are the maximum likelihood estimator, the minimum variance unbiased estimator, and an intuitive estimator that is frequently used in practice. The intuitive estimator is similar to the MLE but uses the usual unbiased estimator of σ² rather than the MLE of σ². We show that the intuitive estimator has low efficiency, and for this reason it is not recommended. For very smallp and for largep the MVUE has the highest efficiency. The MLE is best for moderate values ofp.     

√n-CONSISTENT ESTIMATION IN A RANDOM COEFFICIENT AUTOREGRESSIVE MODEL

This paper deals with √n-consistent estimation of the parameter μ in the RCAR(l) model defined by the difference equation X_j=(μ+U_j)X_j-l+ej (jε Z), where {e_j: jε Z} and {U_j: jε Z} are two independent sets of i.i.d. random variables with zero means, positive finite variances and E[(μ+U₁)²] < 1. A class of asymptotically normal estimators of μ indexed by a family of bounded measurable functions is introduced. Then an estimator is constructed which is asymptotically equivalent to the best estimator in that class. This estimator, asymptotically equivalent to the quasi-maximum likelihood estimator derived in Nicholls & Quinn (1982), is much simpler to calculate and is asymptotically normal without the additional moment conditions those authors impose.     

Inference on the Common Variance of Correlated Normal Random Variables

ABSTRACT

Scale equivariant estimators of the common variance σ², of correlated normal random variables, have mean squared errors (MSE) which depend on the unknown correlations. For this reason, a scale equivariant estimator of σ² which uniformly minimizes the MSE does not exist. For the equi-correlated case, we have developed three equivariant estimators of σ²: a Bayesian estimator for invariant prior as well as two non-Bayesian estimators. We then generalized these three estimators for the case of several variables with multiple unknown correlations. In addition, we developed a system of confidence intervals which produce the desired coverage probability while being efficient in terms of expected length.     

Bayesian estimation for first-order autoregressive model with explanatory variables

In this article, we develop a Bayesian analysis in autoregressive model with explanatory variables. When σ² is known, we consider a normal prior and give the Bayesian estimator for the regression coefficients of the model. For the case σ² is unknown, another Bayesian estimator is given for all unknown parameters under a conjugate prior. Bayesian model selection problem is also being considered under the double-exponential priors. By the convergence of ρ-mixing sequence, the consistency and asymptotic normality of the Bayesian estimators of the regression coefficients are proved. Simulation results indicate that our Bayesian estimators are not strongly dependent on the priors, and are robust.     

A note on the completeness of the normal family with constant coefficient of variation

Suppose that Z₁ …Zⁿ are independent and normally distributed with common mean u and variance σ².When σ² = λμ²with given λ> 0, it is well known that the minimal sufficient statistic is not complete for μ if n ≥ 2. The question of completeness seems to be unresolved when n = 1. In this note, we consider this case and, by using the heat equation, establish the second moment completeness of the minimal sufficient statistic, a property which is weaker than completeness but stronger than bounded completeness. Finally, we apply this result to a linear calibration problem.     

Estimation of a multivariate mean with constraints on the norm

Estimation of the mean θ of a spherical distribution with prior knowledge concerning the norm ||θ|| is considered. The best equivariant estimator is obtained for the local problem ||θ|| = λ₀, and its risk is evaluated. This yields a sharp lower bound for the risk functions of a large class of estimators. The risk functions of the best equivariant estimator and the best linear estimator are compared under departures from the assumption ||θ|| = λ₀.     

Estimating the mean of the selected uniform population

Let π_i(i=1,2,…K) be independent U(0,?_i) populations. Let Y_i denote the largest observation based on a random sample of size n from the i-th population. for selecting the best populaton, that is the one associated with the largest ?_i, we consider the natural selection rule, according to which the population corresponding to the largest Y_i is selected. In this paper, the estimation of M. the mean of the selected population is considered. The natural estimator is positively biased. The UMVUE (uniformly minimum variance unbiased estimator) of M is derived using the (U,V)-method of Robbins (1987) and its asymptotic distribution is found. We obtain a minimax estimator of M for K≤4 and a class of admissible estimators among those of the form cY_max. For the case K = 2, the UMVUE is improved using the Brewster-Zidek (1974) Technique with respect to the squared error loss function L₁ and the scale-invariant loss function L₂. For the case K = 2, the MSE'S of all the estimators are compared for selected values of n and ρ=?₁/(?₁+?₂).     

Three estimators for the poisson regression model with measurement errors

We consider two consistent estimators for the parameters of the linear predictor in the Poisson regression model, where the covariate is measured with errors. The measurement errors are assumed to be normally distributed with known error variance σ _u ² . The SQS estimator, based on a conditional mean-variance model, takes the distribution of the latent covariate into account, and this is here assumed to be a normal distribution. The CS estimator, based on a corrected score function, does not use the distribution of the latent covariate. Nevertheless, for small σ _u ² , both estimators have identical asymptotic covariance matrices up to the order of σ _u ² . We also compare the consistent estimators to the naive estimator, which is based on replacing the latent covariate with its (erroneously) measured counterpart. The naive estimator is biased, but has a smaller covariance matrix than the consistent estimators (at least up to the order of σ _u ² ).     

Estimating population size with truncated sampling

Let X₁, X₂,…,X_n be independent, indentically distributed random variables with density f(x,θ) with respect to a σ-finite measure μ. Let R be a measurable set in the sample space X. The value of X is observable if X ? (X?R) and not otherwise. The number J of observable X’s is binomial, N, Q, Q = 1?P(X ? R). On the basis of J observations, it is desired to estimate N and θ. Estimators considered are conditional and unconditional maximum likelihood and modified maximum likelihood using a prior weight function to modify the likelihood before maximizing. Asymptotic expansions are developed for the [Ncirc]’s of the form [Ncirc] = N + α√N + β + o_p(1), where α and β are random variables. All estimators have the same α, which has mean 0, variance σ² (a function of θ) and is asymptotically normal. Hence all are asymptotically equivalent by the usual limit distributional theory. The β’s differ and Eβ can be considered an “asymptotic bias”. Formulas are developed to compare the asymptotic biases of the various estimators. For a scale parameter family of absolutely continuous distributions with X = (0,∞) and R = (T,∞), special formuli are developed and a best estimator is found.