The Information Geometric Structure of Generalized Empirical Likelihood Estimators

The generalized empirical likelihood (GEL) method produces a class of estimators of parameters defined via general estimating equations. This class includes several important estimators, such as empirical likelihood (EL), exponential tilting (ET), and continuous updating estimators (CUE). We examine the information geometric structure of GEL estimators. We introduce a class of estimators closely related to the class of minimum divergence (MD) estimators and show that there is a one-to-one correspondence between this class and the class GEL.     

Improved estimation of the smallest scale parameter of gamma distributions

In this work improved point and interval estimation of the smallest scale parameter of independent gamma distributions with known shape parameters are studied in an integrated fashion. The approach followed is based on formulating the model in such a way that enables us to treat the estimation of the smallest scale parameter as a problem of estimating an unrestricted scale parameter in the presence of a nuisance parameter. The class of improved point and interval estimators is enriched. Within this class, a subclass of generalized Bayes estimators of a simple form is identified.     

Reliability estimation for the exponential distribution

This paper is concerned with classical statistical estimation of the reliability function for the exponential density with unknown mean failure time θ, and with a known and fixed mission time τ. The minimum variance unbiased (MVU) estimator and the maximum likelihood (ML) estimator are reviewed and their mean square errors compared for different sample sizes. These comparisons serve also to extend previous work, and reinforce further the nonexistence of a uniformly best estimator. A class of shrunken estimators is then defined, and it produces a shrunken quasi-estimator and a shrunken estimator. The mean square errors for both these estimators are compared to the mean square errors of the MVU and ML estimators, and the new estimators are found to perform very well. Unfortunately, these estimators are difficult to compute for practical applications. A second class of estimators, which is easy to compute is also developed. Its mean square error properties are compared to the other estimators, and it outperforms all the contending estimators over the high and low reliability parameter space. Since, for all the estimators, analytical mean square error comparisons are not tractable, extensive numerical analyses are done in obtaining both the exact small sample and large sample results.     

Combining the unrestricted estimators into a single estimator and a simulation study on the unrestricted estimators

The purpose of this paper is to combine several regression estimators (ordinary least squares (OLS), ridge, contraction, principal components regression (PCR), Liu, r?k and r?d class estimators) into a single estimator. The conditions for the superiority of this new estimator over the PCR, the r?k class, the r?d class, β?(k, d), OLS, ridge, Liu and contraction estimators are derived by the scalar mean square error criterion and the estimators of the biasing parameters for this new estimator are examined. Also, a numerical example based on Hald data and a simulation study are used to illustrate the results.     

A note on the estimation of variance of sample mean Using the knowledge of coefficient of variation in normal population

A class of estimators for the variance of sample mean is defined and its properties are studied in case of normal population. It is identified that the usual unbiased estimator, Singh, Pandey and Hirano (1973) -type estimator and Lee (1931) estimator are particular members of the proposed class of estimators. It is found that the minimum Mean Squared Error (MSE) of the proposed class of estimators is less than that of other estimators.     

Improved estimation for the parameters of an inverse gaussian distribution

James-Stein estimators are proposed for the #-parameter of an inverse Gaussian #G# distribution. The estimators of this class have smaller expected quadratic loss than the maximum likelihood estimator usually employed when analysing real sets of data. This problem is also studied for the case of an unknown nuisance parameter. Finally, improved estimators are considered for # in the two sample problem.     

Outlier-detection tests and robust estimators based on signs of residuals

The asymptotic structure of a vector of weighted sums of signs of residuals, in the general linear model, is studied. The vector can be used as a basis for outlier-detection tests, or alternatively, setting the vector to zero and solving for the parameter yields a class of robust estimators which are analogues of the sample median. Asymptotic results for both estimates and tests are obtained. The question of optimal weights is investigated, and the optimal estimators in the case of simple linear regression are found to coincide with estimators introduced by Adichie.     

The successive raising estimator and its relation with the ridge estimator

The raised estimators are used to reduce collinearity in linear regression models by raising a column in the experimental data matrix which may be nearly linear with the other columns. The raising procedure has two components, namely stretching and rotating, which we can analyze separately. We give the relationship between the raised estimators and the classical ridge estimators. Using a case study, we show how to determine the perturbation parameter for the raised estimators by controlling the amount of precision to be retained in the original data.     

On the construction of nonparametric density function estimators using the bootstrap

The derivation of a new class of nonparametric density function estimators, the so-called bootstrap functional estimators (BFE's), is given. These estimators are shown to be strongly consistent under fairly nonrestrictive conditions. Some small-sample properties are discussed and a number of graphs are presented.     

General class of estimators in multi-character surveys

In this paper, a general class of estimators for the estimation of a finite population total in multi-character surveys is proposed. It is shown that the estimators proposed by Arnab (2002), Amahiaet al. (1989) and Bansal and Singh (1985) are the special cases of the proposed class of estimators. The proposed class of estimators is always more efficient than the estimator proposed by Rao (1966).     

Limiting admissible estimators for variance components

Simultaneous estimation of the vector of the variance components for mixed and random models under the quadratic loss function is considered. For a large class of such models there are identified classes of admissible biased invariant quadratic estimators that are better than some admissible unbiased estimators. Numerous numerical results presented in the paper show that for many of the commonly used balanced models the improvements in the quadratic risk may be considerable over a large set of the parameter space.     

On the cohen-sackrowitz estimator of a common mean

The paper reconsider certain estimators proposed by COHENand SACKROWITZ[Ann.Statist.(1974)2,1274-1282,Ann.Statist.4,1294]for the common mean of two normal distributions on the basis of independent samples of equal size from the two populations. It derives the ncecessary and sufficient condition for improvement over the first sample mean, under squared error loss, for any member of a class containing these. It shows that the estimator proposded by them for simultaneous improvement over botyh sample means has the desired property if and only if the common size of the samples is at least nine. The requirement is milder than that for any other estimator at the present state of knolwledge and may be constrasted with their result which implies the desired property of the estimator only if the common size of the samples is at least fifteen. Upper bounds for variances if the estimators derived by them are also improved     

Bayes estimators in the presence of a guess value

The paper deals with the problem of parameter estimation in the presence of a guess value and attempts to justify the use of Bayes estimators as an alternative to ordinary shrinkage estimators. Finally, certain Bayes estimators of exponential parameters are obtained under type II censoring, and these are compared with the corresponding MLEs and ordinary shrinkage estimators using a Monte Carlo study.     

Estimators of Certain Functions of the Variance of a Normal Distribution

Estimators of σ^aand log σ which are functions of Σ(x?x)²/d are considered. Besides the usual sampling theory estimators, Bayesian point estimators which are the usual measures of location of the posterior distribution are given, and in each case an exact or asymptotic expression for the divisor d is stated.     

On the Loss Robustness of Least-Square Estimators

Abstract

The article revisits univariate and multivariate linear regression models. It is shown that least-square estimators (LSEs) are minimum risk estimators in general class of linear unbiased estimators under some general divergence loss. This amounts to the loss robustness of LSEs.     

Estimation of the Bias of the Maximum Likelihood Estimators in an Extreme Value Context

Interest is centered on the maximum likelihood (ML) estimators of the parameters of the Generalized Pareto Distribution in an extreme value context. Our aim consists of reducing the bias of these estimates for which no explicit expression is available. To circumvent this difficulty, we prove that these estimators are asymptotically equivalent to one-step estimators introduced by Beirlant et al. (2010 Beirlant , J. , Guillou , A. , Toulemonde , G. ( 2010 ). Peaks-over-threshold modeling under random censoring . Commun. Statist. Theor. Meth.  [Google Scholar]) in a right-censoring context. Then, using this equivalence property, we estimate the bias of these one-step estimators to approximate the asymptotic bias of the ML-estimators. Finally, a small simulation study and an application to a real data set are provided to illustrate that these new estimators actually exhibit reduced bias.     

Efficient closed-form maximum a posteriori estimators for the gamma distribution

We proposed a new class of maximum a posteriori estimators for the parameters of the Gamma distribution. These estimators have simple closed-form expressions and can be rewritten as a bias-corrected maximum likelihood estimators presented by Ye and Chen [Closed-form estimators for the gamma distribution derived from likelihood equations. Am Statist. 2017;71(2):177–181]. A simulation study was carried out to compare different estimation procedures. Numerical results revels that our new estimation scheme outperforms the existing closed-form estimators and produces extremely efficient estimates for both parameters, even for small sample sizes.     

Pseudo‐likelihood estimation in ARCH models

The author presents asymptotic results for the class of pseudo‐likelihood estimators in the autoregressive conditional heteroscedastic models introduced by Engle (1982). Unlike what is required for the quasi‐likelihood estimator, some estimators in the class he considers do not require the finiteness of the fourth moment of the error density. Thus his method is applicable to heavy‐tailed error distributions for which moments higher than two may not exist.     

Modified maximum likelihood and modified moment estimators for the three-parameter weibull distribution

This article is concerned with modifications of both maximum likelihood and moment estimators for parameters of the three-parameter Wei bull distribution. Modifications presented here are basically the same as those previously proposed by the authors (1980, 1981, 1982) in connection with the lognormal and the gamma distributions. Computer programs were prepared for the practical application of these estimators and an illustrative example is included. Results of a simulation study provide insight into the sampling behavior of the new estimators and include comparisons with the traditional moment and maximum likelihood estimators. For some combinations of parameter values, some of the modified estimators considered here enjoy advantages over both moment and maximum likelihood estimators with respect to bias, variance, and/or ease of calculation.     

Admissibility for linear estimators of regression coefficient in a general Gauss–Markoff model under balanced loss function

A generalization of Zellner's balanced loss function is proposed according to unified theory of least squares under a general Gauss–Markoff model. Admissibility of linear estimators is investigated under the balanced loss function. And necessary and sufficient conditions that linear estimators are admissible in a class of homogeneous and nonhomogeneous linear estimators are obtained, respectively.