A REGRESSION APPROACH TO THE ESTIMATION OF THE FINITE POPULATION MEAN IN THE PRESENCE OF NON‐RESPONSE

This paper presents various estimators for estimating the population mean of the study variable y using information on the auxiliary variable x in the presence of non‐response. Properties of the suggested estimators are studied and compared with those of existing estimators. It is shown that the estimators suggested in this paper are among the best of all the estimators considered. An empirical study is carried out to demonstrate the performance of the suggested estimators and of others, and it is found that the empirical results support the theoretical study.     

Nonparametric estimation of mean residual quantile function under right censoring

In this paper, we develop non-parametric estimation of the mean residual quantile function based on right-censored data. Two non-parametric estimators, one based on the empirical quantile function and the other using the kernel smoothing method, are proposed. Asymptotic properties of the estimators are discussed. Monte Carlo simulation studies are conducted to compare the two estimators. The method is illustrated with the aid of two real data sets.     

On Robust and Efficient Estimation of the Center of Symmetry

In this article, a class of estimators of the center of symmetry based on the empirical characteristic function is examined. In the spirit of the Hodges–Lehmann estimator, the resulting procedures are shown to be a function of the pairwise averages. The proposed procedures are also shown to have an equivalent representation as the minimizers of certain distances between two corresponding kernel density estimators. An alternative characterization of the Hodges–Lehmann estimator is established upon the use of a particularly simple choice of kernel.     

Regression with an infinite number of observations applied to estimating the parameters of the stable distribution using the empirical characteristic function

ABSTRACT

The parameters of stable law parameters can be estimated using a regression based approach involving the empirical characteristic function. One approach is to use a fixed number of points for all parameters of the distribution to estimate the characteristic function. In this work the results are derived where all points in an interval is used to estimate the empirical characteristic function, thus least squares estimators of a linear function of the parameters, using an infinite number of observations. It was found that the procedure performs very good in small samples.     

Bootstrap Procedures for Online Monitoring of Changes in Autoregressive Models

We compare the behavior of several bootstrap procedures for monitoring changes in the error distribution of autoregressive time series. The proposed procedures are designed to control the overall significance level and include classical tests based on the empirical distribution function as well as Fourier-type methods that utilize the empirical characteristic function, both functions being computed on the basis of properly estimated residuals. The Monte Carlo study incorporates different estimators and a variety of sampling situations with and without outliers.     

Robust scale estimation in the error-components model using the empirical characteristic function

Robust estimators of the scale parameters in the error-components model are described. The new estimators are based on the empirical characteristic functions of appropriate sets of residuals and are affine equivariant, consistent and asymptotically normal. The robustness of the new estimators is investigated via influence-function calculations. The results of Monte Carlo experiments and an example based on real data illustrate the usefulness of the estimators.     

Testing for symmetry in multivariate distributions

Using the empirical characteristic function, a Cramér–von Mises test for reflected symmetry about an unspecified point is derived for multivariate distributions. The test statistic is based on an empirical process for which the weak convergence is established. The null properties of the test are studied as well as its power and local power. Estimators for the unknown symmetric point are previously proposed. Their consistency and asymptotical normality are proved by studying the weak convergence of some multidimensional empirical process. A simulation experiment shows that the estimators of the symmetric point are good, and that the test performs well on the examples tested. The new test is compared to the one derived in [N. Henze, B. Klar, S.G. Meintanis, Invariant tests for symmetry about an unspecified point based on empirical characteristic function, J. Multivariate. Anal. 87 (2003) 275–297].     

INFLUENCE FUNCTION OF THE LIKELIHOOD RATIO TEST STATISTIC FOR MULTIVARIATE NORMAL SAMPLE

ABSTRACT

We derive the influence function of the likelihood ratio test statistic for multivariate normal sample. The derived influence function does not depend on the influence functions of the parameters under the null hypothesis. So we can obtain directly the empirical influence function with only the maximum likelihood estimators under the null hypothesis. Since the derived formula is a general form, it can be applied to influence analysis on many statistical testing problems.     

Omnibus tests for the error distribution in the linear regression model

Test procedures are constructed for testing the goodness-of-fit of the error distribution in the regression context. The test statistic is based on an L ²-type distance between the characteristic function of the (assumed) error distribution and the empirical characteristic function of the residuals. The asymptotic null distribution as well as the behavior of the test statistic under contiguous alternatives is investigated, while the issue of the choice of suitable estimators has been particularly emphasized. Theoretical results are accompanied by a simulation study.     

Empirical likelihood inference in the presence of measurement error

Suppose that several different imperfect instruments and one perfect instrument are used independently to measure some characteristic of a population. The authors consider the problem of combining this information to make statistical inference on parameters of interest, in particular the population mean and cumulative distribution function. They develop maximum empirical likelihood estimators and study their asymptotic properties. They also present simulation results on the finite sample efficiency of these estimators.     

Extended linear empirical bayes estimation

In this paper, the linear empirical Bayes estimation method, which is based on approximation of the Bayes estimator by a linear function, is generalized to an extended linear empirical Bayes estimation technique which represents the Bayes estimator by a series of algebraic polynomials. The extended linear empirical Bayes estimators are elaborated in the case of a location or a scale parameter. The theory is illustrated by examples of its application to the normal distribution with a location parameter and the gamma distribution with a scale parameter. The linear and the extended linear empirical Bayes estimators are constructed in these two cases and, then, studied numerically via Monte Carlo simulations. The simulations show that the extended linear empirical Bayes estimators have better convergence rates than the traditional linear empirical Bayes estimators.     

Minimum-distance methods based on quadratic distances for transforms

A class of minimum-distance methods based on empirical transforms is considered. This class includes the minimum-chi-squared method, the K-L method for empirical characteristic functions, and the analogous method for empirical moment generating functions. Asymptotic properties of the minimum-distance estimators and goodness-of-fit test statistics are derived. A general analogue of the Rao-Robson statistic is formulated.     

Inference procedures for the variance gamma model and applications

Goodness-of-fit tests for the family of the four-parameter normal–variance gamma distribution are constructed. The tests are based on a weighted integral incorporating the empirical characteristic function of suitably standardized data. Non-standard algorithms are employed for the computation of the maximum-likelihood estimators of the parameters involved in the test statistic, while Monte Carlo results are used in order to compare the new test with some classical goodness-of-fit methods. A real-data application is also included.     

Estimation of mean in presence of non-response using two phase sampling scheme

This paper considers the problem of estimating the population mean using information on an auxiliary variable in presence of non-response. Some modified ratio, product and regression estimators in double sampling have been suggested and their properties are studied. It is shown that to the first degree of approximation, estimators based on estimated optimum values have the same variance as that of the optimum estimators. An empirical study is carried to judge the merits of the suggested estimators over conventional unbiased estimator and other known estimators. Both theoretical and empirical study results present the soundness and usefulness of the suggested estimators in practice.     

Estimation of the Moment Generating Function

A number of statistical problems use the moment generating function (mgf) for purposes other than determining the moments of a distribution. If the distribution is not completely specified, then the mgf must be estimated from available data. The empirical mgf makes no assumptions concerning the underlying distribution except for the existence of the mgf. In contrast to the nonparametric approach provided by the empirical mgf, alternative estimators can be formed based on an assumed parametric model. Comparison of these approaches is considered for two parametric models; the normal and a one parameter gamma. Comparison criteria are efficiency and empirical confidence interval coverage. In general the parametric estimators outperform the empirical mgf when the model is correct. The comparisons are extended to underlying models which are two component mixtures from the distributional family assumed by the parametric estimators. Under the mixture models the superiority of the parametric estimator depends upon the model, value of the argument of the mgf, and the comparison criterion. The empirical mgf is the better estimator in some cases.     

ROBUST INFERENCE IN PARAMETRIC MODELS USING THE FAMILY OF GENERALIZED NEGATIVE EXPONENTIAL DISPARITIES

We examine robust estimators and tests using the family of generalized negative exponential disparities, which contains the Pearson's chi‐square and the ordinary negative exponential disparity as special cases. The influence function and α‐influence function of the proposed estimators are discussed and their breakdown points derived. Under the model, the estimators are asymptotically efficient, and are shown to have an asymptotic breakdown point of 50%. The proposed tests are shown to be equivalent to the likelihood ratio test under the null hypothesis, and their breakdown points are obtained. The competitive performance of the proposed estimators and tests relative to those based on the Hellinger distance is illustrated through examples and simulation results. Unlike the Hellinger distance, several members of this family of generalized negative exponential disparities generate estimators which also possess excellent inlier‐controlling capability. The corresponding tests of hypothesis are shown to have better power breakdown than the Hellinger deviance test in the cases examined.     

Efficient M-estimators with auxiliary information

This paper introduces a new class of M-estimators based on generalised empirical likelihood (GEL) estimation with some auxiliary information available in the sample. The resulting class of estimators is efficient in the sense that it achieves the same asymptotic lower bound as that of the efficient generalised method of moment (GMM) estimator with the same auxiliary information. The paper also shows that in case of smooth estimating equations the proposed estimators enjoy a small second order bias property compared to both efficient GMM and full GEL estimators. Analytical formulae to obtain bias corrected estimators are also provided. Simulations show that with correctly specified auxiliary information the proposed estimators and in particular those based on empirical likelihood outperform standard M and efficient GMM estimators both in terms of finite sample bias and efficiency. On the other hand with moderately misspecified auxiliary information estimators based on the nonparametric tilting method are typically characterised by the best finite sample properties.     

Maximum likelihood vs. maximum goodness of fit estimation of the three-parameter Weibull distribution

The use of statistics based on the empirical distribution function is analysed for estimation of the scale, shape, and location parameters of the three-parameter Weibull distribution. The resulting maximum goodness of fit (MGF) estimators are compared with their maximum likelihood counterparts. In addition to the Kolmogorov–Smirnov, Cramer–von Mises, and Anderson–Darling statistics, some related empirical distribution function statistics using different weight functions are considered. The results show that the MGF estimators of the scale and shape parameters are usually more efficient than the maximum likelihood estimators when the shape parameter is smaller than 2, particularly if the sample size is large.     

BAYES EMPIRICAL BAYES APPROACH TO ESTIMATION OF THE FAILURE RATE IN EXPONENTIAL DISTRIBUTION

ABSTRACT

In the empirical Bayes (EB) decision problem consisting of squared error estimation of the failure rate in exponential distribution, a prior Λ is placed on the gamma family of prior distributions to produce Bayes EB estimators which are admissible. A subclass of such estimators is shown to be asymptotically optimal (a.o.). The results of a Monte Carlo study are presented to demonstrate the a.o. property of the Bayes EB estimators.     

Estimation of the error distribution in a varying coefficient regression model

This paper deals with the estimation of the error distribution function in a varying coefficient regression model. We propose two estimators and study their asymptotic properties by obtaining uniform stochastic expansions. The first estimator is a residual-based empirical distribution function. We study this estimator when the varying coefficients are estimated by under-smoothed local quadratic smoothers. Our second estimator which exploits the fact that the error distribution has mean zero is a weighted residual-based empirical distribution whose weights are chosen to achieve the mean zero property using empirical likelihood methods. The second estimator improves on the first estimator. Bootstrap confidence bands based on the two estimators are also discussed.