Improved estimators of regression coefficients in measurement error models

This paper is concerned with methods of reducing variability and computer time in a simulation study. The Monte Carlo swindle, through mathematical manipulations, has been shown to yield more precise estimates than the “naive” approach. In this study computer time is considered in conjunction with the variance estimates. It is shown that by this measure the naive method is often a viable alternative to the swindle. This study concentrates on the problem of estimating the variance of an estimator of location. The advantage of one technique over another depends upon the location estimator, the sample size, and the underlying distribution. For a fixed number of samples, while the naive method gives a less precise estimate than the swindle, it requires fewer computations. In addition, for certain location estimators and distributions, the naive method is able to take advantage of certain shortcuts in the generation of each sample. The small amount of time required by this “enlightened” naive method often more than compensates for its relative lack of precision.     

An Extension of the Normal/Independent Family for Studies of Robust Estimators

The family of normal scale mixture distributions, also called the Normal/Independent family, has been used for efficient Monte Carlo studies of robust estimators. The distributions in this family are unimodal. The Normal/Independent family is extended by introducing a location mixing in addition to the scale mixing. Distributions in this extension may be nonunimodal. The asymptotic variances of robust estimators of location are compared using the distributions from the extension. A Monte Carlo swindle similar to the one used in the Princeton study is given for the extended family. A small simulation study demonstrates the efficiency of the swindle. The swindle is compared with other swindle methods based on Fisher's score function and regression.     

Weighted nonparametric regression

In the fixed design regression model, additional weights are considered for the Nad a ray a-Watson and Gasser-Miiller kernel estimators. We study their asymptotic behavior and the relationships between new and classical estimators. For a simple family of weights, and considering the AIMSEAS global loss criterion, we show some possible theoretical advantages. An empirical study illustrates the performance of the weighted kernel estimators in theoretical ideal situations and in simulated data sets. Also some results concerning the use of weights for local polynomial estimators are given.     

Estimators for the Finite Mixture of Rayleigh Model Based on Progressively Censored Data

In this article, based on progressively Type-II censored samples from a heterogeneous population that can be represented by a finite mixture of two-component Rayleigh lifetime model, the problem of estimating the parameters and some lifetime parameters (reliability and hazard functions) are considered. Both Bayesian and maximum likelihood estimators are of interest. A class of natural conjugate prior densities is considered in the Bayesian setting. The Bayes estimators are obtained using both the symmetric (squared error) loss function, and the asymmetric (LINEX and General Entropy) loss functions. It has been seen that the estimators obtained can be easily evaluated for this type of censoring by using suitable numerical methods. Finally, the performance of the estimates have been compared on the basis of their simulated maximum square error via a Monte Carlo simulation study.     

Simultaneous estimation for non-crossing multiple quantile regression with right censored data

In this paper, we consider the estimation problem of multiple conditional quantile functions with right censored survival data. To account for censoring in estimating a quantile function, weighted quantile regression (WQR) has been developed by using inverse-censoring-probability weights. However, the estimated quantile functions from the WQR often cross each other and consequently violate the basic properties of quantiles. To avoid quantile crossing, we propose non-crossing weighted multiple quantile regression (NWQR), which estimates multiple conditional quantile functions simultaneously. We further propose the adaptive sup-norm regularized NWQR (ANWQR) to perform simultaneous estimation and variable selection. The large sample properties of the NWQR and ANWQR estimators are established under certain regularity conditions. The proposed methods are evaluated through simulation studies and analysis of a real data set.     

Adaptive Estimation Using Weighted Least Squares

This paper proposes an adaptive estimator that is more precise than the ordinary least squares estimator if the distribution of random errors is skewed or has long tails. The adaptive estimates are computed using a weighted least squares approach with weights based on the lengths of the tails of the distribution of residuals. Smaller weights are assigned to those observations that have residuals in the tails of long-tailed distributions and larger weights are assigned to observations having residuals in the tails of short-tailed distributions. Monte Carlo methods are used to compare the performance of the proposed estimator and the performance of the ordinary least squares estimator. The estimates that were studied in this simulation include the difference between the means of two populations, the mean of a symmetric distribution, and the slope of a regression line. The adaptive estimators are shown to have lower mean squared errors than those for the ordinary least squares estimators for short-tailed, long-tailed, and skewed distributions, provided the sample size is at least 20. The ordinary least squares estimator has slightly lower mean squared error for normally distributed errors. The adaptive estimator is recommended for general use for studies having sample sizes of at least 20 observations unless the random errors are known to be normally distributed.     

Partially Adaptive Estimation of the Censored Regression Model

Data censoring causes ordinary least squares estimates of linear models to be biased and inconsistent. Tobit, semiparametric, and partially adaptive estimators have been considered as possible solutions. This paper proposes several new partially adaptive estimators that cover a wide range of distributional characteristics. A simulation study is used to investigate the estimators’ relative efficiency in these settings. The partially adaptive censored regression estimators have little efficiency loss for censored normal errors and may outperform Tobit and semiparametric estimators considered for non-normal distributions. An empirical example of out-of-pocket expenditures for a health insurance plan provides an example, which supports these results.     

A monte carlo study of robust estimators of location

Andrews et al (1972) carried out an extensive Monte Carlo study of robust estimators of location. Their conclusions were that the hampel and the skipped estimates, as classes, seemed to be preferable to some of the other currently fashionable estimators. The present study extends this work to include estimators not previously examined. The estimators are compared over short-tailed as well as long-tailed alternatives and also over some dependent data generated by first-order autoregressive schemes. The conclusions of the present study are threefold. First, from our limited study, none of the so-called robust estimators are very efficient over short-tailed situations. More work seems to be necessary in this situation. Second, none of the estimators perform very well in dependent data situations, particularly when the correlation is large and positive. This seems to be a rather pressing problem. Finally, for long-tailed alternatives, the hampel estimators and Hogg-type adaptive versions of the hampels are the strongest classes. The adaptive hampels neither uniformly outperform nor are they outperformed by the hampels. However, the superiority in terms of maximum relative efficiency goes to the adaptive hampels. That is, the adaptive hampels, under their worst performance.     

Weighted empirical adaptive variance estimators for correlated data regression

Estimating equations based on marginal generalized linear models are useful for regression modelling of correlated data, but inference and testing require reliable estimates of standard errors. We introduce a class of variance estimators based on the weighted empirical variance of the estimating functions and show that an adaptive choice of weights allows reliable estimation both asymptotically and by simulation in finite samples. Connections with previous bootstrap and jackknife methods are explored. The effect of reliable variance estimation is illustrated in data on health effects of air pollution in King County, Washington.     

Minimum variance unbiased estimation for modified power series distribution

In this paper we study the problem of finding the minimum variance unbiased (MVU) estimators of the functions of the para-meters of the modified power series distributions (MPSD). A theorem giving the necessary and sufficient conditions for the existence of the MVU estimators has been proved. Also, the estimators for a number of estimable functions of a parameter are obtained. Two other theorems dealing with the MVU estimation of the left truncated MPSD with unknown truncation point are also given. The particular case of the Lagrangian Poisson, the Lagrangian binomial and the Borel-Tanner distributions are considered and tables are also provided for the MVU estimators for some functions of the parameters. The variances of the estimators are also given for some cases.     

On the calculations of the maximum likelihood estimates for the polynomial spline regression model with unknown knots and AR(1) errors

Asymptotic distributions of the maximum likelihood estimators of the regression coefficients and knot points for the polynomial spline regression models with unknown knots and AR(1) errors have been derived by Chan (1989). Chan showed that under some mild conditions the maximum likelihood estimators, after suitable standardization, asymptotically follow normal distributions as n diverges to infinity. For the calculations of the maximum likelihood estimators, iterative methods must be applied. But this is not easy to implement for the model considered. In this paper, we suggested an alternative method to compute the estimates of the regression parameters and knots. It is shown that the estimates obtained by this method are asymptotically equivalent to the maximum likelihood estimates considered by Chan.     

On adaptive progressively Type-II censored competing risks data

In this article, a competing risks model based on exponential distributions is considered under the adaptive Type-II progressively censoring scheme introduced by Ng et al. [2009, Naval Research Logistics 56:687-698], for life testing or reliability experiment. Moreover, we assumed that some causes of failures are unknown. The maximum likelihood estimators (MLEs) of unknown parameters are established. The exact conditional and the asymptotic distributions of the obtained estimators are derived to construct the confidence intervals as well as the two different bootstraps of different unknown parameters. Under suitable priors on the unknown parameters, Bayes estimates and the corresponding two sides of Bayesian probability intervals are obtained. Also, for the purpose of evaluating the average bias and mean square error of the MLEs, and comparing the confidence intervals based on all mentioned methods, a simulation study was carried out. Finally, we present one real dataset to conduct the proposed methods.     

Calibration estimator of population mean under stratified ranked set sampling design

Calibration method adjusts the original design weights to improve the estimates by using auxiliary information. In this article we have proposed new calibration estimators under stratified ranked set sampling design and derive the estimator of variance of calibration estimator. A simulation study is carried out to see the performance of proposed estimators.     

Estimation of parameters of Kumaraswamy-Exponential distribution under progressive type-II censoring

In this paper, the problem of estimating unknown parameters of a two-parameter Kumaraswamy-Exponential (Kw-E) distribution is considered based on progressively type-II censored sample. The maximum likelihood (ML) estimators of the parameters are obtained. Bayes estimates are also obtained using different loss functions such as squared error, LINEX and general entropy. Lindley's approximation method is used to evaluate these Bayes estimates. Monte Carlo simulation is used for numerical comparison between various estimates developed in this paper.     

Estimation for an inverted exponentiated Rayleigh distribution under type II progressive censoring

In this paper, we consider estimation of unknown parameters of an inverted exponentiated Rayleigh distribution under type II progressive censored samples. Estimation of reliability and hazard functions is also considered. Maximum likelihood estimators are obtained using the Expectation–Maximization (EM) algorithm. Further, we obtain expected Fisher information matrix using the missing value principle. Bayes estimators are derived under squared error and linex loss functions. We have used Lindley, and Tiernery and Kadane methods to compute these estimates. In addition, Bayes estimators are computed using importance sampling scheme as well. Samples generated from this scheme are further utilized for constructing highest posterior density intervals for unknown parameters. For comparison purposes asymptotic intervals are also obtained. A numerical comparison is made between proposed estimators using simulations and observations are given. A real-life data set is analyzed for illustrative purposes.     

Estimation from Burr type XII distribution using progressive first-failure censored data

In this paper, a new life test plan called a progressively first-failure-censoring scheme introduced by Wu and Ku? [On estimation based on progressive first-failure-censored sampling, Comput. Statist. Data Anal. 53(10) (2009), pp. 3659–3670] is considered. Based on this type of censoring, the maximum likelihood (ML) and Bayes estimates for some survival time parameters namely reliability and hazard functions, as well as the parameters of the Burr-XII distribution are obtained. The Bayes estimators relative to both the symmetric and asymmetric loss functions are discussed. We use the conjugate prior for the one-shape parameter and discrete prior for the other parameter. Exact and approximate confidence intervals with the exact confidence region for the two-shape parameters are derived. A numerical example using the real data set is provided to illustrate the proposed estimation methods developed here. The ML and the different Bayes estimates are compared via a Monte Carlo simulation study.     

Inference on a progressive type I interval-censored truncated normal distribution

In this paper, we consider the problem of making statistical inference for a truncated normal distribution under progressive type I interval censoring. We obtain maximum likelihood estimators of unknown parameters using the expectation-maximization algorithm and in sequel, we also compute corresponding midpoint estimates of parameters. Estimation based on the probability plot method is also considered. Asymptotic confidence intervals of unknown parameters are constructed based on the observed Fisher information matrix. We obtain Bayes estimators of parameters with respect to informative and non-informative prior distributions under squared error and linex loss functions. We compute these estimates using the importance sampling procedure. The highest posterior density intervals of unknown parameters are constructed as well. We present a Monte Carlo simulation study to compare the performance of proposed point and interval estimators. Analysis of a real data set is also performed for illustration purposes. Finally, inspection times and optimal censoring plans based on the expected Fisher information matrix are discussed.     

Inference under Heteroscedasticity of Unknown Form Using an Adaptive Estimator

The heteroscedasticity consistent covariance matrix estimators are commonly used for the testing of regression coefficients when error terms of regression model are heteroscedastic. These estimators are based on the residuals obtained from the method of ordinary least squares and this method yields inefficient estimators in the presence of heteroscedasticity. It is usual practice to use estimated weighted least squares method or some adaptive methods to find efficient estimates of the regression parameters when the form of heteroscedasticity is unknown. But HCCM estimators are seldom derived from such efficient estimators for testing purposes in the available literature. The current article addresses the same concern and presents the weighted versions of HCCM estimators. Our numerical work uncovers the performance of these estimators and their finite sample properties in terms of interval estimation and null rejection rate.     

Multilevel modelling of survey data: impact of the two-level weights used in the pseudolikelihood

Approaches that use the pseudolikelihood to perform multilevel modelling on survey data have been presented in the literature. To avoid biased estimates due to unequal selection probabilities, conditional weights can be introduced at each level. Less-biased estimators can also be obtained in a two-level linear model if the level-1 weights are scaled. In this paper, we studied several level-2 weights that can be introduced into the pseudolikelihood when the sampling design and the hierarchical structure of the multilevel model do not match. Two-level and three-level models were studied. The present work was motivated by a study that aims to estimate the contributions of lead sources to polluting the interior floor dust of the rooms within dwellings. We performed a simulation study using the real data collected from a French survey to achieve our objective. We conclude that it is preferable to use unweighted analyses or, at the most, to use conditional level-2 weights in a two-level or a three-level model. We state some warnings and make some recommendations.     

Semiparametric jump-preserving estimation for single-index models

Estimation of the single-index model with a discontinuous unknown link function is considered in this paper. Existed refined minimum average variance estimation (rMAVE) method can estimate the single-index parameter and unknown link function simultaneously by minimising the average pointwise conditional variance, where the conditional variance can be estimated using the local linear fit method with centred kernel function. When there are jumps in the link function, big biases around jumps can appear. For this reason, we embed the jump-preserving technique in the rMAVE method, then propose an adaptive jump-preserving estimation procedure for the single-index model. Concretely speaking, the conditional variance is obtained by the one among local linear fits with centred, left-sided and right-sided kernel functions who has minimum weighted residual mean squares. The resulting estimators can preserve the jumps well and also give smooth estimates of the continuity parts. Asymptotic properties are established under some mild conditions. Simulations and real data analysis show the proposed method works well.