Adaptive Estimation Using Weighted Least Squares

This paper proposes an adaptive estimator that is more precise than the ordinary least squares estimator if the distribution of random errors is skewed or has long tails. The adaptive estimates are computed using a weighted least squares approach with weights based on the lengths of the tails of the distribution of residuals. Smaller weights are assigned to those observations that have residuals in the tails of long-tailed distributions and larger weights are assigned to observations having residuals in the tails of short-tailed distributions. Monte Carlo methods are used to compare the performance of the proposed estimator and the performance of the ordinary least squares estimator. The estimates that were studied in this simulation include the difference between the means of two populations, the mean of a symmetric distribution, and the slope of a regression line. The adaptive estimators are shown to have lower mean squared errors than those for the ordinary least squares estimators for short-tailed, long-tailed, and skewed distributions, provided the sample size is at least 20. The ordinary least squares estimator has slightly lower mean squared error for normally distributed errors. The adaptive estimator is recommended for general use for studies having sample sizes of at least 20 observations unless the random errors are known to be normally distributed.     

L Ranked Set Sampling: A Generalization Procedure for Robust Visual Sampling

In this article, a robust ranked set sampling (LRSS) scheme for estimating population mean is introduced. The proposed method is a generalization for many types of ranked set sampling that introduced in the literature for estimating the population mean. It is shown that the LRSS method gives unbiased estimator for the population mean with minimum variance providing that the underlying distribution is symmetric. However, for skewed distributions a weighted mean is given, where the optimal weights is computed by using Shannon's entropy. The performance of the population mean estimator is discussed along with its properties. Monte Carlo comparisons for detecting outliers are made with the traditional simple random sample and the ranked set sampling for some distributions. The results indicate that the LRSS estimator is superior alternative to the existing methods.     

An empirical investigation of different operating characteristics of several estimators of the intraclass correlation in the analysis of binary data

This paper is concerned with properties (bias, standard deviation, mean square error and efficiency) of twenty six estimators of the intraclass correlation in the analysis of binary data. Our main interest is to study these properties when data are generated from different distributions. For data generation we considered three over-dispersed binomial distributions, namely, the beta-binomial distribution, the probit normal binomial distribution and a mixture of two binomial distributions. The findings regarding bias, standard deviation and mean squared error of all these estimators, are that (a) in general, the distributions of biases of most of the estimators are negatively skewed. The biases are smallest when data are generated from the beta-binomial distribution and largest when data are generated from the mixture distribution; (b) the standard deviations are smallest when data are generated from the beta-binomial distribution; and (c) the mean squared errors are smallest when data are generated from the beta-binomial distribution and largest when data are generated from the mixture distribution. Of the 26, nine estimators including the maximum likelihood estimator, an estimator based on the optimal quadratic estimating equations of Crowder (1987), and an analysis of variance type estimator is found to have least amount of bias, standard deviation and mean squared error. Also, the distributions of the bias, standard deviation and mean squared error for each of these estimators are, in general, more symmetric than those of the other estimators. Our findings regarding efficiency are that the estimator based on the optimal quadratic estimating equations has consistently high efficiency and least variability in the efficiency results. In the important range in which the intraclass correlation is small (≤0 5), on the average, this estimator shows best efficiency performance. The analysis of variance type estimator seems to do well for larger values of the intraclass correlation. In general, the estimator based on the optimal quadratic estimating equations seems to show best efficiency performance for data from the beta-binomial distribution and the probit normal binomial distribution, and the analysis of variance type estimator seems to do well for data from the mixture distribution.     

Moments of scale mixtures of skew-normal distributions and their quadratic forms

We obtain the first four moments of scale mixtures of skew-normal distributions allowing for scale parameters. The first two moments of their quadratic forms are obtained using those moments. Previous studies derived the moments, but all relevant results do not allow for scale parameters. In particular, it is shown that the mean squared error becomes an unbiased estimator of σ² with skewed and heavy-tailed errors. Two measures of multivariate skewness are calculated.     

A Horvitz-Thompson Estimator of the Population Mean Using Inclusion Probabilities of Ranked Set Sampling

In this study, we define the Horvitz-Thompson estimator of the population mean using the inclusion probabilities of a ranked set sample in a finite population setting. The second-order inclusion probabilities that are required to calculate the variance of the Horvitz-Thompson estimator were obtained. The Horvitz-Thompson estimator, using the inclusion probabilities of ranked set sample, tends to be more efficient than the classical ranked set sampling estimator especially in a positively skewed population with small sizes. Also, we present a real data example with the volatility of gasoline to illustrate the Horvitz-Thompson estimator based on ranked set sampling.     

Performance of ridge estimator in inverse Gaussian regression model

The presence of multicollinearity among the explanatory variables has undesirable effects on the maximum likelihood estimator (MLE). Ridge estimator (RE) is a widely used estimator in overcoming this issue. The RE enjoys the advantage that its mean squared error (MSE) is less than that of MLE. The inverse Gaussian regression (IGR) model is a well-known model in the application when the response variable positively skewed. The purpose of this paper is to derive the RE of the IGR under multicollinearity problem. In addition, the performance of this estimator is investigated under numerous methods for estimating the ridge parameter. Monte Carlo simulation results indicate that the suggested estimator performs better than the MLE estimator in terms of MSE. Furthermore, a real chemometrics dataset application is utilized and the results demonstrate the excellent performance of the suggested estimator when the multicollinearity is present in IGR model.     

An effective approach to linear calibration estimation with its applications

Abstract

The availability of some extra information, along with the actual variable of interest, may be easily accessible in different practical situations. A sensible use of the additional source may help to improve the properties of statistical techniques. In this study, we focus on the estimators for calibration and intend to propose a setup where we reply only on first two moments instead of modeling the whole distributional shape. We have proposed an estimator for linear calibration problems and investigated it under normal and skewed environments. We have partitioned its mean squared error into intrinsic and estimation components. We have observed that the bias and mean squared error of the proposed estimator are function of four dimensionless quantities. It is to be noticed that both the classical and the inverse estimators become the special cases of the proposed estimator. Moreover, the mean squared error of the proposed estimator and the exact mean squared error of the inverse estimator coincide. We have also observed that the proposed estimator performs quite well for skewed errors as well. The real data applications are also included in the study for practical considerations.     

The Logistic-Uniform Distribution and Its Applications

In this article, we give a new family of univariate distributions generated by the Logistic random variable. A special case of this family is the Logistic-Uniform distribution. We show that the Logistic-Uniform distribution provides great flexibility in modeling for symmetric, negatively and positively skewed, bathtub-shaped, “J”-shaped, and reverse “J”-shaped distributions. We discuss simulation issues, estimation by the methods of moments, maximum likelihood, and the new method of minimum spacing distance estimator. We also derive Shannon entropy and asymptotic distribution of the extreme order statistics of this distribution. The new distribution can be used effectively in the analysis of survival data since the hazard function of the distribution can be “J,” bathtub, and concave-convex shaped. The usefulness of the new distribution is illustrated through two real datasets by showing that it is more flexible in analyzing the data than the Beta Generalized-Exponential, Beta-Exponential, Beta-Normal, Beta-Laplace, Beta Generalized half-Normal, β-Birnbaum-Saunders, Gamma-Uniform, Beta Generalized Pareto, Beta Modified Weibull, Beta-Pareto, Generalized Modified Weibull, Beta-Weibull, and Modified-Weibull distributions.     

ESTIMATION OF THE PARAMETERS OF A NORMAL DISTRIBUTION WHEN THE MEAN IS RESTRICTED TO AN INTERVAL1

Suppose it is known that the mean of a normal distribution is non-negative. Naturally one will use the sample mean truncated at zero as an estimator of the distribution mean. In this paper the properties of such an estimator are investigated.     

Discriminating among Weibull,log-normal,and log-logistic distributions

In this article, we consider the problem of the model selection/discrimination among three different positively skewed lifetime distributions. All these three distributions, namely; the Weibull, log-normal, and log-logistic, have been used quite effectively to analyze positively skewed lifetime data. In this article, we have used three different methods to discriminate among these three distributions. We have used the maximized likelihood method to choose the correct model and computed the asymptotic probability of correct selection. We have further obtained the Fisher information matrices of these three different distributions and compare them for complete and censored observations. These measures can be used to discriminate among these three distributions. We have also proposed to use the Kolmogorov–Smirnov distance to choose the correct model. Extensive simulations have been performed to compare the performances of the three different methods. It is observed that each method performs better than the other two for some distributions and for certain range of parameters. Further, the loss of information due to censoring are compared for these three distributions. The analysis of a real dataset has been performed for illustrative purposes.     

Rare and clustered population estimation using the adaptive cluster sampling with some robust measures

The use of robust measures helps to increase the precision of the estimators, especially for the estimation of extremely skewed distributions. In this article, a generalized ratio estimator is proposed by using some robust measures with single auxiliary variable under the adaptive cluster sampling (ACS) design. We have incorporated tri-mean (TM), mid-range (MR) and Hodges-Lehman (HL) of the auxiliary variable as robust measures together with some conventional measures. The expressions of bias and mean square error (MSE) of the proposed generalized ratio estimator are derived. Two types of numerical study have been conducted using artificial clustered population and real data application to examine the performance of the proposed estimator over the usual mean per unit estimator under simple random sampling (SRS). Related results of the simulation study show that the proposed estimators provide better estimation results on both real and artificial population over the competing estimators.     

SB-robustness of directional mean for circular distributions

In this paper we study the robustness of the directional mean (a.k.a. circular mean) for different families of circular distributions. We show that the directional mean is robust in the sense of finite standardized gross error sensitivity (SB-robust) for the following families: (1) mixture of two circular normal distributions, (2) mixture of wrapped normal and circular normal distributions and (3) mixture of two wrapped normal distributions. We also show that the directional mean is not SB-robust for the family of all circular normal distributions with varying concentration parameter. We define the circular trimmed mean and prove that it is SB-robust for this family. In general the property of SB-robustness of an estimator at a family of probability distributions is dependent on the choice of the dispersion measure. We introduce the concept of equivalent dispersion measures and prove that if an estimator is SB-robust for one dispersion measure then it is SB-robust for all equivalent dispersion measures. Three different dispersion measures for circular distributions are considered and their equivalence studied.     

Variance reduction of estimators arising from Metropolis–Hastings algorithms

The Metropolis–Hastings algorithm is one of the most basic and well-studied Markov chain Monte Carlo methods. It generates a Markov chain which has as limit distribution the target distribution by simulating observations from a different proposal distribution. A proposed value is accepted with some particular probability otherwise the previous value is repeated. As a consequence, the accepted values are repeated a positive number of times and thus any resulting ergodic mean is, in fact, a weighted average. It turns out that this weighted average is an importance sampling-type estimator with random weights. By the standard theory of importance sampling, replacement of these random weights by their (conditional) expectations leads to more efficient estimators. In this paper we study the estimator arising by replacing the random weights with certain estimators of their conditional expectations. We illustrate by simulations that it is often more efficient than the original estimator while in the case of the independence Metropolis–Hastings and for distributions with finite support we formally prove that it is even better than the “optimal” importance sampling estimator.     

Pooling multivariate data

In case it is doubtful whether two sets of data have the same mean vector, four estimation strategies have been developed for the target mean vector. In this situation, the estimates based on a preliminary test as well as on Stein-rule are advantageous. Two measures of relative efficiency are considered; one based on thequadratic loss function, and the other on the determinant of the mean square error matrix. A max-min rule for the size of the preliminary test of significance is presented. It is demonstrated that the shrinkage estimator dominates the classical estimator, whereas none of the shrinkage estimator and the preliminary test estimator dominate each other. The range in the parameter space where preliminary test estimator dominates shrinkage is investigated analytically and computationally. It is found that the shrinkage estimator outperform the preliminary test estimator except in a region around the null hypothesis. Moreover, for large values of a, the level of statistical significance, shrinkage estimator dominates the preliminary test estimator uniformly. The relative dominance of the estimators is presented.     

On estimating the common mean in two normal distributions after a preliminary test for equality of variances

Given two random samples of equal size from two normal distributions with common mean but possibly different variances, we examine the sampling performance of the pre-test estimator for the common mean after a preliminary test for equality of variances. It is shown that when the alternative in the pretest is one-sided, the Graybill-Deal estimator is dominated by the pre-test estimator if the critical value is chosen appropriately. It is also shown that all estimators, the grand mean, the Graybill-Deal estimator and the pre-test estimator, are admissible when the alternative in the pre-test is two-sided. The optimal critical values in the two-sided pre-test are sought based on the minimax regret and the minimum average risk criteria, and it is shown that the Graybill-Deal estimator is most preferable under the minimum average risk criterion when the alternative in the pre-test is two-sided.     

Estimation Under Purposive Sampling

Purposive sampling is described as a random selection of sampling units within the segment of the population with the most information on the characteristic of interest. Nonparametric bootstrap is proposed in estimating location parameters and the corresponding variances. An estimate of bias and a measure of variance of the point estimate are computed using the Monte Carlo method. The bootstrap estimator of the population mean is efficient and consistent in the homogeneous, heterogeneous, and two-segment populations simulated. The design-unbiased approximation of the standard error estimate differs substantially from the bootstrap estimate in severely heterogeneous and positively skewed populations.     

An empirical power study of multi-sample tests for exponentiality

Results are given of an empirical power study of three statistical procedures for testing for exponentiality of several independent samples. The test procedures are the Tiku (1974) test, a multi-sample Durbin (1975) test, and a multi-sample Shapiro–Wilk (1972) test. The alternative distributions considered in the study were selected from the gamma, Weibull, Lomax, lognormal, inverse Gaussian, and Burr families of positively skewed distributions. The general behavior of the conditional mean exceedance function is used to classify each alternative distribution. It is shown that Tiku's test generally exhibits overall greater power than either of the other two test procedures. For certain alternative distributions, Shapiro–Wilk's test is superior when the sample sizes are small.     

A conditionally-unbiased estimator of population size based on plant-capture in continuous time

This paper proposes an estimator of the unknown size of a target population to which has been added a planted population of known size. The augmented population is observed for a fixed time and individuals are sighted according to independent Poisson processes. These processes may be time-inhomogeneous, but, within each population, the intensity function is the same for all individuals. When the two populations have the same intensity function, known results on factorial series distributions suggest that the proposed estimator is approximately unbiased and provide a useful estimator of standard deviation. Except for short sampling times, computational results confirm that the proposed population-size estimator is nearly unbiased, and indicate that it gives a better overall performance than existing estimators in the literature. The robustness of this performance is investigated in situations in which it cannot be assumed that the behaviour of the plants matches that of individuals from the target population.     

A note on estimating the common mean of k normal distributions and the stein problem

An unbiased estimator for the common mean of k normal distributions is suggested. A necessary and sufficient condition for the estimator Lo have a smaller variance than each sample mean is given. In the case of estimating the common mean vector of k p-variate (p ≤ 3) normal distributions a combined unbiased estimator may be used. We give a class of estimators which are better than the combined estimator when the loss is quadratic and the restriction of unbiasedness is removed.     

Efficiency of an adaptive estimator of a log-zero-poisson parameter

An estimator, λ is proposed for the parameter λ of the log-zero-Poisson distribution. While it is not a consistent estimator of λ in the usual statistical sense, it is shown to be quite close to the maximum likelihood estimates for many of the 35 sets of data on which it is tried. Since obtaining maximum likelihood estimates is extremely difficult for this and other contagious distributions, this estimate will act at least as an initial estimate in solving the likelihood equations iteratively. A lesson learned from this experience is that in the area of contagious distributions, variability is so large that attention should be focused directly on the mean squared error and not on consistency or unbiasedness, whether for small samples or for the asymptotic case. Sample sizes for some of the data considered in the paper are in hundreds. The fact that the estimator which is not a consistent estimator of λ is closer to the maximum likeli-hood estimator than the consistent moment estimator shows that the variability is large enough to not permit consistency to materialize even for such large sample sizes usually available in actual practice.