Ordered partially ordered judgment subset sampling with applications to parametric inference

ABSTRACT

In this paper, we use the idea of order statistics from independent and non-identically distributed random variables to propose ordered partially ordered judgment subset sampling (OPOJSS) and then develop optimal linear parametric inferences. The best linear unbiased and invariant estimators of the location and scale parameters of a location-scale family are developed based on OPOJSS. It is shown that, despite the presence or absence of ranking errors, the proposed estimators with OPOJSS are uniformly better than the existing estimators with simple random sampling (SRS), ranked set sampling (RSS), ordered RSS (ORSS) and partially ordered judgment subset sampling (POJSS). Moreover, we also derive the best linear unbiased estimators (BLUEs) of the unknown parameters of the simple linear regression model with replicated observations using POJSS and OPOJSS. It is found that the BLUEs with OPOJSS are more precise than the BLUEs based on SRS, RSS, ORSS and POJSS.     

Progressive type II censored order statistics from exponential distributions

In the model of progressive type II censoring, point and interval estimation as well as relations for single and product moments are considered. Based on two-parameter exponential distributions, maximum likelihood estimators (MLEs), uniformly minimum variance unbiased estimators (UMVUEs) and best linear unbiased estimators (BLUEs) are derived for both location and scale parameters. Some properties of these estimators are shown. Moreover, results for single and product moments of progressive type II censored order statistics are presented to obtain recurrence relations from exponential and truncated exponential distributions. These relations may then be used to compute all the means, variances and covariances of progressive type II censored order statistics based on exponential distributions for arbitrary censoring schemes. The presented recurrence relations simplify those given by Aggarwala and Balakrishnan (1996)     

Linear estimation for the extended exponential power distribution

Tiao and Lund [The use of OLUMV estimators in inference robustness studies of the location parameter of a class of symmetric distributions. J Amer Statist Assoc. 1970;65(329):370–386] tabulated the coefficients of the best linear unbiased estimators (BLUEs) of location and scale for a particular family of symmetric distributions. This family was a reparameterization of the extended exponential power distribution (EEPD) with the shape parameter restricted to be greater than or equal to one. In this work, we consider the BLU estimation of the location and scale parameters of the EEPD when the shape parameter is one-third and one-half. We obtain closed-form expressions for the single and product moments of the order statistics when the shape parameter is in general in the form of a reciprocal of an integer. These expressions are then used to determine the BLUEs and the corresponding variances for complete samples of size 20 and less. We consider some other linear estimators of the location and scale parameters and then compare them with the BLUEs. Finally, we present a numerical example to illustrate the developed results.     

Improved best linear unbiased estimators for the simple linear regression model using double ranked set sampling schemes

ABSTRACT

In this paper, we consider the best linear unbiased estimators (BLUEs) based on double ranked set sampling (DRSS) and ordered DRSS (ODRSS) schemes for the simple linear regression model with replicated observations. We assume three symmetric distributions for the random error term, i.e., normal, Laplace and some scale contaminated normal distributions. The proposed BLUEs under DRSS (BLUEs-DRSS) and ODRSS (BLUEs-ODRSS) are compared with the BLUEs based on ordered simple random sampling (OSRS), ranked set sampling (RSS), and ordered RSS (ORSS) schemes. These estimators are compared in terms of relative efficiency (RE), RE of determinant (RED), and RE of trace (RET). It is found that the BLUEs-ODRSS are uniformly better than the BLUEs based on OSRS, RSS, ORSS, and DRSS schemes. We also compare the estimators based on imperfect RSS (IRSS) schemes. It is worth mentioning here that the BLUEs under ordered imperfect DRSS (OIDRSS) are better than their counterparts based on IRSS, ordered IRSS (OIRSS), and imperfect DRSS (IDRSS) methods. Moreover, for sensitivity analysis of the BLUEs, we calculate REs and REDs of the BLUEs under the assumption of normality when in fact the parent distribution follows a non normal symmetric distribution. It turns out that even under violation of normality assumptions, BLUEs of the intercept and the slope parameters are found to be unbiased with equal REs under each sampling scheme. It is also observed that the BLUEs under ODRSS are more efficient than the existing BLUEs.     

Modified BLUEs and BLIEs of the location and scale parameters and the population mean using ranked set sampling

Ranked set sampling (RSS) is a sampling procedure that can be used to improve the cost efficiency of selecting sample units of an experiment or a study. In this paper, RSS is considered for estimating the location and scale parameters a and b>0, as well as the population mean from the family F((x?a)/b). Modified best linear unbiased estimators (BLUEs) and best linear invariant estimators (BLIEs) are considered. Numerical computations with different location-scale distributions and different sample sizes are conducted to assess the efficiency of the suggested estimators. It is found that the modified BLIEs are uniformly higher than that of BLUEs for all distributions considered in this study. The modified BLUE and BLIE are more efficient when the underlying distribution is symmetric.     

Estimation of Ordered Location Parameters: The Exponential Distribution

The problem of component wise estimation of ordered location parameters θ ₁ (θ ₁ ≤ θ ₂) of two independent exponential distributions is investigated. The scale parameters are assumed to be unequal but known. Independent random samples of unequal sample sizes are drawn from two populations and the estimators admissible among the mixed estimators of θ ₁ and θ ₂ are obtained. It is shown that the minimum risk estimators (MREs) of θ ₁ and θ ₂ without assuming θ ₁ ≤ θ ₂ are inadmissible when one does assume that θ ₁ ≤ θ ₂. The efficiencies of mixed estimators relative to MREs (without assuming θ ₁ ≤ θ ₂) are tabulated for equal sample sizes and equal scale parameters.     

On the simple linear regression model with correlated measurement errors

The simple linear regression model with measurement error has been subject to much research. In this work we will focus on this model when the error in the explanatory variable is correlated with the error in the regression equation. Specifically, we are interested in the comparison between the ordinary errors-in-variables estimator of the regression coefficient β$\beta$ and the estimator that takes account of the correlation between the errors. Based on large sample approximations, we compare the estimators and find that the estimator that takes account of the correlation should be preferred in most situations. We also compare the estimators in small sample situations. This is done by stochastic simulation. The results show that the estimators behave quite similarly in most of the simulated situations, but that the ordinary errors-in-variables estimator performs considerably worse than the estimator that takes account of the correlation for certain parameter combinations. In addition, we look briefly into the bias introduced by ignoring correlated errors when computing sample correlations, and in predictions.     

Bounded risk estimation of linear combinations of the location and scale parameters in exponential distributions under two-stage sampling

Two-stage sampling is proposed for estimating linear combinations of the location and scale parameters of exponential distributions with bounded quadratic risk functions. Exact formulae for the expected values and risks of the estimators are derived, and the performance of estimators is studied. Illustrations with real data are included.     

Multivariate Matsumoto–Yor property is rather restrictive

Matsumoto and Yor [2001. An analogue of Pitman's 2M-X$2M-X$ theorem for exponential Wiener functionals. Part II: the role of the GIG laws. Nagoya Math. J. 162, 65–86] discovered an interesting invariance property of a product of the generalized inverse Gaussian (GIG) and the gamma distributions. For univariate random variables or symmetric positive definite random matrices it is a characteristic property for this pair of distributions. It appears that for random vectors the Matsumoto–Yor property characterizes only very special families of multivariate GIG and gamma distributions: components of the respective random vectors are grouped into independent subvectors, each subvector having linearly dependent components. This complements the version of the multivariate Matsumoto–Yor property on trees and related characterization obtained in Massam and Weso?owski [2004. The Matsumoto–Yor property on trees. Bernoulli 10, 685–700].     

Improved reduced-bias tail index and quantile estimators

In this paper, we deal with bias reduction techniques for heavy tails, trying to improve mainly upon the performance of classical high quantile estimators. High quantiles depend strongly on the tail index γ$\gamma$, for which new classes of reduced-bias estimators have recently been introduced, where the second-order parameters in the bias are estimated at a level _k1$k_1$ of a larger order than the level k at which the tail index is estimated. Doing this, it was seen that the asymptotic variance of the new estimators could be kept equal to the one of the popular Hill estimators. In a similar way, we now introduce new classes of tail index and associated high quantile estimators, with an asymptotic mean squared error smaller than that of the classical ones for all k in a large class of heavy-tailed models. We derive their asymptotic distributional properties and compare them with those of alternative estimators. Next to that, an illustration of the finite sample behavior of the estimators is also provided through a Monte Carlo simulation study and the application to a set of real data in the field of insurance.     

Best linear unbiased and invariant estimation in location-scale families based on double-ranked set sampling

Abstract

In this article, we propose the best linear unbiased estimators (BLUEs) and best linear invariant estimators (BLIEs) for the unknown parameters of location-scale family of distributions based on double-ranked set sampling (DRSS) using perfect and imperfect rankings. These estimators are then compared with the BLUEs and BLIEs based on ranked set sampling (RSS). It is shown that under perfect ranking, the proposed estimators are uniformly better than the BLUEs and BLIEs obtained via RSS. We also propose the best linear unbiased quantile (BLUQ) and the best linear invariant quantile (BLIQ) estimators for normal distribution under DRSS. It is observed that the proposed quantile estimators are more efficient than the BLUQ and BLIQ estimators based on RSS for both perfect and imperfect orderings.     

Ordered ranked set samples and applications to inference

Ranked set sampling (RSS) was first proposed by McIntyre [1952. A method for unbiased selective sampling, using ranked sets. Australian J. Agricultural Res. 3, 385–390] as an effective way to estimate the unknown population mean. Chuiv and Sinha [1998. On some aspects of ranked set sampling in parametric estimation. In: Balakrishnan, N., Rao, C.R. (Eds.), Handbook of Statistics, vol. 17. Elsevier, Amsterdam, pp. 337–377] and Chen et al. [2004. Ranked Set Sampling—Theory and Application. Lecture Notes in Statistics, vol. 176. Springer, New York] have provided excellent surveys of RSS and various inferential results based on RSS. In this paper, we use the idea of order statistics from independent and non-identically distributed (INID) random variables to propose ordered ranked set sampling (ORSS) and then develop optimal linear inference based on ORSS. We determine the best linear unbiased estimators based on ORSS (BLUE-ORSS) and show that they are more efficient than BLUE-RSS for the two-parameter exponential, normal and logistic distributions. Although this is not the case for the one-parameter exponential distribution, the relative efficiency of the BLUE-ORSS (to BLUE-RSS) is very close to 1. Furthermore, we compare both BLUE-ORSS and BLUE-RSS with the BLUE based on order statistics from a simple random sample (BLUE-OS). We show that BLUE-ORSS is uniformly better than BLUE-OS, while BLUE-RSS is not as efficient as BLUE-OS for small sample sizes (n<5$n<5$).     

A cluster‐sample approach for Monte Carlo integration using multiple samplers

A computational problem in many fields is to estimate simultaneously multiple integrals and expectations, assuming that the data are generated by some Monte Carlo algorithm. Consider two scenarios in which draws are simulated from multiple distributions but the normalizing constants of those distributions may be known or unknown. For each scenario, existing estimators can be classified as using individual samples separately or using all the samples jointly. The latter pooled‐sample estimators are statistically more efficient but computationally more costly to evaluate than the separate‐sample estimators. We develop a cluster‐sample approach to obtain computationally effective estimators, after draws are generated for each scenario. We divide all the samples into mutually exclusive clusters and combine samples from each cluster separately. Furthermore, we exploit a relationship between estimators based on samples from different clusters to achieve variance reduction. The resulting estimators, compared with the pooled‐sample estimators, typically yield similar statistical efficiency but have reduced computational cost. We illustrate the value of the new approach by two examples for an Ising model and a censored Gaussian random field. The Canadian Journal of Statistics 41: 151–173; 2013 © 2012 Statistical Society of Canada     

Exact likelihood inference for two populations from two-parameter exponential distributions under joint Type-II censoring

In this article, we develop exact inference for two populations that have a two-parameter exponential distribution with the same location parameter and different scale parameters when Type-II censoring is implemented on the two samples in a combined manner. We obtain the conditional maximum likelihood estimators (MLEs) of the three parameters. We then derive the exact distributions of these MLEs along with their moment generating functions. Based on general entropy loss function, Bayesian study about the parameters is presented. Finally, some simulation results and an illustrative example are presented to illustrate the methods of inference developed here.     

Optimality in presence of damaged observations

In this paper we study a situation where, instead of observing $\text{y}\text{(N×1)}$, we observe $\text{y}\text{+}\text{d}$; where the random variables in the vector d are called damage components. It is shown that A- and E-optimum designs minimize the effect of d in the mean square error (m.s.e.) of estimable linear functions of parameters under the ordinary linear model.     

Point and Interval Estimation for a Generalized Logistic Distribution Under Progressive Type II Censoring

The likelihood equations based on a progressively Type II censored sample from a Type I generalized logistic distribution do not provide explicit solutions for the location and scale parameters. We present a simple method of deriving explicit estimators by approximating the likelihood equations appropriately. We examine numerically the bias and variance of these estimators and show that these estimators are as efficient as the maximum likelihood estimators (MLEs). The probability coverages of the pivotal quantities (for location and scale parameters) based on asymptotic normality are shown to be unsatisfactory, especially when the effective sample size is small. Therefore we suggest using unconditional simulated percentage points of these pivotal quantities for the construction of confidence intervals. A wide range of sample sizes and progressive censoring schemes have been considered in this study. Finally, we present a numerical example to illustrate the methods of inference developed here.     

Inference for the extreme value distribution under progressive Type-II censoring

The extreme value distribution has been extensively used to model natural phenomena such as rainfall and floods, and also in modeling lifetimes and material strengths. Maximum likelihood estimation (MLE) for the parameters of the extreme value distribution leads to likelihood equations that have to be solved numerically, even when the complete sample is available. In this paper, we discuss point and interval estimation based on progressively Type-II censored samples. Through an approximation in the likelihood equations, we obtain explicit estimators which are approximations to the MLEs. Using these approximate estimators as starting values, we obtain the MLEs using an iterative method and examine numerically their bias and mean squared error. The approximate estimators compare quite favorably to the MLEs in terms of both bias and efficiency. Results of the simulation study, however, show that the probability coverages of the pivotal quantities (for location and scale parameters) based on asymptotic normality are unsatisfactory for both these estimators and particularly so when the effective sample size is small. We, therefore, suggest the use of unconditional simulated percentage points of these pivotal quantities for the construction of confidence intervals. The results are presented for a wide range of sample sizes and different progressive censoring schemes. We conclude with an illustrative example.     

Representations of moments using lower-order conditional moments

Moments and central moments of a random variable X   are expressed as integrals of functions of lower-order conditional moments and the cumulative distribution of X$X$. In particular, sample central moments of order 2k$2k$ are expressed as the sum of between groups variations, providing an analogue to the analysis of variance. Similar expressions are obtained for the expectations of real-valued and measurable functions of X$X$.     

Approximate MLEs for the location and scale parameters of the skew logistic distribution

Azzalini (Scand J Stat 12:171–178, 1985) provided a methodology to introduce skewness in a normal distribution. Using the same method of Azzalini (1985), the skew logistic distribution can be easily obtained by introducing skewness to the logistic distribution. For the skew logistic distribution, the likelihood equations do not provide explicit solutions for the location and scale parameters. We present a simple method of deriving explicit estimators by approximating the likelihood equations appropriately. We examine numerically the bias and variance of these estimators and show that these estimators are as efficient as the maximum likelihood estimators (MLEs). The coverage probabilities of the pivotal quantities (for location and scale parameters) based on asymptotic normality are shown to be unsatisfactory, especially when the effective sample size is small. To improve the coverage probabilities and for constructing confidence intervals, we suggest the use of simulated percentage points. Finally, we present a numerical example to illustrate the methods of inference developed here.     

Stress-strength reliability estimation for exponentially distributed system with common minimum guarantee time

Abstract

In this article, we study the problem of estimating the stress-strength reliability, where the stress and strength variables follow independent exponential distributions with a common location parameter but different scale parameters. All parameters are assumed to be unknown. We derive the MLE, the UMVUE of the reliability parameter. We also derive the Bayes estimators considering conjugate prior distributions for the scale parameters and a dependent prior for the common location parameter. Monte Carlo simulations have been carried out to compare among the proposed estimators with respect to different loss functions.