Optimal Nonparametric Quantile Estimators. Towards a General Theory. A Survey

“Nonparametric” in the title is used to say that observations X ₁,…,X _n come from an unknown distribution F ∈ ? with ? being the class of all continuous and strictly increasing distribution functions. The problem is to estimate the quantile of a given order q ∈ (0,1) of the distribution F. The class ? of distributions is very large; it is so large that even X _nq:n , where nq is an integer, may be very poor estimator of the qth quantile. To assess the performance of estimators no properties based on moments may be used: expected values of estimators should be replaced by their medians, their variances—by some characteristics of concentration of distributions around the median. If an estimator is median-biased for one of distributions, the bias of the estimator may be infinitely large for other distributions. In the note optimal estimators with respect to various criteria of optimality are presented. The pivotal function F(T) of the estimator T is introduced which enables us to apply the classical statistical approach.     

A general non-central hypergeometric distribution

We construct a general non-central hypergeometric distribution, which models biased sampling without replacement. Our distribution is constructed from the combined order statistics of two samples: one of independent and identically distributed random variables with absolutely continuous distribution F and the other of independent and identically distributed random variables with absolutely continuous distribution G. The distribution depends on F and G only through F○G^{( ? 1)} (F composed with the quantile function of G), and the standard hypergeometric distribution and Wallenius’ non-central hypergeometric distribution arise as special cases. We show in efficient economic markets the quantity traded has a general non-central hypergeometric distribution.     

EMPIRICAL BAYES ESTIMATION WITH NON-IDENTICAL COMPONENTS. CONTINUOUS CASE.

In this paper a variant of the standard empirical Bayes estimation problem is considered where the component problems in the sequence are not identical in that the conditional distribution of the observations may vary with the component problems. Let {(Θ_n, X_n)} be a sequence of independent random vectors where Θ_n? G and, given Θ_n=Θ_n, X_n -P_Θ,m(n) with {m(n)} a sequence of positive integers where m(n)≤m? < ∞ for all n. With P_Θ,m in a continuous exponential family of distributions, asymptotically optimal empirical Bayes procedures are exhibited which depend on uniform approximations of certain functions on compact sets by polynomials in e^Θ. Such approximations have been explicitly calculated in the case of normal and gamma families. In the case of normal families, asymptotically optimal linear empirical Bayes estimators in the class of all linear estimators are derived and shown to have rate O(n^-1/2).     

Minimum-Distance Estimator for Stable Exponent

Assume that X ₁, X ₂,…, X _n is a sequence of i.i.d. random variables with α-stable distribution (α ∈ (0,2], the stable exponent, is the unknown parameter). We construct minimum distance estimators for α by minimizing the Kolmogorov distance or the Cramér–von-Mises distance between the empirical distribution function G _n , and a class of distributions defined based on the sum-preserving property of stable random variables. The minimum distance estimators can also be obtained by minimizing a U-statistic estimate of an empirical distribution function involving the stable exponent. They share the same invariance property with the maximum likelihood estimates. In this article, we prove the strong consistency of the minimum distance estimators. We prove the asymptotic normality of our estimators. Simulation study shows that the new estimators are competitive to the existing ones and perform very closely even to the maximum likelihood estimator.     

Estimators of location based on Kolmogorov-Smirnov-type statistics

Two classes of estimators of a location parameter ø₀ are proposed, based on a nonnegative functional H₁^* of the pair (D₁^ø_N, G^ø_N), where and where F_N is the sample distribution function. The estimators of the first class are defined as a value of ø minimizing H₁^*; the estimators of the second class are linearized versions of those of the first. The asymptotic distribution of the estimators is derived, and it is shown that the Kolmogorov-Smirnov statistic, the signed linear rank statistics, and the Cramérvon Mises statistics are special cases of such functionals H₁^*;. These estimators are closely related to the estimators of a shift in the two-sample case, proposed and studied by Boulanger in B2 (pp. 271–284).     

On testing more IFRA ordering-II

ABSTRACT

Suppose F and G are two life distribution functions. It is said that F is more IFRA (increasing failure rate average) than G (written by F ? _*G) if G^{? 1}F(x) is star-shaped on (0, ∞). In this paper, the problem of testing H₀: F = _*G against H₁: F ? _*G and F ≠ _*G is considered in both cases when G is known and when G is unknown. We propose a new test based on U-statistics and obtain the asymptotic distribution of the test statistics. The new test is compared with some well-known tests in the literature. In addition, we apply our test to a real data set in the context of reliability.     

Comparison of efficient L- and R-estimators of location

Scholz (1974) proved that the asymptotic variance of an R-estimator of location is no larger than that of an L-estimator when the observations come from a distribution G different from the distribution F for which the two estimators are efficient. This note extends this result to distributions F whose density has a first but no second derivative.     

Inference on progressive-stress model for the exponentiated exponential distribution under type-II progressive hybrid censoring

In this paper, progressive-stress accelerated life tests are applied when the lifetime of a product under design stress follows the exponentiated distribution [G(x)]^α. The baseline distribution, G(x), follows a general class of distributions which includes, among others, Weibull, compound Weibull, power function, Pareto, Gompertz, compound Gompertz, normal and logistic distributions. The scale parameter of G(x) satisfies the inverse power law and the cumulative exposure model holds for the effect of changing stress. A special case for an exponentiated exponential distribution has been discussed. Using type-II progressive hybrid censoring and MCMC algorithm, Bayes estimates of the unknown parameters based on symmetric and asymmetric loss functions are obtained and compared with the maximum likelihood estimates. Normal approximation and bootstrap confidence intervals for the unknown parameters are obtained and compared via a simulation study.     

A New Family of Nonparametric Quantile Estimators

A new core methodology for creating nonparametric L-quantile estimators is introduced and three new quantile L-estimators (SV1 _p , SV2 _p , and SV3 _p ) are constructed using the new methodology. Monte Carlo simulation was used in order to investigate the performance of the new estimators for small and large samples under normal distribution and a variety of light and heavy-tailed symmetric and asymmetric distributions. The new estimators outperform, in most of the cases studied, the Harrell–Davis quantile estimator and the weighted average at X _([np]) quantile estimator.     

On the asymptotic non‐equivalence of efficient‐GMM and MEL estimators in models with missing data

The generalized method of moments (GMM) and empirical likelihood (EL) are popular methods for combining sample and auxiliary information. These methods are used in very diverse fields of research, where competing theories often suggest variables satisfying different moment conditions. Results in the literature have shown that the efficient‐GMM (GMM_E) and maximum empirical likelihood (MEL) estimators have the same asymptotic distribution to order n^?1/2 and that both estimators are asymptotically semiparametric efficient. In this paper, we demonstrate that when data are missing at random from the sample, the utilization of some well‐known missing‐data handling approaches proposed in the literature can yield GMM_E and MEL estimators with nonidentical properties; in particular, it is shown that the GMM_E estimator is semiparametric efficient under all the missing‐data handling approaches considered but that the MEL estimator is not always efficient. A thorough examination of the reason for the nonequivalence of the two estimators is presented. A particularly strong feature of our analysis is that we do not assume smoothness in the underlying moment conditions. Our results are thus relevant to situations involving nonsmooth estimating functions, including quantile and rank regressions, robust estimation, the estimation of receiver operating characteristic (ROC) curves, and so on.     

A new compound class of log-logistic Weibull–Poisson distribution: model,properties and applications

A new class of distributions called the log-logistic Weibull–Poisson distribution is introduced and its properties are explored. This new distribution represents a more flexible model for lifetime data. Some statistical properties of the proposed distribution including the expansion of the density function, quantile function, hazard and reverse hazard functions, moments, conditional moments, moment generating function, skewness and kurtosis are presented. Mean deviations, Bonferroni and Lorenz curves, Rényi entropy and distribution of the order statistics are derived. Maximum likelihood estimation technique is used to estimate the model parameters. A simulation study is conducted to examine the bias, mean square error of the maximum likelihood estimators and width of the confidence interval for each parameter and finally applications of the model to real data sets are presented to illustrate the usefulness of the proposed distribution.     

Limiting distributions of Kolmogorov-Lévy-type statistics under the alternative

Let X_i, 1 ≤ i ≤ n, be independent identically distributed random variables with a common distribution function F, and let G be a smooth distribution function. We derive the limit distribution of □{ρ_α(F_n, G) - _α(F, G)}, where F_n is the empirical distribution function based on X₁,…,X_n and _α is a Kolmogorov-Lévy-type metric between distribution functions. For α ≤ 0 and two distribution functions F and G the metric p_α is given by p_α(F, G) = inf {? ≤ 0: G(x - α?) - ? F(x) ≤ G(x + α?) + ? for all x ?}.     

A class of distributions with the quadratic mean residual quantile function

Abstract

The present paper introduces a new family of distributions with quadratic mean residual quantile function. Various distributional properties as well as reliability characteristics are discussed. Some characterizations of the class of distributions are presented. The estimation of parameters of the model using method of L-moments is studied. The practical application of the class of models is illustrated with a real life data set.     

Precedence tests and Lehmann alternatives

G = F ^k (k > 1); G = 1 − (1−F) ^k (k < 1); G = F ^k (k < 1); and G = 1 − (1−F) ^k (k > 1), where F and G are two continuous cumulative distribution functions. If an optimal precedence test (one with the maximal power) is determined for one of these four classes, the optimal tests for the other classes of alternatives can be derived. Application of this is given using the results of Lin and Sukhatme (1992) who derived the best precedence test for testing the null hypothesis that the lifetimes of two types of items on test have the same distibution. The test has maximum power for fixed κ in the class of alternatives G = 1 − (1−F) ^k , with k < 1. Best precedence tests for the other three classes of Lehmann-type alternatives are derived using their results. Finally, a comparison of precedence tests with Wilcoxon's two-sample test is presented. Received: February 22, 1999; revised version: June 7, 2000     

Smooth tail-index estimation

The two parametric distribution functions appearing in the extreme-value theory – the generalized extreme-value distribution and the generalized Pareto distribution – have log-concave densities if the extreme-value index γ∈[?1, 0]. Replacing the order statistics in tail-index estimators by their corresponding quantiles from the distribution function that is based on the estimated log-concave density ? f _n leads to novel smooth quantile and tail-index estimators. These new estimators aim at estimating the tail index especially in small samples. Acting as a smoother of the empirical distribution function, the log-concave distribution function estimator reduces estimation variability to a much greater extent than it introduces bias. As a consequence, Monte Carlo simulations demonstrate that the smoothed version of the estimators are well superior to their non-smoothed counterparts, in terms of mean-squared error.     

Asymptotic joint distribution of sample quantiles and sample mean with applications

Based on a sample from an absolutely continuous distribution F with density f, and with the aid of the Bahadur (Ann. Math. Statist. 37( 1966 ), 577-580) representation of sample quantiles, the asymptotic joint distribution of three statistics, the sample p^th and q^th quantiles (0 < p < q < l) and the sample mean, is obtained. Using the Cramer-Wold device, asymptotic distributions of functions of the three statistics can be derived. In particular, the asymptotic joint distribution of the ratio of sample p^th quantile to sample mean and the ratio of sample q^th quantile to sample mean is presented. Finally, consistent estimators are proposed for the variances and covariances of these limiting distributions.     

NONPARAMETRIC QUANTILE ESTIMATION FROM RECORD-BREAKING DATA

Sometimes, in industrial quality control experiments and destructive stress testing, only values smaller than all previous ones are observed. Here we consider nonparametric quantile estimation, both the ‘sample quantile function’ and kernel-type estimators, from such record-breaking data. For a single record-breaking sample, consistent estimation is not possible except in the extreme tails of the distribution. Hence replication is required, and for m. such independent record-breaking samples the quantile estimators are shown to be strongly consistent and asymptotically normal as m-→∞. Also, for small m, the mean-squared errors, biases and smoothing parameters (for the smoothed estimators) are investigated through computer simulations.     

Robust empirical Bayes tests for continuous distributions

In this paper, we study the empirical Bayes two-action problem under linear loss function. Upper bounds on the regret of empirical Bayes testing rules are investigated. Previous results on this problem construct empirical Bayes tests using kernel type estimators of nonparametric functionals. Further, they have assumed specific forms, such as the continuous one-parameter exponential family for {F_θ:θΩ}, for the family of distributions of the observations. In this paper, we present a new general approach of establishing upper bounds (in terms of rate of convergence) of empirical Bayes tests for this problem. Our results are given for any family of continuous distributions and apply to empirical Bayes tests based on any type of nonparametric method of functional estimation. We show that our bounds are very sharp in the sense that they reduce to existing optimal or nearly optimal rates of convergence when applied to specific families of distributions.     

Behaviour of skewness, kurtosis and normality tests in long memory data

We establish the limiting distributions for empirical estimators of the coefficient of skewness, kurtosis, and the Jarque–Bera normality test statistic for long memory linear processes. We show that these estimators, contrary to the case of short memory, are neither ${\sqrt{n}}We establish the limiting distributions for empirical estimators of the coefficient of skewness, kurtosis, and the Jarque–Bera normality test statistic for long memory linear processes. We show that these estimators, contrary to the case of short memory, are neither ?n{\sqrt{n}}-consistent nor asymptotically normal. The normalizations needed to obtain the limiting distributions depend on the long memory parameter d. A direct consequence is that if data are long memory then testing normality with the Jarque–Bera test by using the chi-squared critical values is not valid. Therefore, statistical inference based on skewness, kurtosis, and the Jarque–Bera normality test, needs a rescaling of the corresponding statistics and computing new critical values of their nonstandard limiting distributions.     

Attainability of the Upper Bounds for the Mean Past Lifetime of Parallel System Components

Among reliability systems, one of the basic systems is a parallel system. In this article, we consider a parallel system consisting of n identical components with independent lifetimes having a common distribution function F. Under the condition that the system has failed by time t, with t being 100pth percentile of F(t = F ^?1(p), 0 < p < 1), we characterize the probability distributions based on the mean past lifetime of the components of the system. These distributions are described in the form of a specific shape on the left of t and arbitrary continuous function on the right tail.