New estimators of distribution functions

ABSTRACT

This article considers the estimation of a distribution function F_X(x) based on a random sample X₁, X₂, …, X_n when the sample is suspected to come from a close-by distribution F₀(x). The new estimators, namely the preliminary test (PTE) and Stein-type estimator (SE) are defined and compared with the “empirical distribution function” (edf) under local departure. In this case, we show that Stein-type estimators are superior to edf and PTE is superior to edf when it is close to F₀(x). As a by-product similar estimators are proposed for population quantiles.     

BAHADUR SLOPES FOR COMPARISONS OF TESTS BASED ON RESAMPLING

Let X₁,…, X_n be random variables symmetric about θ from a common unknown distribution F_θ(x) =F(x–θ). To test the null hypothesis H₀:θ= 0 against the alternative H₁:θ > 0, permutation tests can be used at the cost of computational difficulties. This paper investigates alternative tests that are computationally simpler, notably some bootstrap tests which are compared with permutation tests. Of these the symmetrical bootstrap-f test competes very favourably with the permutation test in terms of Bahadur asymptotic efficiency, so it is a very attractive alternative.     

Sign test based on k-tuple general ranked set samples

ABSTRACT

The sign test based on the k-tuple ranked set samples is discussed here. We first derive the distribution of the k-tuple ranked set sample sign test statistic, and then the asymptotic distribution is also obtained. We then compare its performance with its counterparts based on simple random sample and classical ranked set sample. The asymptotic relative efficiency and the power are then derived. Finally, the effect of imperfect ranking on the procedure is assessed.     

A Bivariate Distribution Family with Specified Correlation Coefficient and Given Marginals

For given continuous distribution functions F(x) and G(y) and a Pearson correlation coefficient ρ, an algorithm is provided to construct a sequence of continuous bivariate distributions with marginals equal to F(x) and G(y) and the corresponding correlation coefficient converges to ρ. The algorithm can be easily implemented using S-Plus or R. Applications are given to generate bivariate random variables with marginals including Gamma, Beta, Weibull, and uniform distributions.     

Simultaneous estimation of several CDF’s: homogeneity constraint

Let {x_ij(1 ? j ? n_i)|i = 1, 2, …, k} be k independent samples of size n_j from respective distributions of functions F_j(x)(1 ? j ? k). A classical statistical problem is to test whether these k samples came from a common distribution function, F(x) whose form may or may not be known. In this paper, we consider the complementary problem of estimating the distribution functions suspected to be homogeneous in order to improve the basic estimator known as “empirical distribution function” (edf), in an asymptotic setup. Accordingly, we consider four additional estimators, namely, the restricted estimator (RE), the preliminary test estimator (PTE), the shrinkage estimator (SE), and the positive rule shrinkage estimator (PRSE) and study their characteristic properties based on the mean squared error (MSE) and relative risk efficiency (RRE) with tables and graphs. We observed that for k ? 4, the positive rule SE performs uniformly better than both shrinkage and the unrestricted estimator, while PTEs works reasonably well for k < 4.     

A measure of general functional dependence between two continuous variables

Existing measures in the literature that are specifically concerned with testing and measuring independence between two continuous variables are all based on examining the definition of independence, i.e., F_XY(x, y) = F_X(x)F_Y(y). A new measure is constructed uniquely in this paper that uses the absolute value of first difference on adjacent ranks of one variable with respect to the other. This measure captures the degree of functional dependence attributable to the amount of randomness and the complexity of the underlying bivariate dependence structure in a commensurate way that existing coefficients are incapable of. As a test statistic of independence, this measure is shown to have comparable or better power than existing statistics against a wide range of alternative hypotheses that consist of functional and multivalued relational dependence with additive noise.     

Tests of symmetry based on transformed empirical processes

A probability distribution function F is said to be symmetric when 1 ‐ F(x) ‐ F(‐x) = 0 for all x∈ R. Given a sequence of alternatives contiguous to a certain symmetric F₀, the authors are concerned with testing for the null hypothesis of symmetry. The proposed tests are consistent against any nonsymmetric alternative, and their power with respect to the given sequence can easily be optimized. The tests are constructed by means of transformed empirical processes with an adequate selection of the underlying isometry, and the optimum power is obtained by suitably choosing the score functions. The test statistics are very easy to compute and their asymptotic distributions are simple.     

Asymptotic Properties of Random Weighted Empirical Distribution Function

This article studies the asymptotic properties of the random weighted empirical distribution function of independent random variables. Suppose X₁, X₂, ???, X_n is a sequence of independent random variables, and this sequence is not required to be identically distributed. Denote the empirical distribution function of the sequence by F_n(x). Based on the random weighting method and F_n(x), the random weighted empirical distribution function H_n(x) is constructed and the asymptotic properties of H_n are discussed. Under weak conditions, the Glivenko–Cantelli theorem and the central limit theorem for the random weighted empirical distribution function are obtained. The obtained results have also been applied to study the distribution functions of random errors of multiple sensors.     

Kolmogorov-type tests of goodness-of-fit against stochastic ordering

This article addresses the problem of testing the null hypothesis H₀ that a random sample of size n is from a distribution with the completely specified continuous cumulative distribution function F_n(x). Kolmogorov-type tests for H₀ are based on the statistics C⁺ _n = Sup[F_n(x)?F₀(x)] and C^? _n=Sup[F₀(x)?F_n(x)], where F_n(x) is an empirical distribution function. Let F(x) be the true cumulative distribution function, and consider the ordered alternative H₁: F(x)≥F₀(x) for all x and with strict inequality for some x. Although it is natural to reject H₀ and accept H₁ if C ⁺ _n is large, this article shows that a test that is superior in some ways rejects F₀ and accepts H₁ if C^mdash _n is small. Properties of the two tests are compared based on theoretical results and simulated results.     

Data depth‐based nonparametric scale tests

Liu and Singh (1993, 2006) introduced a depth‐based d‐variate extension of the nonparametric two sample scale test of Siegel and Tukey (1960). Liu and Singh (2006) generalized this depth‐based test for scale homogeneity of k ≥ 2 multivariate populations. Motivated by the work of Gastwirth (1965), we propose k sample percentile modifications of Liu and Singh's proposals. The test statistic is shown to be asymptotically normal when k = 2, and compares favorably with Liu and Singh (2006) if the underlying distributions are either symmetric with light tails or asymmetric. In the case of skewed distributions considered in this paper the power of the proposed tests can attain twice the power of the Liu‐Singh test for d ≥ 1. Finally, in the k‐sample case, it is shown that the asymptotic distribution of the proposed percentile modified Kruskal‐Wallis type test is χ² with k ? 1 degrees of freedom. Power properties of this k‐sample test are similar to those for the proposed two sample one. The Canadian Journal of Statistics 39: 356–369; 2011 © 2011 Statistical Society of Canada     

Nonparametric Prediction Intervals for Future Order Statistics in a Proportional Hazard Model

Consider k independent random samples with different sample sizes such that the ith sample comes from the cumulative distribution function (cdf) F _i  = 1 ? (1 ? F)^{α _i} , where α _i is a known positive constant and F is an absolutely continuous cdf. Also, suppose that we have observed the maximum and minimum of the first k samples. This article shows how one can construct the nonparametric prediction intervals for the order statistics of the future samples on the basis of these information. Three schemes are studied and in each case exact expressions for the prediction coefficients of prediction intervals are derived. Numerical computations are given for illustrating the results. Also, a comparison study is done while the complete samples are available.     

Testing for equivalence of variances using Hartley's ratio

Hartley's test for homogeneity of k normal‐distribution variances is based on the ratio between the maximum sample variance and the minimum sample variance. In this paper, the author uses the same statistic to test for equivalence of k variances. Equivalence is defined in terms of the ratio between the maximum and minimum population variances, and one concludes equivalence when Hartley's ratio is small. Exact critical values for this test are obtained by using an integral expression for the power function and some theoretical results about the power function. These exact critical values are available both when sample sizes are equal and when sample sizes are unequal. One related result in the paper is that Hartley's test for homogeneity of variances is no longer unbiased when the sample sizes are unequal. The Canadian Journal of Statistics 38: 647–664; 2010 © 2010 Statistical Society of Canada     

Kernel Estimators for Distribution Functions on Dependent Random Fields

Consider observations (representing lifelengths) taken on a random field indexed by lattice points. Estimating the distribution function F(x) = P(X _i  ≤ x) is an important problem in survival analysis. We propose to estimate F(x) by kernel estimators, which take into account the smoothness of the distribution function. Under some general mixing conditions, our estimators are shown to be asymptotically unbiased and consistent. In addition, the proposed estimator is shown to be strongly consistent and sharp rates of convergence are obtained.     

Limiting distributions of Kolmogorov-Lévy-type statistics under the alternative

Let X_i, 1 ≤ i ≤ n, be independent identically distributed random variables with a common distribution function F, and let G be a smooth distribution function. We derive the limit distribution of □{ρ_α(F_n, G) - _α(F, G)}, where F_n is the empirical distribution function based on X₁,…,X_n and _α is a Kolmogorov-Lévy-type metric between distribution functions. For α ≤ 0 and two distribution functions F and G the metric p_α is given by p_α(F, G) = inf {? ≤ 0: G(x - α?) - ? F(x) ≤ G(x + α?) + ? for all x ?}.     

OPTIMAL SEMIPARAMETRIC INFERENCE FOR THE TAIL INDEX BASED ON RATIOS OF THE LARGEST EXTREMES

The k largest order statistics in a random sample from a common heavy‐tailed parent distribution with a regularly varying tail can be characterized as Fréchet extremes. This paper establishes that consecutive ratios of such Fréchet extremes are mutually independent and distributed as functions of beta random variables. The maximum likelihood estimator of the tail index based on these ratios is derived, and the exact distribution of the maximum likelihood estimator is determined for fixed k, and the asymptotic distribution as k →∞ . Inferential procedures based upon the maximum likelihood estimator are shown to be optimal. The Fréchet extremes are not directly observable, but a feasible version of the maximum likelihood estimator is equivalent to Hill's statistic. A simple diagnostic is presented that can be used to decide on the largest value of k for which an assumption of Fréchet extremes is sustainable. The results are illustrated using data on commercial insurance claims arising from fires and explosions, and from hurricanes.     

Bayesian prediction of order statistics with fixed and random sample sizes based on k-record values from Pareto distribution

In this paper, the two-parameter Pareto distribution is considered and the problem of prediction of order statistics from a future sample and that of its geometric mean are discussed. The Bayesian approach is applied to construct predictors based on observed k-record values for the cases when the future sample size is fixed and when it is random. Several Bayesian prediction intervals are derived. Finally, the results of a simulation study and a numerical example are presented for illustrating all the inferential procedures developed here.     

Test for the equality of several correlation coefficients

We derive two C(α) statistics and the likelihood-ratio statistic for testing the equality of several correlation coefficients, from k ≥ 2 independent random samples from bivariate normal populations. The asymptotic relationship of the C(α) tests, the likelihood-ratio test, and a statistic based on the normality assumption of Fisher's Z-transform of the sample correlation coefficient is established. A comparative performance study, in terms of size and power, is then conducted by Monte Carlo simulations. The likelihood-ratio statistic is often too liberal, and the statistic based on Fisher's Z-transform is conservative. The performance of the two C(α) statistics is identical. They maintain significance level well and have almost the same power as the other statistics when empirically calculated critical values of the same size are used. The C(α) statistic based on a noniterative estimate of the common correlation coefficient (based on Fisher's Z-transform) is recommended.     

A permutation test approach to the choice of size k for the nearest neighbors classifier

The k nearest neighbors (k-NN) classifier is one of the most popular methods for statistical pattern recognition and machine learning. In practice, the size k, the number of neighbors used for classification, is usually arbitrarily set to one or some other small numbers, or based on the cross-validation procedure. In this study, we propose a novel alternative approach to decide the size k. Based on a k-NN-based multivariate multi-sample test, we assign each k a permutation test based Z-score. The number of NN is set to the k with the highest Z-score. This approach is computationally efficient since we have derived the formulas for the mean and variance of the test statistic under permutation distribution for multiple sample groups. Several simulation and real-world data sets are analyzed to investigate the performance of our approach. The usefulness of our approach is demonstrated through the evaluation of prediction accuracies using Z-score as a criterion to select the size k. We also compare our approach to the widely used cross-validation approaches. The results show that the size k selected by our approach yields high prediction accuracies when informative features are used for classification, whereas the cross-validation approach may fail in some cases.     

On testing more IFRA ordering-II

ABSTRACT

Suppose F and G are two life distribution functions. It is said that F is more IFRA (increasing failure rate average) than G (written by F ? _*G) if G^{? 1}F(x) is star-shaped on (0, ∞). In this paper, the problem of testing H₀: F = _*G against H₁: F ? _*G and F ≠ _*G is considered in both cases when G is known and when G is unknown. We propose a new test based on U-statistics and obtain the asymptotic distribution of the test statistics. The new test is compared with some well-known tests in the literature. In addition, we apply our test to a real data set in the context of reliability.