Tests of fit for the Gumbel distribution: EDF-based tests against entropy-based tests

In this article, we propose some tests of fit based on sample entropy for the composite Gumbel (Extreme Value) hypothesis. The proposed test statistics are constructed using different entropy estimates. Through a Monte Carlo simulation, critical values of the test statistics for various sample sizes are obtained. Since the tests based on the empirical distribution function (EDF) are commonly used in practice, the power values of the entropy-based tests with those of the EDF tests are compared against various alternatives and different sample sizes. Finally, two real data sets are modeled by the Gumbel distribution.KEYWORDS: Entropy estimator, Gumbel distribution, Monte Carlo simulation, test power     

Monte Carlo comparison of five exponentiality tests using different entropy estimates

The paper studies five entropy tests of exponentiality using five statistics based on different entropy estimates. Critical values for various sample sizes determined by means of Monte Carlo simulations are presented for each of the test statistics. By simulation, we compare the power of these five tests for various alternatives and sample sizes.     

An extensive power evaluation of some tests for the inverse Gaussian distribution

Many applications of the Inverse Gaussian distribution, including numerous reliability and life testing results are presented in statistical literature. The paper studies the problem of using entropy tests to examine the goodness of fit of an Inverse Gaussian distribution with unknown parameters. Some entropy tests based on different entropy estimates are proposed. Critical values of the test statistics for various sample sizes are obtained by Monte Carlo simulations. Type I error of the tests is investigated and then power values of the tests are compared with the competing tests against various alternatives. Finally, recommendations for the application of the tests in practice are presented.     

Goodness-of-fit tests for Pareto distribution based on a characterization and their asymptotics

In this paper we present a new characterization of the Pareto distribution and consider goodness-of-fit tests based on it. We provide an integral and Kolmogorov–Smirnov-type statistics based on U-statistics and we calculate Bahadur efficiency for various alternatives. We find locally optimal alternatives for those tests. For small sample sizes, we compare the power of those tests with some common goodness-of-fit tests.     

On the behaviour of tests based on sample spacings for moderatesamples

We revisit the question about optimal performance of goodness-of-fit tests based on sample spacings. We reveal the importance of centering of the test-statistic and of the sample size when choosing a suitable test-statistic from a family of statistics based on power transformations of sample spacings. In particular, we find that a test-statistic based on empirical estimation of the Hellinger distance between hypothetical and data-supported distribution does possess some optimality properties for moderate sample sizes. These findings confirm earlier statements about the robust behaviour of the test-statistic based on the Hellinger distance and are in contrast to findings about the asymptotic (when sample size approaches infinity) of statistics such as Moran's and/or Greenwood's statistic. We include simulation results that support our findings.     

Tests of fit for the Laplace distribution based on correcting moments of entropy estimators

ABSTRACT

In this paper, we first consider the entropy estimators introduced by Vasicek [A test for normality based on sample entropy. J R Statist Soc, Ser B. 1976;38:54–59], Ebrahimi et al. [Two measures of sample entropy. Stat Probab Lett. 1994;20:225–234], Yousefzadeh and Arghami [Testing exponentiality based on type II censored data and a new cdf estimator. Commun Stat – Simul Comput. 2008;37:1479–1499], Alizadeh Noughabi and Arghami [A new estimator of entropy. J Iran Statist Soc. 2010;9:53–64], and Zamanzade and Arghami [Goodness-of-fit test based on correcting moments of modified entropy estimator. J Statist Comput Simul. 2011;81:2077–2093], and the nonparametric distribution functions corresponding to them. We next introduce goodness-of-fit test statistics for the Laplace distribution based on the moments of nonparametric distribution functions of the aforementioned estimators. We obtain power estimates of the proposed test statistics with Monte Carlo simulation and compare them with the competing test statistics against various alternatives. Performance of the proposed new test statistics is illustrated in real cases.     

An entropy-based test for goodness of fit of the von mises distribution

The maximum entropy characterization of the von Mises distribution on the circle is exploited to derive a consistent goodness of fit test for the von Mises distribution. Monte Carlo simulation results are tabulated giving critical values of the test statistic for various sample sizes and values of the concentration parameter. A power analysis is presented for various alternative hypotheses, comparing this entropy statistic to two other competing goodness of fit statistics. The entropy statistic is shown to compare favorably and may be more attractive, especially considering its ease of computation.     

A review of model selection procedures relevant to the weibull distribution

A number of goodness-of-fit and model selection procedures related to the Weibull distribution are reviewed. These procedures include probability plotting, correlation type goodness-of-fit tests, and chi-square goodness-of-fit tests. Also the Kolmogorow-Smirniv, Kuiper, and Cramer-Von Mises test statistics for completely specified hypothesis based on censored data are reviewed, and these test statistics based on complete samples for the unspecified parameters case are considered. Goodness-of-fit tests based on sample spacings, and a goodness-of-fit test for the Weibull process, is also discussed.

Model selection procedures for selecting between a Weibull and gamma model, a Weibull and lognormal model, and for selecting from among all three models are considered. Also tests of exponential versus Weibull and Weibull versus generalized gamma are mentioned.     

Goodness-of-fit tests for one-shot device accelerated life testing data

In this article, we develop a formal goodness-of-fit testing procedure for one-shot device testing data, in which each observation in the sample is either left censored or right censored. Such data are also called current status data. We provide an algorithm for calculating the nonparametric maximum likelihood estimate (NPMLE) of the unknown lifetime distribution based on such data. Then, we consider four different test statistics that can be used for testing the goodness-of-fit of accelerated failure time (AFT) model by the use of samples of residuals: a chi-square-type statistic based on the difference between the empirical and expected numbers of failures at each inspection time; two other statistics based on the difference between the NPMLE of the lifetime distribution obtained from one-shot device testing data and the distribution specified under the null hypothesis; as a final statistic, we use White's idea of comparing two estimators of the Fisher Information (FI) to propose a test statistic. We then compare these tests in terms of power, and draw some conclusions. Finally, we present an example to illustrate the proposed tests.     

Some count-based nonparametric tests for circular symmetry of a bivariate distribution

In this paper, we revisit the problem of testing of the hypothesis of circular symmetry of a bivariate distribution. We propose some nonparametric tests based on sector counts. These include tests based on chi-square goodness-of-fit test, the classical likelihood ratio, mean deviation, and the range. The proposed tests are easy to implement and the exact null distributions for small sample sizes of the test statistics are obtained. Two examples with small and large data sets are given to illustrate the application of the tests proposed. For small and moderate sample sizes, the performances of the proposed tests are evaluated using empirical powers (empirical sizes are also reported). Also, we evaluate the performance of these count-based tests with adaptations of several well-known tests such as the Kolmogorov–Smirnov-type tests, tests based on kernel density estimator, and the Wilcoxon-type tests. It is observed that among the count-based tests the likelihood ratio test performs better.     

An Estimator of Shannon Entropy of Beta-Generated Distributions and a Goodness-of-Fit Test

The aim of this article is twofold: on the one hand to introduce and study some of the statistical properties of an estimator for the Shannon entropy and on the other hand to develop a goodness-of-fit test for beta-generated distributions and the distribution of order statistics. Beta-generated distributions are a broad class of univariate distributions which has received great attention during the last 15 years, as it obeys nice properties and it extends the distribution of order statistics. The proposed estimator of Shannon entropy of beta-generated distributions is motivated by the respective Vasicek’s estimator, as the latter one is tailored to the class of the beta-generated distributions and the distribution of order statistics. The estimator of Shannon entropy is defined and its consistency is studied. It is, moreover, exploited to build a goodness-of-fit test for the beta-generated distribution and the distribution of order statistics. Simulations are performed to examine the small- and moderate-sample properties of the proposed estimator and to compare the power of the proposed test with the power of competitors under a variety of alternatives.     

A density-based empirical likelihood ratio goodness-of-fit test for the Rayleigh distribution and power comparison

The Rayleigh distribution has been used to model right skewed data. Rayleigh [On the resultant of a large number of vibrations of the some pitch and of arbitrary phase. Philos Mag. 1880;10:73–78] derived it from the amplitude of sound resulting from many important sources. In this paper, a new goodness-of-fit test for the Rayleigh distribution is proposed. This test is based on the empirical likelihood ratio methodology proposed by Vexler and Gurevich [Empirical likelihood ratios applied to goodness-of-fit tests based on sample entropy. Comput Stat Data Anal. 2010;54:531–545]. Consistency of the proposed test is derived. It is shown that the distribution of the proposed test does not depend on scale parameter. Critical values of the test statistic are computed, through a simulation study. A Monte Carlo study for the power of the proposed test is carried out under various alternatives. The performance of the test is compared with some well-known competing tests. Finally, an illustrative example is presented and analysed.     

Percentage points for directional anderson-darling goodness-of-fit tests

This paper discusses the problem of assessing the asymptotic distribution when parameters of the hypothesized distribution are estimated from a sample, pointing out a common mistake included in the paper by Sinclair, Spurr, and Ahmad (1990) which introduced two modifications of the Anderson-Darling goodness-of-fit test statistic. Their two test statistics modify the popular Anderson-Darling test statistic to be sensitive to departures of the fitted distribution from the true distribution in one or the other of the tails. This paper uses these new test statistics to develop tests of fit for the normal and exponential distributions. Easy to use formulas are given so the reader can perform these tests at any sample size without consulting exhaustive tables of percentage points. Finally a power study is given to demonstrate the test statistics’ viability against a broad range of alternatives.     

On testing the skew normal hypothesis

In this work two goodness-of-fit tests are proposed for the skew normal distribution, based on properties of this family of distributions and the sample correlation coefficient. The critical values for the tests are obtained by using Monte Carlo simulation for several sample sizes and levels of significance. The power of the proposed tests are compared with that of the tests studied by Mateu et al. (2007) and the one studied by Meintanis (2007) for several sample sizes and considering diverse alternatives. The results show that the proposed tests have greater power than those studied by Mateu et al. (2007) and Meintanis (2007) against some alternative distributions.     

New Goodness-of-Fit Tests Based on Sample Quantiles

In this article power divergences statistics based on sample quantiles are transformed in order to introduce new goodness-of-fit tests. Quantiles of the distribution of proposed statistics are calculated under uniformity, normality, and exponentiality. Several power comparisons are performed to show that the new tests are generally more powerful than the original ones.     

A Cautionary Note on the Use of the Grønnesby and Borgan Goodness-of-Fit Test for the Cox Proportional Hazards Model

Grønnesby and Borgan (1996, Lifetime Data Analysis 2, 315–328) propose an omnibus goodness-of-fit test for the Cox proportional hazards model. The test is based on grouping the subjects by their estimated risk score and comparing the number of observed and a model based estimated number of expected events within each group. We show, using extensive simulations, that even for moderate sample sizes the choice of number of groups is critical for the test to attain the specified size. In light of these results we suggest a grouping strategy under which the test attains the correct size even for small samples. The power of the test statistic seems to be acceptable when compared to other goodness-of-fit tests.     

Cumulative ratio information based on general cumulative entropy

In this paper, we suggest an extension of the cumulative residual entropy (CRE) and call it generalized cumulative entropy. The proposed entropy not only retains attributes of the existing uncertainty measures but also possesses the absolute homogeneous property with unbounded support, which the CRE does not have. We demonstrate its mathematical properties including the entropy of order statistics and the principle of maximum general cumulative entropy. We also introduce the cumulative ratio information as a measure of discrepancy between two distributions and examine its application to a goodness-of-fit test of the logistic distribution. Simulation study shows that the test statistics based on the cumulative ratio information have comparable statistical power with competing test statistics.     

Goodness-of-Fit Tests for the Skew-Normal Distribution When the Parameters Are Estimated from the Data

In this article, tests are developed which can be used to investigate the goodness-of-fit of the skew-normal distribution in the context most relevant to the data analyst, namely that in which the parameter values are unknown and are estimated from the data. We consider five test statistics chosen from the broad Cramér–von Mises and Kolmogorov–Smirnov families, based on measures of disparity between the distribution function of a fitted skew-normal population and the empirical distribution function. The sampling distributions of the proposed test statistics are approximated using Monte Carlo techniques and summarized in easy to use tabular form. We also present results obtained from simulation studies designed to explore the true size of the tests and their power against various asymmetric alternative distributions.     

Goodness-of-fit tests for the Pareto distribution based on its characterization

A new characterization of the Pareto distribution is proposed, and new goodness-of-fit tests based on it are constructed. Test statistics are functionals of U-empirical processes. The first of these statistics is of integral type, it is similar to the classical statistics \(\omega _n^1\). The second one is a Kolmogorov type statistic. We show that the kernels of our statistics are non-degenerate. The limiting distribution and large deviations asymptotics of the new statistics under null hypothesis are described. Their local Bahadur efficiency for parametric alternatives is calculated. This type of efficiency is mostly appropriate for the solution of our problem since the Kolmogorov type statistic is not asymptotically normal, and the Pitman approach is not applicable to this statistic. For the second statistic we evaluate the critical values by using Monte-Carlo methods. Also conditions of local optimality of new statistics in the sense of Bahadur are discussed and examples of such special alternatives are given. For small sample size we compare the power of those tests with some common goodness-of-fit tests.     

New tests based on Rubin's empirical distribution function

In this paper we derive some new tests for goodness-of-fit based on Rubin's empirical distribution function (EDF). Substituting Rubin's EDF for the classical EDF in the Kolmogorov–Smirnov, Cramér–von Mises, Anderson–Darling statistics, since Rubin's EDF for a given sample is a randomized distribution function, randomized statistics are derived, of which the qth quantile and the expectation are chosen as test statistics. We show that the new tests are consistent under simple hypothesis. Several power comparisons are also performed to show that the new tests are generally more powerful than the classical ones.