An adjusted cumulative Kullback-Leibler information with application to test of exponentiality

Abstract

In order to discriminate between two probability distributions extensions of Kullback–Leibler (KL) information have been proposed in the literature. In recent years, an extension called cumulative Kullback–Leibler (CKL) information is considered by authors which is closely related to equilibrium distributions. In this paper, we propose an adjusted version of CKL based on equilibrium distributions. Some properties of the proposed measure of divergence are investigated. A test of exponentiality based on the adjusted measure, is proposed. The empirical power of the presented test is calculated and compared with some existing standard tests of exponentiality. The results show that our proposed test, for some important alternative distributions, has better performance than some of the existing tests.     

Exponentiality test based on alpha-divergence and gamma-divergence

In the present paper, we use the already defined alpha-divergence and gamma-divergence for constructing some goodness of fit tests for exponentiality. These divergence measures are very robust with respect to outliers. Since the existence of outliers among statistical data can be lead to misleading results, therefore utilizing these divergence measures can be of importance. In order to construct test statistics, two estimators are used for alpha-divergence and gamma-divergence. In the first one, we consider the alpha-divergence and gamma-divergence of the equilibrium distribution function, which is well defined on the empirical distribution function (EDF) and is proposed as an EDF-based goodness of fit test statistic. The second one is an estimator in manner of Vasicek entropy estimator. Simulation results indicate that in comparison with the other tests statistics, our mentioned test statistics almost in most of the cases have higher power. Finally, two examples containing outliers illustrate the importance and use of the proposed tests.     

A NEW TEST FOR EQUALITY OF VARIANCES FOR k NORMAL POPULATIONS

ABSTRACT

A simple test based on Gini's mean difference is proposed to test the hypothesis of equality of population variances. Using 2000 replicated samples and empirical distributions, we show that the test compares favourably with Bartlett's and Levene's test for the normal population. Also, it is more powerful than Bartlett's and Levene's tests for some alternative hypotheses for some non-normal distributions and more robust than the other two tests for large sample sizes under some alternative hypotheses. We also give an approximate distribution to the test statistic to enable one to calculate the nominal levels and P-values.     

Testing the Fit of Gamma Distributions Using the Empirical Moment Generating Function

ABSTRACT

This article presents goodness-of-fit tests for two and three-parameter gamma distributions that are based on minimum quadratic forms of standardized logarithmic differences of values of the moment generating function and its empirical counterpart. The test statistics can be computed without reliance to special functions and have asymptotic chi-squared distributions. Monte Carlo simulations are used to compare the proposed test for the two-parameter gamma distribution with goodness-of-fit tests employing empirical distribution function or spacing statistics. Two data sets are used to illustrate the various tests.     

Testing the homogeneity of risk differences with sparse count data

ABSTRACT

In this paper, we consider testing the homogeneity of risk differences in independent binomial distributions especially when data are sparse. We point out some drawback of existing tests in either controlling a nominal size or obtaining powers through theoretical and numerical studies. The proposed test is designed to avoid the drawbacks of existing tests. We present the asymptotic null distribution and asymptotic power function for the proposed test. We also provide numerical studies including simulations and real data examples showing the proposed test has reliable results compared to existing testing procedures.     

Tests of fit for the Gumbel distribution: EDF-based tests against entropy-based tests

In this article, we propose some tests of fit based on sample entropy for the composite Gumbel (Extreme Value) hypothesis. The proposed test statistics are constructed using different entropy estimates. Through a Monte Carlo simulation, critical values of the test statistics for various sample sizes are obtained. Since the tests based on the empirical distribution function (EDF) are commonly used in practice, the power values of the entropy-based tests with those of the EDF tests are compared against various alternatives and different sample sizes. Finally, two real data sets are modeled by the Gumbel distribution.KEYWORDS: Entropy estimator, Gumbel distribution, Monte Carlo simulation, test power     

On zero-distorted generalized geometric distribution

ABSTRACT

We propose a new generalized geometric distribution which permits inflation/deflation of the zero count probability and study some of its properties. We also present an actuarial application of this distribution and fit it to three datasets used by other researchers. It is observed that the proposed distribution fits reasonably well to these data. Further, in a regression setup, the performance of this distribution is studied vis–a–vis other competing distributions used for explaining variability in a response variable.     

A random weighting approach for posterior distributions

ABSTRACT

In Bayesian theory, calculating a posterior probability distribution is highly important but typically difficult. Therefore, some methods have been proposed to deal with such problem, among which, the most popular one is the asymptotic expansions of posterior distributions. In this paper, we propose an alternative approach, named a random weighting method, for scaled posterior distributions, and give an ideal convergence rate, o(n^{( ? 1/2)}), which serves as the theoretical guarantee for methods of numerical simulations.     

Goodness of fit tests for Nakagami distribution based on smooth tests

ABSTRACT

Nakagami distribution is one of the most common distributions used to model positive valued and right skewed data. In this study, we interest goodness of fit problem for Nakagami distribution. Thus, we propose smooth tests for Nakagami distribution based on orthonormal functions. We also compare these tests with some classical goodness of fit tests such as Cramer–von Mises, Anderson–Darling, and Kolmogorov–Smirnov tests in respect to type-I error rates and powers of tests. Simulation study indicates that smooth tests give better results than these classical tests give in respect to almost all cases considered.     

A Modified Kolmogorov–Smirnov Test for Normality

In this article we propose an improvement of the Kolmogorov-Smirnov test for normality. In the current implementation of the Kolmogorov-Smirnov test, given data are compared with a normal distribution that uses the sample mean and the sample variance. We propose to select the mean and variance of the normal distribution that provide the closest fit to the data. This is like shifting and stretching the reference normal distribution so that it fits the data in the best possible way. A study of the power of the proposed test indicates that the test is able to discriminate between the normal distribution and distributions such as uniform, bimodal, beta, exponential, and log-normal that are different in shape but has a relatively lower power against the student's, t-distribution that is similar in shape to the normal distribution. We also compare the performance (both in power and sensitivity to outlying observations) of the proposed test with existing normality tests such as Anderson–Darling and Shapiro–Francia.     

THE LOG-EIG DISTRIBUTION: A NEW PROBABILITY MODEL FOR LIFETIME DATA

ABSTRACT

In this paper, we propose a new probability model called the log-EIG distribution for lifetime data analysis. Some important properties of the proposed model and maximum likelihood estimation of its parameters are discussed. Its relationship with the exponential inverse Gaussian distribution is similar to that of the lognormal and the normal distributions. Through applications to well-known datasets, we show that the log-EIG distribution competes well, and in some instances even provides a better fit than the commonly used lifetime models such as the gamma, lognormal, Weibull and inverse Gaussian distributions. It can accommodate situations where an increasing failure rate model is required as well as those with a decreasing failure rate at larger times.     

Correcting moments for goodness of fit tests based on two entropy estimates

The sample entropy (Vasicek, 1976) has been most widely used as a nonparametric entropy estimator due to its simplicity, but its underlying distribution function has not been known yet though its moments are required in establishing the entropy-based goodness of test statistic (Soofi et al., 1995). In this paper we derive the nonparametric distribution function of the sample entropy as a piece-wise uniform distribution in the lights of Theil (1980) and Dudwicz and van der Meulen (1987). Then we establish the entropy-based goodness of fit test statistics based on the nonparametric distribution functions of the sample entropy and modified sample entropy (Ebrahimi et al., 1994), and compare their performances for the exponential and normal distributions.     

A Conway Maxwell Poisson type generalization of the negative hypergeometric distribution

Abstract

Negative hypergeometric distribution arises as a waiting time distribution when we sample without replacement from a finite population. It has applications in many areas such as inspection sampling and estimation of wildlife populations. However, as is well known, the negative hypergeometric distribution is over-dispersed in the sense that its variance is greater than the mean. To make it more flexible and versatile, we propose a modified version of negative hypergeometric distribution called COM-Negative Hypergeometric distribution (COM-NH) by introducing a shape parameter as in the COM-Poisson and COMP-Binomial distributions. It is shown that under some limiting conditions, COM-NH approaches to a distribution that we call the COM-Negative binomial (COMP-NB), which in turn, approaches to the COM Poisson distribution. For the proposed model, we investigate the dispersion characteristics and shape of the probability mass function for different combinations of parameters. We also develop statistical inference for this model including parameter estimation and hypothesis tests. In particular, we investigate some properties such as bias, MSE, and coverage probabilities of the maximum likelihood estimators for its parameters by Monte Carlo simulation and likelihood ratio test to assess shape parameter of the underlying model. We present illustrative data to provide discussion.     

Analysis of over-dispersed count data with extra zeros using the Poisson log-skew-normal distribution

ABSTRACT

Mixed Poisson distributions are widely used in various applications of count data mainly when extra variation is present. This paper introduces an extension in terms of a mixed strategy to jointly deal with extra-Poisson variation and zero-inflated counts. In particular, we propose the Poisson log-skew-normal distribution which utilizes the log-skew-normal as a mixing prior and present its main properties. This is directly done through additional hierarchy level to the lognormal prior and includes the Poisson lognormal distribution as its special case. Two numerical methods are developed for the evaluation of associated likelihoods based on the Gauss–Hermite quadrature and the Lambert's W function. By conducting simulation studies, we show that the proposed distribution performs better than several commonly used distributions that allow for over-dispersion or zero inflation. The usefulness of the proposed distribution in empirical work is highlighted by the analysis of a real data set taken from health economics contexts.     

The impact of fat-tailed distributions on some leading unit roots tests

There is substantial evidence that many time series associated with financial and insurance claim data are fat-tailed, with a (much) higher probability of " outliers' compared with the normal distribution. However, standard tests, or variants of them, for the presence of unit roots assume a normal distribution for the innovations driving the series. Application of the former to the latter therefore involves an inconsistency. We assess the impact of this inconsistency and provide information on its impact on inference when innovations are drawn from the Cauchy and sequence of t(v) distributions. A simple prediction that fat tails will uniformly lead to over-sizing of standard tests (because the fatness in the tail translates to the test distribution) turns out to be incorrect: we find that some tests are over-sized but some are under-sized. We also consider size retention and the power of the Dickey-Fuller pivotal and normalized bias test statistics and weighted symmetric versions of these tests. To make the unit root testing procedure feasible, we develop an entropy-based test for some fat-tailed distributions and apply it to share prices from the FTSE100.     

On entropy-based goodness-of-fit test for asymmetric Student-t and exponential power distributions

This paper examines the goodness-of-fit (GOF) test for a generalized asymmetric Student-t distribution (ASTD) and asymmetric exponential power distribution (AEPD). These distributions are known to include a broad class of distribution families and are quite suitable to modelling the innovations of financial time series. Despite their popularity, to our knowledge, no studies in the literature have so far investigated their affinity and differences in implementation. To fill this gap, we examine the empirical power behaviour of entropy-based GOF tests for hypotheses wherein the ASTD and AEPD play the role of null and alternative distributions. Our findings through a simulation study and real data analysis indicate that the two distributions are generally hard to distinguish and that the ASTD family accommodates AEPDs to a greater degree than the other way around for larger samples.     

Permutation Tests for Comparing Inequality Measures

ABSTRACT

Asymptotic and bootstrap tests for inequality measures are known to perform poorly in finite samples when the underlying distribution is heavy-tailed. We propose Monte Carlo permutation and bootstrap methods for the problem of testing the equality of inequality measures between two samples. Results cover the Generalized Entropy class, which includes Theil’s index, the Atkinson class of indices, and the Gini index. We analyze finite-sample and asymptotic conditions for the validity of the proposed methods, and we introduce a convenient rescaling to improve finite-sample performance. Simulation results show that size correct inference can be obtained with our proposed methods despite heavy tails if the underlying distributions are sufficiently close in the upper tails. Substantial reduction in size distortion is achieved more generally. Studentized rescaled Monte Carlo permutation tests outperform the competing methods we consider in terms of power.     

Estimation of the parameters of the Gompertz distribution under the first failure-censored sampling plan

This article presents the goodness-of-fit tests for the Laplace distribution based on its maximum entropy characterization result. The critical values of the test statistics estimated by Monte Carlo simulations are tabulated for various window and sample sizes. The test statistics use an entropy estimator depending on the window size; so, the choice of the optimal window size is an important problem. The window sizes for yielding the maximum power of the tests are given for selected sample sizes. Power studies are performed to compare the proposed tests with goodness-of-fit tests based on the empirical distribution function. Simulation results report that entropy-based tests have consistently higher power than EDF tests against almost all alternatives considered.     

An empirical likelihood ratio based goodness-of-fit test for Inverse Gaussian distributions

The Inverse Gaussian (IG) distribution is commonly introduced to model and examine right skewed data having positive support. When applying the IG model, it is critical to develop efficient goodness-of-fit tests. In this article, we propose a new test statistic for examining the IG goodness-of-fit based on approximating parametric likelihood ratios. The parametric likelihood ratio methodology is well-known to provide powerful likelihood ratio tests. In the nonparametric context, the classical empirical likelihood (EL) ratio method is often applied in order to efficiently approximate properties of parametric likelihoods, using an approach based on substituting empirical distribution functions for their population counterparts. The optimal parametric likelihood ratio approach is however based on density functions. We develop and analyze the EL ratio approach based on densities in order to test the IG model fit. We show that the proposed test is an improvement over the entropy-based goodness-of-fit test for IG presented by Mudholkar and Tian (2002). Theoretical support is obtained by proving consistency of the new test and an asymptotic proposition regarding the null distribution of the proposed test statistic. Monte Carlo simulations confirm the powerful properties of the proposed method. Real data examples demonstrate the applicability of the density-based EL ratio goodness-of-fit test for an IG assumption in practice.     

A new test for two-sample location problem based on empirical distribution function

We propose a new test for testing the equality of location parameter of two populations based on empirical distribution function (ECDF). The test statistics is obtained as a power divergence between two ECDFs. The test is shown to be distribution free, and its null distribution is obtained. We conducted empirical power comparison of the proposed test with several other available tests in the literature. We found that the proposed test performs better than its competitors considered here under several population structures. We also used two real datasets to illustrate the procedure.