An adjusted cumulative Kullback-Leibler information with application to test of exponentiality

Abstract

In order to discriminate between two probability distributions extensions of Kullback–Leibler (KL) information have been proposed in the literature. In recent years, an extension called cumulative Kullback–Leibler (CKL) information is considered by authors which is closely related to equilibrium distributions. In this paper, we propose an adjusted version of CKL based on equilibrium distributions. Some properties of the proposed measure of divergence are investigated. A test of exponentiality based on the adjusted measure, is proposed. The empirical power of the presented test is calculated and compared with some existing standard tests of exponentiality. The results show that our proposed test, for some important alternative distributions, has better performance than some of the existing tests.     

Testing exponentiality based on Kullback—Leibler information for progressively Type II censored data

In many life-testing and reliability experiments, data are often censored in order to reduce the cost and time associated with testing and since the conventional Type-I and Type-II censoring schemes are not flexible enough, progressive censoring is developed by researchers. In this article, we develop a general goodness of fit test by using a new estimate of Kullback–Leibler information based on progressively Type-II censored data. Consistency and other properties of the proposed test are shown. Then, we use the proposed test statistic to test for exponentiality based on progressively Type-II censored data. The power values of the proposed test under different progressively Type-II censoring schemes are computed, through Monte Carlo simulations. It is observed that the proposed test is quite powerful in compared with the test proposed by Balakrishnan et al. (2007 Balakrishnan, N., Habibi Rad, A., and Arghami, N. R. (2007). Testing exponentiality based on Kullback–Leibler information with progressively type-II censored data. IEEE Transactions on Reliability 56:301–307. [Google Scholar]). Two real datasets from progressive censoring literature are finally presented for illustrative purpose.     

Goodness-of-fit test based on correcting moments of modified entropy estimator

In this paper, we first propose a new estimator of entropy for continuous random variables. Our estimator is obtained by correcting the coefficients of Vasicek's [A test for normality based on sample entropy, J. R. Statist. Soc. Ser. B 38 (1976), pp. 54–59] entropy estimator. We prove the consistency of our estimator. Monte Carlo studies show that our estimator is better than the entropy estimators proposed by Vasicek, Ebrahimi et al. [Two measures of sample entropy, Stat. Probab. Lett. 20 (1994), pp. 225–234] and Correa [A new estimator of entropy, Commun. Stat. Theory Methods 24 (1995), pp. 2439–2449] in terms of root mean square error. We then derive the non-parametric distribution function corresponding to our proposed entropy estimator as a piece-wise uniform distribution. We also introduce goodness-of-fit tests for testing exponentiality and normality based on the said distribution and compare its performance with their leading competitors.     

On the entropy estimators

The paper introduces an estimator of the entropy of a continuous random variable. The estimator is obtained by modifying the estimator proposed by Ebrahimi et al. [Two measures of sample entropy, Statist. Probab. Lett. 20 (1994), pp. 225–234]. The consistency of the estimator is proved and comparisons are made with Vasicek's estimator [A test for normality based on sample entropy, J. R. Stat. Soc. Ser. B 38 (1976), pp. 54–59], van Es estimator [Estimating functionals related to a density by class of statistics based on spacings, Scand. J. Statist. 19 (1992), pp. 61–72], Ebrahimi et al. estimator and Correa estimator [A new estimator of entropy, Comm. Statist. Theory Methods 24 (1995), pp. 2439–2449]. The results indicate that the proposed estimator has smaller mean-squared error than above estimators. A real example is presented and analysed.     

Tests of fit for the Laplace distribution based on correcting moments of entropy estimators

ABSTRACT

In this paper, we first consider the entropy estimators introduced by Vasicek [A test for normality based on sample entropy. J R Statist Soc, Ser B. 1976;38:54–59], Ebrahimi et al. [Two measures of sample entropy. Stat Probab Lett. 1994;20:225–234], Yousefzadeh and Arghami [Testing exponentiality based on type II censored data and a new cdf estimator. Commun Stat – Simul Comput. 2008;37:1479–1499], Alizadeh Noughabi and Arghami [A new estimator of entropy. J Iran Statist Soc. 2010;9:53–64], and Zamanzade and Arghami [Goodness-of-fit test based on correcting moments of modified entropy estimator. J Statist Comput Simul. 2011;81:2077–2093], and the nonparametric distribution functions corresponding to them. We next introduce goodness-of-fit test statistics for the Laplace distribution based on the moments of nonparametric distribution functions of the aforementioned estimators. We obtain power estimates of the proposed test statistics with Monte Carlo simulation and compare them with the competing test statistics against various alternatives. Performance of the proposed new test statistics is illustrated in real cases.     

An entropy test for the Rayleigh distribution and power comparison

In this paper, a goodness-of-fit test is proposed for the Rayleigh distribution. This test is based on the Kullback–Leibler discrimination methodology proposed by Song [2002, Goodness of fit tests based on Kullback–Leibler discrimination, IEEE Trans. Inf. Theory 48(5), pp. 1103–1117]. The critical values and powers for some alternatives are obtained by simulation. The proposed test is compared with other tests, namely Kolmogorov–Smirnov, Kuiper, Cramer–von Mises, Watson and Anderson–Darling. The use of the proposed test is shown in a real example.     

A Laguerre polynomial approximation for a goodness-of-fit test for exponential distribution based on progressively censored data

This paper proposes an approximation to the distribution of a goodness-of-fit statistic proposed recently by Balakrishnan et al. [Balakrishnan, N., Ng, H.K.T. and Kannan, N., 2002, A test of exponentiality based on spacings for progressively Type-II censored data. In: C. Huber-Carol et al. (Eds.), Goodness-of-Fit Tests and Model Validity (Boston: Birkhäuser), pp. 89–111.] for testing exponentiality based on progressively Type-II right censored data. The moments of this statistic can be easily calculated, but its distribution is not known in an explicit form. We first obtain the exact moments of the statistic using Basu's theorem and then the density approximants based on these exact moments of the statistic, expressed in terms of Laguerre polynomials, are proposed. A comparative study of the proposed approximation to the exact critical values, computed by Balakrishnan and Lin [Balakrishnan, N. and Lin, C.T., 2003, On the distribution of a test for exponentiality based on progressively Type-II right censored spacings. Journal of Statistical Computation and Simulation, 73 (4), 277–283.], is carried out. This reveals that the proposed approximation is very accurate.     

A modified test for testing exponentiality using transformed data

In this article, we present a test for testing uniformity. Based on the test, we provide a test for testing exponentiality. Empirical critical values for both the tests are computed. Both the tests are compared with the tests proposed by Noughabi and Arghami [H. Alizadeh Noughabi, and N.R. Arghami, Testing exponentiality using transformed data, J. Statist. Comput. Simul. 81 (4) (2011), pp. 511–516] using simulation experiments for a wide class of alternatives. The tests possess attractive power properties.     

ON ENTROPY BASED TESTS FOR EXPONENTIALITY

ABSTRACT

Recent literature has proposed a test for exponentiality based on sample entropy. We consider transformations of the observations which turn the test of exponentiality into one of uniformity and use a corresponding test based on entropy. The test based on the transformed variables performs better in many cases of interest.     

Testing the validity of the exponential model for hybrid Type-I censored data

The exponential distribution has been used in life-testing and reliability studies. In this article, we first express the entropy of Type-I hybrid censoring scheme in terms of hazard function and provide an estimate of the entropy of Type-I hybrid censored data. Then, we construct a goodness-of-fit test statistic based on Kullback–Leibler information for Type-I hybrid censored data. The test statistic is used to test for exponentiality. A Monte Carlo simulation is conducted to obtain the power of the proposed test against various alternatives. Finally, a data example is presented for illustrative purpose.     

Testing Exponentiality Based on Type II Censored Data and a New cdf Estimator

In this article, we use a new cdf estimator to obtain a nanparametric entropy estimate and use it for testing exponentiality and normality. We also use the new cdf estimator to estimate the joint entropy of the Type II censored data which we use for some goodness-of-fit tests based on Kullback–Leibler information and show, by simulation, that it compares favorably with the leading competitor.     

Comments on “Testing for NBUL using goodness of fit approach with applications” (Statistical Papers (2010) 51: 27–40, DOI 10.1007/s00362-007-0113-0)

We comment on a new testing procedure for testing exponentiality against NBUL alternatives. We show that the proposed test is inappropriate and point out the subtle flaw in the argument. The other deficiencies in the paper are also highlighted.     

On testing exponentiality against new better than used of specified age

R.M. Hollander, D.H. Park and F. Proschan [A class of life distributions for aging, J. Amer. Statist. Assoc. 81 (1986) 91–95] introduced the concept of the larger class of life distributions called new better than used of specified age. In practice, one might be interested in the new better than used behaviour at an unknown but estimable age t₀. Here, we investigate the testing of new better than used of specified age t₀ (NBU-t₀) alternatives. A class of test statistics for testing NBU-t₀ (t₀ is known) based on a U-statistic whose kernel depends on sub-sample minima is proposed. A member of the class of tests proposed by N. Ebrahimi and M. Habbibullah [Testing whether the survival distribution is new better than used of specified age, Biometrika 77 (1990) 212–215] for this problem belongs to the class of tests proposed here. The distributional properties of the class of test statistics are studied. The performances of a few members of the proposed class of tests are studied in terms of Pitman asymptotic relative efficiency. The Pitman ARE values show that the members of the class perform well in comparison with the N. Ebrahimi and M. Habbibullah [Testing whether the survival distribution is new better than used of specified age, Biometrika 77 (1990) 212–215] tests. The proposed class of tests is shown to be consistent for NBU-t₀ alternatives.     

Exponentiality Test Based on the Progressive Type II Censoring via Cumulative Entropy

In this article, we use cumulative residual Kullback-Leibler information (CRKL) and cumulative Kullback-Leibler information (CKL) to construct two goodness-of-fit test statistics for testing exponentiality with progressively Type-II censored data. The power of the proposed tests are compared with the power of goodness-of-fit test for exponentiality introduced by Balakrishnan et al. (2007 Balakrishnan, N., Habibi Rad, A., Arghami, N.R. (2007). Testing exponentiality based on Kullback-Leibler information with progressively type-II censored data. IEEE Transactions on Reliability 56(2):301–307.[Crossref], [Web of Science ®] , [Google Scholar]). We show that when the hazard function of the alternative is monotone decreasing, the test based on CRKL has higher power and when the hazard function of the alternative is non-monotone, the test based on CKL has higher power. But, when it is monotone increasing the power difference between test based on CKL and their proposed test is not so remarkable. The use of the proposed tests is shown in an illustrative example.     

On the distribution of a test for exponentiality based on progressively type-II right censored spacings

A test for exponentiality based on progressively Type-II right censored spacings has been proposed recently by Balakrishnan et al. (2002). They derived the asymptotic null distribution of the test statistic. In this work, we utilize the algorithm of Huffer and Lin (2001) to evaluate the exact null probabilities and the exact critical values of this test statistic.     

Correcting moments for goodness of fit tests based on two entropy estimates

The sample entropy (Vasicek, 1976) has been most widely used as a nonparametric entropy estimator due to its simplicity, but its underlying distribution function has not been known yet though its moments are required in establishing the entropy-based goodness of test statistic (Soofi et al., 1995). In this paper we derive the nonparametric distribution function of the sample entropy as a piece-wise uniform distribution in the lights of Theil (1980) and Dudwicz and van der Meulen (1987). Then we establish the entropy-based goodness of fit test statistics based on the nonparametric distribution functions of the sample entropy and modified sample entropy (Ebrahimi et al., 1994), and compare their performances for the exponential and normal distributions.     

A general long-term aging model with different underlying activation mechanisms: Modeling,Bayesian estimation,and case influence diagnostics

In this paper we propose a general cure rate aging model. Our approach enables different underlying activation mechanisms which lead to the event of interest. The number of competing causes of the event of interest is assumed to follow a logarithmic distribution. The model is parameterized in terms of the cured fraction which is then linked to covariates. We explore the use of Markov chain Monte Carlo methods to develop a Bayesian analysis for the proposed model. Moreover, some discussions on the model selection to compare the fitted models are given, as well as case deletion influence diagnostics are developed for the joint posterior distribution based on the ψ-divergence, which has several divergence measures as particular cases, such as the Kullback–Leibler (K-L), J-distance, L₁ norm, and χ²-square divergence measures. Simulation studies are performed and experimental results are illustrated based on a real malignant melanoma data.     

Measures of dependence for the multivariate t distribution with applications to the stock market

Two measures of dependence for multivariate t and Cauchy random variables are developed based on Kullback–Leibler number. The mutual information number T(X) is obtained in a closed expression form, as well as its asymptotic distribution. A dependence coefficient ρ₁, is defined (based on the Kullback–Leibler number) with the properties of ρ₁=0 indicating independence and ρ₁=1indicating degeneracy. Two real life examples from the stock market are used to analyze the level of dependence and correlation among stocks.     

Goodness-of-fit tests for exponentiality based on a loss-of-memory type functional equation

Three goodness-of-fit tests for exponentiality based on the functional equation characterization 1?F(2x)=[1?F(x)]² for every x?0 are proposed and shown to compare well to several popular tests against common alternative cdf's. Small-sample critical values for α=0.10,0.05 are developed for the two superior test statistics and the asymptotic null-distributions are characterized.     

Bayesian inference and diagnostics in zero-inflated generalized power series regression model

ABSTRACT

The paper provides a Bayesian analysis for the zero-inflated regression models based on the generalized power series distribution. The approach is based on Markov chain Monte Carlo methods. The residual analysis is discussed and case-deletion influence diagnostics are developed for the joint posterior distribution, based on the ψ-divergence, which includes several divergence measures such as the Kullback–Leibler, J-distance, L₁ norm, and χ²-square in zero-inflated general power series models. The methodology is reflected in a data set collected by wildlife biologists in a state park in California.