Testing exponentiality using transformed data

In this paper, we introduce a test for uniformity and use it as the second stage of an exact goodness-of-fit test of exponentiality. By simulation, the powers of the proposed test under various alternatives are compared with exponentiality test based on Kullback–Leibler information proposed by Ebrahimi et al. [N. Ebrahimi, M. Habibullah, and E.S. Soofi, Testing exponentiality based on Kullback–Leiber information, J. R. Statist. Soc. Ser. B 54 (1992), pp. 739–748]. The results are impressive, i.e. the proposed test has higher power than the test based on entropy.     

General cumulative Kullback–Leibler information

The cumulative residual Kullback–Leibler information is defined on the semi-infinite (non negative) interval. In this paper, we extend the cumulative residual Kullback–Leibler information to the whole real line and propose a general cumulative Kullback–Leibler information. We study its application to a test for normality in comparison with some competing test statistics based on the empirical distribution function including the well-known tests applied in practice like Kolmogorov–Smirnov, Cramer–von Mises, Anderson–Darling, and other existing tests.     

Quantile-based cumulative Kullback–Leibler divergence

The paper introduces a quantile-based cumulative Kullback–Leibler divergence and study its various properties. Unlike the distribution function approach, the quantile-based measure possesses some unique properties. The quantile functions used in many applied works do not have any tractable distribution functions where the proposed measure is a useful tool to compute the distance between two random variables. Some useful bounds are obtained for quantile-based residual cumulative Kullback–Leibler divergence and quantile-based reliability measures. Characterization results based on the functional forms of quantile-based residual Kullback–Leibler divergence are obtained for some well-known life distributions, namely exponential, Pareto II and beta.     

An entropy test for the Rayleigh distribution and power comparison

In this paper, a goodness-of-fit test is proposed for the Rayleigh distribution. This test is based on the Kullback–Leibler discrimination methodology proposed by Song [2002, Goodness of fit tests based on Kullback–Leibler discrimination, IEEE Trans. Inf. Theory 48(5), pp. 1103–1117]. The critical values and powers for some alternatives are obtained by simulation. The proposed test is compared with other tests, namely Kolmogorov–Smirnov, Kuiper, Cramer–von Mises, Watson and Anderson–Darling. The use of the proposed test is shown in a real example.     

Testing for Covariate Effect in the Cox Proportional Hazards Regression Model

This article presents methods for testing covariate effect in the Cox proportional hazards model based on Kullback–Leibler divergence and Renyi's information measure. Renyi's measure is referred to as the information divergence of order γ (γ ≠ 1) between two distributions. In the limiting case γ → 1, Renyi's measure becomes Kullback–Leibler divergence. In our case, the distributions correspond to the baseline and one possibly due to a covariate effect. Our proposed statistics are simple transformations of the parameter vector in the Cox proportional hazards model, and are compared with the Wald, likelihood ratio and score tests that are widely used in practice. Finally, the methods are illustrated using two real-life data sets.     

A new estimator of Kullback–Leibler information and its application in goodness of fit tests*

We propose here a general statistic for the goodness of fit test of statistical distributions. The proposed statistic is constructed based on an estimate of Kullback–Leibler information. The proposed test is consistent and the limiting distribution of the test statistic is derived. Then, the established results are used to introduce goodness of fit tests for the normal, exponential, Laplace and Weibull distributions. A simulation study is carried out for examining the power of the proposed test and to compare it with those of some existing procedures. Finally, some illustrative examples are presented and analysed, and concluding comments are made.     

Goodness-of-fit tests for lifetime distributions based on Type II censored data

In this article, the general test statistic introduced by Alizadeh Noughabi and Balakrishnan [Goodness of fit using a new estimate of Kullback-Leibler information based on Type II censored data. IEEE Trans Reliab. 2015;64:627–635.] is applied for testing goodness of fit of lifetime distributions based on Type II censored data. The test statistic is constructed based on an estimate of Kullback–Leibler (KL) information. We investigate the properties of the proposed test statistic such as the test statistic is nonnegative, just like KL information. We apply this test statistic to following distributions: Exponential, Weibull, Log-normal and Pareto. The critical values and Type I error of the proposed tests are obtained. It is shown that the proposed tests have an excellent Type I error and hence can be used confidently in practice. Then, by Monte Carlo simulations, the power values of the proposed tests are computed against several alternatives and compared with those of the existing tests. Finally, some real-world reliability data are used for illustrative purpose.     

Goodness-of-fit tests based on Verma Kullback–Leibler information

In this article, a new consistent estimator of Veram’s entropy is introduced. We establish the entropy test based on the new information namely Verma Kullback–Leibler discrimination methodology. The results are used to introduce goodness-of-fit tests for normal and exponential distributions. The root of mean square errors, critical values, and powers for some alternatives are obtained by simulation. The proposed test is compared with other tests.     

Testing Exponentiality Based on Type II Censored Data and a New cdf Estimator

In this article, we use a new cdf estimator to obtain a nanparametric entropy estimate and use it for testing exponentiality and normality. We also use the new cdf estimator to estimate the joint entropy of the Type II censored data which we use for some goodness-of-fit tests based on Kullback–Leibler information and show, by simulation, that it compares favorably with the leading competitor.     

Testing exponentiality based on Kullback—Leibler information for progressively Type II censored data

In many life-testing and reliability experiments, data are often censored in order to reduce the cost and time associated with testing and since the conventional Type-I and Type-II censoring schemes are not flexible enough, progressive censoring is developed by researchers. In this article, we develop a general goodness of fit test by using a new estimate of Kullback–Leibler information based on progressively Type-II censored data. Consistency and other properties of the proposed test are shown. Then, we use the proposed test statistic to test for exponentiality based on progressively Type-II censored data. The power values of the proposed test under different progressively Type-II censoring schemes are computed, through Monte Carlo simulations. It is observed that the proposed test is quite powerful in compared with the test proposed by Balakrishnan et al. (2007 Balakrishnan, N., Habibi Rad, A., and Arghami, N. R. (2007). Testing exponentiality based on Kullback–Leibler information with progressively type-II censored data. IEEE Transactions on Reliability 56:301–307. [Google Scholar]). Two real datasets from progressive censoring literature are finally presented for illustrative purpose.     

Testing for Homogeneity in Mixture Using Weighted Relative Entropy

In this article, we propose a test for homogeneity based on Kullback–Leibler information (also known as relative entropy). Though widely used in hypothesis testing problems, Kullback–Leibler information is not desirable to many researchers in the context of mixture because of its complicated form. In this article, a weighted relative entropy test (WE test), which has closed form expression in terms of the parameter estimators, is proposed. Theoretical results show that this test is consistent. Some simulation results demonstrate that the WE test is better than some leading tests when the mixture components come from normal distribution, and is competitive with them in the Poisson case. The usage of the test is illustrated in an example with data about acidity index of lakes.     

General treatment of goodness-of-fit tests based on Kullback–Leibler information

This paper introduces a general goodness-of-fit test based on the estimated Kullback–Leibler information. The test uses the Vasicek entropy estimate. Two special cases of the test for location–scale and shape families are discussed. The results are used to introduce goodness-of-fit tests for the uniform, Laplace, Weibull and beta distributions. The critical values and powers for some alternatives are obtained by simulation.     

Testing the validity of the exponential model for hybrid Type-I censored data

The exponential distribution has been used in life-testing and reliability studies. In this article, we first express the entropy of Type-I hybrid censoring scheme in terms of hazard function and provide an estimate of the entropy of Type-I hybrid censored data. Then, we construct a goodness-of-fit test statistic based on Kullback–Leibler information for Type-I hybrid censored data. The test statistic is used to test for exponentiality. A Monte Carlo simulation is conducted to obtain the power of the proposed test against various alternatives. Finally, a data example is presented for illustrative purpose.     

Information theoretic results for circular distributions

The broad class of generalized von Mises (GvM) circular distributions has certain optimal properties with respect to information theoretic quantities. It is shown that, under constraints on the trigonometric moments, and using the Kullback–Leibler information as the measure, the closest circular distribution to any other is of the GvM form. The lower bounds for the Kullback–Leibler information in this situation are also provided. The same problem is also considered using a modified version of the Kullback–Leibler information. Finally, series expansions are given for the entropy and the normalizing constants of the GvM distribution.     

Influential observation in complex normal data for problems in allometry

Abstract

The aim of this paper is to investigate how some results related to the complex normal distribution are relevant in size and shape analysis. Our main focus is on the derivation of influential measures. In particular, Cook and Kullback–Leibler distances are combined with their respective asymptotic results as well as to an alternative process of defining cut-off points. Some numerical examples illustrate how these measures are used in practice. We perform an application to simulated and actual data. Results provide evidence that the methodology based on Kullback–Leibler distance outperforms one in terms of the Cook classic distance.     

Fitting time series models for longitudinal survey data under informative sampling

The purpose of this paper is to account for informative sampling in fitting time series models, and in particular an autoregressive model of order one, for longitudinal survey data. The idea behind the proposed approach is to extract the model holding for the sample data as a function of the model in the population and the first-order inclusion probabilities, and then fit the sample model using maximum-likelihood, pseudo-maximum-likelihood and estimating equations methods. A new test for sampling ignorability is proposed based on the Kullback–Leibler information measure. Also, we investigate the issue of the sensitivity of the sample model to incorrect specification of the conditional expectations of the sample inclusion probabilities. The simulation study carried out shows that the sample-likelihood-based method produces better estimators than the pseudo-maximum-likelihood method, and that sensitivity to departures from the assumed model is low. Also, we find that both the conventional t-statistic and the Kullback–Leibler information statistic for testing of sampling ignorability perform well under both informative and noninformative sampling designs.     

Exponentiality Test Based on the Progressive Type II Censoring via Cumulative Entropy

In this article, we use cumulative residual Kullback-Leibler information (CRKL) and cumulative Kullback-Leibler information (CKL) to construct two goodness-of-fit test statistics for testing exponentiality with progressively Type-II censored data. The power of the proposed tests are compared with the power of goodness-of-fit test for exponentiality introduced by Balakrishnan et al. (2007 Balakrishnan, N., Habibi Rad, A., Arghami, N.R. (2007). Testing exponentiality based on Kullback-Leibler information with progressively type-II censored data. IEEE Transactions on Reliability 56(2):301–307.[Crossref], [Web of Science ®] , [Google Scholar]). We show that when the hazard function of the alternative is monotone decreasing, the test based on CRKL has higher power and when the hazard function of the alternative is non-monotone, the test based on CKL has higher power. But, when it is monotone increasing the power difference between test based on CKL and their proposed test is not so remarkable. The use of the proposed tests is shown in an illustrative example.     

Exponentiality test based on Renyi distance between equilibrium distributions

ABSTRACT

On the basis of Csiszar's φ-divergence discrimination information, we propose a measure of discrepancy between equilibriums associated with two distributions. Proving that a distribution can be characterized by associated equilibrium distribution, a Renyi distance of the equilibrium distributions is constructed that made us to propose an EDF-based goodness-of-fit test for exponential distribution. For comparing the performance of the proposed test, some well-known EDF-based tests and some entropy-based tests are considered. Based on the simulation results, the proposed test has better powers than those of competing entropy-based tests for the alternatives with decreasing hazard rate function. The use of the proposed test is evaluated in an illustrative example.     

Uncertainty,information, and disagreement of economic forecasters

ABSTRACT

An information framework is proposed for studying uncertainty and disagreement of economic forecasters. This framework builds upon the mixture model of combining density forecasts through a systematic application of the information theory. The framework encompasses the measures used in the literature and leads to their generalizations. The focal measure is the Jensen–Shannon divergence of the mixture which admits Kullback–Leibler and mutual information representations. Illustrations include exploring the dynamics of the individual and aggregate uncertainty about the US inflation rate using the survey of professional forecasters (SPF). We show that the normalized entropy index corrects some of the distortions caused by changes of the design of the SPF over time. Bayesian hierarchical models are used to examine the association of the inflation uncertainty with the anticipated inflation and the dispersion of point forecasts. Implementation of the information framework based on the variance and Dirichlet model for capturing uncertainty about the probability distribution of the economic variable are briefly discussed.     

Selection of linear mixed-effects models for clustered data

We consider model selection for linear mixed-effects models with clustered structure, where conditional Kullback–Leibler (CKL) loss is applied to measure the efficiency of the selection. We estimate the CKL loss by substituting the empirical best linear unbiased predictors (EBLUPs) into random effects with model parameters estimated by maximum likelihood. Although the BLUP approach is commonly used in predicting random effects and future observations, selecting random effects to achieve asymptotic loss efficiency concerning CKL loss is challenging and has not been well studied. In this paper, we propose addressing this difficulty using a conditional generalized information criterion (CGIC) with two tuning parameters. We further consider a challenging but practically relevant situation where the number, $m$, of clusters does not go to infinity with the sample size. Hence the random-effects variances are not consistently estimable. We show that via a novel decomposition of the CKL risk, the CGIC achieves consistency and asymptotic loss efficiency, whether $m$ is fixed or increases to infinity with the sample size. We also conduct numerical experiments to illustrate the theoretical findings.