Characterizations Based on Cumulative Residual Entropy of First-Order Statistics

Two different distributions may have equal cumulative residual entropy (CRE), thus a distribution cannot be determined by its CRE. In this article, we explore properties of the CRE and study conditions under which the CRE of the first-order statistics can uniquely determines the parent distribution. Weibull family is characterized through ratio of the CRE of the first-order statistics to its expectation. We have also some bounds for the CRE of residual lifetime of a series system.     

On the dynamic cumulative residual entropy

Recently, Rao et al. [(2004) Cumulative residual entropy: a new measure of information. IEEE Trans. Inform. Theory 50(6), 1220–1228] have proposed a new measure of uncertainty, called cumulative residual entropy (CRE), in a distribution function F and obtained some properties and applications of that. In the present paper, we propose a dynamic form of CRE and obtain some of its properties. We show how CRE (and its dynamic version) is connected with well-known reliability measures such as the mean residual life time.     

Robust methods of estimation of regression coefficients 1

Recently, cumulative residual entropy (CRE) has been found to be a new measure of information that parallels Shannon's entropy (see Rao et al. [Cumulative residual entropy: A new measure of information, IEEE Trans. Inform. Theory. 50(6) (2004), pp. 1220–1228] and Asadi and Zohrevand [On the dynamic cumulative residual entropy, J. Stat. Plann. Inference 137 (2007), pp. 1931–1941]). Motivated by this finding, in this paper, we introduce a generalized measure of it, namely cumulative residual Renyi's entropy, and study its properties. We also examine it in relation to some applied problems such as weighted and equilibrium models. Finally, we extend this measure into the bivariate set-up and prove certain characterizing relationships to identify different bivariate lifetime models.     

Bivariate extension of (dynamic) cumulative past entropy

Recently, the concept of cumulative residual entropy (CRE) has been studied by many researchers in higher dimensions. In this article, we extend the definition of (dynamic) cumulative past entropy (DCPE), a dual measure of (dynamic) CRE, to bivariate setup and obtain some of its properties including bounds. We also look into the problem of extending DCPE for conditionally specified models. Several properties, including monotonicity, and bounds of DCPE are obtained for conditional distributions. It is shown that the proposed measure uniquely determines the distribution function. Moreover, we also propose a stochastic order based on this measure.     

The exponentiated exponential distribution: a survey

The exponentiated exponential distribution, a most attractive generalization of the exponential distribution, introduced by Gupta and Kundu (Aust. N. Z. J. Stat. 41:173–188, 1999) has received widespread attention. It appears, however, that many mathematical properties of this distribution have not been known or have not been known in simpler/general forms. In this paper, we provide a comprehensive survey of the mathematical properties. We derive expressions for the moment generating function, characteristic function, cumulant generating function, the nth moment, the first four moments, variance, skewness, kurtosis, the nth conditional moment, the first four cumulants, mean deviation about the mean, mean deviation about the median, Bonferroni curve, Lorenz curve, Bonferroni concentration index, Gini concentration index, Rényi entropy, Shannon entropy, cumulative residual entropy, Song’s measure, moments of order statistics, L moments, asymptotic distribution of the extreme order statistics, reliability, distribution of the sum of exponentiated exponential random variables, distribution of the product of exponentiated exponential random variables and the distribution of the ratio of exponentiated exponential random variables. We also discuss estimation by the method of maximum likelihood, including the case of censoring, and provide simpler expressions for the Fisher information matrix than those given by Gupta and Kundu. It is expected that this paper could serve as a source of reference for the exponentiated exponential distribution and encourage further research.     

On cumulative entropies

In analogy with the cumulative residual entropy recently proposed by Wang et al. [2003a. A new and robust information theoretic measure and its application to image alignment. In: Information Processing in Medical Imaging. Lecture Notes in Computer Science, vol. 2732, Springer, Heidelberg, pp. 388–400; 2003b. Cumulative residual entropy, a new measure of information and its application to image alignment. In: Proceedings on the Ninth IEEE International Conference on Computer Vision (ICCV’03), vol. 1, IEEE Computer Society Press, Silver Spring, MD, pp. 548–553], we introduce and study the cumulative entropy, which is a new measure of information alternative to the classical differential entropy. We show that the cumulative entropy of a random lifetime X can be expressed as the expectation of its mean inactivity time evaluated at X. Hence, our measure is particularly suitable to describe the information in problems related to ageing properties of reliability theory based on the past and on the inactivity times. Our results include various bounds to the cumulative entropy, its connection to the proportional reversed hazards model, and the study of its dynamic version that is shown to be increasing if the mean inactivity time is increasing. The empirical cumulative entropy is finally proposed to estimate the new information measure.     

Characterizations based on generalized cumulative residual entropy functions

The Shannon entropy and the cumulative residual entropy (CRE) of a random variable are useful tools in probability theory. Recently, a new concept called generalized cumulative residual entropy (GCRE) of order n was introduced and studied. It is related with the record values of a sequence of i.i.d. random variables and with the relevation transform. In this paper, we show that, under some assumptions, the GCRE function of a fixed order n uniquely determines the distribution function. Some characterizations of particular probability models are obtained from this general result.     

A quantile-based generalized dynamic cumulative measure of entropy

The cumulative residual entropy (CRE), introduced by Rao et al. (2004), is a new measure of uncertainty and viewed as a dynamic measure of uncertainty. Asadi and Zohrevand (2007) proposed a dynamic form of the CRE, namely dynamic CRE. Recently, Kumar and Taneja (2011) introduced a generalized dynamic CRE based on the Varma entropy introduced by Varma (1966) and called it dynamic CRE of order α and type β. In the present article, we introduce a quantile version of the dynamic CRE of order α and type β and study its properties. For this measure, we obtain some characterization results, aging classes properties, and stochastic comparisons.     

On the Choice of Nonparametric Entropy Estimator in Entropy-Based Goodness-of-Fit Test Statistics

Entropy-based goodness-of-fit test statistics can be established by estimating the entropy difference or Kullback–Leibler information, and several entropy-based test statistics based on various entropy estimators have been proposed. In this article, we first give comments on some problems resulting from not satisfying the moment constraints. We then study the choice of the entropy estimator by noting the reason why a test based on a better entropy estimator does not necessarily provide better powers.     

Testing the dilation order by using cumulative residual Tsallis entropy

In this paper, we introduce a new test for the dilation order based on cumulative residual Tsallis entropy of order α. The effect of the values of parameter α on the power of the test statistics is numerically investigated. The asymptotic distribution of the test statistic is given. The performance of the test statistic is evaluated using a simulation study. Finally, some numerical examples illustrating the theory are also given.     

Bivariate extension of generalized cumulative past entropy

The cumulative past entropy (CPE) of order α, a dual measure of cumulative residual entropy (CRE) of order α, has recently been proposed as a suitable extension of CPE. In this article, we extend the definition of (dynamic) CPE of order α (DCPE(α)) to bivariate setup and obtain some of its properties including bounds. We also look into the problem of extending DCPE(α) for conditionally specified models. Several properties, including monotonicity, and bounds of DCPE(α) are obtained for conditional distributions. Along with some characterization results it is shown that the proposed generalized measure uniquely determines the distribution function. Moreover, we also propose a stochastic order based on this measure and prove interrelation with some existing stochastic orders.     

Detection and Diagnosis of Distribution Changes of Degree Ratio in Complex Networks

The detection and diagnosis problems of distribution changes of degree ratio in complex networks are studied in this paper. We not only give the asymptotic expressions of the in-control and out-of-control average run lengths in detecting the distribution change by the cumulative sum chart, but also provide an effective and practicable method to transform the detection problem of the high dimensional Markov chain into a one-dimensional problem. Moreover, three multi-charts each based on the reference transition probabilities, the principal components, and the entropy statistics are presented to deal with the diagnosis problem. Finally, a real financial network which describes the dynamics and random correlations among 90 assets is investigated to demonstrate the detection and diagnosis performance of both the reference-free Cuscore chart and the multi-chart based on the entropy statistics.     

On the goodness-of-fit test based on the ratio of cumulative hazard functions with the Type II censored data

For comparing two cumulative hazard functions, we consider an extension of the Kullback–Leibler information to the cumulative hazard function, which is concerning the ratio of cumulative hazard functions. Then we consider its estimate as a goodness-of-fit test with the Type II censored data. For an exponential null distribution, the proposed test statistic is shown to outperform other test statistics based on the empirical distribution function in the heavy censoring case against the increasing hazard alternatives.     

Correcting moments for goodness of fit tests based on two entropy estimates

The sample entropy (Vasicek, 1976) has been most widely used as a nonparametric entropy estimator due to its simplicity, but its underlying distribution function has not been known yet though its moments are required in establishing the entropy-based goodness of test statistic (Soofi et al., 1995). In this paper we derive the nonparametric distribution function of the sample entropy as a piece-wise uniform distribution in the lights of Theil (1980) and Dudwicz and van der Meulen (1987). Then we establish the entropy-based goodness of fit test statistics based on the nonparametric distribution functions of the sample entropy and modified sample entropy (Ebrahimi et al., 1994), and compare their performances for the exponential and normal distributions.     

General cumulative Kullback–Leibler information

The cumulative residual Kullback–Leibler information is defined on the semi-infinite (non negative) interval. In this paper, we extend the cumulative residual Kullback–Leibler information to the whole real line and propose a general cumulative Kullback–Leibler information. We study its application to a test for normality in comparison with some competing test statistics based on the empirical distribution function including the well-known tests applied in practice like Kolmogorov–Smirnov, Cramer–von Mises, Anderson–Darling, and other existing tests.     

On testing homogeneity of variances for nonnormal models using entropy

This paper deals with testing equality of variances of observations in the different treatment groups assuming treatment effects are fixed. We study the distribution of a test statistic which is known to perform comparably well with other statistics for the same purpose under normality. The statistic we consider is based on Shannon’s entropy for a distribution function. We will derive the asymptotic expansion for the distribution of the test statistic based on Shannon’s entropy under nonnormality and numerically examine its performance in comparison with the modified likelihood ratio criteria for normal and some nonnormal populations.      

The logistic-X family of distributions and its applications

ABSTRACT

The logistic distribution has a prominent role in the theory and practice of statistics. We introduce a new family of continuous distributions generated from a logistic random variable called the logistic-X family. Its density function can be symmetrical, left-skewed, right-skewed, and reversed-J shaped, and can have increasing, decreasing, bathtub, and upside-down bathtub hazard rates shaped. Further, it can be expressed as a linear combination of exponentiated densities based on the same baseline distribution. We derive explicit expressions for the ordinary and incomplete moments, quantile and generating functions, Bonferroni and Lorenz curves, Shannon entropy, and order statistics. The model parameters are estimated by the method of maximum likelihood and the observed information matrix is determined. We also investigate the properties of one special model, the logistic-Fréchet distribution, and illustrate its importance by means of two applications to real data sets.     

Some new results on the cumulative residual entropy

The residual entropy function is a relevant dynamic measure of uncertainty in reliability and survival studies. Recently, Rao et al. [2004. Cumulative residual entropy: a new measure of information. IEEE Transactions on Information Theory 50, 1220–1228] and Asadi and Zohrevand [2007. On the dynamic cumulative residual entropy. Journal of Statistical Planning and Inference 137, 1931–1941] define the cumulative residual entropy and the dynamic cumulative residual entropy, respectively, as some new measures of uncertainty. They study some properties and applications of these measures showing how the cumulative residual entropy and the dynamic cumulative residual entropy are connected with the mean residual life function. In this paper, we obtain some new results on these functions. We also define and study the dynamic cumulative past entropy function. Some results are given connecting these measures of a lifetime distribution and that of the associated weighted distribution.     

Weighted extensions of generalized cumulative residual entropy and their applications

Abstract

In this paper, we consider weighted extensions of generalized cumulative residual entropy and its dynamic(residual) version. Our results include linear transformations, stochastic ordering, bounds, aging class properties and some relationships with other reliability concepts. We also define the conditional weighted generalized cumulative residual entropy and discuss some properties of its. For these concepts, we obtain some characterization results under some assumptions. Finally, we provide an estimator of the new information measure using empirical approach. In addition, we study large sample properties of this estimator.