Some new results on the cumulative residual entropy

The residual entropy function is a relevant dynamic measure of uncertainty in reliability and survival studies. Recently, Rao et al. [2004. Cumulative residual entropy: a new measure of information. IEEE Transactions on Information Theory 50, 1220–1228] and Asadi and Zohrevand [2007. On the dynamic cumulative residual entropy. Journal of Statistical Planning and Inference 137, 1931–1941] define the cumulative residual entropy and the dynamic cumulative residual entropy, respectively, as some new measures of uncertainty. They study some properties and applications of these measures showing how the cumulative residual entropy and the dynamic cumulative residual entropy are connected with the mean residual life function. In this paper, we obtain some new results on these functions. We also define and study the dynamic cumulative past entropy function. Some results are given connecting these measures of a lifetime distribution and that of the associated weighted distribution.     

Robust methods of estimation of regression coefficients 1

Recently, cumulative residual entropy (CRE) has been found to be a new measure of information that parallels Shannon's entropy (see Rao et al. [Cumulative residual entropy: A new measure of information, IEEE Trans. Inform. Theory. 50(6) (2004), pp. 1220–1228] and Asadi and Zohrevand [On the dynamic cumulative residual entropy, J. Stat. Plann. Inference 137 (2007), pp. 1931–1941]). Motivated by this finding, in this paper, we introduce a generalized measure of it, namely cumulative residual Renyi's entropy, and study its properties. We also examine it in relation to some applied problems such as weighted and equilibrium models. Finally, we extend this measure into the bivariate set-up and prove certain characterizing relationships to identify different bivariate lifetime models.     

Weighted extensions of generalized cumulative residual entropy and their applications

Abstract

In this paper, we consider weighted extensions of generalized cumulative residual entropy and its dynamic(residual) version. Our results include linear transformations, stochastic ordering, bounds, aging class properties and some relationships with other reliability concepts. We also define the conditional weighted generalized cumulative residual entropy and discuss some properties of its. For these concepts, we obtain some characterization results under some assumptions. Finally, we provide an estimator of the new information measure using empirical approach. In addition, we study large sample properties of this estimator.     

A quantile-based generalized dynamic cumulative measure of entropy

The cumulative residual entropy (CRE), introduced by Rao et al. (2004), is a new measure of uncertainty and viewed as a dynamic measure of uncertainty. Asadi and Zohrevand (2007) proposed a dynamic form of the CRE, namely dynamic CRE. Recently, Kumar and Taneja (2011) introduced a generalized dynamic CRE based on the Varma entropy introduced by Varma (1966) and called it dynamic CRE of order α and type β. In the present article, we introduce a quantile version of the dynamic CRE of order α and type β and study its properties. For this measure, we obtain some characterization results, aging classes properties, and stochastic comparisons.     

A Dynamic Discrimination Information Based On Cumulative Residual Entropy And Its Properties

In this article, we introduce a measure of discrepancy between two life-time distributions based on cumulative residual entropy. The dynamic form of this measure is considered and some of its properties are obtained. The relations between dynamic form and some well-known concepts in reliability such as mean residual life-time, hazard rate order, and new better (worse) than used are studied.     

Characterizations based on generalized cumulative residual entropy functions

The Shannon entropy and the cumulative residual entropy (CRE) of a random variable are useful tools in probability theory. Recently, a new concept called generalized cumulative residual entropy (GCRE) of order n was introduced and studied. It is related with the record values of a sequence of i.i.d. random variables and with the relevation transform. In this paper, we show that, under some assumptions, the GCRE function of a fixed order n uniquely determines the distribution function. Some characterizations of particular probability models are obtained from this general result.     

On cumulative entropies

In analogy with the cumulative residual entropy recently proposed by Wang et al. [2003a. A new and robust information theoretic measure and its application to image alignment. In: Information Processing in Medical Imaging. Lecture Notes in Computer Science, vol. 2732, Springer, Heidelberg, pp. 388–400; 2003b. Cumulative residual entropy, a new measure of information and its application to image alignment. In: Proceedings on the Ninth IEEE International Conference on Computer Vision (ICCV’03), vol. 1, IEEE Computer Society Press, Silver Spring, MD, pp. 548–553], we introduce and study the cumulative entropy, which is a new measure of information alternative to the classical differential entropy. We show that the cumulative entropy of a random lifetime X can be expressed as the expectation of its mean inactivity time evaluated at X. Hence, our measure is particularly suitable to describe the information in problems related to ageing properties of reliability theory based on the past and on the inactivity times. Our results include various bounds to the cumulative entropy, its connection to the proportional reversed hazards model, and the study of its dynamic version that is shown to be increasing if the mean inactivity time is increasing. The empirical cumulative entropy is finally proposed to estimate the new information measure.     

On weighted generalized entropy

In the literature of information theory, the concept of generalized entropy has been proposed and the length-based shift dependent information measure has been studied. In this paper, the concept of weighted generalized entropy has been introduced. The properties of weighted generalized residual entropy and weighted generalized past entropy are also discussed.     

On the dynamic cumulative residual entropy

Recently, Rao et al. [(2004) Cumulative residual entropy: a new measure of information. IEEE Trans. Inform. Theory 50(6), 1220–1228] have proposed a new measure of uncertainty, called cumulative residual entropy (CRE), in a distribution function F and obtained some properties and applications of that. In the present paper, we propose a dynamic form of CRE and obtain some of its properties. We show how CRE (and its dynamic version) is connected with well-known reliability measures such as the mean residual life time.     

Some Results on Dynamic Generalized Survival Entropy

Recently, Zografos and Nadarajah (2005 Zografos, K., Nadarajah, S. (2005). Survival exponential entropies. IEEE Trans. Inform. Theor. 51:1239–1246.[Crossref], [Web of Science ®] , [Google Scholar]) proposed two measures of uncertainty based on the survival function, called the survival exponential entropy and the generalized survival exponential entropy. In this article, we explore properties of the generalized survival entropy and the dynamic version of it. We study conditions under which the generalized survival entropy of first order statistic can uniquely determines the parent distribution. The exponential, Pareto, and finite range distributions, which are commonly used in reliability, have been characterized using this generalized measure. Another measure of entropy is also introduced in analogy with cumulative entropy which has been proposed by Di Crescenzo and Longobardi (2009) and some properties of it are given.     

Bivariate extension of generalized cumulative past entropy

The cumulative past entropy (CPE) of order α, a dual measure of cumulative residual entropy (CRE) of order α, has recently been proposed as a suitable extension of CPE. In this article, we extend the definition of (dynamic) CPE of order α (DCPE(α)) to bivariate setup and obtain some of its properties including bounds. We also look into the problem of extending DCPE(α) for conditionally specified models. Several properties, including monotonicity, and bounds of DCPE(α) are obtained for conditional distributions. Along with some characterization results it is shown that the proposed generalized measure uniquely determines the distribution function. Moreover, we also propose a stochastic order based on this measure and prove interrelation with some existing stochastic orders.     

On generalized conditional cumulative residual inaccuracy measure

Abstract

Recently, the notion of cumulative residual Rényi’s entropy has been proposed in the literature as a measure of information that parallels Rényi’s entropy. Motivated by this, here we introduce a generalized measure of it, namely cumulative residual inaccuracy of order α. We study the proposed measure for conditionally specified models of two components having possibly different ages called generalized conditional cumulative residual inaccuracy measure. Several properties of generalized conditional cumulative residual inaccuracy measure including the effect of monotone transformation are investigated. Further, we provide some bounds on using the usual stochastic order and characterize some bivariate distributions using the concept of conditional proportional hazard rate model.     

Cumulative ratio information based on general cumulative entropy

In this paper, we suggest an extension of the cumulative residual entropy (CRE) and call it generalized cumulative entropy. The proposed entropy not only retains attributes of the existing uncertainty measures but also possesses the absolute homogeneous property with unbounded support, which the CRE does not have. We demonstrate its mathematical properties including the entropy of order statistics and the principle of maximum general cumulative entropy. We also introduce the cumulative ratio information as a measure of discrepancy between two distributions and examine its application to a goodness-of-fit test of the logistic distribution. Simulation study shows that the test statistics based on the cumulative ratio information have comparable statistical power with competing test statistics.     

Bivariate extension of (dynamic) cumulative past entropy

Recently, the concept of cumulative residual entropy (CRE) has been studied by many researchers in higher dimensions. In this article, we extend the definition of (dynamic) cumulative past entropy (DCPE), a dual measure of (dynamic) CRE, to bivariate setup and obtain some of its properties including bounds. We also look into the problem of extending DCPE for conditionally specified models. Several properties, including monotonicity, and bounds of DCPE are obtained for conditional distributions. It is shown that the proposed measure uniquely determines the distribution function. Moreover, we also propose a stochastic order based on this measure.     

Characterization results based on dynamic Tsallis cumulative residual entropy

In this article, the concept of cumulative residual entropy (CRE) given by Rao et al. (2004 Rao, M., Chen, Y., Vemuri, B.C., Wang, F. (2004). Cumulative residual entropy: A new measure of information. IEEE Trans. Inf. Theory 50:1220–1228.[Crossref], [Web of Science ®] , [Google Scholar]) is extended to Tsallis entropy function and dynamic version, both residual and past of it. We study some properties and characterization results for these generalized measures. In addition, we provide some characterization results of the first-order statistic based on the Tsallis survival entropy.     

Renyi's entropy for residual lifetime distribution

In the present paper, we introduce and study Renyi's information measure (entropy) for residual lifetime distributions. It is shown that the proposed measure uniquely determines the distribution. We present characterizations for some lifetime models. Further, we define two new classes of life distributions based on this measure. Various properties of these classes are also given.     

Dynamic version of weighted cumulative residual entropy

Some extensions of Shannon entropy to the survival function have been recently proposed. Misagh et al. (2011 Misagh, F., Panahi, Y., Yari, G.H., Shahi, R. (2011, September). Weighted cumulative entropy and its estimation. In: Quality and Reliability (ICQR), 2011, IEEE International conference (pp. 477–480), IEEE.[Crossref] , [Google Scholar]) introduced weighted cumulative residual entropy (WCRE) that was studied more by Mirali et al. (2015 Mirali, M., Baratpour, S., Fakoor, V. (2015). On weighted cumulative residual entropy. Commun. Stat. Theory Methods. doi:10.1080103610926.2015.1053932.[Web of Science ®] , [Google Scholar]). In this article, the dynamic version of WCRE is proposed. Some relationships of this measure with well-known reliability measures and ageing classes are studied and some characterization results for exponential and Rayleigh distributions are provided. Also, a non parametric estimation of dynamic version of WCRE is introduced and its asymptotic behavior is investigated.     

On study of dynamic survival and cumulative past entropies

Abstract

Recently, a new class of measure of uncertainty, called “dynamic survival entropy”, has been defined and studied in the literature. Based on this entropy, DSE(α) ordering, IDSE(α), and DDSE(α) classes of life distributions are defined and some results are studied. In this paper, our main aim is to prove some more results of the ordering and the aging classes of life distributions mentioned above. Some important distributions such as exponential, Pareto, Pareto II, and finite range distributions are also characterized. Here we have defined cumulative past entropy and proved some interesting results.     

Contribution of maximum entropy principle in the field of queueing theory

ABSTRACT

In the literature of information theory, there exist many well known measures of entropy suitable for entropy optimization principles towards applications in different disciplines of science and technology. The object of this article is to develop a new generalized measure of entropy and to establish the relation between entropy and queueing theory. To fulfill our aim, we have made use of maximum entropy principle which provides the most uncertain probability distribution subject to some constraints expressed by mean values.     

On weighted cumulative residual entropy

In analogy with the weighted Shannon entropy proposed by Belis and Guiasu (1968 Belis, M., Guiasu, S. (1968). A quantitative-qualitative measure of information in cybernetic systems. IEEE Trans. Inf. Th. IT-4:593–594.[Crossref], [Web of Science ®] , [Google Scholar]) and Guiasu (1986 Guiasu, S. (1986). Grouping data by using the weighted entropy. J. Stat. Plann. Inference 15:63–69.[Crossref], [Web of Science ®] , [Google Scholar]), we introduce a new information measure called weighted cumulative residual entropy (WCRE). This is based on the cumulative residual entropy (CRE), which is introduced by Rao et al. (2004 Rao, M., Chen, Y., Vemuri, B.C., Wang, F. (2004). Cumulative residual entropy: a new measure of information. IEEE Trans. Info. Theory 50(6):1220–1228.[Crossref], [Web of Science ®] , [Google Scholar]). This new information measure is “length-biased” shift dependent that assigns larger weights to larger values of random variable. The properties of WCRE and a formula relating WCRE and weighted Shannon entropy are given. Related studies of reliability theory is covered. Our results include inequalities and various bounds to the WCRE. Conditional WCRE and some of its properties are discussed. The empirical WCRE is proposed to estimate this new information measure. Finally, strong consistency and central limit theorem are provided.