On the dynamic cumulative residual entropy

Recently, Rao et al. [(2004) Cumulative residual entropy: a new measure of information. IEEE Trans. Inform. Theory 50(6), 1220–1228] have proposed a new measure of uncertainty, called cumulative residual entropy (CRE), in a distribution function F and obtained some properties and applications of that. In the present paper, we propose a dynamic form of CRE and obtain some of its properties. We show how CRE (and its dynamic version) is connected with well-known reliability measures such as the mean residual life time.     

Bivariate extension of (dynamic) cumulative past entropy

Recently, the concept of cumulative residual entropy (CRE) has been studied by many researchers in higher dimensions. In this article, we extend the definition of (dynamic) cumulative past entropy (DCPE), a dual measure of (dynamic) CRE, to bivariate setup and obtain some of its properties including bounds. We also look into the problem of extending DCPE for conditionally specified models. Several properties, including monotonicity, and bounds of DCPE are obtained for conditional distributions. It is shown that the proposed measure uniquely determines the distribution function. Moreover, we also propose a stochastic order based on this measure.     

Bivariate extension of generalized cumulative past entropy

The cumulative past entropy (CPE) of order α, a dual measure of cumulative residual entropy (CRE) of order α, has recently been proposed as a suitable extension of CPE. In this article, we extend the definition of (dynamic) CPE of order α (DCPE(α)) to bivariate setup and obtain some of its properties including bounds. We also look into the problem of extending DCPE(α) for conditionally specified models. Several properties, including monotonicity, and bounds of DCPE(α) are obtained for conditional distributions. Along with some characterization results it is shown that the proposed generalized measure uniquely determines the distribution function. Moreover, we also propose a stochastic order based on this measure and prove interrelation with some existing stochastic orders.     

Cumulative ratio information based on general cumulative entropy

In this paper, we suggest an extension of the cumulative residual entropy (CRE) and call it generalized cumulative entropy. The proposed entropy not only retains attributes of the existing uncertainty measures but also possesses the absolute homogeneous property with unbounded support, which the CRE does not have. We demonstrate its mathematical properties including the entropy of order statistics and the principle of maximum general cumulative entropy. We also introduce the cumulative ratio information as a measure of discrepancy between two distributions and examine its application to a goodness-of-fit test of the logistic distribution. Simulation study shows that the test statistics based on the cumulative ratio information have comparable statistical power with competing test statistics.     

Robust methods of estimation of regression coefficients 1

Recently, cumulative residual entropy (CRE) has been found to be a new measure of information that parallels Shannon's entropy (see Rao et al. [Cumulative residual entropy: A new measure of information, IEEE Trans. Inform. Theory. 50(6) (2004), pp. 1220–1228] and Asadi and Zohrevand [On the dynamic cumulative residual entropy, J. Stat. Plann. Inference 137 (2007), pp. 1931–1941]). Motivated by this finding, in this paper, we introduce a generalized measure of it, namely cumulative residual Renyi's entropy, and study its properties. We also examine it in relation to some applied problems such as weighted and equilibrium models. Finally, we extend this measure into the bivariate set-up and prove certain characterizing relationships to identify different bivariate lifetime models.     

Some new results on the cumulative residual entropy

The residual entropy function is a relevant dynamic measure of uncertainty in reliability and survival studies. Recently, Rao et al. [2004. Cumulative residual entropy: a new measure of information. IEEE Transactions on Information Theory 50, 1220–1228] and Asadi and Zohrevand [2007. On the dynamic cumulative residual entropy. Journal of Statistical Planning and Inference 137, 1931–1941] define the cumulative residual entropy and the dynamic cumulative residual entropy, respectively, as some new measures of uncertainty. They study some properties and applications of these measures showing how the cumulative residual entropy and the dynamic cumulative residual entropy are connected with the mean residual life function. In this paper, we obtain some new results on these functions. We also define and study the dynamic cumulative past entropy function. Some results are given connecting these measures of a lifetime distribution and that of the associated weighted distribution.     

Characterizations Based on Cumulative Residual Entropy of First-Order Statistics

Two different distributions may have equal cumulative residual entropy (CRE), thus a distribution cannot be determined by its CRE. In this article, we explore properties of the CRE and study conditions under which the CRE of the first-order statistics can uniquely determines the parent distribution. Weibull family is characterized through ratio of the CRE of the first-order statistics to its expectation. We have also some bounds for the CRE of residual lifetime of a series system.     

Some distributional results through past entropy

Measure of uncertainty in past lifetime distribution plays an important role in the context of Information Theory, Forensic Science and other related fields. In this paper we provide characterizations of quite a few continuous and discrete distributions based on certain functional relationships among past entropy, reversed hazard rate and expected inactivity time. Based on past entropy, a conditional measure of uncertainty has been defined, which has helped in defining a new stochastic order and an ageing class. The properties of the stochastic order and those of the ageing class are also studied here.     

Characterizations based on generalized cumulative residual entropy functions

The Shannon entropy and the cumulative residual entropy (CRE) of a random variable are useful tools in probability theory. Recently, a new concept called generalized cumulative residual entropy (GCRE) of order n was introduced and studied. It is related with the record values of a sequence of i.i.d. random variables and with the relevation transform. In this paper, we show that, under some assumptions, the GCRE function of a fixed order n uniquely determines the distribution function. Some characterizations of particular probability models are obtained from this general result.     

A Dynamic Discrimination Information Based On Cumulative Residual Entropy And Its Properties

In this article, we introduce a measure of discrepancy between two life-time distributions based on cumulative residual entropy. The dynamic form of this measure is considered and some of its properties are obtained. The relations between dynamic form and some well-known concepts in reliability such as mean residual life-time, hazard rate order, and new better (worse) than used are studied.     

On study of dynamic survival and cumulative past entropies

Abstract

Recently, a new class of measure of uncertainty, called “dynamic survival entropy”, has been defined and studied in the literature. Based on this entropy, DSE(α) ordering, IDSE(α), and DDSE(α) classes of life distributions are defined and some results are studied. In this paper, our main aim is to prove some more results of the ordering and the aging classes of life distributions mentioned above. Some important distributions such as exponential, Pareto, Pareto II, and finite range distributions are also characterized. Here we have defined cumulative past entropy and proved some interesting results.     

Efficiency of ranked set sampling in entropy estimation and goodness-of-fit testing for the inverse Gaussian law

When measuring units are expensive or time consuming, while ranking them is relatively easy and inexpensive, it is known that ranked set sampling (RSS) is preferable to simple random sampling (SRS). Many authors have suggested several extensions of RSS. As a variation, Al-Saleh and Al-Kadiri [Double ranked set sampling, Statist. Probab. Lett. 48 (2000), pp. 205–212] introduced double ranked set sampling (DRSS) and it was extended by Al-Saleh and Al-Omari [Multistage ranked set sampling, J. Statist. Plann. Inference 102 (2002), pp. 273–286] to multistage ranked set sampling (MSRSS). The entropy of a random variable (r.v.) is a measure of its uncertainty. It is a measure of the amount of information required on the average to determine the value of a (discrete) r.v.. In this work, we discuss entropy estimation in RSS design and aforementioned extensions and compare the results with those in SRS design in terms of bias and root mean square error (RMSE). Motivated by the above observed efficiency, we continue to investigate entropy-based goodness-of-fit test for the inverse Gaussian distribution using RSS. Critical values for some sample sizes determined by means of Monte Carlo simulations are presented for each design. A Monte Carlo power analysis is performed under various alternative hypotheses in order to compare the proposed testing procedure with the existing methods. The results indicate that tests based on RSS and its extensions are superior alternatives to the entropy test based on SRS.     

Some Results Based on a Version of the Generalized Dynamic Entropies

We propose new dynamic measures of uncertainty based on the notion of generalized dynamic entropy introduced in Di Crescenzo and Longobardi (2006). These can uniquely determine distribution functions in continuous and discrete cases, and the characterizations of some well-known distributions are provided. We also define some orderings and aging notions based on the generalized dynamic measures, and prove some of their properties, obtaining as corollaries results that have recently appeared in the literature.     

On Estimating the Residual Rényi Entropy under Progressive Censoring

In this article, the residual Rényi entropy (RRE) as a measure of uncertainty is considered in progressively Type II censored samples and some properties of it are investigated. The RRE of sth order statistic from a continuous distribution function is represented in terms of the RRE of the sth order statistic from uniform distribution. In general, we do not have a closed form for RRE of order statistics in most of distributions. This gives us a motivation for obtaining some bounds for RRE in progressively censored samples. In addition, two estimators are proposed for RRE. The performance of these estimators is compared using simulation studies.     

Weighted extensions of generalized cumulative residual entropy and their applications

Abstract

In this paper, we consider weighted extensions of generalized cumulative residual entropy and its dynamic(residual) version. Our results include linear transformations, stochastic ordering, bounds, aging class properties and some relationships with other reliability concepts. We also define the conditional weighted generalized cumulative residual entropy and discuss some properties of its. For these concepts, we obtain some characterization results under some assumptions. Finally, we provide an estimator of the new information measure using empirical approach. In addition, we study large sample properties of this estimator.     

On cumulative entropies

In analogy with the cumulative residual entropy recently proposed by Wang et al. [2003a. A new and robust information theoretic measure and its application to image alignment. In: Information Processing in Medical Imaging. Lecture Notes in Computer Science, vol. 2732, Springer, Heidelberg, pp. 388–400; 2003b. Cumulative residual entropy, a new measure of information and its application to image alignment. In: Proceedings on the Ninth IEEE International Conference on Computer Vision (ICCV’03), vol. 1, IEEE Computer Society Press, Silver Spring, MD, pp. 548–553], we introduce and study the cumulative entropy, which is a new measure of information alternative to the classical differential entropy. We show that the cumulative entropy of a random lifetime X can be expressed as the expectation of its mean inactivity time evaluated at X. Hence, our measure is particularly suitable to describe the information in problems related to ageing properties of reliability theory based on the past and on the inactivity times. Our results include various bounds to the cumulative entropy, its connection to the proportional reversed hazards model, and the study of its dynamic version that is shown to be increasing if the mean inactivity time is increasing. The empirical cumulative entropy is finally proposed to estimate the new information measure.     

On dynamic weighted survival entropy of order α

Recently, Abbasnejad et al. (2010 Abbasnejad, M., Arghami, N.R., Morgenthaler, S., Mohtashami Borzadaran, G.R. (2010). On the dynamic survival entropy. Stat. Probab. Lett. 80:1962–1971.[Crossref], [Web of Science ®] , [Google Scholar]) proposed a measure of uncertainty based on survival function, called the survival entropy of order α. A dynamic form of the survival entropy of order α is also proposed by them. In this paper, we derive the weighted form of these measures. The properties of the new measures are also discussed.     

Some Results on Dynamic Generalized Survival Entropy

Recently, Zografos and Nadarajah (2005 Zografos, K., Nadarajah, S. (2005). Survival exponential entropies. IEEE Trans. Inform. Theor. 51:1239–1246.[Crossref], [Web of Science ®] , [Google Scholar]) proposed two measures of uncertainty based on the survival function, called the survival exponential entropy and the generalized survival exponential entropy. In this article, we explore properties of the generalized survival entropy and the dynamic version of it. We study conditions under which the generalized survival entropy of first order statistic can uniquely determines the parent distribution. The exponential, Pareto, and finite range distributions, which are commonly used in reliability, have been characterized using this generalized measure. Another measure of entropy is also introduced in analogy with cumulative entropy which has been proposed by Di Crescenzo and Longobardi (2009) and some properties of it are given.     

On generalized conditional cumulative residual inaccuracy measure

Abstract

Recently, the notion of cumulative residual Rényi’s entropy has been proposed in the literature as a measure of information that parallels Rényi’s entropy. Motivated by this, here we introduce a generalized measure of it, namely cumulative residual inaccuracy of order α. We study the proposed measure for conditionally specified models of two components having possibly different ages called generalized conditional cumulative residual inaccuracy measure. Several properties of generalized conditional cumulative residual inaccuracy measure including the effect of monotone transformation are investigated. Further, we provide some bounds on using the usual stochastic order and characterize some bivariate distributions using the concept of conditional proportional hazard rate model.