Weighted extensions of generalized cumulative residual entropy and their applications

Abstract

In this paper, we consider weighted extensions of generalized cumulative residual entropy and its dynamic(residual) version. Our results include linear transformations, stochastic ordering, bounds, aging class properties and some relationships with other reliability concepts. We also define the conditional weighted generalized cumulative residual entropy and discuss some properties of its. For these concepts, we obtain some characterization results under some assumptions. Finally, we provide an estimator of the new information measure using empirical approach. In addition, we study large sample properties of this estimator.     

On generalized dynamic cumulative past entropy measure

Recently, the concept of dynamic cumulative residual entropy and its generalizations has gained much attention among researchers. In this work, a new generalized dynamic cumulative measure in the past lifetime is proposed. Further, some characterization results connecting this new generalized dynamic entropy measure and other reversed measures are obtained.     

Robust methods of estimation of regression coefficients 1

Recently, cumulative residual entropy (CRE) has been found to be a new measure of information that parallels Shannon's entropy (see Rao et al. [Cumulative residual entropy: A new measure of information, IEEE Trans. Inform. Theory. 50(6) (2004), pp. 1220–1228] and Asadi and Zohrevand [On the dynamic cumulative residual entropy, J. Stat. Plann. Inference 137 (2007), pp. 1931–1941]). Motivated by this finding, in this paper, we introduce a generalized measure of it, namely cumulative residual Renyi's entropy, and study its properties. We also examine it in relation to some applied problems such as weighted and equilibrium models. Finally, we extend this measure into the bivariate set-up and prove certain characterizing relationships to identify different bivariate lifetime models.     

A note on characterization based on shannon entropy of record statistics

In this note we compare the Shannon entropy of record statistics with the Shannon entropy of the original data and give an application to characterization of the generalized Pareto distribution,     

Some Results on Dynamic Generalized Survival Entropy

Recently, Zografos and Nadarajah (2005 Zografos, K., Nadarajah, S. (2005). Survival exponential entropies. IEEE Trans. Inform. Theor. 51:1239–1246.[Crossref], [Web of Science ®] , [Google Scholar]) proposed two measures of uncertainty based on the survival function, called the survival exponential entropy and the generalized survival exponential entropy. In this article, we explore properties of the generalized survival entropy and the dynamic version of it. We study conditions under which the generalized survival entropy of first order statistic can uniquely determines the parent distribution. The exponential, Pareto, and finite range distributions, which are commonly used in reliability, have been characterized using this generalized measure. Another measure of entropy is also introduced in analogy with cumulative entropy which has been proposed by Di Crescenzo and Longobardi (2009) and some properties of it are given.     

Strong law of large numbers for generalized sample relative entropy of non homogeneous Markov chains

In this paper, we study the strong law of large numbers for the generalized sample relative entropy of non homogeneous Markov chains taking values from a finite state space. First, we introduce the definitions of generalized sample relative entropy and generalized sample relative entropy rate. Then, using a strong limit theorem for the delayed sums of the functions of two variables and a strong law of large numbers for non homogeneous Markov chains, we obtain the strong law of large numbers for the generalized sample relative entropy of non homogeneous Markov chains. As corollaries, we obtain some important results.     

The generalized maximum Tsallis entropy estimators and applications to the Portland cement dataset

Tsallis entropy is a generalized form of entropy and tends to be Shannon entropy when q → 1. Using Tsallis entropy, an alternative estimation methodology (generalized maximum Tsallis entropy) is introduced and used to estimate the parameters in a linear regression model when the basic data are ill-conditioned. We describe the generalized maximum Tsallis entropy and for q = 2 we call that GMET2 estimator. We apply the GMET2 estimator for estimating the linear regression model Y = Xβ + e where the design matrix X is subject to severe multicollinearity. We compared the GMET2, generalized maximum entropy (GME), ordinary least-square (OLS), and inequality restricted least-square (IRLS) estimators on the analyzed dataset on Portland cement.     

Information Measures for Some Well-Known Families

In this article, results for some well-known families such as Pareto IV, generalized logistic, generalized gamma, double generalized gamma, generalized normal, inverse gamma, and Weibull, and their related families via the links between entropy, variance, Fisher information, and analog of the Fisher information, are derived.     

Bayesian Estimation for Deformed Modified Power Series Distribution

In this article, posterior distribution, posterior moments, and predictive distribution for the modified power series distributions deformed at any of a support point under linex and generalized entropy loss function are derived. It is assumed that the prior information can be summarized by a uniform, Beta, two-sided power, Gamma, or generalized Pareto distributions. The obtained results are demonstrated on the generalized Poisson and the generalized negative binomial distribution deformed at a given point.     

Maximum entropy estimation of income share function from generalized Gini index

Following Sir Anthony and Atkinson who started thinking about the insensitivity of the Gini index to income shares of the lower and the upper income groups, a generalization of the classical Gini index was introduced by Kakwani, Donaldson, Weymark and Yitzhaki which is sensitive to both high and low incomes. In this paper, the maximum entropy method is used to estimate the underlying true income share function based on the limited information of the generalized Gini index about the income shares of a population's percentiles. The income share function is estimated through maximizing both the Shannon entropy and the second-order entropy. In the end, through parametric bootstrap and analyzing a real dataset, the results are compared with the estimator of the share function, which is obtained based on the total information. In contrast to the classic Gini index, the derived share function based on the generalized Gini index provides more accurate approximations for income shares of the lower and the upper percentiles.     

Characterization based on generalized entropy of order statistics

ABSTRACT

In the present study, several characterizations of order statistics are obtained on the basis of the generalized entropy. Under some conditions, it is shown that the parent distribution can be uniquely determined by equality of generalized entropy of order statistics.     

Entropy-based goodness-of-fit tests for the Pareto I distribution

In this article, having observed the generalized order statistics in a sample, we construct a test for the hypothesis that the underlying distribution is the Pareto I distribution. The Shannon entropy of generalized order statistics is used to test the null hypothesis.     

Characterizations based on generalized cumulative residual entropy functions

The Shannon entropy and the cumulative residual entropy (CRE) of a random variable are useful tools in probability theory. Recently, a new concept called generalized cumulative residual entropy (GCRE) of order n was introduced and studied. It is related with the record values of a sequence of i.i.d. random variables and with the relevation transform. In this paper, we show that, under some assumptions, the GCRE function of a fixed order n uniquely determines the distribution function. Some characterizations of particular probability models are obtained from this general result.     

Some new results on the cumulative residual entropy

The residual entropy function is a relevant dynamic measure of uncertainty in reliability and survival studies. Recently, Rao et al. [2004. Cumulative residual entropy: a new measure of information. IEEE Transactions on Information Theory 50, 1220–1228] and Asadi and Zohrevand [2007. On the dynamic cumulative residual entropy. Journal of Statistical Planning and Inference 137, 1931–1941] define the cumulative residual entropy and the dynamic cumulative residual entropy, respectively, as some new measures of uncertainty. They study some properties and applications of these measures showing how the cumulative residual entropy and the dynamic cumulative residual entropy are connected with the mean residual life function. In this paper, we obtain some new results on these functions. We also define and study the dynamic cumulative past entropy function. Some results are given connecting these measures of a lifetime distribution and that of the associated weighted distribution.     

Parameter estimation for generalized Pareto distribution by generalized probability weighted moment-equations

The generalized Pareto distribution (GPD) has been widely used to model exceedances over a threshold. This article generalizes the method of generalized probability weighted moments, and applies this method to estimate the parameters of GPD. The estimator is computationally easy. Some asymptotic results of this method are provided. Two simulations are carried out to investigate the behavior of this method and to compare them with other methods suggested in the literature. The simulation results show that the performance of the proposed method is better than some other methods. Finally, this method is applied to analyze a real-life data.     

Computational Method for Jackknifed Generalized Ridge Tuning Parameter based on Generalized Maximum Entropy

In this article, a new method to estimate the Jackknifed generalized ridge tuning parameter, based on the Jackknifed Ridge-trace and an analytical method borrowed from generalized maximum entropy, is presented. The ideas in the article are illustrated and evaluated using to the well-known Portland cement data set and simulations.     

Contribution of maximum entropy principle in the field of queueing theory

ABSTRACT

In the literature of information theory, there exist many well known measures of entropy suitable for entropy optimization principles towards applications in different disciplines of science and technology. The object of this article is to develop a new generalized measure of entropy and to establish the relation between entropy and queueing theory. To fulfill our aim, we have made use of maximum entropy principle which provides the most uncertain probability distribution subject to some constraints expressed by mean values.     

Conditional entropy,entropy density,and strong law of large numbers for generalized controlled tree-indexed Markov chains

In this paper, we first introduces a tree model without degree boundedness restriction namely generalized controlled tree T, which is an extension of some known tree models, such as homogeneous tree model, uniformly bounded degree tree model, controlled tree model, etc. Then some limit properties including strong law of large numbers for generalized controlled tree-indexed non homogeneous Markov chain are obtained. Finally, we establish some entropy density properties, monotonicity of conditional entropy, and entropy properties for generalized controlled tree-indexed Markov chains.     

熵理论中熵及熵权计算式的不足与修正

简述了熵的概念和熵在社会科学中的应用,分析了熵理论中熵值及熵权传统计算式中存在的不足,提出了一种合理可行的修正方法,并对熵值及熵权计算式的修正进行了数学证明,有效地完善和发展了熵理论。     

Cumulative ratio information based on general cumulative entropy

In this paper, we suggest an extension of the cumulative residual entropy (CRE) and call it generalized cumulative entropy. The proposed entropy not only retains attributes of the existing uncertainty measures but also possesses the absolute homogeneous property with unbounded support, which the CRE does not have. We demonstrate its mathematical properties including the entropy of order statistics and the principle of maximum general cumulative entropy. We also introduce the cumulative ratio information as a measure of discrepancy between two distributions and examine its application to a goodness-of-fit test of the logistic distribution. Simulation study shows that the test statistics based on the cumulative ratio information have comparable statistical power with competing test statistics.