On the generalized cumulative residual entropy weighted distributions

Recently, Feizjavadian and Hashemi (2015 Feizjavadian, S.H., Hashemi, R. (2015). Mean residual weighted versus the length-biased Rayleigh distribution. J. Stat. Comput. Simul. 85:2823–2838.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) introduced and studied the mean residual weighted (MRW) distribution as an alternative to the length-biased distribution, by using the concepts of the mean residual lifetime and the cumulative residual entropy (CRE). In this article, a new sequence of weighted distributions is introduced based on the generalized CRE. This sequence includes the MRW distribution. Properties of this sequence are obtained generalizing and extending previous results on the MRW distribution. Moreover, expressions for some known distributions are given, and finite mixtures between the new sequence of weighted distributions and the length-biased distribution are studied. Numerical examples are given to illustrate the new results.     

On weighted cumulative residual entropy

In analogy with the weighted Shannon entropy proposed by Belis and Guiasu (1968 Belis, M., Guiasu, S. (1968). A quantitative-qualitative measure of information in cybernetic systems. IEEE Trans. Inf. Th. IT-4:593–594.[Crossref], [Web of Science ®] , [Google Scholar]) and Guiasu (1986 Guiasu, S. (1986). Grouping data by using the weighted entropy. J. Stat. Plann. Inference 15:63–69.[Crossref], [Web of Science ®] , [Google Scholar]), we introduce a new information measure called weighted cumulative residual entropy (WCRE). This is based on the cumulative residual entropy (CRE), which is introduced by Rao et al. (2004 Rao, M., Chen, Y., Vemuri, B.C., Wang, F. (2004). Cumulative residual entropy: a new measure of information. IEEE Trans. Info. Theory 50(6):1220–1228.[Crossref], [Web of Science ®] , [Google Scholar]). This new information measure is “length-biased” shift dependent that assigns larger weights to larger values of random variable. The properties of WCRE and a formula relating WCRE and weighted Shannon entropy are given. Related studies of reliability theory is covered. Our results include inequalities and various bounds to the WCRE. Conditional WCRE and some of its properties are discussed. The empirical WCRE is proposed to estimate this new information measure. Finally, strong consistency and central limit theorem are provided.     

On generalized dynamic cumulative past entropy measure

Recently, the concept of dynamic cumulative residual entropy and its generalizations has gained much attention among researchers. In this work, a new generalized dynamic cumulative measure in the past lifetime is proposed. Further, some characterization results connecting this new generalized dynamic entropy measure and other reversed measures are obtained.     

Weighted extensions of generalized cumulative residual entropy and their applications

Abstract

In this paper, we consider weighted extensions of generalized cumulative residual entropy and its dynamic(residual) version. Our results include linear transformations, stochastic ordering, bounds, aging class properties and some relationships with other reliability concepts. We also define the conditional weighted generalized cumulative residual entropy and discuss some properties of its. For these concepts, we obtain some characterization results under some assumptions. Finally, we provide an estimator of the new information measure using empirical approach. In addition, we study large sample properties of this estimator.     

Dynamic version of weighted cumulative residual entropy

Some extensions of Shannon entropy to the survival function have been recently proposed. Misagh et al. (2011 Misagh, F., Panahi, Y., Yari, G.H., Shahi, R. (2011, September). Weighted cumulative entropy and its estimation. In: Quality and Reliability (ICQR), 2011, IEEE International conference (pp. 477–480), IEEE.[Crossref] , [Google Scholar]) introduced weighted cumulative residual entropy (WCRE) that was studied more by Mirali et al. (2015 Mirali, M., Baratpour, S., Fakoor, V. (2015). On weighted cumulative residual entropy. Commun. Stat. Theory Methods. doi:10.1080103610926.2015.1053932.[Web of Science ®] , [Google Scholar]). In this article, the dynamic version of WCRE is proposed. Some relationships of this measure with well-known reliability measures and ageing classes are studied and some characterization results for exponential and Rayleigh distributions are provided. Also, a non parametric estimation of dynamic version of WCRE is introduced and its asymptotic behavior is investigated.     

Characterizations based on generalized cumulative residual entropy functions

The Shannon entropy and the cumulative residual entropy (CRE) of a random variable are useful tools in probability theory. Recently, a new concept called generalized cumulative residual entropy (GCRE) of order n was introduced and studied. It is related with the record values of a sequence of i.i.d. random variables and with the relevation transform. In this paper, we show that, under some assumptions, the GCRE function of a fixed order n uniquely determines the distribution function. Some characterizations of particular probability models are obtained from this general result.     

Bivariate extension of generalized cumulative past entropy

The cumulative past entropy (CPE) of order α, a dual measure of cumulative residual entropy (CRE) of order α, has recently been proposed as a suitable extension of CPE. In this article, we extend the definition of (dynamic) CPE of order α (DCPE(α)) to bivariate setup and obtain some of its properties including bounds. We also look into the problem of extending DCPE(α) for conditionally specified models. Several properties, including monotonicity, and bounds of DCPE(α) are obtained for conditional distributions. Along with some characterization results it is shown that the proposed generalized measure uniquely determines the distribution function. Moreover, we also propose a stochastic order based on this measure and prove interrelation with some existing stochastic orders.     

Parameter estimation for generalized Pareto distribution by generalized probability weighted moment-equations

The generalized Pareto distribution (GPD) has been widely used to model exceedances over a threshold. This article generalizes the method of generalized probability weighted moments, and applies this method to estimate the parameters of GPD. The estimator is computationally easy. Some asymptotic results of this method are provided. Two simulations are carried out to investigate the behavior of this method and to compare them with other methods suggested in the literature. The simulation results show that the performance of the proposed method is better than some other methods. Finally, this method is applied to analyze a real-life data.     

Characterization based on generalized entropy of order statistics

ABSTRACT

In the present study, several characterizations of order statistics are obtained on the basis of the generalized entropy. Under some conditions, it is shown that the parent distribution can be uniquely determined by equality of generalized entropy of order statistics.     

On weighted Renyi’s entropy for double-truncated distribution

In a recent paper, Nourbakhsh and Yari (2017 Nourbakhsh, M., and G. Yari. 2017. Weighted Renyi’s entropy for lifetime distributions. Communications in Statistics—Theory and Methods 46 (14):7085–98.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) introduce the weighted version of Renyi’s entropy for left/right truncated random variables and studied their properties in context of reliability analysis. In the present communication we extend the notion of weighted Renyi’s entropy for two-sided truncated random variable. In reliability theory and survival analysis, this measure may help to study the quantitative-qualitative information spectrum of a system/component when it fails between two time points. Various aspects of weighted Renyi’s interval entropy have been discussed and some mistakes in the preceding literature have also been corrected. These results generalize and enhance the related existing results that are developed based on weighted Renyi’s entropy for one-sided truncated random variable. Finally, a simulation study is added to provide the estimates of the proposed measure and to demonstrate the performance of the estimates.     

On the dynamic cumulative residual entropy

Recently, Rao et al. [(2004) Cumulative residual entropy: a new measure of information. IEEE Trans. Inform. Theory 50(6), 1220–1228] have proposed a new measure of uncertainty, called cumulative residual entropy (CRE), in a distribution function F and obtained some properties and applications of that. In the present paper, we propose a dynamic form of CRE and obtain some of its properties. We show how CRE (and its dynamic version) is connected with well-known reliability measures such as the mean residual life time.     

A quantile-based generalized dynamic cumulative measure of entropy

The cumulative residual entropy (CRE), introduced by Rao et al. (2004), is a new measure of uncertainty and viewed as a dynamic measure of uncertainty. Asadi and Zohrevand (2007) proposed a dynamic form of the CRE, namely dynamic CRE. Recently, Kumar and Taneja (2011) introduced a generalized dynamic CRE based on the Varma entropy introduced by Varma (1966) and called it dynamic CRE of order α and type β. In the present article, we introduce a quantile version of the dynamic CRE of order α and type β and study its properties. For this measure, we obtain some characterization results, aging classes properties, and stochastic comparisons.     

Some new results on the cumulative residual entropy

The residual entropy function is a relevant dynamic measure of uncertainty in reliability and survival studies. Recently, Rao et al. [2004. Cumulative residual entropy: a new measure of information. IEEE Transactions on Information Theory 50, 1220–1228] and Asadi and Zohrevand [2007. On the dynamic cumulative residual entropy. Journal of Statistical Planning and Inference 137, 1931–1941] define the cumulative residual entropy and the dynamic cumulative residual entropy, respectively, as some new measures of uncertainty. They study some properties and applications of these measures showing how the cumulative residual entropy and the dynamic cumulative residual entropy are connected with the mean residual life function. In this paper, we obtain some new results on these functions. We also define and study the dynamic cumulative past entropy function. Some results are given connecting these measures of a lifetime distribution and that of the associated weighted distribution.     

The generalized maximum Tsallis entropy estimators and applications to the Portland cement dataset

Tsallis entropy is a generalized form of entropy and tends to be Shannon entropy when q → 1. Using Tsallis entropy, an alternative estimation methodology (generalized maximum Tsallis entropy) is introduced and used to estimate the parameters in a linear regression model when the basic data are ill-conditioned. We describe the generalized maximum Tsallis entropy and for q = 2 we call that GMET2 estimator. We apply the GMET2 estimator for estimating the linear regression model Y = Xβ + e where the design matrix X is subject to severe multicollinearity. We compared the GMET2, generalized maximum entropy (GME), ordinary least-square (OLS), and inequality restricted least-square (IRLS) estimators on the analyzed dataset on Portland cement.     

Estimating utility functions using generalized maximum entropy

This paper estimates von Neumann and Morgenstern utility functions using the generalized maximum entropy (GME), applied to data obtained by utility elicitation methods. Given the statistical advantages of this approach, we provide a comparison of the performance of the GME estimator with ordinary least square (OLS) in a real data small sample setup. The results confirm the ones obtained for small samples through Monte Carlo simulations. The difference between the two estimators is small and it decreases as the width of the parameter support vector increases. Moreover, the GME estimator is more precise than the OLS one. Overall, the results suggest that GME is an interesting alternative to OLS in the estimation of utility functions when data are generated by utility elicitation methods.     

Strong law of large numbers for generalized sample relative entropy of non homogeneous Markov chains

In this paper, we study the strong law of large numbers for the generalized sample relative entropy of non homogeneous Markov chains taking values from a finite state space. First, we introduce the definitions of generalized sample relative entropy and generalized sample relative entropy rate. Then, using a strong limit theorem for the delayed sums of the functions of two variables and a strong law of large numbers for non homogeneous Markov chains, we obtain the strong law of large numbers for the generalized sample relative entropy of non homogeneous Markov chains. As corollaries, we obtain some important results.     

Renyi's entropy for residual lifetime distribution

In the present paper, we introduce and study Renyi's information measure (entropy) for residual lifetime distributions. It is shown that the proposed measure uniquely determines the distribution. We present characterizations for some lifetime models. Further, we define two new classes of life distributions based on this measure. Various properties of these classes are also given.     

On some generalized orderings: In the spirit of relative ageing

ABSTRACT

We introduce some new generalized stochastic orderings (in the spirit of relative ageing) which compare probability distributions with the exponential distribution. These orderings are useful to understand the phenomenon of positive ageing classes and also helpful to guide the practitioners when there are crossing hazard rates and/or crossing mean residual lives. We study some characterizations of these orderings. Inter-relations among these orderings have also been discussed.     

On generalized order statistics from generalized pareto distribution

The aim of this paper is to estimate parameters of generalized Pareto distribution based on generalized order statistics. Some non-Bayesian methods, such as MLE, bootstrap and unbiased estimators have been obtained to develop point and interval estimations. Bayesian estimations have also been derived under LSE and LINEX loss functions. To compare the performances of the employed methods, numerical results have been computed. To illustrate dependence and association properties of generalized order statistics, correlation coefficient and some informational measures in closed form have been obtained.