On Estimating the Residual Rényi Entropy under Progressive Censoring

In this article, the residual Rényi entropy (RRE) as a measure of uncertainty is considered in progressively Type II censored samples and some properties of it are investigated. The RRE of sth order statistic from a continuous distribution function is represented in terms of the RRE of the sth order statistic from uniform distribution. In general, we do not have a closed form for RRE of order statistics in most of distributions. This gives us a motivation for obtaining some bounds for RRE in progressively censored samples. In addition, two estimators are proposed for RRE. The performance of these estimators is compared using simulation studies.     

Weighted extensions of generalized cumulative residual entropy and their applications

Abstract

In this paper, we consider weighted extensions of generalized cumulative residual entropy and its dynamic(residual) version. Our results include linear transformations, stochastic ordering, bounds, aging class properties and some relationships with other reliability concepts. We also define the conditional weighted generalized cumulative residual entropy and discuss some properties of its. For these concepts, we obtain some characterization results under some assumptions. Finally, we provide an estimator of the new information measure using empirical approach. In addition, we study large sample properties of this estimator.     

Rényi entropy of m-generalized order statistics

Abstract

Characterizing relations via Rényi entropy of m-generalized order statistics are considered along with examples and related stochastic orderings. Previous results for common order statistics are included.     

Rényi statistics for testing composite hypotheses in general exponential models

We introduce a family of Rényi statistics of orders r?∈?R for testing composite hypotheses in general exponential models, as alternatives to the previously considered generalized likelihood ratio (GLR) statistic and generalized Wald statistic. If appropriately normalized exponential models converge in a specific sense when the sample size (observation window) tends to infinity, and if the hypothesis is regular, then these statistics are shown to be χ²-distributed under the hypothesis. The corresponding Rényi tests are shown to be consistent. The exact sizes and powers of asymptotically α-size Rényi, GLR and generalized Wald tests are evaluated for a concrete hypothesis about a bivariate Lévy process and moderate observation windows. In this concrete situation the exact sizes of the Rényi test of the order r?=?2 practically coincide with those of the GLR and generalized Wald tests but the exact powers of the Rényi test are on average somewhat better.     

The exponentiated exponential distribution: a survey

The exponentiated exponential distribution, a most attractive generalization of the exponential distribution, introduced by Gupta and Kundu (Aust. N. Z. J. Stat. 41:173–188, 1999) has received widespread attention. It appears, however, that many mathematical properties of this distribution have not been known or have not been known in simpler/general forms. In this paper, we provide a comprehensive survey of the mathematical properties. We derive expressions for the moment generating function, characteristic function, cumulant generating function, the nth moment, the first four moments, variance, skewness, kurtosis, the nth conditional moment, the first four cumulants, mean deviation about the mean, mean deviation about the median, Bonferroni curve, Lorenz curve, Bonferroni concentration index, Gini concentration index, Rényi entropy, Shannon entropy, cumulative residual entropy, Song’s measure, moments of order statistics, L moments, asymptotic distribution of the extreme order statistics, reliability, distribution of the sum of exponentiated exponential random variables, distribution of the product of exponentiated exponential random variables and the distribution of the ratio of exponentiated exponential random variables. We also discuss estimation by the method of maximum likelihood, including the case of censoring, and provide simpler expressions for the Fisher information matrix than those given by Gupta and Kundu. It is expected that this paper could serve as a source of reference for the exponentiated exponential distribution and encourage further research.     

Pareto Poisson–Lindley distribution with applications

A new lifetime distribution is introduced based on compounding Pareto and Poisson–Lindley distributions. Several statistical properties of the distribution are established, including behavior of the probability density function and the failure rate function, heavy- and long-right tailedness, moments, the Laplace transform, quantiles, order statistics, moments of residual lifetime, conditional moments, conditional moment generating function, stress–strength parameter, Rényi entropy and Song's measure. We get maximum-likelihood estimators of the distribution parameters and investigate the asymptotic distribution of the estimators via Fisher's information matrix. Applications of the distribution using three real data sets are presented and it is shown that the distribution fits better than other related distributions in practical uses.     

Robust methods of estimation of regression coefficients 1

Recently, cumulative residual entropy (CRE) has been found to be a new measure of information that parallels Shannon's entropy (see Rao et al. [Cumulative residual entropy: A new measure of information, IEEE Trans. Inform. Theory. 50(6) (2004), pp. 1220–1228] and Asadi and Zohrevand [On the dynamic cumulative residual entropy, J. Stat. Plann. Inference 137 (2007), pp. 1931–1941]). Motivated by this finding, in this paper, we introduce a generalized measure of it, namely cumulative residual Renyi's entropy, and study its properties. We also examine it in relation to some applied problems such as weighted and equilibrium models. Finally, we extend this measure into the bivariate set-up and prove certain characterizing relationships to identify different bivariate lifetime models.     

Measures of inaccuracy in record values

In this paper , we consider a measure of inaccuracy between distributions of the nth record value and parent random variable. We also propose the measure of residual inaccuracy of record values and study characterization results of dynamic cumulative residual inaccuracy measure. We discuss some properties of the proposed measures.     

Analyzing supersaturated designs with entropic measures

A supersaturated design is a design for which there are fewer runs than effects to be estimated. In this paper, we propose a method for screening out the important factors from a large set of potentially active variables, based on an information theoretical approach. Three entropy measures: Rényi entropy, Tsallis entropy and Havrda–Charvát entropy, have been associated with the measure of information gain, in order to identify the significant factors using data and assuming generalized linear models. The investigation of the proposed method performance and the comparison of each entropic measure application have been accomplished through simulation experiments. A noteworthy advantage of this paper is the use of generalized linear models for analyzing data from supersaturated designs, a fact that, to the best of our knowledge, has not yet been studied.     

Generalized Kerridge’s inaccuracy measure for conditionally specified models

Recently, conditional Renyi’s divergence of order α and Kerridge’s inaccuracy measures are studied by Navarro et al. (2014 Navarro, J., Sunoj, S.M., Linu, M.N. (2014). Characterizations of bivariate models using some dynamic conditional information divergence measures. Commun. Stat. Theory Methods 43:1939–1948.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). In the present article, a generalized dynamic conditional Kerridge’s inaccuracy measure is introduced, which can be represented as the sum of conditional Renyi’s divergence and Renyi’s entropy. Some useful bounds are obtained using the concept of likelihood ratio order. The results are extended to weighted distributions. Sufficient conditions are obtained for the monotonicity of the proposed measure. Characterizations for bivariate exponential conditional distribution are presented based on the proposed measure.     

Bivariate extension of generalized cumulative past entropy

The cumulative past entropy (CPE) of order α, a dual measure of cumulative residual entropy (CRE) of order α, has recently been proposed as a suitable extension of CPE. In this article, we extend the definition of (dynamic) CPE of order α (DCPE(α)) to bivariate setup and obtain some of its properties including bounds. We also look into the problem of extending DCPE(α) for conditionally specified models. Several properties, including monotonicity, and bounds of DCPE(α) are obtained for conditional distributions. Along with some characterization results it is shown that the proposed generalized measure uniquely determines the distribution function. Moreover, we also propose a stochastic order based on this measure and prove interrelation with some existing stochastic orders.     

Statistical estimation of quadratic Rényi entropy for a stationary m-dependent sequence

The Rényi entropy is a generalisation of the Shannon entropy and is widely used in mathematical statistics and applied sciences for quantifying the uncertainty in a probability distribution. We consider estimation of the quadratic Rényi entropy and related functionals for the marginal distribution of a stationary m-dependent sequence. The U-statistic estimators under study are based on the number of ε-close vector observations in the corresponding sample. A variety of asymptotic properties for these estimators are obtained (e.g. consistency, asymptotic normality, and Poisson convergence). The results can be used in diverse statistical and computer science problems whenever the conventional independence assumption is too strong (e.g. ε-keys in time series databases and distribution identification problems for dependent samples).     

Cumulative ratio information based on general cumulative entropy

In this paper, we suggest an extension of the cumulative residual entropy (CRE) and call it generalized cumulative entropy. The proposed entropy not only retains attributes of the existing uncertainty measures but also possesses the absolute homogeneous property with unbounded support, which the CRE does not have. We demonstrate its mathematical properties including the entropy of order statistics and the principle of maximum general cumulative entropy. We also introduce the cumulative ratio information as a measure of discrepancy between two distributions and examine its application to a goodness-of-fit test of the logistic distribution. Simulation study shows that the test statistics based on the cumulative ratio information have comparable statistical power with competing test statistics.     

The McDonald arcsine distribution: a new model to proportional data

We propose a new three-parameter continuous model called the McDonald arcsine distribution, which is a very competitive model to the beta, beta type I and Kumaraswamy distributions for modelling rates and proportions. We provide a mathematical treatment of the new distribution including explicit expressions for the density function, moments, generating and quantile functions, mean deviations, two probability measures based on the Bonferroni and Lorenz curves, Shannon entropy, Rényi entropy and cumulative residual entropy. Maximum likelihood is used to estimate the model parameters and the expected information matrix is determined. An application of the proposed model to real data shows that it can give consistently a better fit than other important statistical models.     

General results for the Kumaraswamy-G distribution

For any continuous baseline G distribution [G.M. Cordeiro and M. de Castro, A new family of generalized distributions, J. Statist. Comput. Simul. 81 (2011), pp. 883–898], proposed a new generalized distribution (denoted here with the prefix ‘Kw-G’ (Kumaraswamy-G)) with two extra positive parameters. They studied some of its mathematical properties and presented special sub-models. We derive a simple representation for the Kw-G density function as a linear combination of exponentiated-G distributions. Some new distributions are proposed as sub-models of this family, for example, the Kw-Chen [Z.A. Chen, A new two-parameter lifetime distribution with bathtub shape or increasing failure rate function, Statist. Probab. Lett. 49 (2000), pp. 155–161], Kw-XTG [M. Xie, Y. Tang, and T.N. Goh, A modified Weibull extension with bathtub failure rate function, Reliab. Eng. System Safety 76 (2002), pp. 279–285] and Kw-Flexible Weibull [M. Bebbington, C.D. Lai, and R. Zitikis, A flexible Weibull extension, Reliab. Eng. System Safety 92 (2007), pp. 719–726]. New properties of the Kw-G distribution are derived which include asymptotes, shapes, moments, moment generating function, mean deviations, Bonferroni and Lorenz curves, reliability, Rényi entropy and Shannon entropy. New properties of the order statistics are investigated. We discuss the estimation of the parameters by maximum likelihood. We provide two applications to real data sets and discuss a bivariate extension of the Kw-G distribution.     

Characterizations based on generalized cumulative residual entropy functions

The Shannon entropy and the cumulative residual entropy (CRE) of a random variable are useful tools in probability theory. Recently, a new concept called generalized cumulative residual entropy (GCRE) of order n was introduced and studied. It is related with the record values of a sequence of i.i.d. random variables and with the relevation transform. In this paper, we show that, under some assumptions, the GCRE function of a fixed order n uniquely determines the distribution function. Some characterizations of particular probability models are obtained from this general result.     

The Marshall–Olkin extended generalized Lindley distribution: Properties and applications

In this article, we define and study a new three-parameter model called the Marshall–Olkin extended generalized Lindley distribution. We derive various structural properties of the proposed model including expansions for the density function, ordinary moments, moment generating function, quantile function, mean deviations, Bonferroni and Lorenz curves, order statistics and their moments, Rényi entropy and reliability. We estimate the model parameters using the maximum likelihood technique of estimation. We assess the performance of the maximum likelihood estimators in a simulation study. Finally, by means of two real datasets, we illustrate the usefulness of the new model.     

Conditional entropy,entropy density,and strong law of large numbers for generalized controlled tree-indexed Markov chains

In this paper, we first introduces a tree model without degree boundedness restriction namely generalized controlled tree T, which is an extension of some known tree models, such as homogeneous tree model, uniformly bounded degree tree model, controlled tree model, etc. Then some limit properties including strong law of large numbers for generalized controlled tree-indexed non homogeneous Markov chain are obtained. Finally, we establish some entropy density properties, monotonicity of conditional entropy, and entropy properties for generalized controlled tree-indexed Markov chains.     

A complementary generalized linear failure rate-geometric distribution

In this article, we shall attempt to introduce a new class of lifetime distributions, which enfolds several known distributions such as the generalized linear failure rate distribution and covers both positive as well as negative skewed data. This new four-parameter distribution allows for flexible hazard rate behavior. Indeed, the hazard rate function here can be increasing, decreasing, bathtub-shaped, or upside-down bathtub-shaped. We shall first study some basic distributional properties of the new model such as the cumulative distribution function, the density of the order statistics, their moments, and Rényi entropy. Estimation of the stress-strength parameter as an important reliability property is also studied. The maximum likelihood estimation procedure for complete and censored data and Bayesian method are used for estimating the parameters involved. Finally, application of the new model to three real datasets is illustrated to show the flexibility and potential of the new model compared to rival models.