Characterization based on generalized entropy of order statistics

ABSTRACT

In the present study, several characterizations of order statistics are obtained on the basis of the generalized entropy. Under some conditions, it is shown that the parent distribution can be uniquely determined by equality of generalized entropy of order statistics.     

A new lifetime model with decreasing,increasing, bathtub-shaped,and upside-down bathtub-shaped hazard rate function

A new three-parameter distribution with decreasing, increasing, bathtub-shaped and upside-down bathtub-shaped hazard rate function is proposed. The new distribution encompasses some previously known distributions as special cases. Basic mathematical properties of the new distribution (including the moment-generating function, moments, order statistics properties, Rényi entropy and stress–strength parameter) are derived. Its parameters are estimated by the method of maximum likelihood. An application is illustrated using a real data set.     

Rényi entropy properties of records

We provide bounds for Rényi entropy of records. We also show that the Rényi entropy ordering of random variables determines the Rényi entropy ordering of their respective records. We characterize exponential distribution by maximization of Rényi entropy under some conditions. We show that Rényi distance between distribution of records and parent distribution is distribution free.     

A generalized normal distribution

Undoubtedly, the normal distribution is the most popular distribution in statistics. In this paper, we introduce a natural generalization of the normal distribution and provide a comprehensive treatment of its mathematical properties. We derive expressions for the nth moment, the nth central moment, variance, skewness, kurtosis, mean deviation about the mean, mean deviation about the median, Rényi entropy, Shannon entropy, and the asymptotic distribution of the extreme order statistics. We also discuss estimation by the methods of moments and maximum likelihood and provide an expression for the Fisher information matrix.     

Some Characterizations Based on Entropy of Order Statistics and Record Values

In the literature of information theory, Shannon entropy plays an important role and in the context of reliability theory, order statistics and record values are used for statistical modeling. The aim of this article is characterizing the parent distributions based on Shannon entropy of order statistics and record values. It is shown that the equality of the Shannon information in order statistics or record values can determine uniquely the parent distribution. The exponential distribution is characterized through maximizing Shannon entropy of record values under some constraints. The results are useful in the modeling problems.     

A complementary generalized linear failure rate-geometric distribution

In this article, we shall attempt to introduce a new class of lifetime distributions, which enfolds several known distributions such as the generalized linear failure rate distribution and covers both positive as well as negative skewed data. This new four-parameter distribution allows for flexible hazard rate behavior. Indeed, the hazard rate function here can be increasing, decreasing, bathtub-shaped, or upside-down bathtub-shaped. We shall first study some basic distributional properties of the new model such as the cumulative distribution function, the density of the order statistics, their moments, and Rényi entropy. Estimation of the stress-strength parameter as an important reliability property is also studied. The maximum likelihood estimation procedure for complete and censored data and Bayesian method are used for estimating the parameters involved. Finally, application of the new model to three real datasets is illustrated to show the flexibility and potential of the new model compared to rival models.     

Statistical estimation of quadratic Rényi entropy for a stationary m-dependent sequence

The Rényi entropy is a generalisation of the Shannon entropy and is widely used in mathematical statistics and applied sciences for quantifying the uncertainty in a probability distribution. We consider estimation of the quadratic Rényi entropy and related functionals for the marginal distribution of a stationary m-dependent sequence. The U-statistic estimators under study are based on the number of ε-close vector observations in the corresponding sample. A variety of asymptotic properties for these estimators are obtained (e.g. consistency, asymptotic normality, and Poisson convergence). The results can be used in diverse statistical and computer science problems whenever the conventional independence assumption is too strong (e.g. ε-keys in time series databases and distribution identification problems for dependent samples).     

Rényi entropy of m-generalized order statistics

Abstract

Characterizing relations via Rényi entropy of m-generalized order statistics are considered along with examples and related stochastic orderings. Previous results for common order statistics are included.     

On Estimating the Residual Rényi Entropy under Progressive Censoring

In this article, the residual Rényi entropy (RRE) as a measure of uncertainty is considered in progressively Type II censored samples and some properties of it are investigated. The RRE of sth order statistic from a continuous distribution function is represented in terms of the RRE of the sth order statistic from uniform distribution. In general, we do not have a closed form for RRE of order statistics in most of distributions. This gives us a motivation for obtaining some bounds for RRE in progressively censored samples. In addition, two estimators are proposed for RRE. The performance of these estimators is compared using simulation studies.     

Exponentiated power Lindley power series class of distributions: Theory and applications

ABSTRACT

We introduce a new four-parameter generalization of the exponentiated power Lindley (EPL) distribution, called the exponentiated power Lindley power series (EPLPS) distribution. The new distribution arises on a latent complementary risks scenario, in which the lifetime associated with a particular risk is not observable; rather, we observe only the minimum lifetime value among all risks. The distribution exhibits a variety of bathtub-shaped hazard rate functions. It contains as particular cases several lifetime distributions. Various properties of the distribution are investigated including closed-form expressions for the density function, cumulative distribution function, survival function, hazard rate function, the rth raw moment, and also the moments of order statistics. Expressions for the Rényi and Shannon entropies are also given. Moreover, we discuss maximum likelihood estimation and provide formulas for the elements of the Fisher information matrix. Finally, two data applications are given showing flexibility and potentiality of the EPLPS distribution.     

Rényi Statistics in Directed Families of Exponential Experiments*

Rényi statistics are considered in a directed family of general exponential models. These statistics are defined as Rényi distances between estimated and hypothetical model. An asymptotically quadratic approximation to the Rényi statistics is established, leading to similar asymptotic distribution results as established in the literature for the likelihood ratio statistics. Some arguments in favour of the Rényi statistics are discussed, and a numerical comparison of the Rényi goodness-of-fit tests with the likelihood ratio test is presented.     

Pareto Poisson–Lindley distribution with applications

A new lifetime distribution is introduced based on compounding Pareto and Poisson–Lindley distributions. Several statistical properties of the distribution are established, including behavior of the probability density function and the failure rate function, heavy- and long-right tailedness, moments, the Laplace transform, quantiles, order statistics, moments of residual lifetime, conditional moments, conditional moment generating function, stress–strength parameter, Rényi entropy and Song's measure. We get maximum-likelihood estimators of the distribution parameters and investigate the asymptotic distribution of the estimators via Fisher's information matrix. Applications of the distribution using three real data sets are presented and it is shown that the distribution fits better than other related distributions in practical uses.     

The Marshall-Olkin Fréchet Distribution

We introduce a new distribution, namely Marshall–Olkin Fréchet distribution. The probability density and hazard rate functions are derived and their shape properties are considered. Expressions for the nth moments are given. Various results with respect to quantiles, Rényi entropy and order statistics are obtained. The unknown parameters of the new distribution are estimated using the maximum likelihood estimation method adopting three different iterative procedures. The model is applied on a real data set on survival times.

[Supplementary materials are available for this article. Go to the publisher's online edition of Communications in Statistics—Theory and Methods for the following free supplemental resource: A file that will allow the random variables from MOF distribution to be generated.]     

A new lifetime model with decreasing failure rate

In this paper, we introduce a new lifetime distribution by compounding exponential and Poisson–Lindley distributions, named the exponential Poisson–Lindley (EPL) distribution. A practical situation where the EPL distribution is most appropriate for modelling lifetime data than exponential–geometric, exponential–Poisson and exponential–logarithmic distributions is presented. We obtain the density and failure rate of the EPL distribution and properties such as mean lifetime, moments, order statistics and Rényi entropy. Furthermore, estimation by maximum likelihood and inference for large samples are discussed. The paper is motivated by two applications to real data sets and we hope that this model will be able to attract wider applicability in survival and reliability.     

On generalized conditional cumulative residual inaccuracy measure

Abstract

Recently, the notion of cumulative residual Rényi’s entropy has been proposed in the literature as a measure of information that parallels Rényi’s entropy. Motivated by this, here we introduce a generalized measure of it, namely cumulative residual inaccuracy of order α. We study the proposed measure for conditionally specified models of two components having possibly different ages called generalized conditional cumulative residual inaccuracy measure. Several properties of generalized conditional cumulative residual inaccuracy measure including the effect of monotone transformation are investigated. Further, we provide some bounds on using the usual stochastic order and characterize some bivariate distributions using the concept of conditional proportional hazard rate model.     

On the Marshall–Olkin extended Weibull distribution

We study some mathematical properties of the Marshall–Olkin extended Weibull distribution introduced by Marshall and Olkin (Biometrika 84:641–652, 1997). We provide explicit expressions for the moments, generating and quantile functions, mean deviations, Bonferroni and Lorenz curves, reliability and Rényi entropy. We determine the moments of the order statistics. We also discuss the estimation of the model parameters by maximum likelihood and obtain the observed information matrix. We provide an application to real data which illustrates the usefulness of the model.     

The Marshall–Olkin extended generalized Lindley distribution: Properties and applications

In this article, we define and study a new three-parameter model called the Marshall–Olkin extended generalized Lindley distribution. We derive various structural properties of the proposed model including expansions for the density function, ordinary moments, moment generating function, quantile function, mean deviations, Bonferroni and Lorenz curves, order statistics and their moments, Rényi entropy and reliability. We estimate the model parameters using the maximum likelihood technique of estimation. We assess the performance of the maximum likelihood estimators in a simulation study. Finally, by means of two real datasets, we illustrate the usefulness of the new model.     

Tests of fit for the Laplace distribution based on correcting moments of entropy estimators

ABSTRACT

In this paper, we first consider the entropy estimators introduced by Vasicek [A test for normality based on sample entropy. J R Statist Soc, Ser B. 1976;38:54–59], Ebrahimi et al. [Two measures of sample entropy. Stat Probab Lett. 1994;20:225–234], Yousefzadeh and Arghami [Testing exponentiality based on type II censored data and a new cdf estimator. Commun Stat – Simul Comput. 2008;37:1479–1499], Alizadeh Noughabi and Arghami [A new estimator of entropy. J Iran Statist Soc. 2010;9:53–64], and Zamanzade and Arghami [Goodness-of-fit test based on correcting moments of modified entropy estimator. J Statist Comput Simul. 2011;81:2077–2093], and the nonparametric distribution functions corresponding to them. We next introduce goodness-of-fit test statistics for the Laplace distribution based on the moments of nonparametric distribution functions of the aforementioned estimators. We obtain power estimates of the proposed test statistics with Monte Carlo simulation and compare them with the competing test statistics against various alternatives. Performance of the proposed new test statistics is illustrated in real cases.     

Renyi Entropy Properties of Order Statistics

In this article, we discuss some properties of Renyi entropy and Renyi information of order statistics. Some bounds for Renyi entropy of order statistics are obtained. Also, we relate Renyi entropy ordering of order statistics to Renyi entropy ordering and other well known orderings of parent random variables. Then it is proved that the Renyi information between order statistics and parent random variable is distribution free, and it is shown, as expected, the distance is minimum for the median.     

The exponentiated exponential distribution: a survey

The exponentiated exponential distribution, a most attractive generalization of the exponential distribution, introduced by Gupta and Kundu (Aust. N. Z. J. Stat. 41:173–188, 1999) has received widespread attention. It appears, however, that many mathematical properties of this distribution have not been known or have not been known in simpler/general forms. In this paper, we provide a comprehensive survey of the mathematical properties. We derive expressions for the moment generating function, characteristic function, cumulant generating function, the nth moment, the first four moments, variance, skewness, kurtosis, the nth conditional moment, the first four cumulants, mean deviation about the mean, mean deviation about the median, Bonferroni curve, Lorenz curve, Bonferroni concentration index, Gini concentration index, Rényi entropy, Shannon entropy, cumulative residual entropy, Song’s measure, moments of order statistics, L moments, asymptotic distribution of the extreme order statistics, reliability, distribution of the sum of exponentiated exponential random variables, distribution of the product of exponentiated exponential random variables and the distribution of the ratio of exponentiated exponential random variables. We also discuss estimation by the method of maximum likelihood, including the case of censoring, and provide simpler expressions for the Fisher information matrix than those given by Gupta and Kundu. It is expected that this paper could serve as a source of reference for the exponentiated exponential distribution and encourage further research.