A unified approach to minimum variance unbiased estimation of a probability function belonging to an exponential family

The problem of minimum variance unbiased estimation of the probability density function of a random variable belonging to an exponential family is considered. The method of estimation proposed in this paper requires the solution of a certain integral equation. For many probability distributions the solution of this equation is given by a known result in integral transform theory.     

A NOTE ON MULTIVARIATE LOGISTIC MODELS FOR CONTINGENCY TABLES

The log-linear model is a tool widely accepted for modelling discrete data given in a contingency table. Although its parameters reflect the interaction structure in the joint distribution of all variables, it does not give information about structures appearing in the margins of the table. This is in contrast to multivariate logistic parameters, recently introduced by Glonek & McCullagh (1995), which have as parameters the highest order log odds ratios derived from the joint table and from each marginal table. Glonek & McCullagh give the link between the cell probabilities and the multivariate logistic parameters, in an algebraic fashion. The present paper focuses on this link, showing that it is derived by general parameter transformations in exponential families. In particular, the connection between the natural, the expectation and the mixed parameterization in exponential families (Barndorff-Nielsen, 1978) is used; this also yields the derivatives of the likelihood equation and shows properties of the Fisher matrix. The paper emphasises the analysis of independence hypotheses in margins of a contingency table.     

A new family of lifetime models

We introduce a new family of distributions by adding a parameter to the Marshall–Olkin family of distributions. Some properties of the new family of distributions are derived. A particular case of the family, a three-parameter generalization of the exponential distribution, is given special attention. The shape properties, moments, distributions of the order statistics, entropies and estimation procedures are derived. An application to a real data set is discussed.     

指数族分布中参数的经验贝叶斯估计

指数族分布是一类应用广泛的分布类,包括了泊松分布、Gamma分布、Beta分布、二项分布等常见分布.在非寿险中,索赔额或索赔次数过程常常被假定服从指数族分布,由于风险的非齐次性,指数族分布中的参数θ也为随机变量,假定服从指数族共轭先验分布.此时风险参数的估计落入了Bayes框架,风险参数θ的Bayes估计被表达“信度”形式.然而,在实际运用中,由于先验分布与样本分布中仍然含有结构参数,根据样本的边际分布的似然函数估计结构参数,从而获得风险参数的经验Bayes估计,最后证明了该经验Bayes估计是渐近最优的.     

An ordinary differential equation based solution path algorithm

Efron, Hastie, Johnstone and Tibshirani (2004) proposed Least Angle Regression (LAR), a solution path algorithm for the least squares regression. They pointed out that a slight modification of the LAR gives the LASSO (Tibshirani, 1996) solution path. However it is largely unknown how to extend this solution path algorithm to models beyond the least squares regression. In this work, we propose an extension of the LAR for generalized linear models and the quasi-likelihood model by showing that the corresponding solution path is piecewise given by solutions of ordinary differential equation systems. Our contribution is twofold. First, we provide a theoretical understanding on how the corresponding solution path propagates. Second, we propose an ordinary differential equation based algorithm to obtain the whole solution path.     

The likelihood ratio under noncontiguous alternatives

The asymptotic distribution of the likelihood ratio under noncontiguous alternatives is shown to be normal for the exponential family of distributions. The rate of convergence of the parameters to the hypothetical value is specified where the asymptotic noncentral chi-square distribution no longer holds. It is only a little slower than $\O\left( {n^{ - \frac{1}{2}} } \right)$. The result provides compact power approximation formulae and is shown to work reasonably well even for moderate sample sizes.     

On generalized order statistics from linear exponential distribution and its characterization

In this paper, recurrence relations for single and product moments of generalized order statistics (gOSs) from linear exponential distribution (LE) are derived and characterizations of this distribution based on the conditional moments of the gOSs are given.     

On Tests for Equicorrelation Coefficient of a Standard Symmetric Multivariate Normal Distribution

Sampson (1976, 1978) has considered applications of the standard symmetric multivariate normal (SSMN) distribution and the estimation of its equi-correlation coefficient, ρ. Tests for ρ are considered here. The likelihood ratio test suffers from several theoretical and practical shortcomings. We propose the locally most powerful (LMP) test which is globally (one-sided) unbiased, very simple to compute and is based on the best natural unbiased estimator of ρ. Exact null and non-null distributions of the test statistic are presented and percentage points are given. Statistical curvature (Efron, 1975) indicates that its performance improves with mk (sample size × dimension) while exact power computations show that even for reasonably small values of mk the performance is quite encouraging. Recalling Brown's (1971) cautions we establish by local comparison with the LMP similar test for ρ in the SMN (Rao, 1973) distribution, that here the additional information on the mean and variance is quite worthwhile.     

A package of four edited books on structural equations modeling

We consider two analytical and a bootstrap bias correction scheme existing in the literature for maximum likelihood estimators (MLEs) in the special case of a particular biparametric exponential family, the estimators being obtained from i.i.d. samples. We assess the performances of the estimators through numerical simulations for three particular cases of the family explored here. We observe that the two analytical proposals display very similar behavior for these distributions and that all proposed estimators are effective in reducing bias and mean square error of the MLEs.     

On a Relation Between a Family of Distributions Attaining the Bhattacharyya Bound and That of Linear Combinations of the Distributions from an Exponential Family

Abstract

An unbiased estimation problem of a function g(θ) of a real parameter is considered. A relation between a family of distributions for which an unbiased estimator of a function g(θ) attains the general order Bhattacharyya lower bound and that of linear combinations of the distributions from an exponential family is discussed. An example on a family of distributions involving an exponential and a double exponential distributions with a scale parameter is given. An example on a normal distribution with a location parameter is also given.     

On an exponential family

This paper considers a generalization of the exponential type distributions in the class of exponential families. A characterization and a method of generating an exponential family from a given family are given. In particular the generalized gamma, the generalized Poisson, the inverse Gaussian distributions belonging to this family are discussed. The approximations of the cumulative sums for the generalized gamma and the generalized Poisson by the Chi-square are considered. Some of the results are extended to the bivariate case.     

Transmuted generalized exponential distribution: A generalization of the exponential distribution with applications to survival data

In this article, we investigate the potential usefulness of the three-parameter transmuted generalized exponential distribution for analyzing lifetime data. We compare it with various generalizations of the two-parameter exponential distribution using maximum likelihood estimation. Some mathematical properties of the new extended model including expressions for the quantile and moments are investigated. We propose a location-scale regression model, based on the log-transmuted generalized exponential distribution. Two applications with real data are given to illustrate the proposed family of lifetime distributions.     

Switching Order Statistics through Random Power Contractions

This paper investigates a new random contraction scheme which complements the length‐biasing and convolution contraction schemes considered in the literature. A random power contraction is used with order statistics, leading to new and elegant characterizations of the power distribution. In view of Rossberg's counter‐example of a non‐exponential law with exponentially distributed spacings of order statistics, possibly the most appealing consequence of the result is a characterization of the exponential distribution via an independent exponential shift of order statistics.     

Mixture of the Riesz Distribution with Respect to a Multivariate Poisson

The aim of this article is to study a statistical model obtained by the mixture of the Riesz probability distribution on symmetric matrices with respect to a multivariate Poisson distribution. We show that this distribution is related to the modified Bessel function of the first kind. We then determine the domain of the means and the variance function of the generated natural exponential family.     

Probability model choice in single samples from exponential families using Poisson log-linear modelling,and model comparison using Bayes and posterior Bayes factors

This paper describes a method due to Lindsey (1974a) for fitting different exponential family distributions for a single population to the same data, using Poisson log-linear modelling of the density or mass function. The method is extended to Efron's (1986) double exponential family, giving exact ML estimation of the two parameters not easily achievable directly. The problem of comparing the fit of the non-nested models is addressed by both Bayes and posterior Bayes factors (Aitkin, 1991). The latter allow direct comparisons of deviances from the fitted distributions.     

Bootstrap confidence intervals in mixtures of discrete distributions

The problem of building bootstrap confidence intervals for small probabilities with count data is addressed. The law of the independent observations is assumed to be a mixture of a given family of power series distributions. The mixing distribution is estimated by nonparametric maximum likelihood and the corresponding mixture is used for resampling. We build percentile-t and Efron percentile bootstrap confidence intervals for the probabilities and we prove their consistency in probability. The new theoretical results are supported by simulation experiments for Poisson and geometric mixtures. We compare percentile-t and Efron percentile bootstrap intervals with eight other bootstrap or asymptotic theory based intervals. It appears that Efron percentile bootstrap intervals outperform the competitors in terms of coverage probability and length.     

An extension of the generalized exponential distribution

The two-parameter generalized exponential distribution has been used recently quite extensively to analyze lifetime data. In this paper the two-parameter generalized exponential distribution has been embedded in a larger class of distributions obtained by introducing another shape parameter. Because of the additional shape parameter, more flexibility has been introduced in the family. It is observed that the new family is positively skewed, and has increasing, decreasing, unimodal and bathtub shaped hazard functions. It can be observed as a proportional reversed hazard family of distributions. This new family of distributions is analytically quite tractable and it can be used quite effectively to analyze censored data also. Analyses of two data sets are performed and the results are quite satisfactory.     

More on progressively Type‐II censored order statistics for multivariate observations

In this paper, we consider some results on distribution theory of multivariate progressively Type‐II censored order statistics. We also establish some characterizations of Freund's bivariate exponential distribution based on the lack of memory property.     

Inference in a two-parameter generalized order statistics model

As a submodel of generalized order statistics with two unknown model parameters, m-generalized order statistics may serve as a simple model for ordered quantities in a given application. It is shown that the joint distribution of m-generalized order statistics has a representation as a regular exponential family in the model parameters, as it is the case for the comprising model. Utilizing this finding, a minimal sufficient and complete statistic is obtained along with distributional properties. Joint maximum likelihood estimation of the parameters is considered, and strong consistency and asymptotic efficiency of the estimator are established. A test is provided to decide whether a restriction to the submodel is reasonable.     

On the moments of record values

In this paper some general relations for expectations of functions of record values are established. It is seen that these relations may be used to obtain recurrence relations for moments of record values. Bounds on expectations of record values with numerical computations are presented. Applications to the characterizations of the generalizeed exponential distribution are also given.