Location and Scale Parameter Family of Distributions Attaining the Bhattacharyya Bound

It is well known that, under appropriate regularity conditions, the variance of an unbiased estimator of a real-valued function of an unknown parameter can coincide with the Cramér–Rao lower bound only if the family of distributions is a one-parameter exponential family. But it seems that the necessary conditions about the probability distribution for which there exists an unbiased estimator whose variance coincides with the Bhattacharyya lower bound are not completely known. The purpose of this paper is to specify the location, scale, and location-scale parameter family of distributions attaining the general order Bhattacharyya bound in certain class.     

Niveaudurchagangszeiten zur charakterisierung sequentieller schätzverfahren

Let θ be a parameter of a homogenous additive stochastic process. In order to get an unbiased and efficient estimator for a function h(v) one has often to use sequential procedures. In this paper we consider processes of the socalled exponential class. We study level crossing times, which characterize certain sequential estimations. It is shown that the family of level crossing times for an increasing sequence of levels is also a process of the exponential class. The density function of the one-dimensional probability distributions of this new process is given Examples and applications conclude the paper.     

Minimax Estimation of the Bounded Parameter of Some Discrete Distributions Under LINEX Loss Function

For a class of discrete distributions, including Poisson(θ), Generalized Poisson(θ), Borel(m, θ), etc., we consider minimax estimation of the parameter θ under the assumption it lies in a bounded interval of the form [0, m] and a LINEX loss function. Explicit conditions for the minimax estimator to be Bayes with respect to a boundary supported prior are given. Also for Bernoulli(θ)-distribution, which is not in the mentioned class of discrete distributions, we give conditions for which the Bayes estimator of θ ∈ [0, m], m < 1 with respect to a boundary supported prior is minimax under LINEX loss function. Numerical values are given for the largest values of m for which the corresponding Bayes estimators of θ are minimax.     

On a Class of Distributions Defined by the Relationship Between Their Density and Distribution Functions

Knowledge concerning the family of univariate continuous distributions with density function f and distribution function F defined through the relation f(x) = F ^α(x)(1 ? F(x))^β, α, β ? , is reviewed and modestly extended. Symmetry, modality, tail behavior, order statistics, shape properties based on the mode, L-moments, and—for the first time—transformations between members of the family are the general properties considered. Fully tractable special cases include all the complementary beta distributions (including uniform, power law and cosine distributions), the logistic, exponential and Pareto distributions, the Student t distribution on 2 degrees of freedom and, newly, the distribution corresponding to α = β = 5/2. The logistic distribution is central to some of the developments of the article.     

Some aspects of the theory of estimating equations

An estimating equation for a parameter θ, based on an observation ?, is an equation g(x,θ)=0 which can be solved for θ in terms of x. An estimating equation is unbiased if the funaction g has 0 mean for every θ. For the case when the form of the frequency function p(x,θ) is completely specified up to the unknown real parameter θ, the optimality of the m.1 equation $\text{?}\text{log}\text{p}\text{?θ}\text{=0}$ in the class of all unbiased estimating equations was established by Godambe (1960). In this paper we allow the form of the frequency function p to vary assuming that $\text{x=(x}{}_1\text{,…,x}{}_{\mathrm{n}}\text{)?}\text{R}{}^{\mathrm{n}}$ and that under p, E(x_i)=θ. x₁,…, x_n are independent observations on a variate x, it is shown that among all the unbiased estimating equations for θ, $\text{x}\text{?}\text{?θ=0}$ is uniquely optimum up to a constant multiple.     

LINEAR MINIMAX ESTIMATORS FOR ESTIMATING A FUNCTION OF THE PARAMETER

In this note we provide sufficient conditions for the minimaxity of linear estimators of the form aX+b in the one-parameter exponential family for estimating a differentiable function g(θ) with normalized quadratic loss. We provide some examples which show that the natural estimator X is minimax in estimating a function of the parameter (different from the mean).     

The Beta Product Distribution with Complex Parameters

The family consisting of the distributions of products of two independent beta variables is extended to include cases where some of the parameters are not positive but negative or complex. This “beta product” distribution is expressible as a Meijer G function. An example (from risk theory) where such a distribution arises is given: an infinite sum of products of independent random variables is shown to have a distribution that is the product convolution of a complex-parameter beta product and an independent exponential. The distribution of the infinite sum is a new explicit solution of the stochastic equation X = (in law) B(X + C). Characterizations of some G distributions are also proved.     

Properties and Inference on the Skew-Curved-Symmetric Family of Distributions

In this article, we study some results related to a specific class of distributions, called skew-curved-symmetric family of distributions that depends on a parameter controlling the skewness and kurtosis at the same time. Special elements of this family which are studied include symmetric and well-known asymmetric distributions. General results are given for the score function and the observed information matrix. It is shown that the observed information matrix is always singular for some special cases. We illustrate the flexibility of this class of distributions with an application to a real dataset on characteristics of Australian athletes.     

Fisher information in weighted distributions

Suppose that a density f_θ (x) belongs to an exponential family, but that inference about θ must be based on data that are obtained from a density that is proportional to W(x)f_θ(x). The authors study the Fisher information about θ in observations obtained from such weighted distributions and give conditions under which this information is greater than under the original density. These conditions involve the hazard- and reversed-hazard-rate functions.     

The interpretation of maximum-likelihood estimation

Maximum-likelihood estimation is interpreted as a procedure for generating approximate pivotal quantities, that is, functions u(X;θ) of the data X and parameter θ that have distributions not involving θ. Further, these pivotals should be efficient in the sense of reproducing approximately the likelihood function of θ based on X, and they should be approximately linear in θ. To this end the effect of replacing θ by a parameter ϕ = ϕ(θ) is examined. The relationship of maximum-likelihood estimation interpreted in this way to conditional inference is discussed. Examples illustrating this use of maximum-likelihood estimation on small samples are given.     

On the Exponential Decay Rate of the Tail of a Discrete Probability Distribution

Abstract

We give a sufficient condition for the exponential decay of the tail of a discrete probability distribution π = (π _n ) _n≥0 in the sense that lim _n→∞(1/n) log∑ _i>n π _i  = ?θ with 0 < θ < ∞. We focus on analytic properties of the probability generating function of a discrete probability distribution, especially, the radius of convergence and the number of poles on the circle of convergence. Furthermore, we give an example of an M/G/1 type Markov chain such that the tail of its stationary distribution does not decay exponentially.     

Nuisance Parameters and the Use of Exploratory Graphical Methods in a Bayesian Analysis

Consider the problem of inference about a parameter θ in the presence of a nuisance parameter v. In a Bayesian framework, a number of posterior distributions may be of interest, including the joint posterior of (θ, ν), the marginal posterior of θ, and the posterior of θ conditional on different values of ν. The interpretation of these various posteriors is greatly simplified if a transformation (θ, h(θ, ν)) can be found so that θ and h(θ, v) are approximately independent. In this article, we consider a graphical method for finding this independence transformation, motivated by techniques from exploratory data analysis. Some simple examples of the use of this method are given and some of the implications of this approximate independence in a Bayesian analysis are discussed.     

On bivariate transformation of scale distributions

ABSTRACT

Elsewhere, I have promoted (univariate continuous) “transformation of scale” (ToS) distributions having densities of the form 2g(Π^?1(x)) where g is a symmetric distribution and Π is a transformation function with a special property. Here, I develop bivariate (readily multivariate) ToS distributions. Univariate ToS distributions have a transformation of random variable relationship with Azzalini-type skew-symmetric distributions; the bivariate ToS distribution here arises from marginal variable transformation of a particular form of bivariate skew-symmetric distribution. Examples are given, as are basic properties—unimodality, a covariance property, random variate generation—and connections with a bivariate inverse Gaussian distribution are pointed out.     

Diagrams for Set Theory & Probability Problems of Four or More Variables

It is pointed out that in many one-sided testing situations for a real-valued parameter θ, the monotonicity of the power function hinges on the stochastic order of the underlying family of distributions [F_θ] rather than on the stronger property of monotone likelihood ratio of the family. An elementary proof, accessible to students of introductory probability and statistics, is presented.     

Third-Order Asymptotic Distributions of Classic Test Statistics for One-Parameter Exponential Family Models

ABSTRACT

In this article we derive third-order asymptotic expansions for the non null distribution functions of four classic statistics under a sequence of local alternatives in one-parameter exponential family models. Our results are quite general and cover a wide range of important distributions.     

A new class of skew-symmetric distributions and related families

In this work, we investigate a new class of skew-symmetric distributions, which includes the distributions with the probability density function (pdf) given by g _α(x)=2f(x) G(α x), introduced by Azzalini [A class of distributions which includes the normal ones, Scand. J. Statist. 12 (1985), pp. 171–178]. We call this new class as the symmetric-skew-symmetric family and it has the pdf proportional to f(x) G _β(α x), where G _β(x) is the cumulative distribution function of g _β(x). We give some basic properties for the symmetric-skew-symmetric family and study the particular case obtained from the normal distribution.     

On estimation of R=P(Y<X) for exponential distribution under progressive type-II censoring

This paper deals with the estimation of the stress–strength parameter R=P(Y<X), when X and Y are independent exponential random variables, and the data obtained from both distributions are progressively type-II censored. The uniformly minimum variance unbiased estimator and the maximum-likelihood estimator (MLE) are obtained for the stress–strength parameter. Based on the exact distribution of the MLE of R, an exact confidence interval of R has been obtained. Bayes estimate of R and the associated credible interval are also obtained under the assumption of independent inverse gamma priors. An extensive computer simulation is used to compare the performances of the proposed estimators. One data analysis has been performed for illustrative purpose.     

Exponential Family Techniques for the Lognormal Left Tail

Let X be lognormal(μ,σ²) with density f(x); let θ > 0 and define . We study properties of the exponentially tilted density (Esscher transform) f_θ(x) = e^?θxf(x)/L(θ), in particular its moments, its asymptotic form as θ→∞ and asymptotics for the saddlepoint θ(x) determined by . The asymptotic formulas involve the Lambert W function. The established relations are used to provide two different numerical methods for evaluating the left tail probability of the sum of lognormals S_n=X₁+?+X_n: a saddlepoint approximation and an exponential tilting importance sampling estimator. For the latter, we demonstrate logarithmic efficiency. Numerical examples for the cdf F_n(x) and the pdf f_n(x) of S_n are given in a range of values of σ²,n and x motivated by portfolio value‐at‐risk calculations.     

The Gamma Distribution as a Mixture of Exponential Distributions

A gamma distribution with arbitrary scale parameter θ and shape parameter r < 1 can be represented as a scale mixture of exponential distributions.     

Graphical Tests for the Frailty Distribution in the Shared Frailty Model

We extend a diagnostic plot for the frailty distribution in proportional hazards models to the case of shared frailty. The plot is based on a closure property of exponential family failure distributions with canonical statistics z and g(z), namely that the frailty distribution among survivors at time t has the same form, with the same values of the parameters associated with g(z). We extend this property to shared frailty, considering various definitions of a “surviving” cluster at time t. We illustrate the effectiveness of the method in the case where the “death” of the cluster is defined by the first death among its members.