The Pearson Diffusions: A Class of Statistically Tractable Diffusion Processes

Abstract.  The Pearson diffusions form a flexible class of diffusions defined by having linear drift and quadratic squared diffusion coefficient. It is demonstrated that for this class explicit statistical inference is feasible. A complete model classification is presented for the ergodic Pearson diffusions. The class of stationary distributions equals the full Pearson system of distributions. Well-known instances are the Ornstein–Uhlenbeck processes and the square root (CIR) processes. Also diffusions with heavy-tailed and skew marginals are included. Explicit formulae for the conditional moments and the polynomial eigenfunctions are derived. Explicit optimal martingale estimating functions are found. The discussion covers GMM, quasi-likelihood, non-linear weighted least squares estimation and likelihood inference too. The analytical tractability is inherited by transformed Pearson diffusions, integrated Pearson diffusions, sums of Pearson diffusions and Pearson stochastic volatility models. For the non-Markov models, explicit optimal prediction-based estimating functions are found. The estimators are shown to be consistent and asymptotically normal.     

A class of maximum-entropy multivariate distributions

This paper characterizes a class of multivariate distributions that includes the multinormal and is contained in the exponential family. The wide range of possible applications of these distributions is suggested by some of hte characteristics germane to them: First, they maximize Shannon's entropy among all distributions that have finite moments of given orders. As such, they constitute a class of distributions that includes the multinormal and some likely alternatives. Second, they can exhibit several modes, and, further-more, they do so with a relatively small number of parameters (compared to mixtures of multinormals). Third, they are the stationary distributions of certain diffusion processes. Fourth, they approximate, near the multinormal, the multivariate Pearson family. And fifth, the maximum likelihood estimators of their population moments are the sample moments. Two possible methods of estimating the distributions are studied in this paper: maximum likelihood estimation, and a fast procedure that can be used to find consistent estimators of the parameters via sample moments. A FORTTAN subroutine that implements the latter method is also provided.     

The generalized transmuted-G family of distributions

We introduce a new class of continuous distributions called the generalized transmuted-G family which extends the transmuted-G class. We provide six special models of the new family. Some of its mathematical properties including explicit expressions for the ordinary and incomplete moments, generating function, Rényi and Shannon entropies, order statistics and probability weighted moments are derived. The estimation of the model parameters is performed by maximum likelihood. The flexibility of the proposed family is illustrated by means of three applications to real data sets.     

Weighted discrepancies and maximum likelihood estimation for discrete distributions

The paper shows that many estimation methods, including ML, moments, even-points, empirical c.f. and minimum chi-square, can be regarded as scoring procedures using weighted sums of the discrepancies between observed and expected frequencies The nature of the weights is investigated for many classes of distributions; the study of approximations to the weights clarifies the relationships between estimation methods, and also leads to useful formulae for initial values for ML iteration.     

On the distribution of the maximum of bivariate normal random variables with general means and variances

A great amount of effort has been devoted to achieving exact expressions for moments of order statistics of independent normal random variables, as well as the dependent case with the same correlation coefficients, means and variances. It does not seem as if there are handy formulae for the order statistics of even the simple bivariate normal random variables when the means and variances are allowed to be different. In this paper we give an explicit formula for the Lanl ace-Stielties Transform of the maximum of bivariate normal random variables by which we obtain formulae for the first two moments in the standard way.     

On some aspects of a flexible class of additive Weibull distribution

Here we consider a more flexible class of the additive Weibull distribution of Xie and Lai (Reliab. Eng. Syst. Safety, 1995) and investigate some of its important properties such as expressions for its cumulative distribution function, reliability measures, quantile function, characteristic function, raw moments, incomplete moments, etc. The distribution and moments of order statistics are obtained along with certain structural properties. The maximum-likelihood estimation of the parameters of the distribution is attempted and the usefulness of the model in certain applied areas is illustrated with the help of certain real life data sets.     

Third and fourth moments of vector autoregressions with regime switching

We derive matrix formulae in closed form for the unconditional third and fourth moments of a broad class of vector autoregressive time series with regime switching. First and second moments are well known. New measures of multivariate skewness and kurtosis are introduced and basic properties are investigated. The knowledge of series level, variation, co-movements, skewness, and kurtosis is useful to support model interpretation in real data application. Numerical examples complete the paper.     

The exponential COM-Poisson distribution

The Conway-Maxwell Poisson (COMP) distribution as an extension of the Poisson distribution is a popular model for analyzing counting data. For the first time, we introduce a new three parameter distribution, so-called the exponential-Conway-Maxwell Poisson (ECOMP) distribution, that contains as sub-models the exponential-geometric and exponential-Poisson distributions proposed by Adamidis and Loukas (Stat Probab Lett 39:35?C42, 1998) and Ku? (Comput Stat Data Anal 51:4497?C4509, 2007), respectively. The new density function can be expressed as a mixture of exponential density functions. Expansions for moments, moment generating function and some statistical measures are provided. The density function of the order statistics can also be expressed as a mixture of exponential densities. We derive two formulae for the moments of order statistics. The elements of the observed information matrix are provided. Two applications illustrate the usefulness of the new distribution to analyze positive data.     

The compound class of linear failure rate-power series distributions: Model,properties, and applications

In this article, a new class of distributions is introduced, which generalizes the linear failure rate distribution and is obtained by compounding this distribution and power series class of distributions. This new class of distributions is called the linear failure rate-power series distributions and contains some new distributions such as linear failure rate-geometric, linear failure rate-Poisson, linear failure rate-logarithmic, linear failure rate-binomial distributions, and Rayleigh-power series class of distributions. Some former works such as exponential-power series class of distributions, exponential-geometric, exponential-Poisson, and exponential-logarithmic distributions are special cases of the new proposed model. The ability of the linear failure rate-power series class of distributions is in covering five possible hazard rate function, that is, increasing, decreasing, upside-down bathtub (unimodal), bathtub and increasing-decreasing-increasing shaped. Several properties of this class of distributions such as moments, maximum likelihood estimation procedure via an EM-algorithm and inference for a large sample, are discussed in this article. In order to show the flexibility and potentiality, the fitted results of the new class of distributions and some of its submodels are compared using two real datasets.     

Moments of order statistics of the standard two-sided power distribution

The standard two-sided power distribution is a flexible distribution having uniform, power function and triangular as subdistributions, and it is a reasonable alternative to the Laplace distribution in some cases. In this work, computationally efficient expressions for moments of order statistics, expressions for L-moments, and asymptotic results for sample extrema are derived. Then a simulation study is performed for the location-scale estimation problem of a small data set by considering the maximum likelihood estimation method and the best linear unbiased estimation method based on the moments of order statistics.     

Estimating Moments in Linear Mixed Models

In this article, we investigate estimating moments, up to fourth order, in linear mixed models. For this estimation, we only assume the existence of moments. The obtained estimators of the model parameters and the third and fourth moments of the errors and random effects are proved to be consistent or asymptotically normal. The estimation provides a base for further statistical inference such as confidence region construction and hypothesis testing for the parameters of interest. Moreover, the method is readily extended to estimate higher moments. A simulation is carried out to examine the performance of this estimating method.     

Application of minque procedure to block designs

Method of minimum norm quadratic unbiased estimation (MINQUE) is applied to incomplete block designs. Simple formulae are derived for a class of designs which includes the balanced designs.     

Moments of sample moments

The problem offinding expressions for sampling moments of sample moments has been ahistorically old one. This problem is treated here, with the use of partitions and multi partitions , for the univariate as well as the multivariate case. The systematic combinatorial approach minimizes the chance of omitting any

contributions and making errors in their computation. Componentwise identification is made possible , soerrors can be located. From the complete set of general moment formulae, s pecial cases may be obtained by identifying identical variables.     

Robust Bayesian analysis of the binomial empirical Bayes problem

Empirical Bayes estimation is considered for an i.i.d. sequence of binomial parameters θ_i arising from an unknown prior distribution G(.). This problem typically arises in industrial sampling, where samples from lots are routinely used to estimate the lot fraction defective of each lot. Two related issues are explored. The first concerns the fact that only the first few moments of G are typically estimable from the data. This suggests consideration of the interval of estimates (e.g., posterior means) corresponding to the different possible G with the specified moments. Such intervals can be obtained by application of well-known moment theory. The second development concerns the need to acknowledge the uncertainty in the estimation of the first few moments of G. Our proposal is to determine a credible set for the moments, and then find the range of estimates (e.g., posterior means) corresponding to the different possible G with moments in the credible set.     

On periodic time-varying bilinear processes: structure and asymptotic inference

This paper is devoted to the bilinear time series models with periodic-varying coefficients \(\left( { PBL}\right) \). So, firstly conditions ensuring the existence of periodic stationary solutions of the \({ PBL}\) and the existence of higher-order moments of such solutions are given. A distribution free approach to the parameter estimation of \({ PBL}\) is presented. The proposed method relies on minimum distance estimator based on the first and second order empirical moments of the observed process. Consistency and asymptotic normality of the estimator are discussed. Examples and Monte Carlo simulation results illustrate the practical relevancy of our general theoretical results are presented.     

On the computing of the moments of bivariate order statistics

In this paper, we establish general recurrence relations satisfied by the product moments (of any order) of bivariate order statistics from any arbitrary bivariate uniform distribution function. Moreover, we present formulae to easily compute the product moments (of any order) of bivariate order statistics from any arbitrary bivariate distribution function, with positive left endpoints, or with negative right endpoints.     

Relationships Between Central Moments and Cumulants,with Formulae for the Central Moments of Gamma Distributions

Abstract

Simple expressions are presented that relate cumulants to central moments without involving moments about the origin. These expressions are used to obtain recursive formulae for the central moments of the gamma distribution, with exponential and chi-square distributions as special cases.     

Importance sampling with the generalized exponential power density

In this paper, the generalized exponential power (GEP) density is proposed as an importance function in Monte Carlo simulations in the context of estimation of posterior moments of a location parameter. This density is divided in five classes according to its tail behaviour which may be exponential, polynomial or logarithmic. The notion of p-credence is also defined to characterize and to order the tails of a large class of symmetric densities by comparing their tails to those of the GEP density.The choice of the GEP density as an importance function allows us to obtain reliable and effective results when p-credences of the prior and the likelihood are defined, even if there are conflicting sources of information. Characterization of the posterior tails using p-credence can be done. Hence, it is possible to choose parameters of the GEP density in order to have an importance function with slightly heavier tails than the posterior. Simulation of observations from the GEP density is also addressed.     

Truncated inverted generalized exponential distribution and its properties

The inverted generalized exponential distribution is defined as an alternative model for lifetime data. The existence of moments of this distribution is shown to hold under some restrictions. However, all the moments exist for the truncated inverted generalized exponential distribution and closed-form expressions for them are derived in this article. The distributional properties of this truncated distribution are studied. Maximum likelihood estimation method is discussed for the estimation of the parameters of the distribution both theoretically and empirically. In order to see the modeling performance of the distribution, two real datasets are analyzed.     

Adjusted Pearson residuals in beta regression models

In this paper, matrix formulae of order n^?1, where n is the sample size, for the first two moments of Pearson residuals are obtained in beta regression models. Adjusted Pearson residuals are also obtained, having, to this order, expected value zero and variance one. Monte Carlo simulation results are presented illustrating the behaviour of both adjusted and unadjusted residuals.