Mixtures of Mixtures Based on Multiresolution Analysis Theory

In this article, the approaches for exploiting mixtures of mixtures are expanded by using the Multiresolution family of probability density functions (MR pdf). The flexibility and the properties of local analysis of the MR pdf facilitate the location of subpopulations into a given population. In order to do this, two algorithms are provided.

The MR model is more flexible in adapting to the different subpopulations than the traditional mixtures. In addition, the problems of identification of mixtures distributions and the label-switching do not appear in the MR pdf context.     

Adaptive rejection sampling with fixed number of nodes

The adaptive rejection sampling (ARS) algorithm is a universal random generator for drawing samples efficiently from a univariate log-concave target probability density function (pdf). ARS generates independent samples from the target via rejection sampling with high acceptance rates. Indeed, ARS yields a sequence of proposal functions that converge toward the target pdf, so that the probability of accepting a sample approaches one. However, sampling from the proposal pdf becomes more computational demanding each time it is updated. In this work, we propose a novel ARS scheme, called Cheap Adaptive Rejection Sampling (CARS), where the computational effort for drawing from the proposal remains constant, decided in advance by the user. For generating a large number of desired samples, CARS is faster than ARS.     

Deriving the Probability Density for Sums of Uniform Random Variables

A simple procedure for deriving the probability density function (pdf) for sums of uniformly distributed random variables is offered. This method is suited to introductory courses in probability and mathematical statistics. In our experience, deriving and working with the pdf for sums of random variables facilitates an understanding of the convergence properties of the density of such sums and motivates consideration of other algebraic manipulation for random variables.     

A generalization of the adaptive rejection sampling algorithm

Rejection sampling is a well-known method to generate random samples from arbitrary target probability distributions. It demands the design of a suitable proposal probability density function (pdf) from which candidate samples can be drawn. These samples are either accepted or rejected depending on a test involving the ratio of the target and proposal densities. The adaptive rejection sampling method is an efficient algorithm to sample from a log-concave target density, that attains high acceptance rates by improving the proposal density whenever a sample is rejected. In this paper we introduce a generalized adaptive rejection sampling procedure that can be applied with a broad class of target probability distributions, possibly non-log-concave and exhibiting multiple modes. The proposed technique yields a sequence of proposal densities that converge toward the target pdf, thus achieving very high acceptance rates. We provide a simple numerical example to illustrate the basic use of the proposed technique, together with a more elaborate positioning application using real data.     

Density modification-based reliability sensitivity analysis

Sensitivity analysis (SA) of a numerical model, for instance simulating physical phenomena, is useful to quantify the influence of the inputs on the model responses. This paper proposes a new sensitivity index, based upon the modification of the probability density function (pdf) of the random inputs, when the quantity of interest is a failure probability (probability that a model output exceeds a given threshold). An input is considered influential if the input pdf modification leads to a broad change in the failure probability. These sensitivity indices can be computed using the sole set of simulations that has already been used to estimate the failure probability, thus limiting the number of calls to the numerical model. In the case of a Monte Carlo sample, asymptotical properties of the indices are derived. Based on Kullback–Leibler divergence, several types of input perturbations are introduced. The relevance of this new SA method is analysed through three case studies.     

Bayesian estimation of the mean of an autoregressive process

The marginal posterior probability density function (pdf) for the mean of a stationary pth order Gaussian autoregressive process is derived using the conditional likelihood function. While the posterior pdf provides a small sample analysis, the pdf is not well known and must be analyzed numerically. This is relatively easy since it is a function of only one variable. Two sets of examples are presented. The first set involves synthetic data generated by computer, and the second set deals with energy expenditure data on a bum patient.     

Efficient estimation in the Pareto distribution

The maximum likelihood estimation (MLE) of the probability density function (pdf) and cumulative distribution function (CDF) are derived for the Pareto distribution. It has been shown that MLEs are more efficient than uniform minimum variance unbiased estimators of pdf and CDF.     

On singular elliptical models

The probability density function (pdf) ofsingular elliptical distributions is represented as an integralseries of singular normal distributions. Explicit formulas for the pdf and the cdf of the generalized Chi-square distribution are derived under singular elliptical assumptions extending the result of Díaz-García [(2002). Singular elliptical distribution: density and applications. Commun. Stat.—Theory Methods 31:665–681]. Applications are given of the proposed result for singular mixedmodels.     

The distribution of the product of two independent generalized trapezoidal random variables

ABSTRACT

In this article, we derive the probability density function (pdf) of the product of two independent generalized trapezoidal random variables having different supports, in closed form, by considering all possible cases. We also show that the results for the product of two triangular and uniform random variables follow as special cases of our main result. As an illustration, we obtain pdf of product for a suitably constrained set of parameters and plot some graphs using MATLAB, which express variation in pdf with change in different parameters of the generalized trapezoidal distribution.     

On the convolution of normal and t random variables

The need for the convolution of normal and Student's t random variables arises in many areas. Since the 1930s, various authors have attempted to derive closed-form expressions for the probability density function (pdf) of the convolution, but with little success. Here, general closed-form expressions are derived for the pdf.     

Approximating Symmetric Distributions via Sampling and Coefficient of Variation

Abstract

The Coefficient of Variation is one of the most commonly used statistical tool across various scientific fields. This paper proposes a use of the Coefficient of Variation, obtained by Sampling, to define the polynomial probability density function (pdf) of a continuous and symmetric random variable on the interval [a, b]. The basic idea behind the first proposed algorithm is the transformation of the interval from [a, b] to [0, b-a]. The chi-square goodness-of-fit test is used to compare the proposed (observed) sample distribution with the expected probability distribution. The experimental results show that the collected data are approximated by the proposed pdf. The second algorithm proposes a new method to get a fast estimate for the degree of the polynomial pdf when the random variable is normally distributed. Using the known percentages of values that lie within one, two and three standard deviations of the mean, respectively, the so-called three-sigma rule of thumb, we conclude that the degree of the polynomial pdf takes values between 1.8127 and 1.8642. In the case of a Laplace (μ, b) distribution, we conclude that the degree of the polynomial pdf takes values greater than 1. All calculations and graphs needed are done using statistical software R.     

A new class of skew-symmetric distributions and related families

In this work, we investigate a new class of skew-symmetric distributions, which includes the distributions with the probability density function (pdf) given by g _α(x)=2f(x) G(α x), introduced by Azzalini [A class of distributions which includes the normal ones, Scand. J. Statist. 12 (1985), pp. 171–178]. We call this new class as the symmetric-skew-symmetric family and it has the pdf proportional to f(x) G _β(α x), where G _β(x) is the cumulative distribution function of g _β(x). We give some basic properties for the symmetric-skew-symmetric family and study the particular case obtained from the normal distribution.     

UMVU estimation of the reliability function of the generalized life distributions

The problems of estimating the reliability function and P=P_rX > Y are considered for the generalized life distributions. Uniformly minimum variance unbiased estimators (UMVUES) of the powers of the parameter involved in the probabilistic model and the probability density function (pdf) at a specified point are derived. The UMVUE of the pdf is utilized to obtain the UMVUE of the reliability function and ‘P’. Our method of obtaining these estimators is quite simple than the traditional approaches. A theoretical method of studying the behaviour of the hazard-rate is provided.     

Some Utilizations of Lambert W Function in Distribution Theory

We introduce a new class of positive infinitely divisible probability laws calling them 𝔏_γ distributions. Their cumulant-generating functions (cgf) are expressed in terms of the principal branch of the Lambert W function. The probability density functions (pdfs) of 𝔏_γ laws are bounded resembling pdf of a Lévy stable distribution. The exponential dispersion model constructed starting from an 𝔏_γ distribution admits the inverse Gaussian approximation. The natural exponential family constructed starting from an 𝔏_γ distribution constitutes the reciprocal of the natural exponential family generated by a spectrally negative stable law with α = 1. We derive new results on 𝔏_γ laws and the related exponential dispersion models, including their convolution and scaling closure properties. We generate another exponential dispersion model starting from an exponentially compounded 𝔏_γ law. This distribution emerges in the Poisson mixture representation of a generalized Poisson law. We extend the Poisson approximation for the scaled Neyman type A exponential dispersion model. We derive saddlepoint-type approximations for some of these exponential dispersion models. The role of the Lambert W function is emphasized.     

The new unified representation of multivariate skewed distributions

There are so many proposals in construction skewed distributions, and it is worth finding an overall class which covers all of these proposals. We introduce a new unified representation of multivariate skewed distributions. We will show that this new unified multivariate form of skewed distributions includes all of the continuous multivariate skewed distributions in the literature. This new unified representation is based on the multivariate probability integral transformation and can be decomposed into one factor that is original multivariate symmetric probability density function (pdf) f on ? ^k and skewed factor defined by a pdf p on [0, 1] ^k . This decomposition leads us to prove some useful properties of this new unified form. Stochastic representations and basic properties of this new form are also investigated in this article. Our work is motivated by considering the different skewing mechanisms which lead to different skewed distributions and show that all of these common-used distributions can be viewed as a new unified form.     

The Correlated Bivariate Noncentral F Distribution and Its Application

This article proposes the singly and doubly correlated bivariate noncentral F (BNCF) distributions. The probability density function (pdf) and the cumulative distribution function (cdf) of the distributions are derived for arbitrary values of the parameters. The pdf and cdf of the distributions for different arbitrary values of the parameters are computed, and their graphs are plotted by writing and implementing new R codes. An application of the correlated BNCF distribution is illustrated in the computations of the power function of the pre-test test for the multivariate simple regression model (MSRM).     

Skewed Bessel function distributions with application to rainfall data

Skewed distributions have attracted significant attention in the last few years. In this article, a skewed Bessel function distribution with the probability density function (pdf) f(x)=2 g (x) G (λ x) is introduced, where g (·) and G (·) are taken, respectively, to be the (pdf) and the cumulative distribution function of the Bessel function distribution [McKay, A.T., 1932, A Bessel function distribution, Biometrica, 24, 39–44]. Several particular cases of this distribution are identified and various representations for its moments derived. Estimation procedures by the method of maximum likelihood are also derived. Finally, an application is provided to rainfall data from Orlando, Florida.     

The t statistic of the skew elliptical distributions

This paper studies the properties of the generalized t statistic when the sample comes from the skew elliptical distributions. Several forms of the probability density functions are obtained. The robustness of the one-sided t test in the family of the skew normal distributions is investigated.     

Bayes Risk Consistency of Nonparametric Bayes Density Estimates2

Even though the literature on nonparametric density estimation is large, the literature on Bayesian estimation of the density function is relatively small. The reason is the lack of a suitable prior over the space of probability density functions. There have been attempts to define priors over the space of probability measures, but they have not yielded any workable prior for the purpose of density estimation. Dubins & Freedman (1963) have denned random distribution functions which are singular with probability one. Kraft (1964) has denned a class of distribution functions which have derivatives but not continuous derivatives and hence are not suitable for density estimation. The only really convenient prior is the Dirichlet process prior due to Ferguson (1973), but unfortunately this prior concentrates all its mass over the discrete distribution with a dense set of jumps. Recently Lo (1978) has overcome this difficulty by taking convolution of the Dirichlet process with a fixed continuous kernel. In Section 2, the existence of a version of the posterior distribution and the conditional expectation for arbitrary prior over the space of continuous density functions are discussed. The Bayes risk consistency of the Bayes estimator is discussed in Section 3. The Bayes estimator and its properties with respect to two specific prior distributions are discussed in Section 4. In Section 5 some negative results are presented. Finally a numerical example is given in Section 6.     

On the hyper-dirichlet type 1 and hyper-liouville distributions

This paper concerns the characterization of a new family of multivariate beta distribution functions - the hyper-Dirichlet type 1 distribution. This family describes the joint density function of the terminal variates of an arbitrary tree constructed from finite sequences of probability vectors having independent Dirichlet type 1 distributions. Expressions for the general properties of the hyper-Dirichlet type 1 distribution are presented. In addition, the hyper-Liouville distribution is described and its properties are discussed as well as a generalization of the Liouville integral identity.