Jacobi and Laguerre polynomial approximations for the distributions of statistics useful in testing for outliers in exponential and gamma samples

Recently, Sanjel and Balakrishnan [A Laguerre Polynomial Approximation for a goodness-of-fit test for exponential distribution based on progressively censored data, J. Stat. Comput. Simul. 78 (2008), pp. 503–513] proposed the use of Laguerre orthogonal polynomials for a goodness-of-fit test for the exponential distribution based on progressively censored data. In this paper, we use Jacobi and Laguerre orthogonal polynomials in order to obtain density approximants for some test statistics useful in testing for outliers in gamma and exponential samples. We first obtain the exact moments of the statistics and then the density approximants, based on these moments, are expressed in terms of Jacobi and Laguerre polynomials. A comparative study is carried out of the critical values obtained by using the proposed methods to the corresponding results given by Barnett and Lewis [Outliers in Statistical Data, 3rd ed., John Wiley & Sons, New York, 1993]. This reveals that the proposed techniques provide very accurate approximations to the distributions. Finally, we present some numerical examples to illustrate the proposed approximations. Monte Carlo simulations suggest that the proposed approximate densities are very accurate.     

Extension Of Dale's Moment Conditions With Application To The Wright–fisher Model

Dale's necessary and sufficient conditions for an array to contain the joint moments for some probability distribution on the unit simplex in R² are extended to the unit simplex in R ^d . These conditions are then used in a computational method, based on linear programming, to evaluate the stationary distribution for the diffusion approximation of the Wright–Fisher model in population genetics. The computational method uses a characterization of the diffusion through an adjoint relation between the diffusion operator and its stationary distribution. Application of this adjoint relation to a set of functions in the domain of the generator leads to one set of constraints for the linear program involving the moments of the stationary distribution. The extension of Dale's conditions on the moments add another set of linear conditions and the linear program is solved to obtain bounds on numerical quantities of interest. Numerical illustrations are given to illustrate the accuracy of the method.

     

Improved orthogonal polynomial density estimates

Density estimates that are expressible as the product of a base density function and a linear combination of orthogonal polynomials are considered in this paper. More specifically, two criteria are proposed for determining the number of terms to be included in the polynomial adjustment component and guidelines are suggested for the selection of a suitable base density function. A simulation study reveals that these stopping rules produce density estimates that are generally more accurate than kernel density estimates or those resulting from the application of the Kronmal–Tarter criterion. Additionally, it is explained that the same approach can be utilized to obtain multivariate density estimates. The proposed orthogonal polynomial density estimation methodology is applied to several univariate and bivariate data sets, some of which have served as benchmarks in the statistical literature on density estimation.     

Sojourn time in an M/M/1 processor sharing queue with permanent customers

We explicitly compute the sojourn time distribution of an arbitrary customer in an M/M/1 processor sharing (PS) queue with permanent customers. We notably exhibit the orthogonal structure associated with this queuing system and we show how sieved Pollaczek polynomials and their associated orthogonality measure can be used to obtain an explicit representation for the complementary cumulative distribution function of the sojourn time of a customer. This explicit formula subsequently allows us to compute the two first moments of this random variable and to study the asymptotic behavior of its distribution. The most salient result is that the decay rate depends on the load of the system and the number K of permanent customers. When the load is above a certain threshold depending on K, the decay rate is identical to that of a regular M/M/1 PS queue.     

A New Regression Model: Modal Linear Regression

The mode of a distribution provides an important summary of data and is often estimated on the basis of some non‐parametric kernel density estimator. This article develops a new data analysis tool called modal linear regression in order to explore high‐dimensional data. Modal linear regression models the conditional mode of a response Y given a set of predictors x as a linear function of x . Modal linear regression differs from standard linear regression in that standard linear regression models the conditional mean (as opposed to mode) of Y as a linear function of x . We propose an expectation–maximization algorithm in order to estimate the regression coefficients of modal linear regression. We also provide asymptotic properties for the proposed estimator without the symmetric assumption of the error density. Our empirical studies with simulated data and real data demonstrate that the proposed modal regression gives shorter predictive intervals than mean linear regression, median linear regression and MM‐estimators.     

The beta exponentiated Weibull distribution

The Weibull distribution is one of the most important distributions in reliability. For the first time, we introduce the beta exponentiated Weibull distribution which extends recent models by Lee et al. [Beta-Weibull distribution: some properties and applications to censored data, J. Mod. Appl. Statist. Meth. 6 (2007), pp. 173–186] and Barreto-Souza et al. [The beta generalized exponential distribution, J. Statist. Comput. Simul. 80 (2010), pp. 159–172]. The new distribution is an important competitive model to the Weibull, exponentiated exponential, exponentiated Weibull, beta exponential and beta Weibull distributions since it contains all these models as special cases. We demonstrate that the density of the new distribution can be expressed as a linear combination of Weibull densities. We provide the moments and two closed-form expressions for the moment-generating function. Explicit expressions are derived for the mean deviations, Bonferroni and Lorenz curves, reliability and entropies. The density of the order statistics can also be expressed as a linear combination of Weibull densities. We obtain the moments of the order statistics. The expected information matrix is derived. We define a log-beta exponentiated Weibull regression model to analyse censored data. The estimation of the parameters is approached by the method of maximum likelihood. The usefulness of the new distribution to analyse positive data is illustrated in two real data sets.     

A generalized skew two-piece skew-elliptical distribution

We present a new generalized family of skew two-piece skew-elliptical (GSTPSE) models and derive some its statistical properties. It is shown that the new family of distribution may be written as a mixture of generalized skew elliptical distributions. Also, a new representation theorem for a special case of GSTPSE-distribution is given. Next, we will focus on t kernel density and prove that it is a scale mixture of the generalized skew two-piece skew normal distributions. An explicit expression for the central moments as well as a recurrence relations for its cumulative distribution function and density are obtained. Since, this special case is a uni-/bimodal distribution, a sufficient condition for each cases is given. A real data set on heights of Australian females athletes is analysed. Finally, some concluding remarks and open problems are discussed.     

On some study of skew-t distributions

Abstract

In this note, through ratio of independent random variables, new families of univariate and bivariate skew-t distributions are introduced. Probability density function for each skew-t distribution will be given. We also derive explicit forms of moments of the univariate skew-t distribution and recurrence relations for its cumulative distribution function. Finally we illustrate the flexibility of this class of distributions with applications to a simulated data and the volcanos heights data.     

Another extended Burr III model: some properties and applications

We introduce an extended Burr III distribution as an important model for problems in survival analysis and reliability. The new distribution can be expressed as a linear combination of Burr III distributions and then it has tractable properties for the ordinary and incomplete moments, generating and quantile functions, mean deviations and reliability. The density of its order statistics can be given in terms of an infinite linear combination of Burr III densities. The estimation of the model parameters is approached by maximum likelihood and the observed information matrix is derived. The proposed model is applied to a real data set to illustrate its potentiality.     

A Laguerre polynomial approximation for a goodness-of-fit test for exponential distribution based on progressively censored data

This paper proposes an approximation to the distribution of a goodness-of-fit statistic proposed recently by Balakrishnan et al. [Balakrishnan, N., Ng, H.K.T. and Kannan, N., 2002, A test of exponentiality based on spacings for progressively Type-II censored data. In: C. Huber-Carol et al. (Eds.), Goodness-of-Fit Tests and Model Validity (Boston: Birkhäuser), pp. 89–111.] for testing exponentiality based on progressively Type-II right censored data. The moments of this statistic can be easily calculated, but its distribution is not known in an explicit form. We first obtain the exact moments of the statistic using Basu's theorem and then the density approximants based on these exact moments of the statistic, expressed in terms of Laguerre polynomials, are proposed. A comparative study of the proposed approximation to the exact critical values, computed by Balakrishnan and Lin [Balakrishnan, N. and Lin, C.T., 2003, On the distribution of a test for exponentiality based on progressively Type-II right censored spacings. Journal of Statistical Computation and Simulation, 73 (4), 277–283.], is carried out. This reveals that the proposed approximation is very accurate.     

The logistic-X family of distributions and its applications

ABSTRACT

The logistic distribution has a prominent role in the theory and practice of statistics. We introduce a new family of continuous distributions generated from a logistic random variable called the logistic-X family. Its density function can be symmetrical, left-skewed, right-skewed, and reversed-J shaped, and can have increasing, decreasing, bathtub, and upside-down bathtub hazard rates shaped. Further, it can be expressed as a linear combination of exponentiated densities based on the same baseline distribution. We derive explicit expressions for the ordinary and incomplete moments, quantile and generating functions, Bonferroni and Lorenz curves, Shannon entropy, and order statistics. The model parameters are estimated by the method of maximum likelihood and the observed information matrix is determined. We also investigate the properties of one special model, the logistic-Fréchet distribution, and illustrate its importance by means of two applications to real data sets.     

Orthogonal polynomials generated by random vectors

Every random q-vector with finite moments generates a set of orthonormal polynomials. These are generated from the basis functions xn = xn11…xnqq using Gram–Schmidt orthogonalization. One can cycle through these basis functions using any number of ways. Here, we give results using minimum cycling. The polynomials look simpler when centered about the mean of X, and still simpler form when X is symmetric about zero. This leads to an extension of the multivariate Hermite polynomial for a general random vector symmetric about zero. As an example, the results are applied to the multivariate normal distribution.     

On approximating the central and noncentral multivariate gamma distributions

In this paper a finite series approximation involving Laguerre polynomials is derived for central and noncentral multivariate gamma distributions. It is shown that if one approximates the density of any k nonnegative continuous random variables by a finite series of Laguerre polynomials up to the (n₁, …, n_k)th degree, then all the mixed moments up to the order (n₁, …, n_k) of the approximated distribution equal to the mixed moments up to the same order of the random variables. Some numerical results are given for the bivariate central and noncentral multivariate gamma distributions to indicate the usefulness of the approximations.     

Moments of Order Statistics—From Even to Odd Sample Sizes

Abstract

A method is demonstrated to compute the complete set of first moments of order statistics for an arbitrary distribution, given only the first moments of the maximal order statistics either for all even sample sizes, or for all odd samples sizes.     

A consistent simulation-based estimator in generalized linear mixed models

We propose a strongly root-n consistent simulation-based estimator for the generalized linear mixed models. This estimator is constructed based on the first two marginal moments of the response variables, and it allows the random effects to have any parametric distribution (not necessarily normal). Consistency and asymptotic normality for the proposed estimator are derived under fairly general regularity conditions. We also demonstrate that this estimator has a bounded influence function and that it is robust against data outliers. A bias correction technique is proposed to reduce the finite sample bias in the estimation of variance components. The methodology is illustrated through an application to the famed seizure count data and some simulation studies.     

Using -splines to test the linearity of partially linear models

The nonparametric component in a partially linear model is estimated by a linear combination of fixed-knot cubic B-splines with a second-order difference penalty on the adjacent B-spline coefficients. The resulting penalized least-squares estimator is used to construct two Wald-type spline-based test statistics for the null hypothesis of the linearity of the nonparametric function. When the number of knots is fixed, the first test statistic asymptotically has the distribution of a linear combination of independent chi-squared random variables, each with one degree of freedom, under the null hypothesis. The smoothing parameter is determined by specifying a value for the asymptotically expected value of the test statistic under the null hypothesis. When the number of knots is fixed and under the null hypothesis, the second test statistic asymptotically has a chi-squared distribution with K=q+2 degrees of freedom, where q is the number of knots used for estimation. The power performances of the two proposed tests are investigated via simulation experiments, and the practicality of the proposed methodology is illustrated using a real-life data set.     

On approximating the distribution of indefinite quadratic forms

This paper provides a simple methodology for approximating the distribution of indefinite quadratic forms in normal random variables. It is shown that the density function of a positive definite quadratic form can be approximated in terms of the product of a gamma density function and a polynomial. An extension which makes use of a generalized gamma density function is also considered. Such representations are based on the moments of a quadratic form, which can be determined from its cumulants by means of a recursive formula. After expressing an indefinite quadratic form as the difference of two positive definite quadratic forms, one can obtain an approximation to its density function by means of the transformation of variable technique. An explicit representation of the resulting density approximant is given in terms of a degenerate hypergeometric function. An easily implementable algorithm is provided. The proposed approximants produce very accurate percentiles over the entire range of the distribution. Several numerical examples illustrate the results. In particular, the methodology is applied to the Durbin–Watson statistic which is expressible as the ratio of two quadratic forms in normal random variables. Quadratic forms being ubiquitous in statistics, the approximating technique introduced herewith has numerous potential applications. Some relevant computational considerations are also discussed.     

A bivariate density estimation method based on level crossings

This article introduces a method of nonparametric bivariate density estimation based on a bivariate sample level crossing function, which leads to the construction of a bivariate level crossing empirical distribution function (BLCEDF). An efficiency function for this BLCEDF relative to the classical empirical distribution function (EDF), is derived. The BLCEDF gives more efficient estimates than the EDF in the tails of any underlying continuous distribution, for both small and large sample sizes. On the basis of BLCEDF we define a bivariate level crossing kernel density estimator (BLCKDE) and study its properties. We apply the BLCEDF and BLCKDE for various distributions and provide results of simulations that confirm the theoretical properties. A real-world example is given.     

General results for the Kumaraswamy-G distribution

For any continuous baseline G distribution [G.M. Cordeiro and M. de Castro, A new family of generalized distributions, J. Statist. Comput. Simul. 81 (2011), pp. 883–898], proposed a new generalized distribution (denoted here with the prefix ‘Kw-G’ (Kumaraswamy-G)) with two extra positive parameters. They studied some of its mathematical properties and presented special sub-models. We derive a simple representation for the Kw-G density function as a linear combination of exponentiated-G distributions. Some new distributions are proposed as sub-models of this family, for example, the Kw-Chen [Z.A. Chen, A new two-parameter lifetime distribution with bathtub shape or increasing failure rate function, Statist. Probab. Lett. 49 (2000), pp. 155–161], Kw-XTG [M. Xie, Y. Tang, and T.N. Goh, A modified Weibull extension with bathtub failure rate function, Reliab. Eng. System Safety 76 (2002), pp. 279–285] and Kw-Flexible Weibull [M. Bebbington, C.D. Lai, and R. Zitikis, A flexible Weibull extension, Reliab. Eng. System Safety 92 (2007), pp. 719–726]. New properties of the Kw-G distribution are derived which include asymptotes, shapes, moments, moment generating function, mean deviations, Bonferroni and Lorenz curves, reliability, Rényi entropy and Shannon entropy. New properties of the order statistics are investigated. We discuss the estimation of the parameters by maximum likelihood. We provide two applications to real data sets and discuss a bivariate extension of the Kw-G distribution.     

Approximating moments of continuous functions of random variables using Bernstein polynomials

Bernstein polynomials have many interesting properties. In statistics, they were mainly used to estimate density functions and regression relationships. The main objective of this paper is to promote further use of Bernstein polynomials in statistics. This includes (1) providing a high-level approximation of the moments of a continuous function $g\left(X\right)$ of a random variable $X$, and (2) proving Jensen’s inequality concerning a convex function without requiring second differentiability of the function. The approximation in (1) is demonstrated to be quite superior to the delta method, which is used to approximate the variance of $g\left(X\right)$ with the added assumption of differentiability of the function. Two numerical examples are given to illustrate the application of the proposed methodology in (1).