A proposal for plotting positions in probability plots

Probability plots allow us to determine whether a set of sample observations is distributed according to a theoretical distribution. Plotting positions are fundamental elements in statistics and, in particular, for the construction of probability plots. In this paper, a new plotting position to construct different probability plots, such as Q–Q Plot, P–P Plot and S–P Plot, is proposed. The proposed definition is based on the median of the ith order statistic of the theoretical distribution considered. The main feature of this plotting position formula is that it is independent of the theoretical distribution selected. Moreover, the procedure developed is ‘almost’ exact, reaching, without a high cost of time, an accuracy as great as we want, which avoids using approximations (proposed by other authors).     

Testing linear hypotheses in high-dimensional regressions

For a multivariate linear model, Wilk's likelihood ratio test (LRT) constitutes one of the cornerstone tools. However, the computation of its quantiles under the null or the alternative hypothesis requires complex analytic approximations, and more importantly, these distributional approximations are feasible only for moderate dimension of the dependent variable, say p≤20. On the other hand, assuming that the data dimension p as well as the number q of regression variables are fixed while the sample size n grows, several asymptotic approximations are proposed in the literature for Wilk's Λ including the widely used chi-square approximation. In this paper, we consider necessary modifications to Wilk's test in a high-dimensional context, specifically assuming a high data dimension p and a large sample size n. Based on recent random matrix theory, the correction we propose to Wilk's test is asymptotically Gaussian under the null hypothesis and simulations demonstrate that the corrected LRT has very satisfactory size and power, surely in the large p and large n context, but also for moderately large data dimensions such as p=30 or p=50. As a byproduct, we give a reason explaining why the standard chi-square approximation fails for high-dimensional data. We also introduce a new procedure for the classical multiple sample significance test in multivariate analysis of variance which is valid for high-dimensional data.     

Multivariate Two-Sided Tests for Normal Mean Vectors Based on Approximations of Likelihood Ratio Test

Assuming that all components of a normal mean vector are simultaneously non negative or non positive, we consider a multivariate two-sided test for testing whether the normal mean vector is equal to zero or not. Since the likelihood ratio test is accompanied with theoretical and computational complications, we discuss two kinds of approximations of the likelihood ratio test. One is based on a conservative critical value determined by a certain inequality. The other is constructed by the approximation of the likelihood ratio test proposed by Tang et al. (1989). We compare the likelihood ratio test and two kinds of approximations through numerical examples regarding critical values and the power of the test.     

On two approximations to the F-distribution: Application to testing for intraclass correlation in family studies

Two approximations to the F-distribution are evaluated in the context of testing for intraclass correlation in the analysis of family data. The evaluation is based on a computation of empirical significance levels and a comparison between p-values associated with these approximations and the corresponding exact p-values. It is found that the approximate methods may give very unsatisfactory results, and exact methods are therefore recommended for general use.     

Modified Normal-based Approximation to the Percentiles of Linear Combination of Independent Random Variables with Applications

A modified normal-based approximation for calculating the percentiles of a linear combination of independent random variables is proposed. This approximation is applicable in situations where expectations and percentiles of the individual random variables can be readily obtained. The merits of the approximation are evaluated for the chi-square and beta distributions using Monte Carlo simulation. An approximation to the percentiles of the ratio of two independent random variables is also given. Solutions based on the approximations are given for some classical problems such as interval estimation of the normal coefficient of variation, survival probability, the difference between or the ratio of two binomial proportions, and for some other problems. Furthermore, approximation to the percentiles of a doubly noncentral F distribution is also given. For all the problems considered, the approximation provides simple satisfactory solutions. Two examples are given to show applications of the approximation.     

Nonparametric two-sample tests for dispersion differences based on placements

Two different two-sample tests for dispersion differences based on placement statistics are proposed. The means and variances of the test statistics are derived, and asymptotic normality is established for both. Variants of the proposed tests based on reversing the X and Y labels in the test statistic calculations are shown to have different small-sample properties; for both pairs of tests, one member of the pair will be resolving, the other nonresolving. The proposed tests are similar in spirit to the dispersion tests of both Mood and Hollander; comparative simulation results for these four tests are given. For small sample sizes, the powers of the proposed tests are approximately equal to the powers of the tests of both Mood and Hollander for samples from the normal, Cauchy and exponential distributions. The one-sample limiting distributions are also provided, yielding useful approximations to the exact tests when one sample is much larger than the other. A bootstrap test may alternatively be performed. The proposed test statistics may be used with lightly censored data by substituting Kaplan-Meier estimates for the empirical distribution functions.     

Characterizing the BMAP/MAP/1 Departure Process via the ETAQA Truncation

Abstract

We propose a family of finite approximations for the departure process of a BMAP/MAP/1 queue. The departure process approximations are derived via an exact aggregate solution technique (called ETAQA) applied to M/G/1-type Markov processes. The proposed approximations are indexed by a parameter n(n > 1), which determines the size of the output model as n + 1 block levels of the M/G/1-type process. This output approximation preserves exactly the marginal distribution of the true departure process and the lag correlations of the interdeparture times up to lag n ? 2. Experimental results support the applicability of the proposed approximation in traffic-based decomposition of queueing networks.     

The Use of Noncentral F Approximations for Calculation of Power and Sample Size

Approximations to the noncentral F distribution yield surprisingly accurate results for power and sample size problems arising from linear hypotheses about normal random variables. The approximations are easy to use with a desk (or hand-held) calculator that computes cumulative F probabilities. These approximations are particularly advantageous for testing the hypothesis that differences among the means are small against the alternative that the differences are large.     

Jacobi and Laguerre polynomial approximations for the distributions of statistics useful in testing for outliers in exponential and gamma samples

Recently, Sanjel and Balakrishnan [A Laguerre Polynomial Approximation for a goodness-of-fit test for exponential distribution based on progressively censored data, J. Stat. Comput. Simul. 78 (2008), pp. 503–513] proposed the use of Laguerre orthogonal polynomials for a goodness-of-fit test for the exponential distribution based on progressively censored data. In this paper, we use Jacobi and Laguerre orthogonal polynomials in order to obtain density approximants for some test statistics useful in testing for outliers in gamma and exponential samples. We first obtain the exact moments of the statistics and then the density approximants, based on these moments, are expressed in terms of Jacobi and Laguerre polynomials. A comparative study is carried out of the critical values obtained by using the proposed methods to the corresponding results given by Barnett and Lewis [Outliers in Statistical Data, 3rd ed., John Wiley & Sons, New York, 1993]. This reveals that the proposed techniques provide very accurate approximations to the distributions. Finally, we present some numerical examples to illustrate the proposed approximations. Monte Carlo simulations suggest that the proposed approximate densities are very accurate.     

Saddlepoint density and distribution functions for the ratio of two linear functions and the product of generalized gamma variates

The generalized gamma distribution is a flexible and attractive distribution because it incorporates several well-known distributions, i.e., gamma, Weibull, Rayleigh, and Maxwell. This article derives saddlepoint density and distribution functions for the ratio of two linear functions of generalized gamma variables and the product of n independent generalized gamma variables. Simulation studies are used to evaluate the accuracy of the saddlepoint approximations. The saddlepoint approximations are fast, easy, and very accurate.     

Instructional Uses of Approximate Convolutions and Their Graphs

A technique is presented for approximating convolution densities f * g by forming the convolution of step-function approximations of f and g. This technique, amenable to the electronic calculator or computer, provides suitably accurate graphs for illustrating concepts in probability and statistics. Several examples are included.     

Approximate maximum likelihood estimation in the presence of extra-poisson variation

A two-stage hierarchical model for analysis of discrete data with extra-Poisson variation is examined. The model consists of a Poisson distribution with a mixing lognormal distribution for the mean. A method of approximate maximum likelihood estimation of the parameters is proposed. The method uses the EM algorithm and approximations to facilitate its implementation are derived. Approximate standard errors of the estimates are provided and a numerical example is used to illustrate the method.     

Modeling Association Between Two or More Categorical Variables that Allow for Multiple Category Choices

Multiple-response (or pick any/c) categorical variables summarize responses to survey questions that ask “pick any” from a set of item responses. Extensions to loglinear model methodology are proposed to model associations between these variables across all their items simultaneously. Because individual item responses to a multiple-response categorical variable are likely to be correlated, the usual chi-square distributional approximations for model-comparison statistics are not appropriate. Adjusted statistics and a new bootstrap procedure are developed to facilitate distributional approximations. Odds ratio and standardized Pearson residual measures are also developed to estimate specific associations and examine deviations from a specified model.     

Critical values of some nonparametric statistics used for tests of total stochastic independence

The problem of testing for total independence of the variates of a stochastic p(≧3) component vector using rank correlation statistics is considered. Two distribution free statistics are considered, one based on the determinant of the matrix of rank correlation statistics, the second on their sum of squares. Tables of critical values are given for p=3,4 for the cases when (a) ranks, and (b) exponential scores are used to replace the ordered observations within each variate. Some approximations to the critical values are proposed and evaluated.     

Calculating the density and distribution function for the singly and doubly noncentral F

Simple, closed form saddlepoint approximations for the distribution and density of the singly and doubly noncentral F distributions are presented. Their overwhelming accuracy is demonstrated numerically using a variety of parameter values. The approximations are shown to be uniform in the right tail and the associated limitating relative error is derived. Difficulties associated with some algorithms used for exact computation of the singly noncentral F are noted.     

Critical point and power calculations for the studentized range test for generally correlated means

The studentized range test is a widely applied statistical procedure to compare several normal means within the analysis of variance. However, up to now no general methodology is available to perform the all-pair comparisons precisely, such as the computation of p-values or quantiles in the simple unbalanced one-way layout. Instead, a variety of approximations have been proposed in the past. This article focuses on exact computations of simultaneous confidence intervals and exact sample size determinations for all-pair comparisons in the analysis of variance involving arbitrary variance-covariance matrices. General power expressions in closed form are developed and numerical issues concerning the arising multivariate central and noncentral t-distributions are discussed. An application to the usual fixed effects analysis of covariance illustrates the use of the obtained results.     

Saddlepoint approximations for some models of circular data

In this article we provide saddlepoint approximations for some important models of circular data. The particularity of these saddlepoint approximations is that they do not require solving the saddlepoint equation iteratively, so their evaluation is immediate. We first give very accurate approximations to P-values, critical values and power functions for some optimal tests regarding the concentration parameter under wrapped symmetric α-stable and circular normal models. Then, we consider an approximation to the distribution of a projection of the two-dimensional Pearson random walk with exponential step sizes.     

Allowance for skewness in maximum-likelihood estimation with application to the location-scale model

The use of maximum-likelihood estimation as discussed by Sprott and Viveros (1984) is extended to include the log F distribution to accommodate skewness. The role played by linear pivotals in relation to likelihood and efficiency is discussed. Normal, t, and log F likelihoods are defined and used to generate possible normal, t, and log F linear pivotal quantities. The results are applied to the location-scale family, where exact results are available to assess the numerical accuracy of the proposed procedure. Refinements using saddlepoint approximations are obtained.     

Study of the quality of several asymptotic and near-exact approximations based on moments for the distribution of the Wilks Lambda statistic

In this paper a measure of proximity of distributions, when moments are known, is proposed. Based on cases where the exact distribution is known, evidence is given that the proposed measure is accurate to evaluate the proximity of quantiles (exact vs. approximated). The measure may be applied to compare asymptotic and near-exact approximations to distributions, in situations where although being known the exact moments, the exact distribution is not known or the expression for its probability density function is not known or too complicated to handle. In this paper the measure is applied to compare newly proposed asymptotic and near-exact approximations to the distribution of the Wilks Lambda statistic when both groups of variables have an odd number of variables. This measure is also applied to the study of several cases of telescopic near-exact approximations to the exact distribution of the Wilks Lambda statistic based on mixtures of generalized near-integer gamma distributions.