The evaluation of trivariate normal probabilities defined by linear inequalities

This paper considers the evaluation of probabilities which are defined by a set of linear inequalities of a trivariate normal distribution. It is shown that these probabilities can be evaluated by a one-dimensional numerical integration. The trivariate normal distribution can have any covariance matrix and any mean vector, and the probability can be defined by any number of one-sided and two-sided linear inequalities. This affords a practical and efficient method for the calculation of these probabilities which is superior to basic simulation methods. An application of this method to the analysis of pairwise comparisons of four treatment effects is discussed.     

The computation of standard normal distribution integral in any required precision based on reliability method

Based on reliability theory, the value of the standard normal distribution integral can be obtained by calculating the probability of the failure domain of the linear performance function. After the sample space is divided into some sub-sample spaces, a number of sub-failure domains are obtained. In the paper, the methods of computing the probabilities of sub-failure domains are discussed. All the formulae and the steps of computing the standard normal distribution integral which meet any required precision are given in the paper. Examples show that it is easy for the method to compute the standard normal distribution integral.     

Computation of multivariate normal probabilities with polar coordinate systems

We consider the problem of evaluation of the probability that all elements of a multivariate normally distributed vector have non-negative coordinates; this probability is called the non-centred orthant probability. The necessity for the evaluation of this probability arises frequently in statistics. The probability is defined by the integral of the probability density function. However, direct numerical integration is not practical. In this article, a method is proposed for the computation of the probability. The method involves the evaluation of a measure on a unit sphere surface in p-dimensional space that satisfies conditions derived from a covariance matrix. The required computational time for the p-dimensional problem is proportional to p²·2^p?1, and it increases at a rate that is lower than that in the case of the existing method.     

Efficient time/space algorithm to compute rectangular probabilities of multinomial, multivariate hypergeometric and multivariate Pólya distributions

The computation of rectangular probabilities of multivariate discrete integer distributions such as the multinomial, multivariate hypergeometric or multivariate Pólya distributions is of great interest both for statistical applications and for probabilistic modeling purpose. All these distributions are members of a broader family of multivariate discrete integer distributions for which computationaly efficient approximate methods have been proposed for the evaluation of such probabilities, but with no control over their accuracy. Recently, exact algorithms have been proposed for computing such probabilities, but they are either dedicated to a specific distribution or to very specific rectangular probabilities. We propose a new algorithm that allows to perform the computation of arbitrary rectangular probabilities in the most general case. Its accuracy matches or even outperforms the accuracy exact algorithms when the rounding errors are taken into account. In the worst case, its computational cost is the same as the most efficient exact method published so far, and is much lower in many situations of interest. It does not need any additional storage than the one for the parameters of the distribution, which allows to deal with large dimension/large counting parameter applications at no extra memory cost and with an acceptable computation time, which is a major difference with respect to the methods published so far.     

Orthant probabilities of elliptical distributions from orthogonal projections to subspaces

Statistics and Computing - A new procedure is proposed for evaluating non-centred orthant probabilities of elliptical distributed vectors, which is the probabilities that all elements of a vector...     

The Bayesian and frequentist approaches to testing a one-sided hypothesis about a multivariate mean

This paper compares the Bayesian and frequentist approaches to testing a one-sided hypothesis about a multivariate mean. First, this paper proposes a simple way to assign a Bayesian posterior probability to one-sided hypotheses about a multivariate mean. The approach is to use (almost) the exact posterior probability under the assumption that the data has multivariate normal distribution, under either a conjugate prior in large samples or under a vague Jeffreys prior. This is also approximately the Bayesian posterior probability of the hypothesis based on a suitably flat Dirichlet process prior over an unknown distribution generating the data. Then, the Bayesian approach and a frequentist approach to testing the one-sided hypothesis are compared, with results that show a major difference between Bayesian reasoning and frequentist reasoning. The Bayesian posterior probability can be substantially smaller than the frequentist p-value. A class of example is given where the Bayesian posterior probability is basically 0, while the frequentist p-value is basically 1. The Bayesian posterior probability in these examples seems to be more reasonable. Other drawbacks of the frequentist p-value as a measure of whether the one-sided hypothesis is true are also discussed.     

A Generalization of the Childs-Moran Result for Orthoscheme Probabilities

van der Vaart (1953, 1955) introduced the orthoscheme probability R_n (c ₁,..., c_n−1 ), meaning the orthant probability of an n -dimensional normal random vector with zero mean and tridiagonal correlation matrix with elements c ₁,..., c_n−1 on the upper diagonal. Childs (1967) conjectured and Moran (1983) proved that the generating function of { R_n (½,...,½)} equals tan z + sin z . This paper derives the generating function of { R_n (τ,½,...,½)}.     

An integral representation technique for calculating general multivariate probabilities with an application to multivariate x2

Recently in Dutt (1973, (1975), intgral representations over (0,A) were obtained for upper and lover multivariate normal and the probilities. It was pointed out that these integral representaitons when evaluated by Gauss-Hermite uadrature yield rapid and accurate numerical results.

Here integral representaitons, based on an integral formula due to Gurland (1948), are indicated for arbitrary multivariate probabilities. Application of this general representaion for computing multivariate x2 probabilities is discussed and numerical results using Gaussian quadrature are given for the bivariate and equicorre lated trivariate cases. Applications to the multivariate densities studied by Miller (1965) are also included     

Design-based confidence limits for a distribution function

A method for constructing confidence limits for a distribution function is proposed. This method is a simple modification of the common method based on a normal approximation to the distribution of the estimated distribution function. The methods differ in how the estimated standard errors are used. The coverage properties of the two methods are compared in a simulation study. Coverage probabilities for the proposed method are found to be much closer to the nominal levels, particularly in the tails of the population distribution.     

Confidence interval estimation and hypothesis testing for a common correlation coefficient

Several procedures have been proposed for testing the hypothesis that all off-diagonal elements of the correlation matrix of a multivariate normal distribution are equal. If the hypothesis of equal correlation can be accepted, it is then of interest to estimate and perhaps test hypotheses for the common correlation. In this paper, two versions of five different test statistics are compared via simulation in terms of adequacy of the normal approximation, coverage probabilities of confidence intervals, control of Type I error, and power. The results indicate that two test statistics based on the average of the Fisher z-transforms of the sample correlations should be used in most cases. A statistic based on the sample eigenvalues also gives reasonable results for confidence intervals and lower-tailed tests.     

Algorithms

Abstract

The main reason for the limited use of multivariate discrete models is the difficulty in calculating the required probabilities. The task is usually undertaken via recursive relationships which become quite computationally demanding for high dimensions and large values. The present paper discusses efficient algorithms that make use of the recurrence relationships in a manner that reduces the computational effort and thus allow for easy and cheap calculation of the probabilities. The most common multivariate discrete distribution, the multivariate Poisson distribution is treated. Real data problems are provided to motivate the use of the proposed strategies. Extensions of our results are discussed. It is shown that probabilities, for a large family of multivariate distributions, can be computed efficiently via our algorithms.     

Confidence intervals for product of powers of the generalized variances of k multivariate normal populations

In this paper, some confidence intervals (CIs) for the product of powers of the generalized variances of k multivariate normal populations with possibly different dimensions are proposed. The performance of these CIs in terms of the coverage probabilities and average lengths were evaluated via a Monte Carlo simulation study. The results were found to be satisfactory. To demonstrate utility of the proposed CIs, applications on three real data sets were provided.     

A New Procedure to Monitor the Mean of a Quality Characteristic

The Shewhart, Bonferroni-adjustment, and analysis of means (ANOM) control charts are typically applied to monitor the mean of a quality characteristic. The Shewhart and Bonferroni procedure are utilized to recognize special causes in production process, where the control limits are constructed by assuming normal distribution for known parameters (mean and standard deviation), and approximately normal distribution regarding to unknown parameters. The ANOM method is an alternative to the analysis of variance method. It can be used to establish the mean control charts by applying equicorrelated multivariate non central t distribution. In this article, we establish new control charts, in phases I and II monitoring, based on normal and t distributions having as a cause a known (or unknown) parameter (standard deviation). Our proposed methods are at least as effective as the classical Shewhart methods and have some advantages.     

Inequalities for tail probabilities for the multivariate normal distribution

Inequalities for tail probabilities of the multivariate normal distribution are obtained, as a generalization of those given by Feller (1966). Upper and lower bounds are given in the equi-correlated case. For an arbitrary correlation matrix R, an upper bound is obtained, using a result of Slepian (1962) which asserts that certain multivariate normal probabilities are a non-decreasing function of correlations.     

Robust multivariate mixture regression models with incomplete data

Multivariate mixture regression models can be used to investigate the relationships between two or more response variables and a set of predictor variables by taking into consideration unobserved population heterogeneity. It is common to take multivariate normal distributions as mixing components, but this mixing model is sensitive to heavy-tailed errors and outliers. Although normal mixture models can approximate any distribution in principle, the number of components needed to account for heavy-tailed distributions can be very large. Mixture regression models based on the multivariate t distributions can be considered as a robust alternative approach. Missing data are inevitable in many situations and parameter estimates could be biased if the missing values are not handled properly. In this paper, we propose a multivariate t mixture regression model with missing information to model heterogeneity in regression function in the presence of outliers and missing values. Along with the robust parameter estimation, our proposed method can be used for (i) visualization of the partial correlation between response variables across latent classes and heterogeneous regressions, and (ii) outlier detection and robust clustering even under the presence of missing values. We also propose a multivariate t mixture regression model using MM-estimation with missing information that is robust to high-leverage outliers. The proposed methodologies are illustrated through simulation studies and real data analysis.     

A fiducial approach to multiple comparisons

Comparing treatment means from populations that follow independent normal distributions is a common statistical problem. Many frequentist solutions exist to test for significant differences amongst the treatment means. A different approach would be to determine how likely it is that particular means are grouped as equal. We developed a fiducial framework for this situation. Our method provides fiducial probabilities that any number of means are equal based on the data and the assumed normal distributions. This methodology was developed when there is constant and non-constant variance across populations. Simulations suggest that our method selects the correct grouping of means at a relatively high rate for small sample sizes and asymptotic calculations demonstrate good properties. Additionally, we have demonstrated the flexibility in the methods ability to calculate the fiducial probability for any number of equal means. This was done by analyzing a simulated data set and a data set measuring the nitrogen levels of red clover plants that were inoculated with different treatments.     

Fitting finite mixture models using iterative Monte Carlo classification

Parameters of a finite mixture model are often estimated by the expectation–maximization (EM) algorithm where the observed data log-likelihood function is maximized. This paper proposes an alternative approach for fitting finite mixture models. Our method, called the iterative Monte Carlo classification (IMCC), is also an iterative fitting procedure. Within each iteration, it first estimates the membership probabilities for each data point, namely the conditional probability of a data point belonging to a particular mixing component given that the data point value is obtained, it then classifies each data point into a component distribution using the estimated conditional probabilities and the Monte Carlo method. It finally updates the parameters of each component distribution based on the classified data. Simulation studies were conducted to compare IMCC with some other algorithms for fitting mixture normal, and mixture t, densities.     

Joint coverage probability in a simulation study on continuous-time Markov chain parameter estimation

Parameter dependency within data sets in simulation studies is common, especially in models such as continuous-time Markov chains (CTMCs). Additionally, the literature lacks a comprehensive examination of estimation performance for the likelihood-based general multi-state CTMC. Among studies attempting to assess the estimation, none have accounted for dependency among parameter estimates. The purpose of this research is twofold: (1) to develop a multivariate approach for assessing accuracy and precision for simulation studies (2) to add to the literature a comprehensive examination of the estimation of a general 3-state CTMC model. Simulation studies are conducted to analyze longitudinal data with a trinomial outcome using a CTMC with and without covariates. Measures of performance including bias, component-wise coverage probabilities, and joint coverage probabilities are calculated. An application is presented using Alzheimer's disease caregiver stress levels. Comparisons of joint and component-wise parameter estimates yield conflicting inferential results in simulations from models with and without covariates. In conclusion, caution should be taken when conducting simulation studies aiming to assess performance and choice of inference should properly reflect the purpose of the simulation.     

A Bounded Derivative Model for Prior Ignorance about a Real-valued Parameter

A new method is proposed for drawing coherent statistical inferences about a real-valued parameter in problems where there is little or no prior information. Prior ignorance about the parameter is modelled by the set of all continuous probability density functions for which the derivative of the log-density is bounded by a positive constant. This set is translation-invariant, it contains density functions with a wide variety of shapes and tail behaviour, and it generates prior probabilities that are highly imprecise. Statistical inferences can be calculated by solving a simple type of optimal control problem whose general solution is characterized. Detailed results are given for the problems of calculating posterior upper and lower means, variances, distribution functions and probabilities of intervals. In general, posterior upper and lower expectations are achieved by prior density functions that are piecewise exponential. The results are illustrated by normal and binomial examples     

Confidence interval estimation for the population coefficient of variation using ranked set sampling: a simulation study

In this paper, an evaluation of the performance of several confidence interval estimators of the population coefficient of variation (τ) using ranked set sampling compared to simple random sampling is performed. Two performance measures are used to assess the confidence intervals for τ, namely: width and coverage probabilities. Simulated data were generated from normal, log-normal, skew normal, Gamma, and Weibull distributions with specified population parameters so that the same values of τ are obtained for each distribution, with sample sizes n=15, 20, 25, 50, 100. A real data example representing birth weight of 189 newborns is used for illustration and performance comparison.