CONVERGENT SERIES EXPRESSIONS FOR INVERSE MOMENTS OF QUADRATIC FORMS IN NORMAL VARIABLES

Using relatively recent results from multivariate distribution theory, a direct approach to evaluating the inverse moments of a quadratic form in normal variables is proposed. Convergent infinite series expressions involving the invariant polynomials of matrix argument are obtained. The solution also depends upon a positive scalar which is arbitrarily chosen. For the solution to converge an upper bound upon this scalar is derived.     

Multivariate generalizations of jonckheere's test for ordered alternatives

In many dose-response studies, each of several independent groups of animals is treated with a different dose of a substance. Many response variables are then measured on each animal. The distributions of the response variables may be nonnormal, and Jonckheere's (1954) test for ordered alternatives in the one-way layout is sometimes used to test whether the level of a single variable increases with increasing dose. In some applications, however, it is important to consider a set of response variables simultaneously. For instance, an increase in each of certain enzymes in the blood serum may suggest liver damage. To test whether these enzyme levels increase with increasing dose, it may be preferable to consider these enzymes as a group, rather than individually.

I propose two multivariate generalizations of Jonckheere's univariate test. Each multivariate test statistic is a function of coordinate-wise Jonckheere statistics—one a sum, the other a quadratic form. The sum statistic can be used to test the alternative hypothesis that each variable is stochastically increasing with increasing dose. The quadratic form statistic is designed for the more general alternative hypothesis that each variable is stochastically ordered with increasing dose.

For each of these two alternatives, I also propose a multivariate generalization of a normal theory test described by Puri (1965). I examine the asymptotic distributions of the four test statistics under the null hypothesis and under translation alternatives and compare each distribution-free test to the corresponding normal theory test in terms of asymptotic relative efficiency.

The multivariate Jonckheere tests are illustrated using does-response data from a subchronic toxicology study carried out by the National Toxicology Program. Four groups of ten male rats each were treated with increasing doses of vinylidene flouride, and the serum enzymes SDH, SGOT, and SGPT were measured. A comparison of univariate Jonckheere tests on each variable, bivariate tests on SDH and SGOT, and multivariate tests on all three variables gives insight into the behavior of the various procedures.     

Estimates of regression coefficients based on the sign covariance matrix

Summary. A new estimator of the regression parameters is introduced in a multivariate multiple-regression model in which both the vector of explanatory variables and the vector of response variables are assumed to be random. The affine equivariant estimate matrix is constructed using the sign covariance matrix (SCM) where the sign concept is based on Oja's criterion function. The influence function and asymptotic theory are developed to consider robustness and limiting efficiencies of the SCM regression estimate. The estimate is shown to be consistent with a limiting multinormal distribution. The influence function, as a function of the length of the contamination vector, is shown to be linear in elliptic cases; for the least squares (LS) estimate it is quadratic. The asymptotic relative efficiencies with respect to the LS estimate are given in the multivariate normal as well as the t -distribution cases. The SCM regression estimate is highly efficient in the multivariate normal case and, for heavy-tailed distributions, it performs better than the LS estimate. Simulations are used to consider finite sample efficiencies with similar results. The theory is illustrated with an example.     

Moments of generalized quadratic forms and distributions of certain multivariate test statistics

Summary Moments and distributions of quadratic forms or quadratic expressions in normal variables are available in literature. Such quadratic expressions are shown to be equivalent to a linear function of independent central or noncentral chi-square variables. Some results on linear functions of generalized quadratic forms are also available in literature. Here we consider an arbitrary linear function of matrix-variate gamma variables. Moments of the determinant of such a linear function are evaluated when the matrix-variate gammas are independently distributed. By using these results, arbitrary non-null moments as well as the non-null distribution of the likelihood ratio criterion for testing the hypothesis of equality of covariance matrices in independent multivariate normal populations are derived. As a related result, the distribution of a linear function of independent matrix-variate gamma random variables, which includes linear functions of independent Wishart matrices, is also obtained. Some properties of generalized special functions of several matrix arguments are used in deriving these results.     

A multivariate two-factor skew model

It is well known that many data, such as the financial or demographic data, exhibit asymmetric distributions. In recent years, researchers have concentrated their efforts to model this asymmetry. Skew normal model is one of such models that are skew and yet possess many properties of the normal model. In this paper, a new multivariate skew model is proposed, along with its statistical properties. It includes the multivariate normal distribution and multivariate skew normal distribution as special cases. The quadratic form of this random vector follows a χ² distribution. The roles of the parameters in the model are investigated using contour plots of bivariate densities.     

An approximation to the distribution of the ratio of two general quadratic forms with application

Based on mixed cumulants up to order six, this paper provides a four moment approximation to the distribution of a ratio of two general quadratic forms in normal variables. The approximation is applied to calculate the percentile points of modified F-test statistics for testing treatment effects when standard F-ratio test is misleading because of dependence among observations. For the special case, when data is generated by an AR(1) process, the approximation is evaluated by a simulation study. For the general SARMA (p,q)(P,Q)_s process, a modified F-test statistic Is given, and its distribution for the (0,1)(0,l)₁₂ process, is approximated by the moment approximation technique.     

On approximating the distribution of indefinite quadratic forms

This paper provides a simple methodology for approximating the distribution of indefinite quadratic forms in normal random variables. It is shown that the density function of a positive definite quadratic form can be approximated in terms of the product of a gamma density function and a polynomial. An extension which makes use of a generalized gamma density function is also considered. Such representations are based on the moments of a quadratic form, which can be determined from its cumulants by means of a recursive formula. After expressing an indefinite quadratic form as the difference of two positive definite quadratic forms, one can obtain an approximation to its density function by means of the transformation of variable technique. An explicit representation of the resulting density approximant is given in terms of a degenerate hypergeometric function. An easily implementable algorithm is provided. The proposed approximants produce very accurate percentiles over the entire range of the distribution. Several numerical examples illustrate the results. In particular, the methodology is applied to the Durbin–Watson statistic which is expressible as the ratio of two quadratic forms in normal random variables. Quadratic forms being ubiquitous in statistics, the approximating technique introduced herewith has numerous potential applications. Some relevant computational considerations are also discussed.     

Detection and Interpretation of a Multivariate Signal Using Combined Charts

A control procedure is presented in this article that is based on jointly using two separate control statistics in the detection and interpretation of signals in a multivariate normal process. The procedure detects the following three situations: (i) a mean vector shift without a shift in the covariance matrix; (ii) a shift in process variation (covariance matrix) without a mean vector shift; and (iii) both a simultaneous shift in the mean vector and covariance matrix as the result of a change in the parameters of some key process variables. It is shown that, following the occurrence of a signal on either of the separate control charts, the values from both of the corresponding signaling statistics can be decomposed into interpretable elements. Viewing the two decompositions together helps one to specifically identify the individual components and associated variables that are being affected. These components may include individual means or variances of the process variables as well as the correlations between or among variables. An industrial data set is used to illustrate the procedure.     

Skew-mixed effects model for multivariate longitudinal data with categorical outcomes and missingness

A longitudinal study commonly follows a set of variables, measured for each individual repeatedly over time, and usually suffers from incomplete data problem. A common approach for dealing with longitudinal categorical responses is to use the Generalized Linear Mixed Model (GLMM). This model induces the potential relation between response variables over time via a vector of random effects, assumed to be shared parameters in the non-ignorable missing mechanism. Most GLMMs assume that the random-effects parameters follow a normal or symmetric distribution and this leads to serious problems in real applications. In this paper, we propose GLMMs for the analysis of incomplete multivariate longitudinal categorical responses with a non-ignorable missing mechanism based on a shared parameter framework with the less restrictive assumption of skew-normality for the random effects. These models may contain incomplete data with monotone and non-monotone missing patterns. The performance of the model is evaluated using simulation studies and a well-known longitudinal data set extracted from a fluvoxamine trial is analyzed to determine the profile of fluvoxamine in ambulatory clinical psychiatric practice.     

Goodness of fit and homogeneity tests on the basis of N-distances

In this paper we propose an application of N-distance theory [Klebanov, L.B., 2005. N-distances and their applications. Karolinum, Prague] for testing simple hypotheses of goodness of fit and homogeneity. The asymptotic null distribution of test statistics is established and coincides with the distribution of infinite quadratic form of independent standard normal random variables. A construction of multivariate free-of-distribution homogeneity test is considered. The power of proposed criteria is compared with classical tests using Monte-Carlo simulations.     

Evaluating the Contributions of Individual Variables to a Quadratic Form

Quadratic forms capture multivariate information in a single number, making them useful, for example, in hypothesis testing. When a quadratic form is large and hence interesting, it might be informative to partition the quadratic form into contributions of individual variables. In this paper it is argued that meaningful partitions can be formed, though the precise partition that is determined will depend on the criterion used to select it. An intuitively reasonable criterion is proposed and the partition to which it leads is determined. The partition is based on a transformation that maximises the sum of the correlations between individual variables and the variables to which they transform under a constraint. Properties of the partition, including optimality properties, are examined. The contributions of individual variables to a quadratic form are less clear‐cut when variables are collinear, and forming new variables through rotation can lead to greater transparency. The transformation is adapted so that it has an invariance property under such rotation, whereby the assessed contributions are unchanged for variables that the rotation does not affect directly. Application of the partition to Hotelling's one‐ and two‐sample test statistics, Mahalanobis distance and discriminant analysis is described and illustrated through examples. It is shown that bootstrap confidence intervals for the contributions of individual variables to a partition are readily obtained.     

A Conditional Autoregressive Gaussian Process for Irregularly Spaced Multivariate Data with Application to Modelling Large Sets of Binary Data

A Gaussian conditional autoregressive (CAR) formulation is presented that permits the modelling of the spatial dependence and the dependence between multivariate random variables at irregularly spaced sites so capturing some of the modelling advantages of the geostatistical approach. The model benefits not only from the explicit availability of the full conditionals but also from the computational simplicity of the precision matrix determinant calculation using a closed form expression involving the eigenvalues of a precision matrix submatrix. The introduction of covariates into the model adds little computational complexity to the analysis and thus the method can be straightforwardly extended to regression models. The model, because of its computational simplicity, is well suited to application involving the fully Bayesian analysis of large data sets involving multivariate measurements with a spatial ordering. An extension to spatio-temporal data is also considered. Here, we demonstrate use of the model in the analysis of bivariate binary data where the observed data is modelled as the sign of the hidden CAR process. A case study involving over 450 irregularly spaced sites and the presence or absence of each of two species of rain forest trees at each site is presented; Markov chain Monte Carlo (MCMC) methods are implemented to obtain posterior distributions of all unknowns. The MCMC method works well with simulated data and the tree biodiversity data set.     

Posterior moments of scalar functions of a covariance matrix

Given multivariate normal data and a certain spherically invariant prior distribution on the covariance matrix, it is desired to estimate the moments of the posterior marginal distributions of some scalar functions of the covariance matrix by importance sampling. To this end a family of distributions is defined on the group of orthogonal matrices and a procedure is proposed for selecting one of these distributions for use as a weighting distribution in the importance sampling process. In an example estimates are calculated for the posterior mean and variance of each element in the covariance matrix expressed in the original coordinates, for the posterior mean of each element in the correlation matrix expressed in the original coordinates, and for the posterior mean of each element in the covariance matrix expressed in the coordinates of the principal variables.     

Gammaization and wishartness of dependent quadratic forms

In this paper two equivalent sets of necessary and sufficient conditions are derived for dependent quadratic forms to be distributed as multivariate gamma distribution. The procedure also gives a set of necessary and sufficient conditions for principal minors of generalized quadratic forms to be jointly distributed as the joint distribution of principal minors of a Kishart matrix.     

An error-bounded polynomial approximation for bivariate normal probabilities

Although the bivariate normal distribution is frequently employed in the development of screening models, the formulae for computing bivariate normal probabilities are quite complicated. A simple and accurate error-bounded, noniterative approximation for bivariate normal probabilities based on a simple univariate normal quadratic or cubic approximation is developed for use in screening applications. The approximation, which is most accurate for large absolute correlation coefficients, is especially suitable for screening applications (e.g., in quality control), where large absolute correlations between performance and screening variables are desired. A special approximation for conditional bivariate normal probabilities is also provided which in quality control screening applications improves the accuracy of estimating the average outgoing product quality. Some anomalies in computing conditional bivariate normal probabilities using BNRDF and NORDF in IMSL are also discussed.     

Modeling a mixture of ordinal and continuous repeated measures

We study the correlation structure for a mixture of ordinal and continuous repeated measures using a Bayesian approach. We assume a multivariate probit model for the ordinal variables and a normal linear regression for the continuous variables, where latent normal variables underlying the ordinal data are correlated with continuous variables in the model. Due to the probit model assumption, we are required to sample a covariance matrix with some of the diagonal elements equal to one. The key computational idea is to use parameter-extended data augmentation, which involves applying the Metropolis-Hastings algorithm to get a sample from the posterior distribution of the covariance matrix incorporating the relevant restrictions. The methodology is illustrated through a simulated example and through an application to data from the UCLA Brain Injury Research Center.     

Applications of a new power normal family

The main purpose of this paper is to give an algorithm to attain joint normality of non-normal multivariate observations through a new power normal family introduced by the author (Isogai, 1999). The algorithm tries to transform each marginal variable simultaneously to joint normality, but due to a large number of parameters it repeats a maximization process with respect to the conditional normal density of one transformed variable given the other transformed variables. A non-normal data set is used to examine performance of the algorithm, and the degree of achievement of joint normality is evaluated by measures of multivariate skewness and kurtosis. Besides the above topic, making use of properties of our power normal family, we discuss not only a normal approximation formula of non-central F distributions in the frame of regression analysis but also some decomposition formulas of a power parameter, which appear in a Wilson-Hilferty power transformation setting.     

Some remarks about the gasser-sroka-jennen-steinmetz variance estimator

This article proposes some simplifications of the residual variance estimator of Gasset, Sroka, and Jeneen-Steinmetz (GSJ, 1986) which is often used in conjunction with non parametric regression. The GSJ estimator is a quadratic form of the data, which depends on the relative spacings of the design points. When the errors are independent, identically distributed Gaussian variables, and the true regression curve is flat, the estimate is distributed as a weighted sum of x² variables. By matching the first two moments, the distribution can be approximated by a x² with degrees of freedom determined by the coefficients of the. quadratic form. Computation of the estimated degrees of freedom requires computing the trace of the square of an n x n matrix, where n is the number of design points. In this article, (n-2)/3 is shown to be a conservative estimate of the approximate degrees of freedom, and (n-2)/2 is shown to be conservative for many designs. In addition, a simplified version of the estimator is shown to be asymptotically equivalent, under many conditions.     

Concurrent generation of multivariate mixed data with variables of dissimilar types

ABSTRACT

Data sets originating from wide range of research studies are composed of multiple variables that are correlated and of dissimilar types, primarily of count, binary/ordinal and continuous attributes. The present paper builds on the previous works on multivariate data generation and develops a framework for generating multivariate mixed data with a pre-specified correlation matrix. The generated data consist of components that are marginally count, binary, ordinal and continuous, where the count and continuous variables follow the generalized Poisson and normal distributions, respectively. The use of the generalized Poisson distribution provides a flexible mechanism which allows under- and over-dispersed count variables generally encountered in practice. A step-by-step algorithm is provided and its performance is evaluated using simulated and real-data scenarios.     

Multiple imputation using multivariate gh transformations

Multiple imputation has emerged as a popular approach to handling data sets with missing values. For incomplete continuous variables, imputations are usually produced using multivariate normal models. However, this approach might be problematic for variables with a strong non-normal shape, as it would generate imputations incoherent with actual distributions and thus lead to incorrect inferences. For non-normal data, we consider a multivariate extension of Tukey's gh distribution/transformation [38] to accommodate skewness and/or kurtosis and capture the correlation among the variables. We propose an algorithm to fit the incomplete data with the model and generate imputations. We apply the method to a national data set for hospital performance on several standard quality measures, which are highly skewed to the left and substantially correlated with each other. We use Monte Carlo studies to assess the performance of the proposed approach. We discuss possible generalizations and give some advices to practitioners on how to handle non-normal incomplete data.