Bayesian Inference in Multivariate Regression With Missing Observations on the Response Variables

We discuss the case of the multivariate linear model Y = XB + E with Y an (n × p) matrix, and so on, when there are missing observations in the Y matrix in a so-called nested pattern. We propose an analysis that arises by incorporating the predictive density of the missing observations in determining the posterior distribution of B, and its mean and variance matrix. This involves us with matric-T variables. The resulting analysis is illustrated with some Canadian economic data.     

Approximate confidence bounds for ratios of variance components in two-way unbalanced crossed models with interactions

Consider the general unbalanced two-factor crossed components-of-variance model with interaction given by Y_ijk: = μ+A_i: +B_j: + C_ij: +E_ijk: (i = 1,2, … a; j = 1,…,b; k = 1,…,.n_ij:=0) A_i:,B_j:, C_ij: and E_ijk: are independent unobservable random variables. Also A_i:sim; N(0,σ² _A),B_j: ～ N(0,σ² _B), C_ij:～N(0,s² _C:) and E_ijk:～N(0,s² _E:). In this paper approximate confidence bounds are obtained for ρ_A: = ρ² _A/² and ρ_B: = ρ² _B:/ρ² (where σ² = σ² _A:+ σ² _B+σ² _Cσ² _E) for special cases of the above model. The balanced incomplete block model is studied as a special case.     

Maximum Likelihood Estimation in the Bivariate Binomial (0,1) Distribution:Application TO 2×2 Tables

We consider a 2×2 contingency table, with dichotomized qualitative characters (A,A) and (B,B), as a sample of size n drawn from a bivariate binomial (0,1) distribution. Maximum likelihood estimates p?₁p?₂ and p? are derived for the parameters of the two marginals p₁p₂ and the coefficient of correlation. It is found that p? is identical to Pearson's (1904)?=(χ²/n)½, where ?² is Pearson's usual chi-square for the 2×2 table. The asymptotic variance-covariance matrix of p?_lp?₂and p is also derived.     

Regression and correlation for 3 × 3 rotation matrices

This paper investigates a regression model for orthogonal matrices introduced by Prentice (1989). It focuses on the special case of 3 × 3 rotation matrices. The model under study expresses the dependent rotation matrix V as A₁UA^t₂ perturbed by experimental errors, where A₁ and A₂ are unknown 3 × 3 rotation matrices and U is an explanatory 3 × 3 rotation matrix. Several specifications for the errors in this regression model are proposed. The asymptotic distributions, as the sample size n becomes large or as the experimental errors become small, of the least squares estimators for A₁ and A₂ are derived. A new algorithm for calculating the least squares estimates of A₁ and A₂ is presented. The independence model is not a submodel of Prentice's regression model, thus the independence between the U and the V sample cannot be tested when fitting Prentice's model. To overcome this difficulty, permutation tests of independence are investigated. Examples dealing with postural variations of subjects performing a drilling task and with the calibration of a camera system for motion analysis using a magnetic tracking device illustrate the methodology of this paper.     

On the Distribution of Matrix Quadratic Forms

A characterization of the distribution of the multivariate quadratic form given by X A X′, where X is a p × n normally distributed matrix and A is an n × n symmetric real matrix, is presented. We show that the distribution of the quadratic form is the same as the distribution of a weighted sum of non central Wishart distributed matrices. This is applied to derive the distribution of the sample covariance between the rows of X when the expectation is the same for every column and is estimated with the regular mean.     

The n.s. conditions for the ration of two quadratic forms to have an f-distribution and its applications

Suppose that ξ and η be two random vectors and that (ξ^τ, η^τ have an elliptically contoured distribution or a multivariate normal distribution. In this article, we obtain some necessary and sufficient (N.S.) conditions such that the ratio of two quadratic forms, say ξ^τ Aξ and η^τ Bη(for some symmetric nonnegative matrices A and B), has an F-distribution. As applications, we extend the classical F-test to some dependent two group samples. Two cases are considered: elliptically contoured and normal distributions.     

Regression analysis using order statistics

In this article, we study the joint distribution of X and two linear combinations of order statistics, a ^T Y ₍₂₎ and b ^T Y ₍₂₎, where a = (a ₁, a ₂) ^T and b = (b ₁, b ₂) ^T are arbitrary vectors in R ² and Y ₍₂₎ = (Y ₍₁₎, Y ₍₂₎) ^T is a vector of ordered statistics obtained from (Y ₁, Y ₂) ^T when (X, Y ₁, Y ₂) ^T follows a trivariate normal distribution with a positive definite covariance matrix. We show that this distribution belongs to the skew-normal family and hence our work is a generalization of Olkin and Viana (J Am Stat Assoc 90:1373–1379, 1995) and Loperfido (Test 17:370–380, 2008).     

The use of probabilistic models to produce optimal graphical displays of high-dimensional data sets

Summary Several techniques for exploring ann×p data set are considered in the light of the statistical framework: data-structure+noise. The first application is to Principal Component Analysis (PCA), in fact generalized PCA with any metric M on the unit space ℝ _p . A natural model for supporting this analysis is the fixed-effect model where the expectation of each unit is assumed to belong to some q-dimensional linear manyfold defining the structure, while the variance describes the noise. The best estimation of the structure is obtained for a proper choice of metric M and dimensionality q: guidelines are provided for both choices in section 2. The second application is to Projection Pursuit which aims to reveal structure in the original data by means of suitable low-dimensional projections of them. We suggest the use of generalized PCA with suitable metric M as a Projection Pursuit technique. According to the kind of structure which is looked for, two such metrics are proposed in section 3. Finally, the analysis ofn×p contingency tables is considered in section 4. Since the data are frequencies, we assume a multinomial or Poisson model for the noise. Several models may be considered for the structural part; we can say that Correspondence Analysis rests on one of them, spherical factor analysis on another one; Goodman association models also provide an alternative modelling. These different approaches are discussed and compared from several points of view.     

Synthetic data method to incorporate external information into a current study

We consider the situation where there is a known regression model that can be used to predict an outcome, Y, from a set of predictor variables X . A new variable B is expected to enhance the prediction of Y. A dataset of size n containing Y, X and B is available, and the challenge is to build an improved model for Y| X ,B that uses both the available individual level data and some summary information obtained from the known model for Y| X . We propose a synthetic data approach, which consists of creating m additional synthetic data observations, and then analyzing the combined dataset of size n + m to estimate the parameters of the Y| X ,B model. This combined dataset of size n + m now has missing values of B for m of the observations, and is analyzed using methods that can handle missing data (e.g., multiple imputation). We present simulation studies and illustrate the method using data from the Prostate Cancer Prevention Trial. Though the synthetic data method is applicable to a general regression context, to provide some justification, we show in two special cases that the asymptotic variances of the parameter estimates in the Y| X ,B model are identical to those from an alternative constrained maximum likelihood estimation approach. This correspondence in special cases and the method's broad applicability makes it appealing for use across diverse scenarios. The Canadian Journal of Statistics 47: 580–603; 2019 © 2019 Statistical Society of Canada     

A characterization of the dilation order and its applications

LetX andY be two random variables with finite expectationsE X andE Y, respectively. ThenX is said to be smaller thanY in the dilation order ifE[ϕ(X-E X)]≤E[ϕ(Y-E Y)] for any convex functionϕ for which the expectations exist. In this paper we obtain a new characterization of the dilation order. This characterization enables us to give new interpretations to the dilation order, and using them we identify conditions which imply the dilation order. A sample of applications of the new characterization is given. Partially supported by MURST 40% Program on Non-Linear Systems and Applications. Partially supported by “Gruppo Nazionale per l'Analisi Funzionale e sue Applicazioni”—CNR.     

DECOMPOSITIONS OF THE QUEUE LENGTH DISTRIBUTIONS IN THE MAP/G/1 QUEUE UNDER MULTIPLE AND SINGLE VACATIONS WITH N-POLICY

In this paper, we establish an explicit form of matrix decompositions for the queue length distributions of the MAP/G/1 queues under multiple and single vacations with N-policy. We show that the vector generating function Y (z) of the queue length at an arbitrary time and X (z) at departures are decomposed into Y (z) = p _idle (z)ζ _Y (z) and X (z) = p _idle (z)ζ _X (z) where p _idle (z) is the vector generating function of the queue length at an arbitrary epoch at which the server is not in service, and ζ _Y (z) and ζ _X (z) are unidentified matrix generating functions.     

Confidence Intervals for Nonparametric Regression Functions with Missing Data

Suppose that we have a nonparametric regression model Y = m(X) + ε with X ∈ R^p, where X is a random design variable and is observed completely, and Y is the response variable and some Y-values are missing at random. Based on the “complete” data sets for Y after nonaprametric regression imputation and inverse probability weighted imputation, two estimators of the regression function m(x₀) for fixed x₀ ∈ R^p are proposed. Asymptotic normality of two estimators is established, which is used to construct normal approximation-based confidence intervals for m(x₀). We also construct an empirical likelihood (EL) statistic for m(x₀) with limiting distribution of χ²₁, which is used to construct an EL confidence interval for m(x₀).     

Improved shrinkage estimators for the mean vector of a scale mixture of normals with unknown variance

The problem of estimating the mean θ of a not necessarily normal p-variate (p > 3) distribution with unknown covariance matrix of the form σ²A (A a known diagonal matrix) on the basis of n_i > 2 observations on each coordinate X_t (1 < i < p) is considered. It is argued that the class of scale (or variance) mixtures of normal distributions is a reasonable class to study. Assuming the loss function is quadratic, a large class of improved shrinkage estimators is developed in the case of a balanced design. We generalize results of Berger and Strawderman for one observation in the known-variance case. This methodology also permits the development of a new class of minimax shrinkage estimators of the mean of a p-variate normal distribution for an unbalanced design. Numerical calculations show that the improvements in risk can be substantial.     

Generalized minimum distance estimators of a linear model with correlated errors

R^p of a linear regression model of the type Y = Xθ + ɛ, where X is the design matrix, Y the vector of the response variable and ɛ the random error vector that follows an AR(1) correlation structure. These estimators are asymptotically analyzed, by proving their strong consistency, asymptotic normality and asymptotic efficiency. In a simulation study, a better behaviour of the Mean Squared Error of the proposed estimator with respect to that of the generalized least squares estimators is observed. Received: November 16, 1998; revised version: May 10, 2000     

Model fitting and inference under latent equilibrium processes

This paper presents a methodology for model fitting and inference in the context of Bayesian models of the type f(Y | X,θ)f(X|θ)f(θ), where Y is the (set of) observed data, θ is a set of model parameters and X is an unobserved (latent) stationary stochastic process induced by the first order transition model f(X ^(t+1)|X ^(t),θ), where X ^(t) denotes the state of the process at time (or generation) t. The crucial feature of the above type of model is that, given θ, the transition model f(X ^(t+1)|X ^(t),θ) is known but the distribution of the stochastic process in equilibrium, that is f(X|θ), is, except in very special cases, intractable, hence unknown. A further point to note is that the data Y has been assumed to be observed when the underlying process is in equilibrium. In other words, the data is not collected dynamically over time. We refer to such specification as a latent equilibrium process (LEP) model. It is motivated by problems in population genetics (though other applications are discussed), where it is of interest to learn about parameters such as mutation and migration rates and population sizes, given a sample of allele frequencies at one or more loci. In such problems it is natural to assume that the distribution of the observed allele frequencies depends on the true (unobserved) population allele frequencies, whereas the distribution of the true allele frequencies is only indirectly specified through a transition model. As a hierarchical specification, it is natural to fit the LEP within a Bayesian framework. Fitting such models is usually done via Markov chain Monte Carlo (MCMC). However, we demonstrate that, in the case of LEP models, implementation of MCMC is far from straightforward. The main contribution of this paper is to provide a methodology to implement MCMC for LEP models. We demonstrate our approach in population genetics problems with both simulated and real data sets. The resultant model fitting is computationally intensive and thus, we also discuss parallel implementation of the procedure in special cases.     

The Equality of the Ordinary Least Squares Estimator and the Best Linear Unbiased Estimator

It is well known that the ordinary least squares estimator of Xβ in the general linear model E _y = Xβ, cov y = σ² V, can be the best linear unbiased estimator even if V is not a multiple of the identity matrix. This article presents, in a historical perspective, the development of the several conditions for the ordinary least squares estimator to be best linear unbiased. Various characterizations of these conditions, using generalized inverses and orthogonal projectors, along with several examples, are also given. In addition, a complete set of references is provided.     

Order-preserving Estimators and an Inequality on the Integration of Zonal Polynomial

ABSTRACT

Suppose X , p × p p.d. random matrix, has the distribution which depends on a p × p p.d. parameter matrix Σ and this distribution is orthogonally invariant. The orthogonally invariant estimator of Σ which has the eigenvalues of the same order as the eigenvalues of X is called order-preserving. We conjecture that a non-order-preserving estimator is dominated by modified order-preserving estimators with respect to the entropy (Stein's) loss function. We show that an inequality on the integration of zonal polynomial is sufficient for this conjecture. We also prove this inequality for the case p = 2.     

E- and R-optimality of block designs for treatment-control comparisons

Abstract

We study optimal block designs for comparing a set of test treatments with a control treatment. We provide the class of all E-optimal approximate block designs, which is characterized by simple linear constraints. Based on this characterization, we obtain a class of E-optimal exact designs for unequal block sizes. In the studied model, we provide a statistical interpretation for wide classes of E-optimal designs. Moreover, we show that all approximate A-optimal designs and a large class of A-optimal exact designs for treatment-control comparisons are also R-optimal. This reinforces the observation that A-optimal designs perform well even for rectangular confidence regions.