Distribution theory of quadratic forms for matrix multivariate elliptical distribution

This paper proposes the density and characteristic functions of a general matrix quadratic form X^(?)AX${\mathbf{X}}^{(?)}\mathbf{AX}$, when A=A^(?)$\mathbf{A}={\mathbf{A}}^{(?)}$ is a positive semidefinite matrix, X$\mathbf{X}$ has a matrix multivariate elliptical distribution and X^(?)${\mathbf{X}}^{(?)}$ denotes the usual conjugate transpose of X$\mathbf{X}$. These results are obtained for real normed division algebras. With particular cases we obtained the density and characteristic functions of matrix quadratic forms for matrix multivariate normal, Pearson type VII, t and Cauchy distributions.     

On E(s)-optimal supersaturated designs

A popular measure to assess 2-level supersaturated designs is the E(s²)$E(s^2)$ criterion. In this paper, improved lower bounds on E(s²)$E(s^2)$ are obtained. The same improvement has recently been established by Ryan and Bulutoglu [2007. E(s²)$E(s^2)$-optimal supersaturated designs with good minimax properties. J. Statist. Plann. Inference 137, 2250–2262]. However, our analysis provides more details on precisely when an improvement is possible, which is lacking in Ryan and Bulutoglu [2007. E(s²)$E(s^2)$-optimal supersaturated designs with good minimax properties. J. Statist. Plann. Inference 137, 2250–2262]. The equivalence of the bounds obtained by Butler et al. [2001. A general method of constructing E(s²)$E(s^2)$-optimal supersaturated designs. J. Roy. Statist. Soc. B 63, 621–632] (in the cases where their result applies) and those obtained by Bulutoglu and Cheng [2004. Construction of E(s²)$E(s^2)$-optimal supersaturated designs. Ann. Statist. 32, 1662–1678] is established. We also give two simple methods of constructing E(s²)$E(s^2)$-optimal designs.     

On empirical likelihood for linear models with missing responses

Suppose that we have a linear regression model Y=X^′β+_ν0(X)ε$Y=X^{\prime }\beta +{\nu }_0(X)\epsilon$ with random error ε$\epsilon$, where X is a random design variable and is observed completely, and Y is the response variable and some Y-values are missing at random (MAR). In this paper, based on the ‘complete’ data set for Y after inverse probability weighted imputation, we construct empirical likelihood statistics on EY   and β$\beta$ which have the χ²${\chi }^2$-type limiting distributions under some new conditions compared with Xue (2009). Our results broaden the applicable scope of the approach combined with Xue (2009).     

Linear sufficiency and completeness in the context of estimating the parametric function in the general Gauss–Markov model

In this paper we consider linear sufficiency and linear completeness in the context of estimating the estimable parametric function K^′β${\mathbf{K}}^{\prime }\mathit{\beta }$ under the general Gauss–Markov model {y,Xβ,σ²V}$\{\mathbf{y},\mathbf{X}\mathit{\beta },{\sigma }^2\mathbf{V}\}$. We give new characterizations for linear sufficiency, and define and characterize linear completeness in a case of estimation of K^′β${\mathbf{K}}^{\prime }\mathit{\beta }$. Also, we consider a predictive approach for obtaining the best linear unbiased estimator of K^′β${\mathbf{K}}^{\prime }\mathit{\beta }$, and subsequently, we give the linear analogues of the Rao–Blackwell and Lehmann–Scheffé Theorems in the context of estimating K^′β${\mathbf{K}}^{\prime }\mathit{\beta }$.     

Quasi-minimax estimation in the general linear regression model

This paper is mainly concerned with minimax estimation in the general linear regression model y=Xβ+ε$y=X\beta +\epsilon$ under ellipsoidal restrictions on the parameter space and quadratic loss function. We confine ourselves to estimators that are linear in the response vector y  . The minimax estimators of the regression coefficient β$\beta$ are derived under homogeneous condition and heterogeneous condition, respectively. Furthermore, these obtained estimators are the ridge-type estimators and mean dispersion error (MDE) superior to the best linear unbiased estimator b=(X^′W^-1X)^-1X^′W^-1y$b=(X^{\prime }{W}^{-1}X{)}^{-1}{X}^{\prime }{W}^{-1}y$ under some conditions.     

Confidence intervals in regression utilizing prior information

We consider a linear regression model with regression parameter β=(_β1,…,_βp)$\beta =({\beta }_1,\dots ,{\beta }_p)$ and independent and identically N(0,σ²)$N(0,{\sigma }^2)$ distributed errors. Suppose that the parameter of interest is θ=a^Tβ$\theta =a^T\beta$ where a$a$ is a specified vector. Define the parameter τ=c^Tβ-t$\tau =c^T\beta -t$ where the vector c$c$ and the number t$t$ are specified and a$a$ and c$c$ are linearly independent. Also suppose that we have uncertain prior information that τ=0$\tau =0$. We present a new frequentist 1-α$1-\alpha$ confidence interval for θ$\theta$ that utilizes this prior information. We require this confidence interval to (a) have endpoints that are continuous functions of the data and (b) coincide with the standard 1-α$1-\alpha$ confidence interval when the data strongly contradict this prior information. This interval is optimal in the sense that it has minimum weighted average expected length where the largest weight is given to this expected length when τ=0$\tau =0$. This minimization leads to an interval that has the following desirable properties. This interval has expected length that (a) is relatively small when the prior information about τ$\tau$ is correct and (b) has a maximum value that is not too large. The following problem will be used to illustrate the application of this new confidence interval. Consider a 2×2$2\times 2$ factorial experiment with 20 replicates. Suppose that the parameter of interest θ$\theta$ is a specified simple   effect and that we have uncertain prior information that the two-factor interaction is zero. Our aim is to find a frequentist 0.95 confidence interval for θ$\theta$ that utilizes this prior information.     

Tabu search for covering arrays using permutation vectors

A covering array  CA(N;t,k,v)$\mathsf{CA}(N;t,k,v)$ is an N×k$N\times k$ array, in which in every N×t$N\times t$ subarray, each of the v^t$v^t$ possible t  -tuples over v$v$ symbols occurs at least once. The parameter t is the strength   of the array. Covering arrays have a wide range of applications for experimental screening designs, particularly for software interaction testing. A compact representation of certain covering arrays employs “permutation vectors” to encode v^t×1$v^t\times 1$ subarrays of the covering array so that a covering perfect hash family whose entries correspond to permutation vectors yields a covering array. We introduce a method for effective search for covering arrays of this type using tabu search. Using this technique, improved covering arrays of strength 3, 4 and 5 have been found, as well as the first arrays of strength 6 and 7 found by computational search.     

Construction of blocked two-level regular designs with general minimum lower order confounding

Zhang et al. (2008) proposed a general minimum lower order confounding (GMC for short) criterion, which aims to select optimal factorial designs in a more elaborate and explicit manner. By extending the GMC criterion to the case of blocked designs, Wei et al. (submitted for publication) proposed a B¹-GMC criterion. The present paper gives a construction theory and obtains the B¹-GMC 2^n−m:2^r$2^{n-m}:2^r$ designs with n≥5N/16+1$n\ge 5N/16+1$, where 2^n−m:2^r$2^{n-m}:2^r$ denotes a two-level regular blocked design with N=2^n−m$N=2^{n-m}$ runs, n   treatment factors, and 2^r$2^r$ blocks. The construction result is simple. Up to isomorphism, the B¹-GMC 2^n−m:2^r$2^{n-m}:2^r$ designs can be constructed as follows: the n   treatment factors and the 2^r−1$2^r-1$ block effects are, respectively, assigned to the last n   columns and specific 2^r−1$2^r-1$ columns of the saturated 2^{(N−1)−(N−1−n+m)}$2^{(N-1)-(N-1-n+m)}$ design with Yates order. With such a simple structure, the B¹-GMC designs can be conveniently used in practice. Examples are included to illustrate the theory.     

Statistical properties of Rechtschaffner designs

Rechtschaffner designs are saturated designs of resolution V   in which main effects and two-factor interactions are estimable if three-factor and higher order interactions are negligible. Statistical properties of Rechtschaffner designs are studied in this paper. Best linear unbiased estimators of main effects and two-factor interactions are given explicitly and asymptotic properties of correlations between these estimators are studied as well. It is shown that designs recommended by Rechtschaffner [1967. Saturated fractions of 2ⁿ$2^n$ and 3ⁿ$3^n$ factorial designs, Technometrics 9, 569–576] are not only A-optimal but also D-optimal. Comparisons of Rechtschaffner designs with other A- and D-optimal designs of resolution V are also discussed.     

Lattice and Schröder paths with periodic boundaries

We consider paths in the plane with (1,0$1,0$), (0,1$0,1$), and (a,b$a,b$)-steps that start at the origin, end at height n$n$, and stay strictly to the left of a given non-decreasing right boundary. We show that if the boundary is periodic and has slope at most b/a$b/a$, then the ordinary generating function for the number of such paths ending at height n   is algebraic. Our argument is in two parts. We use a simple combinatorial decomposition to obtain an Appell relation or “umbral” generating function, in which the power zⁿ$z^n$ is replaced by a power series of the form zⁿ_φn(z),$z^n{\phi }_n(z),$ where _φn(0)=1.${\phi }_n(0)=1.$ Then we convert (in an explicit way) the umbral generating function to an ordinary generating function by solving a system of linear equations and a polynomial equation. This conversion implies that the ordinary generating function is algebraic. We give several concrete examples, including an alternative way to solve the tennis ball problem.     

An identity for the Fisher information and Mahalanobis distance

Consider a mixture problem consisting of k classes. Suppose we observe an s-dimensional random vector X   whose distribution is specified by the relations P(X∈A|Y=i)=_Pi(A)$P(X\in A|Y=i)=P_i(A)$, where Y   is an unobserved class identifier defined on {1,…,k}$\{1,\dots ,k\}$, having distribution P(Y=i)=_pi$P(Y=i)=p_i$. Assuming the distributions _Pi$P_i$ having a common covariance matrix, elegant identities are presented that connect the matrix of Fisher information in Y   on the parameters _p1,…,_pk$p_1,\dots ,p_k$, the matrix of linear information in X, and the Mahalanobis distances between the pairs of P  's. Since the parameters are not free, the information matrices are singular and the technique of generalized inverses is used. A matrix extension of the Mahalanobis distance and its invariant forms are introduced that are of interest in their own right. In terms of parameter estimation, the results provide an independent of the parameter upper bound for the loss of accuracy by esimating _p1,…,_pk$p_1,\dots ,p_k$ from a sample of X^′$X^{\prime }$s, as compared with the ideal estimator based on a random sample of Y^′$Y^{\prime }$s.     

Optimal block designs for three treatments when observations are correlated

E$E$-optimal designs for comparing three treatments in blocks of size three are identified, where intrablock observations are correlated according to a first order autoregressive error process with parameter ρ∈(0,1)$\rho \in (0,1)$. For number of blocks b   of the form b=3n+1$b=3n+1$, there are two distinct optimal designs depending on the value of ρ$\rho$, with the best design being unequally replicated for large ρ$\rho$. For other values of b$b$, binary, equireplicate designs with specified within-block assignment patterns are best. In many cases, the stronger majorization optimality is established.     

Optimal mixed-level k-circulant supersaturated designs

Supersaturated designs (SSDs) offer a potentially useful way to investigate many factors with only few experiments in the preliminary stages of experimentation. This paper explores how to construct E(_fNOD)$E(f_{\mathrm{NOD}})$-optimal mixed-level SSDs using k-cyclic generators. The necessary and sufficient conditions for the existence of mixed-level k-circulant SSDs with the equal occurrence property are provided. Properties of the mixed-level k  -circulant SSDs are investigated, in particular, the sufficient condition under which the generator vector produces an E(_fNOD)$E(f_{\mathrm{NOD}})$-optimal SSD is obtained. Moreover, many new E(_fNOD)$E(f_{\mathrm{NOD}})$-optimal mixed-level SSDs are constructed and listed. The method here generalizes the one proposed by Liu and Dean [2004. k$k$-circulant supersaturated designs. Technometrics 46, 32–43] for two-level SSDs and the one due to Georgiou and Koukouvinos [2006. Multi-level k-circulant supersaturated designs. Metrika 64, 209–220] for the multi-level case.     

Testing regions with nonsmooth boundaries via multiscale bootstrap

A new class of approximately unbiased tests based on bootstrap probabilities is obtained for the multivariate normal model with unknown expectation parameter vector. The null hypothesis is represented as an arbitrary-shaped region with possibly nonsmooth boundary surfaces such as cones, which appear in, for example, multiple comparisons and hierarchical clustering. The size n^′$n^{\prime }$ of bootstrap samples is intentionally altered from the size n of the data. A scaling-law of the bootstrap probability leads to our bias corrected p  -values which are calculated by extrapolating the bootstrap probability back to n^′=-n$n^{\prime }=-n$. The new method approximates the bootstrap iteration applied to the bootstrap probability.     

Truncated linear estimation of a bounded multivariate normal mean

We consider the problem of estimating the mean θ$\theta$ of an _Np(θ,_Ip)${\mathrm{N}}_{\mathrm{p}}(\theta ,I_p)$ distribution with squared error loss ∥δ−θ∥²$\parallel \delta -\theta {\parallel }^2$ and under the constraint ∥θ∥≤m$\parallel \theta \parallel \le m$, for some constant m>0$m>0$. Using Stein's identity to obtain unbiased estimates of risk, Karlin's sign change arguments, and conditional risk analysis, we compare the risk performance of truncated linear estimators with that of the maximum likelihood estimator _δmle${\delta }_{\mathrm{mle}}$. We obtain for fixed (m,p)$(m,p)$ sufficient conditions for dominance. An asymptotic framework is developed, where we demonstrate that the truncated linear minimax estimator dominates _δmle${\delta }_{\mathrm{mle}}$, and where we obtain simple and accurate measures of relative improvement in risk. Numerical evaluations illustrate the effectiveness of the asymptotic framework for approximating the risks for moderate or large values of p.     

General minimum lower order confounding designs: An overview and a construction theory

For fractional factorial (FF) designs, Zhang et al. (2008) introduced a new pattern for assessing regular designs, called aliased effect-number pattern (AENP), and based on the AENP, proposed a general minimum lower order confounding (denoted by GMC for short) criterion for selecting design. In this paper, we first have an overview of the existing optimality criteria of FF designs, and then propose a construction theory for 2^n−m$2^{n-m}$ GMC designs with 33N/128≤n≤5N/16$33N/128\le n\le 5N/16$, where N=2^n−m$N=2^{n-m}$ is the run size and n is the number of factors, for all N's and n  's, via the doubling theory and SOS resolution IV designs. The doubling theory is extended with a new approach. By introducing a notion of rechanged (RC) Yates order for the regular saturated design, the construction result turns out to be quite transparent: every GMC 2^n−m$2^{n-m}$ design simply consists of the last n columns of the saturated design with a specific RC Yates order. This can be very conveniently applied in practice.