On the analysis of circular balanced crossover designs

The paper considers Azaïs' (J. Roy. Statist. Soc. B, 49 (1987) 334–345) randomization procedure for circular balanced crossover designs. It is shown that this randomization does not justify the assumption of independent identically distributed errors when the estimates are corrected for carryover effects. This might lead to underestimation of the variance of treatment estimates. Similar to the results of Kunert (Biometrics, 43 (1987) 833–845) and Kunert and Utzig (J. Roy. Statist. Soc. B, 55 (1993) 919–927), we give constants, such that multiplication with this constant makes the usual estimate of variance conservative.     

On the use of the t-statistic in preliminary testing procedures for the Behrens-Fisher problem

Preliminary testing procedures for the two means problem traditionally employ the pooled variance t-statistic. In this paper we show that bias of the t-statistic under conditions of heterogeneity of variance may be increased if use of the t-statistic is conditional on an affirmative F-test. For this reason we conclude that use of the t-statistic in preliminary testing procedures is inappropriate.     

On discrimination and classification with multivariate repeated measures data

We study the problem of classification with multiple q-variate observations with and without time effect on each individual. We develop new classification rules for populations with certain structured and unstructured mean vectors and under certain covariance structures. The new classification rules are effective when the number of observations is not large enough to estimate the variance–covariance matrix. Computational schemes for maximum likelihood estimates of required population parameters are given. We apply our findings to two real data sets as well as to a simulated data set.     

Optimality and bias of some interpolation and extrapolation designs

We consider interpolation and extrapolation designs with controlled bias. A consistent estimate of an upper bound of the bias is presented. The estimate of some extrapolated value is obtained in a two-stage procedure. The first one provides an estimate of some interpolated value. The second one uses a Taylor expansion around this point. This procedure yields a new type of designs. We discuss their optimality properties with respect to the variance and the bias.     

Linear hypothesis testing for weighted functional data with applications

In socioeconomic areas, functional observations may be collected with weights, called weighted functional data. In this paper, we deal with a general linear hypothesis testing (GLHT) problem in the framework of functional analysis of variance with weighted functional data. With weights taken into account, we obtain unbiased and consistent estimators of the group mean and covariance functions. For the GLHT problem, we obtain a pointwise F-test statistic and build two global tests, respectively, via integrating the pointwise F-test statistic or taking its supremum over an interval of interest. The asymptotic distributions of test statistics under the null and some local alternatives are derived. Methods for approximating their null distributions are discussed. An application of the proposed methods to density function data is also presented. Intensive simulation studies and two real data examples show that the proposed tests outperform the existing competitors substantially in terms of size control and power.     

Restricted maximum likelihood estimation of joint mean‐covariance models

The class of joint mean‐covariance models uses the modified Cholesky decomposition of the within subject covariance matrix in order to arrive to an unconstrained, statistically meaningful reparameterisation. The new parameterisation of the covariance matrix has two sets of parameters that separately describe the variances and correlations. Thus, with the mean or regression parameters, these models have three sets of distinct parameters. In order to alleviate the problem of inefficient estimation and downward bias in the variance estimates, inherent in the maximum likelihood estimation procedure, the usual REML estimation procedure adjusts for the degrees of freedom lost due to the estimation of the mean parameters. Because of the parameterisation of the joint mean covariance models, it is possible to adapt the usual REML procedure in order to estimate the variance (correlation) parameters by taking into account the degrees of freedom lost by the estimation of both the mean and correlation (variance) parameters. To this end, here we propose adjustments to the estimation procedures based on the modified and adjusted profile likelihoods. The methods are illustrated by an application to a real data set and simulation studies. The Canadian Journal of Statistics 40: 225–242; 2012 © 2012 Statistical Society of Canada     

D-optimal minimax regression designs on discrete design space

One classical design criterion is to minimize the determinant of the covariance matrix of the regression estimates, and the designs are called D-optimal designs. To reflect the nature that the proposed models are only approximately true, we propose a robust design criterion to study response surface designs. Both the variance and bias are considered in the criterion. In particular, D-optimal minimax designs are investigated and constructed. Examples are given to compare D-optimal minimax designs with classical D-optimal designs.     

CONSTRUCTION OF CROSSOVER DESIGNS WITH CORRELATED ERRORS

Crossover experiments are widely used, particularly where a sequence of treatments is given to subjects. Correlations between observations on the same subject are therefore likely and should be considered in both the design and analysis of crossover experiments. This paper presents an algorithm for the generation of efficient crossover designs with autoregressive and linear variance structures. The algorithm has been implemented as a module in the experimental design generation package CycDesigN (Release 3.0; CycSoftware, Hamilton, New Zealand). Output from the algorithm is compared with earlier work. Some results are given from the analysis of a crossover experiment assuming correlated errors.     

Optimum designs in complete two-way layouts

In the usual two-way layout of ANOVA (interactions are admitted) let nij ? 1 be the number of observations for the factor-level combination(i, j). For testing the hypothesis that all main effects of the first factor vanish numbers $\text{n}{}^1\text{ij}$ are given such that the power function of the F-test is uniformly maximized (U-optimality), if one considers only designs (nij) for which the row-sums ni are prescribed. Furthermore, in the (larger) set of all designs for which the total number of observations is given, all D-optimum designs are constructed.     

Rank covariance matrix estimation of a partially known covariance matrix

Classical multivariate methods are often based on the sample covariance matrix, which is very sensitive to outlying observations. One alternative to the covariance matrix is the affine equivariant rank covariance matrix (RCM) that has been studied in Visuri et al. [2003. Affine equivariant multivariate rank methods. J. Statist. Plann. Inference 114, 161–185]. In this article we assume that the covariance matrix is partially known and study how to estimate the corresponding RCM. We use the properties that the RCM is affine equivariant and that the RCM is proportional to the inverse of the regular covariance matrix, and hence reduce the problem of estimating the original RCM to estimating marginal rank covariance matrices. This is a great computational advantage when the dimension of the original data vector is large.     

A review of uniform cross-over designs

Uniform cross-over designs form an important family of experimental designs. They have been applied in many scientific disciplines including clinical trials, agricultural studies and psychological experiments. In this paper we consider the four types of uniform cross-over design, as given by Williams [1949. Experimental designs balanced for the estimation of residual effects of treatments. Aust. J. Sci. Res. 2, 149–168], Cheng and Wu [1980. Balanced repeated measurements designs. Ann. Statist. 8, 1272–1283. Corrigendum 11 (1983) 349], Bate and Jones [2006. The construction of nearly balanced and nearly strongly balanced uniform cross-over designs. J. Statist. Plann. Inference 136, 3248–3267] and Kunert [1983. Optimal design and refinement of the linear model with applications to repeated measurements designs. Ann. Statist. 11, 247–257]. The efficiency of these designs, existence criteria and methods of construction are described.     

Comparison of the estimators of the intra-cluster correlation for the nested error regression model

The intra-cluster correlation is insisted on nested error regression model that, in practice, is rarely known. This article demonstrates the size in generalized least squares (GLS) F-test using Fuller–Battese transformation and modification F-test. For the balanced case, the former using strictly positive, analysis of covariance (ANCOVA) and analysis of variance (ANOVA) estimators of intra-cluster correlation can control the size for moderate intra-cluster correlations. For small intra-cluster correlation, they perform well when the numbers of cluster are large. The latter using the ANOVA estimator performs well except for small numbers of cluster. When intra-cluster correlation is large, it cannot control the size. For the unbalanced case, the GLS F-test using the Fuller–Battese transformation and the modification F-test using the strictly positive, the ANCOVA and the ANOVA estimators maintain the significance level for small total sample size and small intra-cluster correlations when there is a large variation in cluster sizes, but they perform well in controlling the size for large total sample size and small different variation in cluster sizes. Besides, Henderson’s method 3 estimator maintains the significance level for a few situations.     

Randomization of neighbour balanced generalized Youden designs

If a crossover design with more than two treatments is carryover balanced, then the usual randomization of experimental units and periods would destroy the neighbour structure of the design. As an alternative, Bailey [1985. Restricted randomization for neighbour-balanced designs. Statist. Decisions Suppl. 2, 237–248] considered randomization of experimental units and of treatment labels, which leaves the neighbour structure intact. She has shown that, if there are no carryover effects, this randomization validates the row–column model, provided the starting design is a generalized Latin square. We extend this result to generalized Youden designs where either the number of experimental units is a multiple of the number of treatments or the number of periods is equal to the number of treatments. For the situation when there are carryover effects we show for so-called totally balanced designs that the variance of the estimates of treatment differences does not change in the presence of carryover effects, while the estimated variance of this estimate becomes conservative.     

Optimal Designs for the Carryover Model with Random Interactions Between Subjects and Treatments

The paper considers a model for crossover designs with carryover effects and a random interaction between treatments and subjects. Under this model, two observations of the same treatment on the same subject are positively correlated and therefore provide less information than two observations of the same treatment on different subjects. The introduction of the interaction makes the determination of optimal designs much harder than is the case for the traditional model. Generalising the results of Bludowsky's thesis, the present paper uses Kushner's method to determine optimal approximate designs. We restrict attention to the case where the number of periods is less than or equal to the number of treatments. We determine the optimal designs in the important special cases that the number of periods is 3, 4 or 5. It turns out that the optimal designs depend on the variance of the random interactions and in most cases are not binary. However, we can show that neighbour balanced binary designs are highly efficient, regardless of the number of periods and of the size of the variance of the interaction effects.     

Minimum bias designs with constraints

A new class of model-robust optimality criteria, based on the mean squared error, is introduced in this paper. The motivation is to find designs when the researcher is more concerned with controlling the variance than the bias, or vice versa. The set of criteria proposed here is also appealing from a mathematical perspective in the sense that, unlike the Box and Draper (1959, J. Amer. Statist. Assoc. 54, 622–654), criterion, they can be imbedded in the framework of convex design theory and, hence, facilitate the search for globally optimal designs. The basic idea is to minimize a convex function of the bias part of the mean squared error subject to a convex constraint on the variance part, or vice versa. Equivalence theorems are derived and examples for the linear and quadratic regression problems are provided.     

Rotation designs for experiments in high-bias situations

Many experiments in the physical and engineering sciences study complex processes in which bias due to model inadequacy dominates random error. A noteworthy example of this situation is the use of computer experiments, in which scientists simulate the phenomenon being studied by a computer code. Computer experiments are deterministic: replicate observations from running the code with the same inputs will be identical. Such high-bias settings demand different techniques for design and prediction. This paper will focus on the experimental design problem introducing a new class of designs called rotation designs. Rotation designs are found by taking an orthogonal starting design D and rotating it to obtain a new design matrix D_R=DR, where R is any orthonormal matrix. The new design is still orthogonal for a first-order model. In this paper, we study some of the properties of rotation designs and we present a method to generate rotation designs that have some appealing symmetry properties.     

Hadamard matrix methods in identifying differentially expressed genes from microarray experiments

Identifying differentially expressed genes is a basic objective in microarray experiments. Many statistical methods for detecting differentially expressed genes in multiple-slide experiments have been proposed. However, sometimes with limited experimental resources, only a single cDNA array or two Oligonuleotide arrays could be made or only insufficient replicated arrays could be conducted. Many current statistical models cannot be used because of the non-availability of replicated data. Simply using fold changes is also unreliable and inefficient [Chen et al. 1997. Ratio-based decisions and the quantitative analysis of cDNA microarray images. J. Biomed. Optics 2, 364–374; Newton et al. 2001. On differential variability of expression ratios: improving statistical inference about gene expression changes from microarray data. J. Comput. Biol. 8, 37–52; Pan et al. 2002. How many replicates of arrays are required to detect gene expression changes in microarray experiments? a mixture model approach. Genome Biol. 3, research0022.1-0022.10]. We propose a new method. If the log-transformed ratios for the expressed genes as well as unexpressed genes have equal variance, we use a Hadamard matrix to construct a t-test from a single array data. Basically, we test whether each doubtful gene has significantly differential expression compared to the unexpressed genes. We form some new random variables corresponding to the rows of a Hadamard matrix using the algebraic sum of gene expressions. A one-sample t-test is constructed and the p-value is calculated for each doubtful gene based on these random variables. By using any method for multiple testing, adjusted p-values could be obtained from original p-values and significance of doubtful genes can be determined. When the variance of expressed genes differs from the variance of unexpressed genes, we construct a z-statistic based on the result from application of Hadamard matrix and find the confidence interval to retain the null hypothesis. Using the interval, we determine differentially expressed genes. This method is also useful for multiple microarrays, especially when sufficient replicated data are not available for a traditional t-test. We apply our methodology to ApoAI data. The results appear to be promising. They not only confirm the early known differentially expressed genes, but also indicate more genes to be differentially expressed.     

New HEAVY Models for Fat-Tailed Realized Covariances and Returns

ABSTRACT

We develop a new score-driven model for the joint dynamics of fat-tailed realized covariance matrix observations and daily returns. The score dynamics for the unobserved true covariance matrix are robust to outliers and incidental large observations in both types of data by assuming a matrix-F distribution for the realized covariance measures and a multivariate Student's t distribution for the daily returns. The filter for the unknown covariance matrix has a computationally efficient matrix formulation, which proves beneficial for estimation and simulation purposes. We formulate parameter restrictions for stationarity and positive definiteness. Our simulation study shows that the new model is able to deal with high-dimensional settings (50 or more) and captures unobserved volatility dynamics even if the model is misspecified. We provide an empirical application to daily equity returns and realized covariance matrices up to 30 dimensions. The model statistically and economically outperforms competing multivariate volatility models out-of-sample. Supplementary materials for this article are available online.     

Posterior moments of scalar functions of a covariance matrix

Given multivariate normal data and a certain spherically invariant prior distribution on the covariance matrix, it is desired to estimate the moments of the posterior marginal distributions of some scalar functions of the covariance matrix by importance sampling. To this end a family of distributions is defined on the group of orthogonal matrices and a procedure is proposed for selecting one of these distributions for use as a weighting distribution in the importance sampling process. In an example estimates are calculated for the posterior mean and variance of each element in the covariance matrix expressed in the original coordinates, for the posterior mean of each element in the correlation matrix expressed in the original coordinates, and for the posterior mean of each element in the covariance matrix expressed in the coordinates of the principal variables.     

Pseudo-likelihood inference for clustered binary data

The maximum likelihood procedure to estimate paraneters of a model has scveral attractive properties including the existence of the covariance matrix which yield asymptotic covariances: for a sample size N the asymptotics are in general of order 1/N. Here we give an asymptotic for the skewness of the distribution of the maximum likelihood estimator of a parameter; this is of order 1/ n2 and this expression is new. Applications relate to the parameters of (i) the Poisson, binomial, and normal density. (ii) the gamna density and (iii) the Beta debsity. Other application are being considered. The expression for the asymptotic skowness at one phase of the study tured out to be unusually complicated involving the asymptotic expressions for variance and bias. When these were identified a much simpler compact expression appeared which we now describe. The work is a much improved treatment of the subject described in Shenton and Bowman (Mariunm likelihood estimation in small samples, Griffin. 1977).