Comparison of design for quadratic regression on cubes

Designs for quadratic regression are considered when the possible choices of the controllable variable are points x=(x₁,x₂,…,x_q) in the q-dimensional cube of side 2. The designs that are optimum with respect to such criteria as those of D-, A-, and E-optimality are compared in their performance relative to these and other criteria. Some of the results are developed algebraically; others, numerically. The possible supports of E-optimum designs are much more numerous than the D-optimum supports characterized earlier. The A-optimum design appears to be fairly robust in its efficiency, under variation of criterion.     

Optimum designs in complete two-way layouts

In the usual two-way layout of ANOVA (interactions are admitted) let nij ? 1 be the number of observations for the factor-level combination(i, j). For testing the hypothesis that all main effects of the first factor vanish numbers $\text{n}{}^1\text{ij}$ are given such that the power function of the F-test is uniformly maximized (U-optimality), if one considers only designs (nij) for which the row-sums ni are prescribed. Furthermore, in the (larger) set of all designs for which the total number of observations is given, all D-optimum designs are constructed.     

A-optimal designs for heteroscedastic multifactor regression models

Abstract

This paper searches for A-optimal designs for Kronecker product and additive regression models when the errors are heteroscedastic. Sufficient conditions are given so that A-optimal designs for the multifactor models can be built from A-optimal designs for their sub-models with a single factor. The results of an efficiency study carried out to check the adequacy of the products of optimal designs for uni-factor marginal models when these are used to estimate different multi-factor models are also reported.     

Optimal regression designs in the presence of random block effects

A- and D-optimal regression designs under random block-effects models are considered. We first identify certain situations where D- and A-optimal designs do not depend on the intra-block correlation and can be obtained easily from the optimal designs under uncorrelated models. For example, for quadratic regression on [−1,1], this covers D-optimal designs when the block size is a multiple of 3 and A-optimal designs when the block size is a multiple of 4. In general, the optimal designs depend on the intra-block correlation. For quadratic regression, we provide expressions for D-optimal designs for any block size. A-optimal designs with blocks of size 2 for quadratic regression are also obtained. In all the cases considered, robust designs which do not depend on the intrablock correlation can be constructed.     

ALL-BIAS DESIGNS FOR POLYNOMIAL SPLINE REGRESSION MODELS

Polynomial spline regression models of low degree have proved useful in modeling responses from designed experiments in science and engineering when simple polynomial models are inadequate. Where there is uncertainty in the number and location of the knots, or breakpoints, of the spline, then designs that minimize the systematic errors resulting from model misspecification may be appropriate. This paper gives a method for constructing such all‐bias designs for a single variable spline when the distinct knots in the assumed and true models come from some specified set. A class of designs is defined in terms of the inter‐knot intervals and sufficient conditions are obtained for a design within this class to be all‐bias under linear, quadratic and cubic spline models. An example of the construction of all‐bias designs is given.     

Optimal cross-over designs for nonlinear mixed models using a first-order expansion

We consider the construction of optimal cross-over designs for nonlinear mixed effect models based on the first-order expansion. We show that for AB/BA designs a balanced subject allocation is optimal when the parameters depend on treatments only. For multiple period, multiple sequence designs, uniform designs are optimal among dual balanced designs under the same conditions. As a by-product, the same results hold for multivariate linear mixed models with variances depending on treatments.     

Mixture designs for five components in orthogonal blocks

The methods developed by John and Draper et al. of partitioning the blends (runs) of four mixture components into two or more orthogonal blocks when fitting quadratic models are extended to mixtures of five components. The characteristics of Latin squares of side five are used to derive rules for reliably and quickly obtaining designs with specific properties. The designs also produce orthogonal blocks when higher order models are fitted.     

Optimal designs for additive mixture model with heteroscedastic errors

This paper presents a study of D- and A-optimality of direct sum designs for additive mixture models when the errors are heteroscedastic. Sufficient conditions are given so that D- and A-optimal designs for additive mixture models can be constructed from the D- and A-optimal designs for homogeneous models in sub-mixture systems.     

Circular balanced repeated measurements designs

The concept of a circular design is defined and when proper balance for various effects is assumed, its universal optimality is proved over the class of all designs with the same set of parameters, Such designs are shown to minimize the variance of the best linear unbiased estimators of contrasts of residual and direct effects over the class of equireplicated designs. All models assume first order residual effects and are of a circular nature. The proofs are presented in a unified manner for several models at a time. They are based on certain matrix domination which occurs when parameters are eliminated from a linear modelj this latter fact is proved for a general linear model.     

Optimal minimax designs for prediction in heteroscedastic models

We construct optimal designs for heteroscedastic models when the goal is to make efficient prediction over a compact interval. It is assumed that the point or points which are interesting to predict are not known before the experiment is run. Two minimax strategies for minimizing the maximum fitted variance and maximum predictive variance across the interval of interest are proposed and, optimal designs are found and compared. An algorithm for generating these designs is included.     

A semi-infinite programming based algorithm for finding minimax optimal designs for nonlinear models

Minimax optimal experimental designs are notoriously difficult to study largely because the optimality criterion is not differentiable and there is no effective algorithm for generating them. We apply semi-infinite programming (SIP) to solve minimax design problems for nonlinear models in a systematic way using a discretization based strategy and solvers from the General Algebraic Modeling System (GAMS). Using popular models from the biological sciences, we show our approach produces minimax optimal designs that coincide with the few theoretical and numerical optimal designs in the literature. We also show our method can be readily modified to find standardized maximin optimal designs and minimax optimal designs for more complicated problems, such as when the ranges of plausible values for the model parameters are dependent and we want to find a design to minimize the maximal inefficiency of estimates for the model parameters.     

Robust designs for linear mixed effects models

Summary.  In health sciences, medicine and social sciences linear mixed effects models are often used to analyse time-structured data. The search for optimal designs for these models is often hampered by two problems. The first problem is that these designs are only locally optimal. The second problem is that an optimal design for one model may not be optimal for other models. In this paper the maximin principle is adopted to handle both problems, simultaneously. The maximin criterion is formulated by means of a relative efficiency measure, which gives an indication of how much efficiency is lost when the uncertainty about the models over a prior domain of parameters is taken into account. The procedure is illustrated by means of three growth studies. Results are presented for a vocabulary growth study from education, a bone gain study from medical research and an epidemiological decline in height study. It is shown that, for the mixed effects polynomial models that are applied to these studies, the maximin designs remain highly efficient for different sets of models and combinations of parameter values.     

Some results on optimality in models with heteroscedastic errors from partial optimum designs

This paper studies optimum designs for linear models when the errors are heteroscedastic. Sufficient conditions are given in order to obtainD-, A- andE-optimum designs for a complete regression model from partial optimum designs for some sub-parameters. A result about optimality for a complete model from the optimality for the submodels is included. Supported by Junta de Andalucía, research group FQM244.     

On Exact K-optimal Designs Minimizing the Condition Number

A new design criterion based on the condition number of an information matrix is proposed to construct optimal designs for linear models, and the resulting designs are called K-optimal designs. The relationship between exact and asymptotic K-optimal designs is derived. Since it is usually hard to find exact optimal designs analytically, we apply a simulated annealing algorithm to compute K-optimal design points on continuous design spaces. Specific issues are addressed to make the algorithm effective. Through exact designs, we can examine some properties of the K-optimal designs such as symmetry and the number of support points. Examples and results are given for polynomial regression models and linear models for fractional factorial experiments. In addition, K-optimal designs are compared with A-optimal and D-optimal designs for polynomial regression models, showing that K-optimal designs are quite similar to A-optimal designs.     

Optimal Designs for Random Coefficient Regression Models with Heteroscedastic Errors

The purpose of this article is to present the optimal designs based on D-, G-, A-, I-, and D _β-optimality criteria for random coefficient regression (RCR) models with heteroscedastic errors. A sufficient condition for the heteroscedastic structure is given to make sure that the search of optimal designs can be confined at extreme settings of the design region when the criteria satisfy the assumption of the real valued monotone design criteria. Analytical solutions of D-, G-, A-, I-, and D _β-optimal designs for the RCR models are derived. Two examples are presented for random slope models with specific heteroscedastic errors.     

Design and relative efficiency in two-phase studies

Many two-phase sampling designs have been applied in practice to obtain efficient estimates of regression parameters while minimizing the cost of data collection. This research investigates two-phase sampling designs for so-called expensive variable problems, and compares them with one-phase designs. Closed form expressions for the asymptotic relative efficiency of maximum likelihood estimators from the two designs are derived for parametric normal models, providing insight into the available information for regression coefficients under the two designs. We further discuss when we should apply the two-phase design and how to choose the sample sizes for two-phase samples. Our numerical study indicates that the results can be applied to more general settings.     

Horwitz's rule, transforming both sides and the design of experiments for mechanistic models

Summary. The paper develops methods for the design of experiments for mechanistic models when the response must be transformed to achieve symmetry and constant variance. The power transformation that is used is partially justified by a rule in analytical chemistry. Because of the nature of the relationship between the response and the mechanistic model, it is necessary to transform both sides of the model. Expressions are given for the parameter sensitivities in the transformed model and examples are given of optimum designs, not only for single-response models, but also for experiments in which multivariate responses are measured and for experiments in which the model is defined by a set of differential equations which cannot be solved analytically. The extension to designs for checking models is discussed.     

Model-Robust Design of Conjoint Choice Experiments

Within the context of choice experimental designs, most authors have proposed designs for the multinomial logit model under the assumption that only the main effects matter. Very little attention has been paid to designs for attribute interaction models. In this article, three types of Bayesian D-optimal designs for the multinomial logit model are studied: main-effects designs, interaction-effects designs, and composite designs. Simulation studies are used to show that in situations where a researcher is not sure whether or not attribute interaction effects are present, it is best to take into account interactions in the design stage. In particular, it is shown that a composite design constructed by including an interaction-effects model and a main-effects model in the design criterion is most robust against misspecification of the underlying model when it comes to making precise predictions.     

Optimal designs for calibration of orientations

This paper concerns designed experiments involving observations of orientations following the models of Prentice (1989) and Rivest &Chang (2006). The authors state minimal conditions on the designs for consistent least squares estimation of the matrix parameters in these models. The conditions are expressed in terms of the axes and rotation angles of the design orientations. The authors show that designs satisfying U₁ + … + U_n = 0 are optimal in the sense of minimizing the estimation error average angular distance. The authors give constructions of optimal n‐point designs when n ≥ 4 and they compare the performance of several designs through approximations and simulation.     

Response surface design evaluation and comparison

Designing an experiment to fit a response surface model typically involves selecting among several candidate designs. There are often many competing criteria that could be considered in selecting the design, and practitioners are typically forced to make trade-offs between these objectives when choosing the final design. Traditional alphabetic optimality criteria are often used in evaluating and comparing competing designs. These optimality criteria are single-number summaries for quality properties of the design such as the precision with which the model parameters are estimated or the uncertainty associated with prediction. Other important considerations include the robustness of the design to model misspecification and potential problems arising from spurious or missing data. Several qualitative and quantitative properties of good response surface designs are discussed, and some of their important trade-offs are considered. Graphical methods for evaluating design performance for several important response surface problems are discussed and we show how these techniques can be used to compare competing designs. These graphical methods are generally superior to the simplistic summaries of alphabetic optimality criteria. Several special cases are considered, including robust parameter designs, split-plot designs, mixture experiment designs, and designs for generalized linear models.