Applications and Implementations of Continuous Robust Designs

In the literature concerning the construction of robust optimal designs, many resulting designs turn out to have densities. In practice, an exact design should tell the experimenter what the support points are and how many subjects should be allocated to each of these points. In particular, we consider a practical situation in which the number of support points allowed is constrained. We discuss an intuitive approach, which motivates a new implementation scheme that minimizes the loss function based on the Kolmogorov and Smirnov distance between an exact design and the optimal design having a density. We present three examples to illustrate the application and implementation of a robust design constructed: one for a nonlinear dose-response experiment and the other two for general linear regression. Additionally, we perform some simulation studies to compare the efficiencies of the exact designs obtained by our optimal implementation with those by other commonly used implementation methods.     

A new characterization of Elfving's method for high dimensional computation

We give a new characterization of Elfving's (1952) method for computing c-optimal designs in k dimensions which gives explicit formulae for the k unknown optimal weights and k unknown signs in Elfving's characterization. This eliminates the need to search over these parameters to compute c-optimal designs, and thus reduces the computational burden from solving a family of optimization problems to solving a single optimization problem for the optimal finite support set. We give two illustrative examples: a high dimensional polynomial regression model and a logistic regression model, the latter showing that the method can be used for locally optimal designs in nonlinear models as well.     

On Exact K-optimal Designs Minimizing the Condition Number

A new design criterion based on the condition number of an information matrix is proposed to construct optimal designs for linear models, and the resulting designs are called K-optimal designs. The relationship between exact and asymptotic K-optimal designs is derived. Since it is usually hard to find exact optimal designs analytically, we apply a simulated annealing algorithm to compute K-optimal design points on continuous design spaces. Specific issues are addressed to make the algorithm effective. Through exact designs, we can examine some properties of the K-optimal designs such as symmetry and the number of support points. Examples and results are given for polynomial regression models and linear models for fractional factorial experiments. In addition, K-optimal designs are compared with A-optimal and D-optimal designs for polynomial regression models, showing that K-optimal designs are quite similar to A-optimal designs.     

Designs for weighted least squares regression, with estimated weights

We study designs, optimal up to and including terms that are O(n ^?1), for weighted least squares regression, when the weights are intended to be inversely proportional to the variances but are estimated with random error. We take a finite, but arbitrarily large, design space from which the support points are to be chosen, and obtain the optimal proportions of observations to be assigned to each point. Specific examples of D- and I-optimal design for polynomial responses are studied. In some cases the same designs that are optimal under homoscedasticity remain so for a range of variance functions; in others there tend to be more support points than are required in the homoscedastic case. We also exhibit minimax designs, that minimize the maximum, over finite classes of variance functions, value of the loss. These also tend to have more support points, often resulting from the breaking down of replicates into clusters.     

D- and V-optimal population designs for the quadratic regression model with a random intercept term

In this paper D- and V-optimal population designs for the quadratic regression model with a random intercept term and with values of the explanatory variable taken from a set of equally spaced, non-repeated time points are considered. D-optimal population designs based on single-point individual designs were readily found but the derivation of explicit expressions for designs based on two-point individual designs was not straightforward and was complicated by the fact that the designs now depend on ratio of the variance components. Further algebraic results pertaining to d-point D-optimal population designs where d≥3 and to V-optimal population designs proved elusive. The requisite designs can be calculated by careful programming and this is illustrated by means of a simple example.     

Optimal designs for estimating the slope of a regression

In the common linear model with quantitative predictors we consider the problem of designing experiments for estimating the slope of the expected response in a regression. We discuss locally optimal designs, where the experimenter is only interested in the slope at a particular point, and standardized minimax optimal designs, which could be used if precise estimation of the slope over a given region is required. General results on the number of support points of locally optimal designs are derived if the regression functions form a Chebyshev system. For polynomial regression and Fourier regression models of arbitrary degree the optimal designs for estimating the slope of the regression are determined explicitly for many cases of practical interest.     

Optimal and efficient designs for 2-parameter nonlinear models

By Carathéodory's theorem, for a k-parameter nonlinear model, the minimum number of support points for any D-optimal design is between k and k(k+1)/2. Characterizing classes of models for which a D-optimal design sits on exactly k support points is of great theoretical interest. By utilizing the equivalence theorem, we identify classes of 2-parameter nonlinear models for which a D-optimal design is precisely supported on 2 points. We also introduce the theory of maximum principle from differential equations into the design area and obtain some results on characterizing the minimally supported nonlinear designs. Examples are given to demonstrate our results. Designs with minimum number of support points may not always be suitable in practice. To alleviate this problem, we utilize some geometric and analytical methods to obtain some efficient designs which provide more opportunity for the model checking and prevent biases due to mis-specified initial parameters.     

E-optimal designs for polynomial regression without intercept

We give all E-optimal designs for the mean parameter vector in polynomial regression of degree d without intercept in one real variable. The derivation is based on interplays between E-optimal design problems in the present and in certain heteroscedastic polynomial setups with intercept. Thereby the optimal supports are found to be related to the alternation points of the Chebyshev polynomials of the first kind, but the structure of optimal designs essentially depends on the regression degree being odd or even. In the former case the E-optimal designs are precisely the (infinitely many) scalar optimal designs, where the scalar parameter system refers to the Chebyshev coefficients, while for even d there is exactly one optimal design. In both cases explicit formulae for the corresponding optimal weights are obtained. Remarks on extending the results to E-optimality for subparameters of the mean vector (in heteroscdastic setups) are also given.     

Optimum designs for estimating EDp based on raw optical density data

For raw optical density (ROD) data, such as those generated in biological assays employing an ELISA plate reader, ED_p-optimal designs are identified for a family of homogeneous non-linear models with two parameters. In every case, the theoretical ED_p-optimal design is a design with one or two support points. These theoretical optimal designs might not be suitable for many practical applications. To overcome this shortcoming, we have specified ED_p-optimal designs within the class of k-point equally spaced and uniform designs. The efficiency robustness of these designs with respect to initial nominal values of the parameters have been investigated.     

Adaptive grid semidefinite programming for finding optimal designs

We find optimal designs for linear models using a novel algorithm that iteratively combines a semidefinite programming (SDP) approach with adaptive grid techniques. The proposed algorithm is also adapted to find locally optimal designs for nonlinear models. The search space is first discretized, and SDP is applied to find the optimal design based on the initial grid. The points in the next grid set are points that maximize the dispersion function of the SDP-generated optimal design using nonlinear programming. The procedure is repeated until a user-specified stopping rule is reached. The proposed algorithm is broadly applicable, and we demonstrate its flexibility using (i) models with one or more variables and (ii) differentiable design criteria, such as A-, D-optimality, and non-differentiable criterion like E-optimality, including the mathematically more challenging case when the minimum eigenvalue of the information matrix of the optimal design has geometric multiplicity larger than 1. Our algorithm is computationally efficient because it is based on mathematical programming tools and so optimality is assured at each stage; it also exploits the convexity of the problems whenever possible. Using several linear and nonlinear models with one or more factors, we show the proposed algorithm can efficiently find optimal designs.     

An optimal response adaptive biased coin design with k heteroscedastic treatments

For comparing treatments in clinical trials, Atkinson (1982) introduced optimal biased coins for balancing patients across treatment assignments by using D-optimality under the assumption of homoscedastic responses of different treatments. However, this assumption can be violated in many real applications. In this paper, we relax the homoscedasticity assumption in the k treatments setting with k>2. A general family of optimal response adaptive biased coin designs are proposed following Atkinson's procedure. Asymptotic properties of the proposed designs are obtained. Some advantages of the proposed design are discussed.     

On the Choice of a Prior for Bayesian D-Optimal Designs for the Logistic Regression Model with a Single Predictor

The Bayesian design approach accounts for uncertainty of the parameter values on which optimal design depends, but Bayesian designs themselves depend on the choice of a prior distribution for the parameter values. This article investigates Bayesian D-optimal designs for two-parameter logistic models, using numerical search. We show three things: (1) a prior with large variance leads to a design that remains highly efficient under other priors, (2) uniform and normal priors lead to equally efficient designs, and (3) designs with four or five equidistant equally weighted design points are highly efficient relative to the Bayesian D-optimal designs.     

Some extremal problems in designing discriminating experiments

This paper is devoted to some properties of local T-optimaj. designs fox discriminating between two rival regression models. It is demonstrated that the problem of searching for an optimal design is closely connected with the problem of searching for a Tchebycheff extremal basis. The question raised concerns the number of supporting points in an optimal design.     

Computing A-optimal Designs for Weighted Polynomial Regression by Taylor Expansion

This article is concerned with the problem of constructing A-optimal design for polynomial regression with analytic weight function on the interval [m ? a, m + a], m, a > 0. It is shown that the structure of the optimal design depends on a and weight function only, as a close to 0. Moreover, if the weight function is an analytic function a, then a scaled version of optimal support points, and weights are analytic functions of a at a = 0. We make use of a Taylor expansion to provide a recursive procedure for calculating the A-optimal designs. Examples are presented to illustrate the procedures for computing the optimal designs.     

Optimal designs in growth curve models: Part I Correlated model for linear growth: Optimal designs for slope parameter estimation and growth prediction

In the present paper we discuss the situation for a linear growth with correlated structure of the errors and indicate the nature of optimal designs for estimation and prediction problems. We study the intraclass structure of the error distribution. As regards estimation of the slope parameter, we look for robust optimal designs. Here robustness means that optimality should hold for a large variety of correlation parameters. The robust optimal designs for the prediction problem center around a performance measure of the predictors for all design points simultaneously. We have also studied the autocorrelated error structure and found similar results which are reported very briefly.     

Optimal designs for discriminating between some extensions of the Michaelis–Menten model

In this paper some results on the computation of optimal designs for discriminating between nonlinear models are provided. In particular, some typical deviations of the Michaelis–Menten model are considered. A common deviation of this pharmacokinetic model consists on adding a linear term. If two linear models differ in one parameter the T-optimal design for discriminating between them is c-optimal for estimating the added linear term. This is not the case for nonlinear models.     

Robust designs for nearly linear regression

In this paper we seek designs and estimators which are optimal in some sense for multivariate linear regression on cubes and simplexes when the true regression function is unknown. More precisely, we assume that the unknown true regression function is the sum of a linear part plus some contamination orthogonal to the set of all linear functions in the L₂ norm with respect to Lebesgue measure. The contamination is assumed bounded in absolute value and it is shown that the usual designs for multivariate linear regression on cubes and simplices and the usual least squares estimators minimize the supremum over all possible contaminations of the expected mean square error. Additional results for extrapolation and interpolation, among other things, are discussed. For suitable loss functions optimal designs are found to have support on the extreme points of our design space.     

Minimax designs for approximately linear models with AR(1) errors

We obtain designs for linear regression models under two main departures from the classical assumptions: (1) the response is taken to be only approximately linear, and (2) the errors are not assumed to be independent, but to instead follow a first-order autoregressive process. These designs have the property that they minimize (a modification of) the maximum integrated mean squared error of the estimated response, with the maximum taken over a class of departures from strict linearity and over all autoregression parameters ρ,|ρ,| < 1, of fixed sign. Specific methods of implementation are discussed. We find that an asymptotically optimal procedure for AR(1) models consists of choosing points from that design measure which is optimal for uncorrelated errors, and then implementing them in an appropriate order.     

Optimal designs for generalized linear models

Summary This paper solves some D-optimal design problems for certain Generalized Linear Models where the mean depends on two parameters and two explanatory variables. In all of the cases considered the support point of the optimal designs are found to be independent of the unknown parameters. While in some cases the optimal design measures are given by two points with equal weights, in others the support is given by three point with weights depending on the unknown parameters, hence the designs are locally optimal in general. Empirical results on the efficiency of the locally optimal designs are also given. Some of the designs found can also be used for planning D-optimal experiments for the normal linear model, where the mean must be positive. This research was carried out in part at University College, London as an M.Sc. project. Thanks are due to Prof. I. Ford (University of Glasgow) and Prof. A. Giovagnoli (University of Perugia) for their valuable suggestions and critical observations.     

Model robust extrapolation designs

We seek designs which are optimal in some sense for extrapolation when the true regression function is in a certain class of regression functions. More precisely, the class is defined to be the collection of regression functions such that its (h + 1)-th derivative is bounded. The class can be viewed as representing possible departures from an ‘ideal’ model and thus describes a model robust setting. The estimates are restricted to be linear and the designs are restricted to be with minimal number of points. The design and estimate sought is minimax for mean square error. The optimal designs for cases X = [0, ∞] and X = [-1, 1], where X is the place where observations can be taken, are discussed.