D-optimal minimax design criterion for two-level fractional factorial designs

A D-optimal minimax design criterion is proposed to construct two-level fractional factorial designs, which can be used to estimate a linear model with main effects and some specified interactions. D-optimal minimax designs are robust against model misspecification and have small biases if the linear model contains more interaction terms. When the D-optimal minimax criterion is compared with the D-optimal design criterion, we find that the D-optimal design criterion is quite robust against model misspecification. Lower and upper bounds derived for the loss functions of optimal designs can be used to estimate the efficiencies of any design and evaluate the effectiveness of a search algorithm. Four algorithms to search for optimal designs for any run size are discussed and compared through several examples. An annealing algorithm and a sequential algorithm are particularly effective to search for optimal designs.     

On Exact K-optimal Designs Minimizing the Condition Number

A new design criterion based on the condition number of an information matrix is proposed to construct optimal designs for linear models, and the resulting designs are called K-optimal designs. The relationship between exact and asymptotic K-optimal designs is derived. Since it is usually hard to find exact optimal designs analytically, we apply a simulated annealing algorithm to compute K-optimal design points on continuous design spaces. Specific issues are addressed to make the algorithm effective. Through exact designs, we can examine some properties of the K-optimal designs such as symmetry and the number of support points. Examples and results are given for polynomial regression models and linear models for fractional factorial experiments. In addition, K-optimal designs are compared with A-optimal and D-optimal designs for polynomial regression models, showing that K-optimal designs are quite similar to A-optimal designs.     

A- and D-optimal designs for a log contrast model for experiments with mixtures

A- and D-optimal designs are investigated for a log contrast model suggested by Aitchison & Bacon-Shone for experiments with mixtures. It is proved that when the number of mixture components q is an even integer, A- and D-optimal designs are identical; and when q is an odd integer, A- and D-optimal designs are different, but they share some common support points and are very close to each other in efficiency. Optimal designs with a minimum number of support points are also constructed for 3, 4, 5 and 6 mixture components.     

A clustering-based coordinate exchange algorithm for generating G-optimal experimental designs

In the optimal experimental design literature, the G-optimality is defined as minimizing the maximum prediction variance over the entire experimental design space. Although the G-optimality is a highly desirable property in many applications, there are few computer algorithms developed for constructing G-optimal designs. Some existing methods employ an exhaustive search over all candidate designs, which is time-consuming and inefficient. In this paper, a new algorithm for constructing G-optimal experimental designs is developed for both linear and generalized linear models. The new algorithm is made based on the clustering of candidate or evaluation points over the design space and it is a combination of point exchange algorithm and coordinate exchange algorithm. In addition, a robust design algorithm is proposed for generalized linear models with modification of an existing method. The proposed algorithm are compared with the methods proposed by Rodriguez et al. [Generating and assessing exact G-optimal designs. J. Qual. Technol. 2010;42(1):3–20] and Borkowski [Using a genetic algorithm to generate small exact response surface designs. J. Prob. Stat. Sci. 2003;1(1):65–88] for linear models and with the simulated annealing method and the genetic algorithm for generalized linear models through several examples in terms of the G-efficiency and computation time. The result shows that the proposed algorithm can obtain a design with higher G-efficiency in a much shorter time. Moreover, the computation time of the proposed algorithm only increases polynomially when the size of model increases.     

Constructing Efficient Experimental Designs for Generalized Linear Models

Exchange algorithms are popular for finding optimal or efficient designs for linear models, but there are few discussions of this type of algorithm for generalized linear models (GLMs) in literature. A new algorithm, generalized Coordinate Exchange Algorithm (gCEA), is developed in this article to construct efficient designs for GLMs. We compare the performance of the proposed algorithm with other optimization algorithms, including point exchange algorithm, columnwise-pairwise algorithm, simulated annealing and generic algorithm, and demonstrate the superior performance of this new algorithm.     

Bayesian D-optimal designs for exponential regression models

We consider the Bayesian D-optimal design problem for exponential growth models with one, two or three parameters. For the one-parameter model conditions on the shape of the density of the prior distribution and on the range of its support are given guaranteeing that a one-point design is also Bayesian D-optimal within the class of all designs. In the case of two parameters the best two-point designs are determined and for special prior distributions it is proved that these designs are Bayesian D-optimal. Finally, the exponential growth model with three parameters is investigated. The best three-point designs are characterized by a nonlinear equation. The global optimality of these designs cannot be proved analytically and it is demonstrated that these designs are also Bayesian D-optimal within the class of all designs if gamma-distributions are used as prior distributions.     

Differential evolutionary algorithm in the construction process of optimal experimental designs

This article shows how a differential evolution algorithm can be used to find statistical designs under several optimality criteria as A, D, and T. The general algorithm of differential evolution is described and then applied on constructing optimal designs for several well-known models and compare them with those already available by other algorithms, in terms of relative efficiency. Moreover, the great effect of population size in the running of this algorithm establishes a precedent in the use of differential evolution algorithms over genetic algorithms.     

D-optimal designs for Poisson regression models

Most of the current research on optimal experimental designs for generalized linear models focuses on logistic regression models. In this paper, D-optimal designs for Poisson regression models are discussed. For the one-variable first-order Poisson regression model, it has been found that the D-optimal design, in terms of effective dose levels, is independent of the model parameters. However, it is not the case for more complicated models. We investigate how the D-optimal designs depend on the model parameters for the one-variable second-order model and two-variable interaction model. The performance of some “standard” designs that appeal to practitioners is also studied.     

Optimal multi-criteria designs for Fourier regression models

Riccomagno, Schwabe and Wynn (RSW) (1997) have given a necessary and sufficient condition for obtaining a complete Fourier regression model with a design based on lattice points that is D-optimal. However, in practice, the number of factors to be considered may be large, or the experimental data may be restricted or not homogeneous. To address these difficulties we extend the results of RSW to obtain a sufficient condition for an incomplete interaction Fourier model design based on lattice points that is D-, A-, E- and G-optimal. We also propose an algorithm for finding such optimal designs that requires fewer design points than those obtained using RSW's generators when the underlying model is a complete interaction model.     

An evolutionary algorithm for A-optimal incomplete block designs

Evolutionary algorithms are heuristic stochastic search and optimization techniques with principles taken from natural genetics. They are procedures mimicking the evolution process of an initial population through genetic transformations. This paper is concerned with the problem of finding A-optimal incomplete block designs for multiple treatment comparisons represented by a matrix of contrasts. An evolutionary algorithm for searching optimal, or nearly optimal, incomplete block designs is described in detail. Various examples regarding the application of the algorithm to some well-known problems illustrate the good performance of the algorithm     

Genetic algorithms for numerical optimization

Genetic algorithms (GAs) are stochastic adaptive algorithms whose search method is based on simulation of natural genetic inheritance and Darwinian striving for survival. They can be used to find approximate solutions to numerical optimization problems in cases where finding the exact optimum is prohibitively expensive, or where no algorithm is known. However, such applications can encounter problems that sometimes delay, if not prevent, finding the optimal solutions with desired precision. In this paper we describe applications of GAs to numerical optimization, present three novel ways to handle such problems, and give some experimental results.     

On the Choice of a Prior for Bayesian D-Optimal Designs for the Logistic Regression Model with a Single Predictor

The Bayesian design approach accounts for uncertainty of the parameter values on which optimal design depends, but Bayesian designs themselves depend on the choice of a prior distribution for the parameter values. This article investigates Bayesian D-optimal designs for two-parameter logistic models, using numerical search. We show three things: (1) a prior with large variance leads to a design that remains highly efficient under other priors, (2) uniform and normal priors lead to equally efficient designs, and (3) designs with four or five equidistant equally weighted design points are highly efficient relative to the Bayesian D-optimal designs.     

D-optimal minimax regression designs on discrete design space

One classical design criterion is to minimize the determinant of the covariance matrix of the regression estimates, and the designs are called D-optimal designs. To reflect the nature that the proposed models are only approximately true, we propose a robust design criterion to study response surface designs. Both the variance and bias are considered in the criterion. In particular, D-optimal minimax designs are investigated and constructed. Examples are given to compare D-optimal minimax designs with classical D-optimal designs.     

Optimum Designs for Estimation of Parameters in a Quadratic Mixture-Amount Model

The authors propose a mixture-amount model, which is quadratic both in the proportions of mixing components and the amount of mixture. They attempt to find the A- and D-optimal designs for the estimation of the model parameters within a subclass of designs. The optimality of the derived designs in the entire class of competing designs has been investigated through equivalence theorem.     

Optimal designs in random coefficient cubic regression models

In this article we investigate the problem of ascertaining A- and D-optimal designs in a cubic regression model with random coefficients. Our interest lies in estimation of all the parameters or in only those except the intercept term. Assuming the variance ratios to be known, we tabulate D-optimal designs for various combinations of the variance ratios. A-optimality does not pose any new problem in the random coefficients situation.     

Optimal regression designs in the presence of random block effects

A- and D-optimal regression designs under random block-effects models are considered. We first identify certain situations where D- and A-optimal designs do not depend on the intra-block correlation and can be obtained easily from the optimal designs under uncorrelated models. For example, for quadratic regression on [−1,1], this covers D-optimal designs when the block size is a multiple of 3 and A-optimal designs when the block size is a multiple of 4. In general, the optimal designs depend on the intra-block correlation. For quadratic regression, we provide expressions for D-optimal designs for any block size. A-optimal designs with blocks of size 2 for quadratic regression are also obtained. In all the cases considered, robust designs which do not depend on the intrablock correlation can be constructed.     

D-optimal designs with minimal and nearly minimal number of units

D-optimal designs are identified in classes of connected block designs with fixed block size when the number of experimental units is one or two more than the minimal number required for the design to be connected. An application of one of these results is made to identify D-optimal designs in a class of minimally connected row-column designs. Graph-theoretic methods are employed to arrive at the optimality results.     

D-optimal weighted paired comparison designs

As a generalization of the paired comparison designs, the experimental design which considers the weighted difference between responses is studied. D-optimal designs are constructed for a model with main effects and first-order interactions. The experimental region is a hypercube or a hypersphere.     

A genetic algorithm tutorial

This tutorial covers the canonical genetic algorithm as well as more experimental forms of genetic algorithms, including parallel island models and parallel cellular genetic algorithms. The tutorial also illustrates genetic search by hyperplane sampling. The theoretical foundations of genetic algorithms are reviewed, include the schema theorem as well as recently developed exact models of the canonical genetic algorithm.     

Linear Integer Programming Approach to Construction of Balanced Incomplete Block Designs

This article proposes a linear integer programming-based algorithm to construct balanced incomplete block designs. Working of the algorithm is illustrated with the help of an example. The algorithm is able to generate balanced incomplete block designs very fast in most of the cases. The performance of the proposed algorithm is compared with other algorithms proposed in the literature. It is demonstrated that the proposed algorithm is competitive with the existing algorithms.