Optimal regression designs in the presence of random block effects

A- and D-optimal regression designs under random block-effects models are considered. We first identify certain situations where D- and A-optimal designs do not depend on the intra-block correlation and can be obtained easily from the optimal designs under uncorrelated models. For example, for quadratic regression on [−1,1], this covers D-optimal designs when the block size is a multiple of 3 and A-optimal designs when the block size is a multiple of 4. In general, the optimal designs depend on the intra-block correlation. For quadratic regression, we provide expressions for D-optimal designs for any block size. A-optimal designs with blocks of size 2 for quadratic regression are also obtained. In all the cases considered, robust designs which do not depend on the intrablock correlation can be constructed.     

Bayesian D-optimal designs for exponential regression models

We consider the Bayesian D-optimal design problem for exponential growth models with one, two or three parameters. For the one-parameter model conditions on the shape of the density of the prior distribution and on the range of its support are given guaranteeing that a one-point design is also Bayesian D-optimal within the class of all designs. In the case of two parameters the best two-point designs are determined and for special prior distributions it is proved that these designs are Bayesian D-optimal. Finally, the exponential growth model with three parameters is investigated. The best three-point designs are characterized by a nonlinear equation. The global optimality of these designs cannot be proved analytically and it is demonstrated that these designs are also Bayesian D-optimal within the class of all designs if gamma-distributions are used as prior distributions.     

D-optimal minimax regression designs on discrete design space

One classical design criterion is to minimize the determinant of the covariance matrix of the regression estimates, and the designs are called D-optimal designs. To reflect the nature that the proposed models are only approximately true, we propose a robust design criterion to study response surface designs. Both the variance and bias are considered in the criterion. In particular, D-optimal minimax designs are investigated and constructed. Examples are given to compare D-optimal minimax designs with classical D-optimal designs.     

On Exact K-optimal Designs Minimizing the Condition Number

A new design criterion based on the condition number of an information matrix is proposed to construct optimal designs for linear models, and the resulting designs are called K-optimal designs. The relationship between exact and asymptotic K-optimal designs is derived. Since it is usually hard to find exact optimal designs analytically, we apply a simulated annealing algorithm to compute K-optimal design points on continuous design spaces. Specific issues are addressed to make the algorithm effective. Through exact designs, we can examine some properties of the K-optimal designs such as symmetry and the number of support points. Examples and results are given for polynomial regression models and linear models for fractional factorial experiments. In addition, K-optimal designs are compared with A-optimal and D-optimal designs for polynomial regression models, showing that K-optimal designs are quite similar to A-optimal designs.     

E-optimal designs for regression models with quantitative factors— a reasonable choice?

For regression models with quantitative factors it is illustrated that the E-optimal design can be extremely inefficient in the sense that it degenerates to a design which takes all observations at only one point. This phenomenon is caused by the different size of the elements in the covariance matrix of the least-squares estimator for the unknown parameters. For these reasons we propose to replace the E-criterion by a corresponding standardized version. The advantage of this approach is demonstrated for the polynomial regression on a nonnegative interval, where the classical and standardized E-optimal designs can be found explicitly. The described phenomena are not restricted to the E-criterion but appear for nearly all optimality criteria proposed in the literature. Therefore standardization is recommended for optimal experimental design in regression models with quantitative factors. The optimal designs with respect to the new standardized criteria satisfy a similar invariance property as the famous D-optimal designs, which allows an easy calculation of standardized optimal designs on many linearly transformed design spaces.     

On some DS-optimal designs in spherical regions

For polynomial regression over spherical regions the d-th order D_s-optimal designs for the λ-th order models are derived for 1 ≤ λ ≤ d ≤ 4. Efficiencies of these designs with respect to the λ-th order D-optimal designs are obtained. The effects of estimating addtional parameters due to an m-th order model (d ≥ m >>λ) on the efficiencies are investigated.     

D-optimal Designs for a Combined Simple Linear and Haar-Wavelet Regression Model

A combined simple linear and Haar-wavelet regression model is the combination of a simple linear model and a Haar-wavelet regression model. In this article we show how to construct D-optimal designs for a combined simple linear and Haar-wavelet regression model. An example is also given.     

Bayesian D-optimal design for logistic regression model with exponential distribution for random intercept

ABSTRACT

Nowadays, generalized linear models have many applications. Some of these models which have more applications in the real world are the models with random effects; that is, some of the unknown parameters are considered random variables. In this article, this situation is considered in logistic regression models with a random intercept having exponential distribution. The aim is to obtain the Bayesian D-optimal design; thus, the method is to maximize the Bayesian D-optimal criterion. For the model was considered here, this criterion is a function of the quasi-information matrix that depends on the unknown parameters of the model. In the Bayesian D-optimal criterion, the expectation is acquired in respect of the prior distributions that are considered for the unknown parameters. Thus, it will only be a function of experimental settings (support points) and their weights. The prior distribution of the fixed parameters is considered uniform and normal. The Bayesian D-optimal design is finally calculated numerically by R3.1.1 software.     

D-optimal minimax design criterion for two-level fractional factorial designs

A D-optimal minimax design criterion is proposed to construct two-level fractional factorial designs, which can be used to estimate a linear model with main effects and some specified interactions. D-optimal minimax designs are robust against model misspecification and have small biases if the linear model contains more interaction terms. When the D-optimal minimax criterion is compared with the D-optimal design criterion, we find that the D-optimal design criterion is quite robust against model misspecification. Lower and upper bounds derived for the loss functions of optimal designs can be used to estimate the efficiencies of any design and evaluate the effectiveness of a search algorithm. Four algorithms to search for optimal designs for any run size are discussed and compared through several examples. An annealing algorithm and a sequential algorithm are particularly effective to search for optimal designs.     

Sequential designs for a Poisson regression model

The locally D-optimal design for the two-variable interaction Poisson regression model is not robust to parameter misspecification. To deal with this issue, a sequential design approach is investigated. Simulation is used to evaluate the sequential design. It is found that the sequential design is very efficient and quite robust to parameter misspecification on both unrestricted and restricted design regions.     

Optimal designs in random coefficient cubic regression models

In this article we investigate the problem of ascertaining A- and D-optimal designs in a cubic regression model with random coefficients. Our interest lies in estimation of all the parameters or in only those except the intercept term. Assuming the variance ratios to be known, we tabulate D-optimal designs for various combinations of the variance ratios. A-optimality does not pose any new problem in the random coefficients situation.     

D-optimal designs for beta regression models with single predictor

The problem of construction of D-optimal designs for beta regression models involving one predictor is considered for the mean-precision parameterization suggested by Ferrari and Cribari-Neto [Beta regression for modelling rates and proportions. J Appl Stat. 2004;31:799–815]. Here we use the logit link function for the mean sub-model. These designs are presented and discussed for unrestricted as well as restricted design regions by considering the precision parameter as (1) a known constant and (2) an unknown constant. Efficiency comparison of obtained designs with commonly used equi-weighted, equi-spaced designs is made to recommend designs for practical use. Real-life applications are given to show the usefulness of these designs.     

Bayesian A- and D-optimal designs for gamma regression model with inverse link function

Bayesian optimal designs have received increasing attention in recent years, especially in biomedical and clinical trials. Bayesian design procedures can utilize the available prior information of the unknown parameters so that a better design can be achieved. With this in mind, this article considers the Bayesian A- and D-optimal designs of the two- and three-parameter Gamma regression model. In this regard, we first obtain the Fisher information matrix of the proposed model and then calculate the Bayesian A- and D-optimal designs assuming various prior distributions such as normal, half-normal, gamma, and uniform distribution for the unknown parameters. All of the numerical calculations are handled in R software. The results of this article are useful in medical and industrial researches.     

Optimal and efficient designs for 2-parameter nonlinear models

By Carathéodory's theorem, for a k-parameter nonlinear model, the minimum number of support points for any D-optimal design is between k and k(k+1)/2. Characterizing classes of models for which a D-optimal design sits on exactly k support points is of great theoretical interest. By utilizing the equivalence theorem, we identify classes of 2-parameter nonlinear models for which a D-optimal design is precisely supported on 2 points. We also introduce the theory of maximum principle from differential equations into the design area and obtain some results on characterizing the minimally supported nonlinear designs. Examples are given to demonstrate our results. Designs with minimum number of support points may not always be suitable in practice. To alleviate this problem, we utilize some geometric and analytical methods to obtain some efficient designs which provide more opportunity for the model checking and prevent biases due to mis-specified initial parameters.     

On the Choice of a Prior for Bayesian D-Optimal Designs for the Logistic Regression Model with a Single Predictor

The Bayesian design approach accounts for uncertainty of the parameter values on which optimal design depends, but Bayesian designs themselves depend on the choice of a prior distribution for the parameter values. This article investigates Bayesian D-optimal designs for two-parameter logistic models, using numerical search. We show three things: (1) a prior with large variance leads to a design that remains highly efficient under other priors, (2) uniform and normal priors lead to equally efficient designs, and (3) designs with four or five equidistant equally weighted design points are highly efficient relative to the Bayesian D-optimal designs.     

A- and D-optimal designs for a log contrast model for experiments with mixtures

A- and D-optimal designs are investigated for a log contrast model suggested by Aitchison & Bacon-Shone for experiments with mixtures. It is proved that when the number of mixture components q is an even integer, A- and D-optimal designs are identical; and when q is an odd integer, A- and D-optimal designs are different, but they share some common support points and are very close to each other in efficiency. Optimal designs with a minimum number of support points are also constructed for 3, 4, 5 and 6 mixture components.     

Optimum designs for parameter estimation in a mixture experiment with two correlated responses

In this paper, we investigate a mixture problem with two responses, which are functions of the mixing proportions, and are correlated with known dispersion matrix. We obtain D- and A-optimal designs for estimating the parameters of the response functions, when none or some of the regression coefficients of the two functions are the same. It is shown that when no prior knowledge about the regression coefficients is available, the D-optimal design is independent of the dispersion matrix, while the A-optimal design depends on it, provided the response functions are of different degree. On the other hand, when some of the regression coefficients are known to be the same for both the functions, the D-optimal design depends on the dispersion matrix when the two response functions are not of the same degree.     

New classes of D-optimal edge designs

Edge designs are screening experimental designs that allow a model-independent estimate of the set of relevant variables, thus providing more robustness than traditional designs. In this paper we construct new classes of D-optimal edge designs. This construction uses weighing matrices of order n and weight k together with permutation matrices of order n to obtain D-optimal edge designs. One linear and one quadratic simulated screening scenarios are studied and compared using linear regression and edge designs analysis.     

D-optimal designs for logistic models with three and four parameters

Logistic functions are used in different applications, including biological growth studies and assay data analysis. Locally D-optimal designs for logistic models with three and four parameters are investigated. It is shown that these designs are minimally supported. Efficiencies are computed for equally spaced and uniform designs.     

Application of genetic algorithms to the construction of exact D-optimal designs

This paper studies the application of genetic algorithms to the construction of exact D-optimal experimental designs. The concept of genetic algorithms is introduced in the general context of the problem of finding optimal designs. The algorithm is then applied specifically to finding exact D-optimal designs for three different types of model. The performance of genetic algorithms is compared with that of the modified Fedorov algorithm in terms of computing time and relative efficiency. Finally, potential applications of genetic algorithms to other optimality criteria and to other types of model are discussed, along with some open problems for possible future research.