Construction of optimal designs in random coefficient regression models

We consider the problem of optimal experimental design in random coefficient regression models with respect to a quadratic loss function. By application of WHITTLE'S general equivalence theorem we obtain the structure of optimal designs. An alogrithm is given which allows, under certain assumptions, the construction of the information matrix of an optimal design. Moreover, we give conditions on the equivalence of optimal designs with respect to optimality criteria which are analogous to usual A-D- and _E/-optimality.     

Optimal designs for the logit and probit models for binary data

We consider optimal designs for a class of symmetric models for binary data which includes the common probit and logit models. We show that for a large group of optimality criteria which includes the main ones in the literature (e.g. A-, D-, E-, F- and G-optimality) the optimal design for our class of models is a two-point design with support points symmetrically placed about the ED50 but with possibly unequal weighting. We demonstrate how one can further reduce the problem to a one-variable optimization by characterizing various of the common criteria. We also use the results to demonstrate major qualitative differences between the F - and c-optimal designs, two design criteria which have similar motivation.     

A bidimensional class of optimality criteria involving φp and characteristic criteria

A new biparametric class of criteria for Optimal Experimental Design generalizing the families of φ_p and Characteristic Criteria is presented. Some properties of the Characteristic Criteria are provided: in particular, differentiability, monotonicity and convexity. A statistical interpretation is also offered. Optimal designs with respect to Characteristic Criteria are obtained for polynomial and compartmental models and an extension of the Michaelis-Menten model. A thorough discussion for the trigonometric model is given. The computed optimal designs are shown to be quite efficient for A-, D- and D_s -optimality. Thus, some of them appear as a natural compromise between different optimality criteria. A simulation in multiple linear regression confirms the quality of Characteristic designs for discovering significant differences between parameters.     

Design of experiments in the presence of errors in factor levels

This paper is concerned with the statistical properties of experimental designs where the factor levels cannot be set precisely. When the errors in setting the factor levels cannot be measured, design robustness is explored. However, when the actual design could be measured at the end of the investigation, its optimality is of interest. D-optimality could be assessed in different ways. Several measures are compared. Evaluating them is difficult even in simple cases. Therefore, in general, simulations are used to obtain their values. It is shown that if D-optimality is measured by the expected value of the determinant of the information matrix of the experimental design, as has been suggested in the past, on average the designs appear to improve with the variance of the error in setting the factor levels. However, we argue that the criterion of D-optimality should be based on the inverse of the information matrix. In this case it is shown that the experiment could be better or worse than the planned one. It is also recognized that setting the factor levels with error could lead to an increased risk of losing observations, which on its own could reduce considerably the optimality of the experimental designs. Advice on choosing the design region in such a way that such a risk is controlled to an acceptable level is given.     

Adaptive grid semidefinite programming for finding optimal designs

We find optimal designs for linear models using a novel algorithm that iteratively combines a semidefinite programming (SDP) approach with adaptive grid techniques. The proposed algorithm is also adapted to find locally optimal designs for nonlinear models. The search space is first discretized, and SDP is applied to find the optimal design based on the initial grid. The points in the next grid set are points that maximize the dispersion function of the SDP-generated optimal design using nonlinear programming. The procedure is repeated until a user-specified stopping rule is reached. The proposed algorithm is broadly applicable, and we demonstrate its flexibility using (i) models with one or more variables and (ii) differentiable design criteria, such as A-, D-optimality, and non-differentiable criterion like E-optimality, including the mathematically more challenging case when the minimum eigenvalue of the information matrix of the optimal design has geometric multiplicity larger than 1. Our algorithm is computationally efficient because it is based on mathematical programming tools and so optimality is assured at each stage; it also exploits the convexity of the problems whenever possible. Using several linear and nonlinear models with one or more factors, we show the proposed algorithm can efficiently find optimal designs.     

Optimal design in average for inference in generalized linear models

This paper considers the problem of optimal design for inference in Generalized Linear Models, when prior information about the parameters is available. The general theory of optimum design usually requires knowledge of the parameter values. These are usually unknown and optimal design can, therefore, not be used in practice. However, one way to circumvent this problem is through so-called “optimal design in average”, or shortly, “ave optimal”. The ave optimal design is chosen to minimize the expected value of some criterion function over a prior distribution. We focus our interest on the aveD _A-optimality, including aveD- and avec-optimality and show the appropriate equivalence theorems for these optimality criterions, which give necessary conditions for an optimal design. Ave optimal designs are of interest when e.g. a factorial experiment with a binary or a Poisson response in to be conducted. The results are applied to factorial experiments, including a control group experiment and a 2×2 experiment.     

Bayesian D-optimal Accelerated Life Test plans for series systems with competing exponential causes of failure

This paper provides methods of obtaining Bayesian D-optimal Accelerated Life Test (ALT) plans for series systems with independent exponential component lives under the Type-I censoring scheme. Two different Bayesian D-optimality design criteria are considered. For both the criteria, first optimal designs for a given number of experimental points are found by solving a finite-dimensional constrained optimization problem. Next, the global optimality of such an ALT plan is ensured by applying the General Equivalence Theorem. A detailed sensitivity analysis is also carried out to investigate the effect of different planning inputs on the resulting optimal ALT plans. Furthermore, these Bayesian optimal plans are also compared with the corresponding (frequentist) locally D-optimal ALT plans.     

On linear regression designs which maximize information

Necessary and sufficient conditions are established when a continuous design contains maximal information for a prescribed s-dimensional parameter in a classical linear model. The development is based on a thorough study of a particular dual problem and its interplay with the optimal design problem, extending partial results and earlier approaches based on differential calculus, game theory, and other programming methods. The results apply in particular to a class of information functionals which covers c-, D-, A-, L-optimality, they include a complete account of the non-differentiable criterion of E-optimality, and provide a constructive treatment of those situations in which the information matrix is singular. Corollaries pertain to the case of s out of k parameters, simultaneous optimality with respect to several criteria, multiplicity of optimal designs, bounds on their weights, and optimality which is induced by admissibility.     

Equivalence theorem for Schur optimality of experimental designs

An experimental design is said to be Schur optimal, if it is optimal with respect to the class of all Schur isotonic criteria, which includes Kiefer's criteria of _Φp${\Phi }_p$-optimality, distance optimality criteria and many others. In the paper we formulate an easily verifiable necessary and sufficient condition for Schur optimality in the set of all approximate designs of a linear regression experiment with uncorrelated errors. We also show that several common models admit a Schur optimal design, for example the trigonometric model, the first-degree model on the Euclidean ball, and the Berman's model.     

Optimal Multiple Constant-Stress Accelerated Life Tests for Generalized Exponential Distribution

Recently generalized exponential distribution has been discussed by many authors. In this article, we study the optimal constant-stress accelerated life tests with complete sample for the generalized exponential distribution. The problem of choosing the optimal proportions of test units allocated to each stress level is addressed by using V-optimality as well as D-optimality criteria. Some interesting conclusions are obtained. Finally, real data example and numerical examples have been analyzed to illustrate the proposed procedures.     

AN ALGORITHM FOR THE CONSTRUCTION OF OPTIMAL OR NEAR-OPTIMAL CHANGE-OVER DESIGNS

This paper presents an algorithm for the construction of optimal or near optimal change-over designs for arbitrary numbers of treatments, periods and units. Previous research on optimality has been either theoretical or has resulted in limited tabulations of small optimal designs. The algorithm consists of a number of steps:first find an optimal direct treatment effects design, ignoring residual effects, and then optimise this class of designs with respect to residual effects. Poor designs are avoided by judicious application of the (M, S)-optimality criterion, and modifications of it, to appropriate matrices. The performance of the algorithm is illustrated by examples.     

On optimality properties of simple block designs in the approximate design theory

Optimality properties of approximate block designs are studied under variations of (1) the class of competing designs, (2) the optimality criterion, (3) the parametric function of interest, and (4) the statistical model. The designs which are optimal turn out to be the product of their treatment and block marginals, and uniform designs when the support is specified in advance. Optimality here means uniform, universal, and simultaneous j_p-optimality. The classical balanced incomplete block designs are embedded into this approach, and shown to be simultaneously j_p-optimal for a maximal system of identifiable parameters. A geometric account of universal optimality is given which applies beyond the context of block designs.     

Sequential imputation for models with latent variables assuming latent ignorability

Models that involve an outcome variable, covariates, and latent variables are frequently the target for estimation and inference. The presence of missing covariate or outcome data presents a challenge, particularly when missingness depends on the latent variables. This missingness mechanism is called latent ignorable or latent missing at random and is a generalisation of missing at random. Several authors have previously proposed approaches for handling latent ignorable missingness, but these methods rely on prior specification of the joint distribution for the complete data. In practice, specifying the joint distribution can be difficult and/or restrictive. We develop a novel sequential imputation procedure for imputing covariate and outcome data for models with latent variables under latent ignorable missingness. The proposed method does not require a joint model; rather, we use results under a joint model to inform imputation with less restrictive modelling assumptions. We discuss identifiability and convergence‐related issues, and simulation results are presented in several modelling settings. The method is motivated and illustrated by a study of head and neck cancer recurrence. Imputing missing data for models with latent variables under latent‐dependent missingness without specifying a full joint model.     

Goodness of exact experimental designs with respect to a certain family of criteria

In the paper we assume to be given an approximate optimum exact design with respect to one optimality criterion. We investigate the goodness of this design in the sense of a family of criteria that includes those of A-E-, and .D-optimality.     

Optimal Designs for Random Coefficient Regression Models with Heteroscedastic Errors

The purpose of this article is to present the optimal designs based on D-, G-, A-, I-, and D _β-optimality criteria for random coefficient regression (RCR) models with heteroscedastic errors. A sufficient condition for the heteroscedastic structure is given to make sure that the search of optimal designs can be confined at extreme settings of the design region when the criteria satisfy the assumption of the real valued monotone design criteria. Analytical solutions of D-, G-, A-, I-, and D _β-optimal designs for the RCR models are derived. Two examples are presented for random slope models with specific heteroscedastic errors.     

Optimum Designs for Parameter Estimation in Linear Mixture Models with Synergistic Effects

In this article, we derive optimum designs for parameter estimation in a mixture experiment when the response function is linear in the mixing components with some synergistic effects. The D- and A-optimality criteria have been used for the purpose. The Equivalence Theorem has been used to check for the optimality of the proposed designs.     

Optimum properties of latin square designs and a matrix inequality

The paper deals with uniform and D-optimality of designs in the two-way elimination of heterogeneities. It is shown that designs which are optimum for the hypothesis that all treatment effects are equal are optimum for some other hypotheses, too. The Proof is based on a new matrix- and determinantal inequality.     

Optimal experimental design criterion for discriminating semiparametric models

This paper studies the optimal experimental design problem to discriminate two regression models. Recently, López-Fidalgo et al. [2007. An optimal experimental design criterion for discriminating between non-normal models. J. Roy. Statist. Soc. B 69, 231–242] extended the conventional T-optimality criterion by Atkinson and Fedorov [1975a. The designs of experiments for discriminating between two rival models. Biometrika 62, 57–70; 1975b. Optimal design: experiments for discriminating between several models. Biometrika 62, 289–303] to deal with non-normal parametric regression models, and proposed a new optimal experimental design criterion based on the Kullback–Leibler information divergence. In this paper, we extend their parametric optimality criterion to a semiparametric setup, where we only need to specify some moment conditions for the null or alternative regression model. Our criteria, called the semiparametric Kullback–Leibler optimality criteria, can be implemented by applying a convex duality result of partially finite convex programming. The proposed method is illustrated by a simple numerical example.     

Generalized Least Squares Model Averaging

In this article, we propose a method of averaging generalized least squares estimators for linear regression models with heteroskedastic errors. The averaging weights are chosen to minimize Mallows’ C_p-like criterion. We show that the weight vector selected by our method is optimal. It is also shown that this optimality holds even when the variances of the error terms are estimated and the feasible generalized least squares estimators are averaged. The variances can be estimated parametrically or nonparametrically. Monte Carlo simulation results are encouraging. An empirical example illustrates that the proposed method is useful for predicting a measure of firms’ performance.     

Optimal designs for treatment comparisons represented by graphs

Consider an experiment for comparing a set of treatments: in each trial, one treatment is chosen and its effect determines the mean response of the trial. We examine the optimal approximate designs for the estimation of a system of treatment contrasts under this model. These designs can be used to provide optimal treatment proportions in more general models with nuisance effects. For any system of pairwise treatment comparisons, we propose to represent such a system by a graph. Then, we represent the designs by the inverses of the vertex weights in the corresponding graph and we show that the values of the eigenvalue-based optimality criteria can be expressed using the Laplacians of the vertex-weighted graphs. We provide a graph theoretic interpretation of D-, A- and E-optimality for estimating sets of pairwise comparisons. We apply the obtained graph representation to provide optimality results for these criteria as well as for ’symmetric’ systems of treatment contrasts.