Bayesian and maximin optimal designs for heteroscedastic regression models

The authors consider the problem of constructing standardized maximin D‐optimal designs for weighted polynomial regression models. In particular they show that by following the approach to the construction of maximin designs introduced recently by Dette, Haines & Imhof (2003), such designs can be obtained as weak limits of the corresponding Bayesian _q‐optimal designs. They further demonstrate that the results are more broadly applicable to certain families of nonlinear models. The authors examine two specific weighted polynomial models in some detail and illustrate their results by means of a weighted quadratic regression model and the Bleasdale–Nelder model. They also present a capstone example involving a generalized exponential growth model.     

Some results on optimality in models with heteroscedastic errors from partial optimum designs

This paper studies optimum designs for linear models when the errors are heteroscedastic. Sufficient conditions are given in order to obtainD-, A- andE-optimum designs for a complete regression model from partial optimum designs for some sub-parameters. A result about optimality for a complete model from the optimality for the submodels is included. Supported by Junta de Andalucía, research group FQM244.     

Locally optimal designs for binary dose‐response models

In this article, we consider the problem of seeking locally optimal designs for nonlinear dose‐response models with binary outcomes. Applying the theory of Tchebycheff Systems and other algebraic tools, we show that the locally D‐, A‐, and c‐optimal designs for three binary dose‐response models are minimally supported in finite, closed design intervals. The methods to obtain such designs are presented along with examples. The efficiencies of these designs are also discussed. The Canadian Journal of Statistics 46: 336–354; 2018 © 2018 Statistical Society of Canada     

Marginally restricted sequential D‐optimal designs

In many experiments, not all explanatory variables can be controlled. When the units arise sequentially, different approaches may be used. The authors study a natural sequential procedure for “marginally restricted” D‐optimal designs. They assume that one set of explanatory variables (x₁) is observed sequentially, and that the experimenter responds by choosing an appropriate value of the explanatory variable x₂. In order to solve the sequential problem a priori, the authors consider the problem of constructing optimal designs with a prior marginal distribution for x₁. This eliminates the influence of units already observed on the next unit to be designed. They give explicit designs for various cases in which the mean response follows a linear regression model; they also consider a case study with a nonlinear logistic response. They find that the optimal strategy often consists of randomizing the assignment of the values of x₂.     

D‐optimal minimax fractional factorial designs

The D‐optimal minimax criterion is proposed to construct fractional factorial designs. The resulting designs are very efficient, and robust against misspecification of the effects in the linear model. The criterion was first proposed by Wilmut & Zhou (2011); their work is limited to two‐level factorial designs, however. In this paper we extend this criterion to designs with factors having any levels (including mixed levels) and explore several important properties of this criterion. Theoretical results are obtained for construction of fractional factorial designs in general. This minimax criterion is not only scale invariant, but also invariant under level permutations. Moreover, it can be applied to any run size. This is an advantage over some other existing criteria. The Canadian Journal of Statistics 41: 325–340; 2013 © 2013 Statistical Society of Canada     

Locally and maximin optimal designs for multi-factor nonlinear models

This paper considers the search for locally and maximin optimal designs for multi-factor nonlinear models from optimal designs for sub-models of a lower dimension. In particular, sufficient conditions are given so that maximin D-optimal designs for additive multi-factor nonlinear models can be built from maximin D-optimal designs for their sub-models with a single factor. Some examples of application are models involving exponential decay in several variables.     

Bayesian D-optimal designs for exponential regression models

We consider the Bayesian D-optimal design problem for exponential growth models with one, two or three parameters. For the one-parameter model conditions on the shape of the density of the prior distribution and on the range of its support are given guaranteeing that a one-point design is also Bayesian D-optimal within the class of all designs. In the case of two parameters the best two-point designs are determined and for special prior distributions it is proved that these designs are Bayesian D-optimal. Finally, the exponential growth model with three parameters is investigated. The best three-point designs are characterized by a nonlinear equation. The global optimality of these designs cannot be proved analytically and it is demonstrated that these designs are also Bayesian D-optimal within the class of all designs if gamma-distributions are used as prior distributions.     

Robust extrapolation designs and weights for biased regression models with heteroscedastic errors

We consider the construction of designs for the extrapolation of regression responses, allowing both for possible heteroscedasticity in the errors and for imprecision in the specification of the response function. We find minimax designs and correspondingly optimal estimation weights in the context of the following problems: (1) for ordinary least squares estimation, determine a design to minimize the maximum value of the integrated mean squared prediction error (IMSPE), with the maximum being evaluated over both types of departure; (2) for weighted least squares estimation, determine both weights and a design to minimize the maximum IMSPE; (3) choose weights and design points to minimize the maximum IMSPE, subject to a side condition of unbiasedness. Solutions to (1) and (2) are given for multiple linear regression with no interactions, a spherical design space and an annular extrapolation space. For (3) the solution is given in complete generality; as one example we consider polynomial regression. Applications to a dose-response problem for bioassays are discussed. Numerical comparisons, including a simulation study, indicate that, as well as being easily implemented, the designs and weights for (3) perform as well as those for (1) and (2) and outperform some common competitors for moderate but undetectable amounts of model bias.     

Constrained optimal designs for regressiom models

An attempt of combining several optimality criteria simulaneously by using the techniques of nonliear programming is demonstrated. Four constrained D- and G-optimality criteria are introduced, namely, D-restrcted, D_s-restricted, A-restricted and E-restricted D- and G-optimality. The emphasis is particularly on the polynomial regression. Examples for quadratic polynomial regression are investigated to illustrate the applicability of these constrained optimality criteria.     

Minimax A‐ and D‐optimal integer‐valued wavelet designs for estimation

The author discusses integer‐valued designs for wavelet estimation of nonparametric response curves in the possible presence of heteroscedastic noise using a modified wavelet version of the Gasser‐Müller kernel estimator or weighted least squares estimation. The designs are constructed using a minimax treatment and the simulated annealing algorithm. The author presents designs for three case studies in experiments for investigating Gompertz's theory on mortality rates, nitrite utilization in bush beans and the impact of crash helmets in motorcycle accidents.     

E-optimal designs for regression models with quantitative factors— a reasonable choice?

For regression models with quantitative factors it is illustrated that the E-optimal design can be extremely inefficient in the sense that it degenerates to a design which takes all observations at only one point. This phenomenon is caused by the different size of the elements in the covariance matrix of the least-squares estimator for the unknown parameters. For these reasons we propose to replace the E-criterion by a corresponding standardized version. The advantage of this approach is demonstrated for the polynomial regression on a nonnegative interval, where the classical and standardized E-optimal designs can be found explicitly. The described phenomena are not restricted to the E-criterion but appear for nearly all optimality criteria proposed in the literature. Therefore standardization is recommended for optimal experimental design in regression models with quantitative factors. The optimal designs with respect to the new standardized criteria satisfy a similar invariance property as the famous D-optimal designs, which allows an easy calculation of standardized optimal designs on many linearly transformed design spaces.     

Minimax designs for 2k factorial experiments for generalized linear models

ABSTRACT

Formulas for A- and C-optimal allocations for binary factorial experiments in the context of generalized linear models are derived. Since the optimal allocations depend on GLM weights, which often are unknown, a minimax strategy is considered. This is shown to be simple to apply to factorial experiments. Efficiency is used to evaluate the resulting design. In some cases, the minimax design equals the optimal design. For other cases no general conclusion can be drawn. An example of a two-factor logit model suggests that the minimax design performs well, and often better than a uniform allocation.     

Construction of optimal designs in random coefficient regression models

We consider the problem of optimal experimental design in random coefficient regression models with respect to a quadratic loss function. By application of WHITTLE'S general equivalence theorem we obtain the structure of optimal designs. An alogrithm is given which allows, under certain assumptions, the construction of the information matrix of an optimal design. Moreover, we give conditions on the equivalence of optimal designs with respect to optimality criteria which are analogous to usual A-D- and _E/-optimality.     

Convergence properties of sequential Bayesian D-optimal designs

We establish convergence properties of sequential Bayesian optimal designs. In particular, for sequential D-optimality under a general nonlinear location-scale model for binary experiments, we establish posterior consistency, consistency of the design measure, and the asymptotic normality of posterior following the design. We illustrate our results in the context of a particular application in the design of phase I clinical trials, namely a sequential design of Haines et al. [2003. Bayesian optimal designs for phase I clinical trials. Biometrics 59, 591–600] that incorporates an ethical constraint on overdosing.     

Optimal designs for multivariate logistic mixed models with longitudinal data

This paper considers the optimal design problem for multivariate mixed-effects logistic models with longitudinal data. A decomposition method of the binary outcome and the penalized quasi-likelihood are used to obtain the information matrix. The D-optimality criterion based on the approximate information matrix is minimized under different cost constraints. The results show that the autocorrelation coefficient plays a significant role in the design. To overcome the dependence of the D-optimal designs on the unknown fixed-effects parameters, the Bayesian D-optimality criterion is proposed. The relative efficiencies of designs reveal that both the cost ratio and autocorrelation coefficient play an important role in the optimal designs.     

On d- and e- minimax optimal designs for estimating the axial slopes of a second-order response surface over hypercubic regions

Design of experiments for estimating the slopes of a response surface is considered. Design criteria analogous to the traditional ones but based upon the variance-covariance matrix of the estimated slopes along factor axes are proposed. Optimal designs under the proposed criteria are derived for second-order polynomial regression over hypercubic regions. Best de¬signs within some commonly used classes of designs are also obtained and their efficiencies are investigated.     

Bayesian model selection for D‐vine pair‐copula constructions

In recent years analyses of dependence structures using copulas have become more popular than the standard correlation analysis. Starting from Aas et al. ( 2009 ) regular vine pair‐copula constructions (PCCs) are considered the most flexible class of multivariate copulas. PCCs are involved objects but (conditional) independence present in data can simplify and reduce them significantly. In this paper the authors detect (conditional) independence in a particular vine PCC model based on bivariate t copulas by deriving and implementing a reversible jump Markov chain Monte Carlo algorithm. However, the methodology is general and can be extended to any regular vine PCC and to all known bivariate copula families. The proposed approach considers model selection and estimation problems for PCCs simultaneously. The effectiveness of the developed algorithm is shown in simulations and its usefulness is illustrated in two real data applications. The Canadian Journal of Statistics 39: 239–258; 2011 © 2011 Statistical Society of Canada     

Asymptotic properties of maximum quasi-likelihood estimators in generalized linear models with adaptive designs

In this paper, we present the asymptotic properties of maximum quasi-likelihood estimators (MQLEs) in generalized linear models with adaptive designs under some mild regular conditions. The existence of MQLEs in quasi-likelihood equation is discussed. The rate of convergence and asymptotic normality of MQLEs are also established. The results are illustrated by Monte-Carlo simulations.     

Accounting for uncertainty in the historical response rate of the standard treatment in single‐arm two‐stage designs based on Bayesian power functions

In phase II single‐arm studies, the response rate of the experimental treatment is typically compared with a fixed target value that should ideally represent the true response rate for the standard of care therapy. Generally, this target value is estimated through previous data, but the inherent variability in the historical response rate is not taken into account. In this paper, we present a Bayesian procedure to construct single‐arm two‐stage designs that allows to incorporate uncertainty in the response rate of the standard treatment. In both stages, the sample size determination criterion is based on the concepts of conditional and predictive Bayesian power functions. Different kinds of prior distributions, which play different roles in the designs, are introduced, and some guidelines for their elicitation are described. Finally, some numerical results about the performance of the designs are provided and a real data example is illustrated. Copyright © 2016 John Wiley & Sons, Ltd.