Construction of optimal designs in random coefficient regression models

We consider the problem of optimal experimental design in random coefficient regression models with respect to a quadratic loss function. By application of WHITTLE'S general equivalence theorem we obtain the structure of optimal designs. An alogrithm is given which allows, under certain assumptions, the construction of the information matrix of an optimal design. Moreover, we give conditions on the equivalence of optimal designs with respect to optimality criteria which are analogous to usual A-D- and _E/-optimality.     

On the choice of optimality criteria in comparing statistical designs

We formulate in a reasonable sense a class of optimality functionals for comparing feasible statistical designs available in a given setup. It is desired that the optimality functionals reflect symmetric measures of the lack of information contained in the designs being compared. In view of this, Kiefer's (1975) universal optimality criterion is seen to rest on stringent conditions, some of which can be relaxed while preserving optimality (in an extended sense) of the so-called balanced designs.     

SECOND ORDER ASYMPTOTIC COMPARISON OF ESTIMATORS UNDER UNIVERSAL DOMINATION CRITERION

The main purpose of this paper is to formulate theories of universal optimality, in the sense that some criteria for performances of estimators are considered over a class of loss functions. It is shown that the difference of the second order terms between two estimators in any risk functions is expressed as a form which is characterized by a peculiar value associated with the loss functions, which is referred to as the loss coefficient. This means that the second order optimal problem is completely characterized by the value of the loss coefficient. Furthermore, from the viewpoint of change of the loss coefficient, the relationship between two estimators is classified into six types. On the basis of this classification, the concept of universal second order admissibility is introduced. Some sufficient conditions are given to determine whether any estimators are universally admissible or not.     

OPTIMAL EXPERIMENTAL DESIGNS FOR MULTILEVEL MODELS WITH COVARIATES

In this paper optimal experimental designs for multilevel models with covariates and two levels of nesting are considered. Multilevel models are used to describe the relationship between an outcome variable and a treatment condition and covariate. It is assumed that the outcome variable is measured on a continuous scale. As optimality criteria D-optimality, and L-optimality are chosen. It is shown that pre-stratification on the covariate leads to a more efficient design and that the person level is the optimal level of randomization. Furthermore, optimal sample sizes are given and it is shown that these do not depend on the optimality criterion when randomization is done at the group level.     

Comparison of designs equivalent under one or two criteria

Two designs equivalent under one or two criteria may be compared under other criteria. For certain configurations of eigenvalues of the information matrices, we decide which design is the better of the two for many other such criteria. The relationship to universal optimality (in the case of equivalence under one criterion) is indicated. For two criteria, applications are given to weighing and treatment-with-covariate settings.     

The Mean Squared Error Optimum Design Criterion for Parameter Estimation in Nonlinear Regression Models

In the context of nonlinear regression models, we propose an optimal experimental design criterion for estimating the parameters that account for the intrinsic and parameter-effects nonlinearity. The optimal design criterion proposed in this article minimizes the determinant of the mean squared error matrix of the parameter estimator that is quadratically approximated using the curvature array. The design criterion reduces to the D-optimal design criterion if there are no intrinsic and parameter-effects nonlinearity in the model, and depends on the scale parameter estimator and on the reparameterization used. Some examples, using a well known nonlinear kinetics model, demonstrate the application of the proposed criterion to nonsequential design of experiments as compared with the D-optimal criterion.     

Spatial sampling design for parameter estimation of the covariance function

We study the spatial optimal sampling design for covariance parameter estimation. The spatial process is modeled as a Gaussian random field and maximum likelihood (ML) is used to estimate the covariance parameters. We use the log determinant of the inverse Fisher information matrix as the design criterion and run simulations to investigate the relationship between the inverse Fisher information matrix and the covariance matrix of the ML estimates. A simulated annealing algorithm is developed to search for an optimal design among all possible designs on a fine grid. Since the design criterion depends on the unknown parameters, we define relative efficiency of a design and consider minimax and Bayesian criteria to find designs that are robust for a range of parameter values. Simulation results are presented for the Matérn class of covariance functions.     

Some sufficient conditions for the type 1 optimality of block designs

In this paper, we investigate the problem of determining block designs which are optimal under type 1 optimality criteria within various classes of designs having υ treatments arranged in b blocks of size k. The solutions to two optimization problems are given which are related to a general result obtained by Cheng (1978) and which are useful in this investigation. As one application of the solutions obtained, the definition of a regular graph design given in Mitchell and John (1977) is extended to that of a semi-regular graph design and some sufficient conditions are derived for the existence of a semi-regular graph design which is optimal under a given type 1 criterion. A result is also given which shows how the sufficient conditions derived can be used to establish the optimality under a specific type 1 criterion of some particular types of semi- regular graph designs having both equal and unequal numbers of replicates. Finally,some sufficient conditions are obtained for the dual of an A- or D-optimal design to be A- or D-optimal within an appropriate class of dual designs.     

Design of experiments in the presence of errors in factor levels

This paper is concerned with the statistical properties of experimental designs where the factor levels cannot be set precisely. When the errors in setting the factor levels cannot be measured, design robustness is explored. However, when the actual design could be measured at the end of the investigation, its optimality is of interest. D-optimality could be assessed in different ways. Several measures are compared. Evaluating them is difficult even in simple cases. Therefore, in general, simulations are used to obtain their values. It is shown that if D-optimality is measured by the expected value of the determinant of the information matrix of the experimental design, as has been suggested in the past, on average the designs appear to improve with the variance of the error in setting the factor levels. However, we argue that the criterion of D-optimality should be based on the inverse of the information matrix. In this case it is shown that the experiment could be better or worse than the planned one. It is also recognized that setting the factor levels with error could lead to an increased risk of losing observations, which on its own could reduce considerably the optimality of the experimental designs. Advice on choosing the design region in such a way that such a risk is controlled to an acceptable level is given.     

Constructing optimal projection designs

ABSTRACT

The early stages of many real-life experiments involve a large number of factors among which only a few factors are active. Unfortunately, the optimal full-dimensional designs of those early stages may have bad low-dimensional projections and the experimenters do not know which factors turn out to be important before conducting the experiment. Therefore, designs with good projections are desirable for factor screening. In this regard, significant questions are arising such as whether the optimal full-dimensional designs have good projections onto low dimensions? How experimenters can measure the goodness of a full-dimensional design by focusing on all of its projections?, and are there linkages between the optimality of a full-dimensional design and the optimality of its projections? Through theoretical justifications, this paper tries to provide answers to these interesting questions by investigating the construction of optimal (average) projection designs for screening either nominal or quantitative factors. The main results show that: based on the aberration and orthogonality criteria the full-dimensional design is optimal if and only if it is optimal projection design; the full-dimensional design is optimal via the aberration and orthogonality if and only if it is uniform projection design; there is no guarantee that a uniform full-dimensional design is optimal projection design via any criterion; the projection design is optimal via the aberration, orthogonality and uniformity criteria if it is optimal via any criterion of them; and the saturated orthogonal designs have the same average projection performance.     

Optimal and efficient crossover designs for comparing test treatments to a control treatment under various models

We study the optimality, efficiency, and robustness of crossover designs for comparing several test treatments to a control treatment. Since A-optimality is a natural criterion in this context, we establish lower bounds for the trace of the inverse of the information matrix for the test treatments versus control comparisons under various models. These bounds are then used to obtain lower bounds for efficiencies of a design under these models. Two algorithms, both guided by these efficiencies and results from optimal design theory, are proposed for obtaining efficient designs under the various models.     

Optimal Progressive Type-II Censoring Schemes for Nonparametric Confidence Intervals of Quantiles

In this article, optimal progressive censoring schemes are examined for the nonparametric confidence intervals of population quantiles. The results obtained can be universally applied to any continuous probability distribution. By using the interval mass as an optimality criterion, the optimization process is free of the actual observed values from the sample and needs only the initial sample size n and the number of complete failures m. Using several sample sizes combined with various degrees of censoring, the results of the optimization are presented here for the population median at selected levels of confidence (99, 95, and 90%). With the optimality criterion under consideration, the efficiencies of the worst progressive Type-II censoring scheme and ordinary Type-II censoring scheme are also examined in comparison to the best censoring scheme obtained for fixed n and m.     

Characterization of an optimal matrix estimator under convex loss function

Characterization of an optimal vector estimator and an optimal matrix estimator are obtained. In each case appropriate convex loss functions are considered. The results are illustrated through the problems of simultaneous unbiased estimation, simultaneous equivariant estimation and simultaneous unbiased prediction. Further an optimality criterion is proposed for matrix unbiased estimation and it is shown that the matrix unbiased estimation of a matrix parametric function and the minimum variance unbiased estimation of its components are equivalent.     

Optimality and Contrasts in Block Designs with Unequal Treatment Replication

The computer construction of optimal or near‐optimal experimental designs is common in practice. Search procedures are often based on the non‐zero eigenvalues of the information matrix of the design. Minimising the average of the pairwise treatment variances can also be used as a search criterion. For equal treatment replication these approaches are equivalent to maximising the harmonic mean of the design's canonical efficiency factors, but differ when treatments are unequally replicated. This paper investigates the extent of these differences and discusses some apparent inconsistencies previously observed when comparing the optimality of equally and unequally replicated designs.     

Optimal experimental design criterion for discriminating semiparametric models

This paper studies the optimal experimental design problem to discriminate two regression models. Recently, López-Fidalgo et al. [2007. An optimal experimental design criterion for discriminating between non-normal models. J. Roy. Statist. Soc. B 69, 231–242] extended the conventional T-optimality criterion by Atkinson and Fedorov [1975a. The designs of experiments for discriminating between two rival models. Biometrika 62, 57–70; 1975b. Optimal design: experiments for discriminating between several models. Biometrika 62, 289–303] to deal with non-normal parametric regression models, and proposed a new optimal experimental design criterion based on the Kullback–Leibler information divergence. In this paper, we extend their parametric optimality criterion to a semiparametric setup, where we only need to specify some moment conditions for the null or alternative regression model. Our criteria, called the semiparametric Kullback–Leibler optimality criteria, can be implemented by applying a convex duality result of partially finite convex programming. The proposed method is illustrated by a simple numerical example.     

Goodness of exact experimental designs with respect to a certain family of criteria

In the paper we assume to be given an approximate optimum exact design with respect to one optimality criterion. We investigate the goodness of this design in the sense of a family of criteria that includes those of A-E-, and .D-optimality.     

On linear regression designs which maximize information

Necessary and sufficient conditions are established when a continuous design contains maximal information for a prescribed s-dimensional parameter in a classical linear model. The development is based on a thorough study of a particular dual problem and its interplay with the optimal design problem, extending partial results and earlier approaches based on differential calculus, game theory, and other programming methods. The results apply in particular to a class of information functionals which covers c-, D-, A-, L-optimality, they include a complete account of the non-differentiable criterion of E-optimality, and provide a constructive treatment of those situations in which the information matrix is singular. Corollaries pertain to the case of s out of k parameters, simultaneous optimality with respect to several criteria, multiplicity of optimal designs, bounds on their weights, and optimality which is induced by admissibility.     

On optimality properties of simple block designs in the approximate design theory

Optimality properties of approximate block designs are studied under variations of (1) the class of competing designs, (2) the optimality criterion, (3) the parametric function of interest, and (4) the statistical model. The designs which are optimal turn out to be the product of their treatment and block marginals, and uniform designs when the support is specified in advance. Optimality here means uniform, universal, and simultaneous j_p-optimality. The classical balanced incomplete block designs are embedded into this approach, and shown to be simultaneously j_p-optimal for a maximal system of identifiable parameters. A geometric account of universal optimality is given which applies beyond the context of block designs.     

Optimal design in average for inference in generalized linear models

This paper considers the problem of optimal design for inference in Generalized Linear Models, when prior information about the parameters is available. The general theory of optimum design usually requires knowledge of the parameter values. These are usually unknown and optimal design can, therefore, not be used in practice. However, one way to circumvent this problem is through so-called “optimal design in average”, or shortly, “ave optimal”. The ave optimal design is chosen to minimize the expected value of some criterion function over a prior distribution. We focus our interest on the aveD _A-optimality, including aveD- and avec-optimality and show the appropriate equivalence theorems for these optimality criterions, which give necessary conditions for an optimal design. Ave optimal designs are of interest when e.g. a factorial experiment with a binary or a Poisson response in to be conducted. The results are applied to factorial experiments, including a control group experiment and a 2×2 experiment.     

The Bayesian D-optimal design for simple beta regression model in two cases (both known and unknown nuisance parameter)

According to investigated topic in the context of optimal designs, various methods can be used to obtain optimal design, of which Bayesian method is one. In this paper, considering the model and the features of the information matrix, this method (Bayesian optimality criterion) has been used for obtaining optimal designs which due to the variation range of the model parameters, prior distributions such as Uniform, Normal and Exponential have been used and the results analysed.