Optimal design of complex experiments with qualitative factors of influence

A complex experiment with qualirarive factors influencing the outcome of the experiment can be seen as a general ANOVA setup. A design of such an experiment will be the assignment at which of the possible levels of the factors the actual experiment should be performed. In this paper optimal designs of such experiments will be characterized with respect to three different optimality criteria including the so called uniform optimality of a design. The possible applications of the main optimization result providing these characterizations can be used to more general experiments. The particular results on these generalizations will be indicated at the end of this paper.     

Comparison of design for quadratic regression on cubes

Designs for quadratic regression are considered when the possible choices of the controllable variable are points x=(x₁,x₂,…,x_q) in the q-dimensional cube of side 2. The designs that are optimum with respect to such criteria as those of D-, A-, and E-optimality are compared in their performance relative to these and other criteria. Some of the results are developed algebraically; others, numerically. The possible supports of E-optimum designs are much more numerous than the D-optimum supports characterized earlier. The A-optimum design appears to be fairly robust in its efficiency, under variation of criterion.     

The Mean Squared Error Optimum Design Criterion for Parameter Estimation in Nonlinear Regression Models

In the context of nonlinear regression models, we propose an optimal experimental design criterion for estimating the parameters that account for the intrinsic and parameter-effects nonlinearity. The optimal design criterion proposed in this article minimizes the determinant of the mean squared error matrix of the parameter estimator that is quadratically approximated using the curvature array. The design criterion reduces to the D-optimal design criterion if there are no intrinsic and parameter-effects nonlinearity in the model, and depends on the scale parameter estimator and on the reparameterization used. Some examples, using a well known nonlinear kinetics model, demonstrate the application of the proposed criterion to nonsequential design of experiments as compared with the D-optimal criterion.     

Optimal design for discrete choice experiments

In this paper we derive locally optimal designs for discrete choice experiments. As in Kanninen (2002) we consider a multinomial logistic model, which contains various qualitative attributes as well as a quantitative one, which may range over a sufficiently large interval. The derived optimal designs improve upon those given in the literature, but have the feature that every choice set contains alternatives, which coincide in all but the quantitative attributes. The multinomial logistic model will then lead to a response behavior, which is apparently unrealistic.     

On the Functional Approach to Bayesian Efficient Designs for Nonlinear Regression Models

The present article is devoted to an extension of the functional approach elaborated in the book Melas (2006 Melas , V. B. ( 2006 ). Functional Approach to Optimal Experimental Design . Lecture Notes in Statistics , Vol. 184. Heidelberg : Springer . [Google Scholar]) for studying optimal designs in linear and nonlinear regression models. Here we consider Bayesian efficient designs for nonlinear models under the standard assumptions on the observational errors. Sufficient conditions for uniqueness of locally optimal and Bayesian efficient designs for common optimality criteria are given. L-efficient Bayesian designs are constructed and investigated for a special nonlinear regression model of a rational form as an illustration of our main results. This model is interesting in both a practical and a theoretical sense.     

Linear model estimation errors with estimated design parameters

The problem of error estimation of parameters b in a linear model,Y = Xb+ e, is considered when the elements of the design matrix X are functions of an unknown ‘design’ parameter vector c. An estimated value c is substituted in X to obtain a derived design matrix [Xtilde]. Even though the usual linear model conditions are not satisfied with [Xtilde], there are situations in physical applications where the least squares solution to the parameters is used without concern for the magnitude of the resulting error. Such a solution can suffer from serious errors.

This paper examines bias and covariance errors of such estimators. Using a first-order Taylor series expansion, we derive approximations to the bias and covariance matrix of the estimated parameters. The bias approximation is a sum of two terms:One is due to the dependence between ? and Y; the other is due to the estimation errors of ? and is proportional to b, the parameter being estimated. The covariance matrix approximation, on the other hand, is composed of three omponents:One component is due to the dependence between ? and Y; the second is the covariance matrix ∑_b corresponding to the minimum variance unbiased b, as if the design parameters were known without error; and the third is an additional component due to the errors in the design parameters. It is shown that the third error component is directly proportional to bb'. Thus, estimation of large parameters with wrong design matrix [Xtilde] will have larger errors of estimation. The results are illustrated with a simple linear example.     

Optimal designs for the power logistic model

We investigate non-sequential designs for estimating model parameters in a power logistic model when the power is assumed to be approximately known and only the ranges for the other two parameters are available. The sensitivity of these designs to nominal values of all the three parameters are studied and our proposed optimal designs are shown to be reasonably robust under moderate deviation from the assumed model. An application to a toxicity experiment involving adult beetles is discussed, including the benefits of using an optimal design.     

Robust estimation and design procedures for the random effects model

The authors discuss two robust estimators for estimating variance components in the random effects model, and they obtain finite‐sample breakdown points for the estimators. Based on the finite‐sample breakdown point, they propose a criterion for selecting robust designs. With robust designs, one can get efficient and reliable estimates for variance components regardless of outliers which may happen in the experiment. The authors give examples to show the performance of robust estimators and to compare robust designs with optimal designs based on the traditional analysis of variance estimation method.     

Estimation Bias in the First-Order Autoregressive Model and Its Impact on Predictions and Prediction Intervals

The least squares estimate of the autoregressive coefficient in the AR(1) model is known to be biased towards zero, especially for parameters close to the stationarity boundary. Several methods for correcting the autoregressive parameter estimate for the bias have been suggested. Using simulations, we study the bias and the mean square error of the least squares estimate and the bias-corrections proposed by Kendall and Quenouille.

We also study the mean square forecast error and the coverage of the 95% prediction interval when using the biased least squares estimate or one of its bias-corrected versions. We find that the estimation bias matters little for point forecasts, but that it affects the coverage of the prediction intervals. Prediction intervals for forecasts more than one step ahead, when calculated with the biased least squares estimate, are too narrow.     

On optimality properties of simple block designs in the approximate design theory

Optimality properties of approximate block designs are studied under variations of (1) the class of competing designs, (2) the optimality criterion, (3) the parametric function of interest, and (4) the statistical model. The designs which are optimal turn out to be the product of their treatment and block marginals, and uniform designs when the support is specified in advance. Optimality here means uniform, universal, and simultaneous j_p-optimality. The classical balanced incomplete block designs are embedded into this approach, and shown to be simultaneously j_p-optimal for a maximal system of identifiable parameters. A geometric account of universal optimality is given which applies beyond the context of block designs.     

The Bayesian D-optimal design for simple beta regression model in two cases (both known and unknown nuisance parameter)

According to investigated topic in the context of optimal designs, various methods can be used to obtain optimal design, of which Bayesian method is one. In this paper, considering the model and the features of the information matrix, this method (Bayesian optimality criterion) has been used for obtaining optimal designs which due to the variation range of the model parameters, prior distributions such as Uniform, Normal and Exponential have been used and the results analysed.     

Estimation of variance components in the mixed effects models: A comparison between analysis of variance and spectral decomposition

The mixed effects models with two variance components are often used to analyze longitudinal data. For these models, we compare two approaches to estimating the variance components, the analysis of variance approach and the spectral decomposition approach. We establish a necessary and sufficient condition for the two approaches to yield identical estimates, and some sufficient conditions for the superiority of one approach over the other, under the mean squared error criterion. Applications of the methods to circular models and longitudinal data are discussed. Furthermore, simulation results indicate that better estimates of variance components do not necessarily imply higher power of the tests or shorter confidence intervals.     

On the optimality of chemical balance weighing designs

In this paper we consider the problem of optimally weighing n objects with N weighings on a chemical balance. Several previously known results are generalized. In particular, the designs shown by Ehlich (1964a) and Payne (1974) to be D-optimal in various classes of weighing designs where N≡2 (mod4) are shown to be optimal with respect to any optimality criterion of Type I as defined in Cheng (1980). Several results on the E-optimality of weighing designs are also given.     

Efficient crossover designs in the presence of interactions between direct and carry-over treatment effects

Crossover designs, or repeated measurements designs, are used for experiments in which t treatments are applied to each of n experimental units successively over p time periods. Such experiments are widely used in areas such as clinical trials, experimental psychology and agricultural field trials. In addition to the direct effect on the response of the treatment in the period of application, there is also the possible presence of a residual, or carry-over, effect of a treatment from one or more previous periods. We use a model in which the residual effect from a treatment depends upon the treatment applied in the succeeding period; that is, a model which includes interactions between the treatment direct and residual effects. We assume that residual effects do not persist further than one succeeding period.A particular class of strongly balanced repeated measurements designs with n=t² units and which are uniform on the periods is examined. A lower bound for the A-efficiency of the designs for estimating the direct effects is derived and it is shown that such designs are highly efficient for any number of periods p=2,…,2t.     

A-Optimality Standardized Through the Coefficient of Variation

Many of the usual criteria for optimal experimental design do not take into account the different scale of the variance of the parameters. Dette (1997 Dette , H. ( 1997 ). Designing experiments with respect to “standardized” optimality criteria . J. J. Roy. Statist. Soc. Ser. B Statist. Methodol. 59 ( 1 ): 97 – 110 .[Crossref] , [Google Scholar]) provided a standardization which leads to designs with similar efficiencies for all of the parameters.

In this article, a new way of standardization through the coefficient of variation is given. This leads to designs useful when one of the parameters is expected to be very small. Thus, this criterion may be used if there is special interest in maximizing the power of some parameter tests. Locally standardized through the coefficient of variation A-optimal designs are computed for simple linear and quadratic regression.     

Estimation of parameters in a generalized GMANOVA model based on an outer product analogy and least squares

This paper investigates estimation of parameters in a combination of the multivariate linear model and growth curve model, called a generalized GMANOVA model. Making analogy between the outer product of data vectors and covariance yields an approach to directly do least squares to covariance. An outer product least squares estimator of covariance (COPLS estimator) is obtained and its distribution is presented if a normal assumption is imposed on the error matrix. Based on the COPLS estimator, two-stage generalized least squares estimators of the regression coefficients are derived. In addition, asymptotic normalities of these estimators are investigated. Simulation studies have shown that the COPLS estimator and two-stage GLS estimators are alternative competitors with more efficiency in the sense of sample mean, standard deviations and mean of the variance estimates to the existing ML estimator in finite samples. An example of application is also illustrated.     

On the efficiency of nonparametric variance estimation in sequential dose-finding

Dose-finding in clinical studies is typically formulated as a quantile estimation problem, for which a correct specification of the variance function of the outcomes is important. This is especially true for sequential study where the variance assumption directly involves in the generation of the design points and hence sensitivity analysis may not be performed after the data are collected. In this light, there is a strong reason for avoiding parametric assumptions on the variance function, although this may incur efficiency loss. In this paper, we investigate how much information one may retrieve by making additional parametric assumptions on the variance in the context of a sequential least squares recursion. By asymptotic comparison, we demonstrate that assuming homoscedasticity achieves only a modest efficiency gain when compared to nonparametric variance estimation: when homoscedasticity in truth holds, the latter is at worst 88% as efficient as the former in the limiting case, and often achieves well over 90% efficiency for most practical situations. Extensive simulation studies concur with this observation under a wide range of scenarios.     

Efficient Estimation of the PDF and the CDF of the Weibull Extension Model

The Weibull extension model is a useful extension of the Weibull distribution, allowing for bathtub shaped hazard rates among other things. Here, we consider estimation of the PDF and the CDF of the Weibull extension model. The following estimators are considered: uniformly minimum variance unbiased (UMVU) estimator, maximum likelihood (ML) estimator, percentile (PC) estimator, least squares (LS) estimator, and weighted least squares (WLS) estimator. Analytical expressions are derived for the bias and the mean squared error. Simulation studies and real data applications show that the ML estimator performs better than others.     

On the Choice of a Prior for Bayesian D-Optimal Designs for the Logistic Regression Model with a Single Predictor

The Bayesian design approach accounts for uncertainty of the parameter values on which optimal design depends, but Bayesian designs themselves depend on the choice of a prior distribution for the parameter values. This article investigates Bayesian D-optimal designs for two-parameter logistic models, using numerical search. We show three things: (1) a prior with large variance leads to a design that remains highly efficient under other priors, (2) uniform and normal priors lead to equally efficient designs, and (3) designs with four or five equidistant equally weighted design points are highly efficient relative to the Bayesian D-optimal designs.     

On the Optimality of Circular Block Designs Under a Mixed Interference Model

Filipiak and Markiewicz (2012 Filipiak, K., Markiewicz, A. (2012). On universal optimality of circular weakly neighbor balanced designs under an interference model. Comm. Stat. Theor Methods 41: 2356–2366.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) proved the universal optimality of circular weakly neighbor balanced designs (CWNBDs) under the interference model with fixed neighbor effects among the class of complete block designs. In two special cases where a CWNBD cannot exist, Filipiak et al. (2012 Filipiak, K., Markiewicz, A., Ró?ański, R. (2012). Maximal determinant over a certain class of matrices and its application to D-optimality of designs. Linear Algebra Appl. 436(4): 874–887.[Crossref], [Web of Science ®] , [Google Scholar]) characterized D-optimal designs. The aim of this paper is to show the universal optimality of CWNBDs and to characterize D-optimal designs under the interference model with random neighbor effects.