Measures of uniformity in experimental designs: A selective overview

ABSTRACT

Discrepancies are measures which are defined as the deviation between the empirical and the theoretical uniform distribution. In this way, discrepancy is a measure of uniformity which provides a way of construction a special kind of space filling designs, namely uniform designs. Several discrepancies have been proposed in recent literature. A brief, selective review of these measures including some construction algorithms are given in this paper. Furthermore, a critical discussion along with some comparisons is provided, as well.     

An effective construction method for multi-level uniform designs

Uniform designs are widely used in various applications. However, it is computationally intractable to construct uniform designs, even for moderate number of runs, factors and levels. We establish a linear relationship between average squared centered L₂-discrepancy and generalized wordlength pattern, and then based on it, we propose a general method for constructing uniform designs with arbitrary number of levels. The main idea is to choose a generalized minimum aberration design and then permute its levels. We propose a novel stochastic algorithm and obtain many new uniform designs that have smaller centered L₂-discrepancies than the existing ones.     

Algorithmic construction of nearly column-orthogonal designs

Computer models can describe complicated phenomena encountered in science and engineering fields. To use these models for scientific investigation, however, their generally long running time and mostly deterministic nature require a specially designed experiment. The column-orthogonal design (COD) is a popular choice for computer experiments. Because of the restriction on the orthogonality, however, only little CODs can be constructed. In this article, we propose two algorithms for constructing nearly CODs by rotating orthogonal arrays under two different criteria. Further, some obtained nearly CODs are nearly Latin hypercube designs. Some examples are provided to show the advantages of our algorithms. Some rotation matrices obtained via the algorithms are listed.     

A review of uniform cross-over designs

Uniform cross-over designs form an important family of experimental designs. They have been applied in many scientific disciplines including clinical trials, agricultural studies and psychological experiments. In this paper we consider the four types of uniform cross-over design, as given by Williams [1949. Experimental designs balanced for the estimation of residual effects of treatments. Aust. J. Sci. Res. 2, 149–168], Cheng and Wu [1980. Balanced repeated measurements designs. Ann. Statist. 8, 1272–1283. Corrigendum 11 (1983) 349], Bate and Jones [2006. The construction of nearly balanced and nearly strongly balanced uniform cross-over designs. J. Statist. Plann. Inference 136, 3248–3267] and Kunert [1983. Optimal design and refinement of the linear model with applications to repeated measurements designs. Ann. Statist. 11, 247–257]. The efficiency of these designs, existence criteria and methods of construction are described.     

Construction of uniform designs for mixture experiments with complex constraints

Abstract

Mixture experiments have attracted increasingly attention due to their great practical value in production and living, while uniform designs over irregular experimental regions have become a hot topic in the area of experimental designs in the past two decades. Noting that the experimental region of a mixture experiment with q components under some constraints is in fact a (q ? 1)-dimensional geometry, this article proposes a new method for searching nearly uniform designs for mixture experiments with any complex constraints. Two examples with some tables and figures are given to illustrate this method.     

On algorithmic construction of maximin distance designs

Maximin distance designs are useful for conducting expensive computer experiments. In this article, we compare some global optimization algorithms for constructing such designs. We also introduce several related space-filling designs, including nested maximin distance designs, sliced maximin distance designs, and general maximin distance designs with better projection properties. These designs possess more flexible structures than their analogs in the literature. Examples of these designs constructed by the algorithms are presented.     

Lower bounds of various criteria in experimental designs

Criterion is essential for measuring the goodness of an experimental design. In this paper, lower bounds of various criteria in experimental designs will be reviewed according to methodology of their construction. The criteria include most well-known ones which are frequently used as benchmarks for orthogonal array, uniform design, supersaturated design and other types of designs. To derive the lower bounds of these criteria, five different approaches are explored. Some new results are given. Throughout the paper, some relationships among different types of lower bounds are also discussed.     

Effect of missing plots in some response surface designs

The effect of one or more missing observations for response surface designs arranged in blocks are examined in this paper. The results as applied to a central composite design with orthogonal blocking, and an equirdial design with orthogonal blocking, are reported.     

Extensions of D-optimal minimal designs for symmetric mixture models

The purpose of mixture experiments is to explore the optimum blends of mixture components, which will provide the desirable response characteristics in finished products. D-optimal minimal designs have been considered for a variety of mixture models, including Scheffé's linear, quadratic, and cubic models. Usually, these D-optimal designs are minimally supported since they have just as many design points as the number of parameters. Thus, they lack the degrees of freedom to perform the lack-of-fit (LOF) tests. Also, the majority of the design points in D-optimal minimal designs are on the boundary: vertices, edges, or faces of the design simplex. In this article, extensions of the D-optimal minimal designs are developed for a general mixture model to allow additional interior points in the design space to enable prediction of the entire response surface. Also a new strategy for adding multiple interior points for symmetric mixture models is proposed. We compare the proposed designs with Cornell (1986 Cornell, J.A. (1986). A comparison between two ten-point designs for studying three-component mixture systems. J. Qual. Technol. 18(1):1–15.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) two 10-point designs for the LOF test by simulations.     

On the optimality of chemical balance weighing designs

In this paper we consider the problem of optimally weighing n objects with N weighings on a chemical balance. Several previously known results are generalized. In particular, the designs shown by Ehlich (1964a) and Payne (1974) to be D-optimal in various classes of weighing designs where N≡2 (mod4) are shown to be optimal with respect to any optimality criterion of Type I as defined in Cheng (1980). Several results on the E-optimality of weighing designs are also given.     

Measures of non orthogonality in block designs

Orthogonality is an important concept in block design. Necessary and sufficient condition for a connected block design to be orthogonal is well known. However, when a design is not orthogonal, it is not clear how much it deviates from orthogonality. In this paper, an attempt has been made to first define the measures of or indices to non orthogonality in block design and then to characterize designs possessing minimum non orthogonality indices. It is shown that a Balanced Incomplete Block Design (BIBD) and a Balanced Block Design (BBD), if exist, possess this property.     

Optimum points of stratification for two or more stage designs

In this paper, an attempt is made to obtain optimum points of stratification for two or more stage designs with equal p.s.u.'s and the subsequent units. Stratification on the auxiliary variable when the study variable is closely related to the auxiliary variable has also been obtained. The determination of OPS in these cases have been illustrated with the help of some known specific distributions.     

Modifications of sequential designs in bioequivalence trials

Bioequivalence (BE) studies are designed to show that two formulations of one drug are equivalent and they play an important role in drug development. When in a design stage, it is possible that there is a high degree of uncertainty on variability of the formulations and the actual performance of the test versus reference formulation. Therefore, an interim look may be desirable to stop the study if there is no chance of claiming BE at the end (futility), or claim BE if evidence is sufficient (efficacy), or adjust the sample size. Sequential design approaches specially for BE studies have been proposed previously in publications. We applied modification to the existing methods focusing on simplified multiplicity adjustment and futility stopping. We name our method modified sequential design for BE studies (MSDBE). Simulation results demonstrate comparable performance between MSDBE and the original published methods while MSDBE offers more transparency and better applicability. The R package MSDBE is available at https://sites.google.com/site/modsdbe/ . Copyright © 2015 John Wiley & Sons, Ltd.     

Minimum breakdown designs in blocks of size two

In scientific investigations, there are many situations where each two experimental units have to be grouped into a block of size two. For planning such experiments, the variance-based optimality criteria like A-, D- and E-criterion are typically employed to choose efficient designs, if the estimation efficiency of treatment contrasts is primarily concerned. Alternatively, if there are observations which tend to become lost during the experimental period, the robustness criteria against the unavailability of data should be strongly recommended for selecting the planning scheme. In this study, a new criterion, called minimum breakdown criterion, is proposed to quantify the robustness of designs in blocks of size two. Based on the proposed criterion, a new class of robust designs, called minimum breakdown designs, is defined. When various numbers of blocks are missing, the minimum breakdown designs provide the highest probabilities that all the treatment contrasts are estimable. An exhaustive search procedure is proposed to generate such designs. In addition, two classes of uniformly minimum breakdown designs are theoretically verified.     

On optimality properties of simple block designs in the approximate design theory

Optimality properties of approximate block designs are studied under variations of (1) the class of competing designs, (2) the optimality criterion, (3) the parametric function of interest, and (4) the statistical model. The designs which are optimal turn out to be the product of their treatment and block marginals, and uniform designs when the support is specified in advance. Optimality here means uniform, universal, and simultaneous j_p-optimality. The classical balanced incomplete block designs are embedded into this approach, and shown to be simultaneously j_p-optimal for a maximal system of identifiable parameters. A geometric account of universal optimality is given which applies beyond the context of block designs.     

Error variance bias in neighbour balance and evenness of distribution designs

Neighbour balance and evenness of distribution designs help to address user concerns in the two‐dimensional layout of agricultural field trials. This is done by minimising the occurrence of pairwise treatment plot neighbours and ensuring that the replications of treatments are spread out across rows and columns of a trial. Such considerations result in a restriction on the normal randomisation process for a row‐column design which can lead to error variance bias. In this paper, uniformity trial data is used to assess the degree of this bias for both resolvable and non‐resolvable designs. Comparisons are made with a similar investigation using Linear Variance spatial designs.     

On the recovery of intra- and interblock information in n-ary designs

This note presents an extension of Q-method of analysis for binary designs given by Rao (1956) to n-ary balanced and partially balanced block designs. Here a linked n-ary block (LNB) design is defined as the dual of balanced n-ary (BN) design. Having a note on Yates’ (1939, 1940) method of P-analysis, we further extend the expressions for binary linked block (LB) designs given by Rao (1956) to linked n-ary block (LNB) designs which admit easy estimation of parameters for these type of all n-ary designs.     

A new look on optimal foldover plans in terms of uniformity criteria

In this paper, we develop a new mechanism for finding the optimal foldover plans (OFPs) which is based on the uniformity criteria measured by Lee discrepancy, wrap-around L₂-discrepancy, and centered L₂-discrepancy. For three-level fractional factorials as the original designs, general foldover plans and combined designs are defined, and lower bounds of these three discrepancies of combined designs under general foldover plans are also obtained, which can be used as benchmarks for searching OFPs. Illustrative examples with a comparison study between the foldover plans under these discrepancies are provided. Our results provide a theoretical justification for OFPs of three-level designs in terms of uniformity criteria.     

The robustness of response surface designs with errors in factor levels

ABSRTACT

Since errors in factor levels affect the traditional statistical properties of response surface designs, an important question to consider is robustness of design to errors. However, when the actual design could be observed in the experimental settings, its optimality and prediction are of interest. Various numerical and graphical methods are useful tools for understanding the behavior of the designs. The D- and G-efficiencies and the fraction of design space plot are adapted to assess second-order response surface designs where the predictor variables are disturbed by a random error. Our study shows that the D-efficiencies of the competing designs are considerably low for big variance of the error, while the G-efficiencies are quite good. Fraction of design space plots display the distribution of the scaled prediction variance through the design space with and without errors in factor levels. The robustness of experimental designs against factor errors is explored through comparative study. The construction and use of the D- and G-efficiencies and the fraction of design space plots are demonstrated with several examples of different designs with errors.