Non-orthogonal designs for measuring dispersion effects in sequential factor screening experiments using search linear models

“Dispersion” effects are considered in addition to “Location” effects of factors in the inferential procedure of sequential factor screening experiments with m factors each at two levels under search linear models. Search designs in measuring "Dispersion" and "Location" effects of factors are presented for both stage one and stage two of factor screening experiments with 4 ≤ m ≤ 10.     

Estimates for mean and dispersion effects in unreplicated factorial designs

One important goal of experimentation in quality improvement is to minimize the variability of a product or process around a target mean value. Factors which affect variances as well as factors that affect the mean can be identified using the analysis of mean and dispersion. Box and Meyer (1986b) proposed a method of model identification and maximum likelihood estimation for mean and dispersion effects from unreplicated designs. In this article, we address two problems associated with MLE’s. First, asymptotic variance of MLE's for dispersion effects which can be used to judge the significance of factors can be misleading. A possible explanation is provided; simulation results also indicate that the asymptotic, variance underestimates.     

On the equivalence of three estimators for dispersion effects in unreplicated two-level factorial designs

Box and Meyer [1986. Dispersion effects from fractional designs. Technometrics 28(1), 19–27] were the first to consider identifying both location and dispersion effects from unreplicated two-level fractional factorial designs. Since the publication of their paper a number of different procedures (both iterative and non-iterative) have been proposed for estimating the location and dispersion effects. An overview and a critical analysis of most of these procedures is given by Brenneman and Nair [2001. Methods for identifying dispersion effects in unreplicated factorial experiments: a critical analysis and proposed strategies. Technometrics 43(4), 388–405]. Under a linear structure for the dispersion effects, non-iterative estimation methods for the dispersion effects were proposed by Brenneman and Nair [2001. Methods for identifying dispersion effects in unreplicated factorial experiments: a critical analysis and proposed strategies. Technometrics 43(4), 388–405], Liao and Iyer [2000. Optimal 2^n-p$2^{n-p}$ fractional factorial designs for dispersion effects under a location-dispersion model. Comm. Statist. Theory Methods 29(4), 823–835] and Wiklander [1998. A comparison of two estimators of dispersion effects. Comm. Statist. Theory Methods 27(4), 905–923] (see also Wiklander and Holm [2003. Dispersion effects in unreplicated factorial designs. Appl. Stochastic. Models Bus. Ind. 19(1), 13–30]). We prove that for two-level factorial designs the proposed estimators are different representations of a single estimator. The proof uses the framework of Seely [1970a. Linear spaces and unbiased estimation. Ann. Math. Statist. 41, 1725–1734], in which quadratic estimators are expressed as inner products of symmetric matrices.     

Generalized linear models for the analysis of quality-improvement experiments

Generalized linear models provide a useful tool for analyzing data from quality-improvement experiments. We discuss why analysis must be done for all the data, not just for summarizing quantities, and show by examples how residuals can be used for model checking. A restricted-maximum-likelihood-type adjustment for the dispersion analysis is developed.     

Designs for two-level factorial experiments with linear models containing main effects and selected two-factor interactions

An orthogonal polynomial model is used to model the response influenced by n two level factors. Such a model is represented by an undirected graph g with n vertices and e edges. The vertices identify the n main effects and the e edges identify the two-factor interactions of interest which together with the mean are the parameters of interest. A g-design is a saturated design which can provide an unbiased estimator for these parameters and its design matrix is called a g-matrix. The latter two concepts were introduced by Hedayat and Pesotan (Statistica Sinica 2 (1992), 453–464). In this paper methods of constructing g-matrices are studied since such constructions are equivalent to the construction of g-designs. Some bounds on the absolute value of a determinant of a g-matrix are given and D-optimality results on certain classes of g-matrices are presented.     

Generalized linear mixed models for ordered responses in complex multilevel structures: effects beneath the school or college in education

Summary.  The complexities of educational processes and structure and the need for disentangling effects beneath the level of the school or college are discussed. Ordinal response multilevel crossed random-effects models for educational grades are introduced. Weighted random effects for teacher contributions are then added. Estimation methodology is reviewed. Specially written macros for quasi-likelihood with second-order terms are described. The application discusses General Certificate of Education at advanced level grades cross-classified by student and teaching group within a number of institutions. The methods handle teacher effects where several teachers contribute to provision and where each teacher deals with several groups. Some methodological lessons are drawn for sparse data and the use of extra-multinomial variation. Developments of the analysis yield conclusions about the sources of variation in educational progress, and particularly the effect of teachers.     

A note on the selection of optimal foldover plans for 16- and 32-run fractional factorial designs

The minimum aberration criterion has been advocated for ranking foldovers of 2^k−p$2^{k-p}$ fractional factorial designs (Li and Lin, 2003); however, a minimum aberration design may not maximize the number of clear low-order effects. We propose using foldover plans that sequentially maximize the number of clear low-order effects in the combined (initial plus foldover) design and investigate the extent to which these foldover plans differ from those that are optimal under the minimum aberration criterion. A small catalog is provided to summarize the results.     

Random effects in generalized linear models and the em algoritham

Nelder and Wedderburn (1972) gave a practical fitting procedure that encompassed a more gencral family of data distributions than the Gaussian distribution and provided an easily understood conceptual framework. In extending the framework to more than one error structure the technical difficulties of the fitting procedure have tended to cloud the concepts. Here we show that a simple extension to the fitting procedure is possible and thus pave the way for a fuller examimtion of mixed effects models in generalized linear model distributions. It is clear that we should not, and do not have to, confine ourselves to fitting random effects using the Gaussian distribiition. In addition, in, some quite general mixing distribution problems the application of the EM algorithm to the complete data likelihood leads to iterative schemes that maximize the marginal likelihood of the observed data variable.     

Interpretation of dispersion effects in a robust design context

The purpose of this paper is to discuss the interpretation of dispersion effects in un-replicated fractional factorials from a robust design perspective. We propose an interpretation of dispersion effects as manifested interactions between control factors and unobserved and uncontrolled factors, an interpretation shown to be useful in achieving robust designs. Further, we show the consequences this interpretation has on the identification of dispersion effects.     

Determination of optimum experimental conditions using dispersion main effects and interactions of factors in replicated factorial experiments

Dispersion main effects and two-factor interactions are first defined and then estimated in replicated factorial experiments. A method based on Union-Intersection rules, using dispersion main effects and two factor interactions is proposed for finding the level combinations of control factors so that the response variability due to noise is minimum. Illustrative examples are also given.     

Generalized linear models with random effects in the two-parameter exponential family

In this paper, we develop a new class of double generalized linear models, introducing a random-effect component in the link function describing the linear predictor related to the precision parameter. This is a useful procedure to take into account extra variability and also to make the model more robust. The Bayesian paradigm is adopted to make inference in this class of models. Samples of the joint posterior distribution are drawn using standard Monte Carlo Markov Chain procedures. Finally, we illustrate this algorithm by considering simulated and real data sets.     

Semi-empirical pseudo-likelihood for estimating equations in the presence of missing responses

Consider a semiparametric model which parameterizes only the conditional distribution of Y given X, f(y|x,β), and allows the marginal distribution of X to be completely arbitrary. Under the semiparametric model, we develop semi-empirical pseudo-likelihood inference with estimating equation in the presence of missing responses. We define semi-empirical likelihood pseudo-score estimates for both the model parameter and the parameter in the estimating equation simultaneously. Also, we develop semi-empirical pseudo-likelihood ratio inference for them, respectively. A simulation was conducted to evaluate the finite sample properties of the proposed estimators and semi-empirical pseudo-likelihood approach.     

Checking identifiability of covariance parameters in linear mixed effects models

To build a linear mixed effects model, one needs to specify the random effects and often the associated parametrized covariance matrix structure. Inappropriate specification of the structures can result in the covariance parameters of the model not identifiable. Non-identifiability can result in extraordinary wide confidence intervals, and unreliable parameter inference. Sometimes software produces implication of model non-identifiability, but not always. In the simulation of fitting non-identifiable models we tried, about half of the times the software output did not look abnormal. We derive necessary and sufficient conditions of covariance parameters identifiability which does not require any prior model fitting. The results are easy to implement and are applicable to commonly used covariance matrix structures.     

Score test for homogeneity of dispersion in generalized Poisson mixed models with excess zeros

In many applications, the clustered count data often contain excess zeros and the zero-inflated generalized Poisson mixed (ZIGPM) regression model may be suitable. However, dispersion in ZIGPM is often treated as fixed unknown parameter, and this assumption may be not appropriate in some situations. In this article, a score test for homogeneity of dispersion parameter in ZIGPM regression model is developed and corresponding test statistic is obtained. Sampling distribution and power of the score test statistic are investigated through Monte Carlo simulation. Finally, results from a biological example illustrate the usefulness of the diagnostic statistic.     

Testing for departures from nominal dispersion in generalized nonlinear models with varying dispersion and/or additive random effects

This paper discusses the tests for departures from nominal dispersion in the framework of generalized nonlinear models with varying dispersion and/or additive random effects. We consider two classes of exponential family distributions. The first is discrete exponential family distributions, such as Poisson, binomial, and negative binomial distributions. The second is continuous exponential family distributions, such as normal, gamma, and inverse Gaussian distributions. Correspondingly, we develop a unifying approach and propose several tests for testing for departures from nominal dispersion in two classes of generalized nonlinear models. The score test statistics are constructed and expressed in simple, easy to use, matrix formulas, so that the tests can easily be implemented using existing statistical software. The properties of test statistics are investigated through Monte Carlo simulations.     

Posterior consistency in frailty models and simulation studies to test the presence of random effects

The estimation of random effects in frailty models is an important problem in survival analysis. Testing for the presence of random effects can be essential to improving model efficiency. Posterior consistency in dispersion parameters and coefficients of the frailty model was demonstrated in theory and simulations using the posterior induced by Cox’s partial likelihood and simple priors. We also conducted simulation studies to test for the presence of random effects; the proposed method performed well in several simulations. Data analysis was also conducted. The proposed method is easily tractable and can be used to develop various methods for Bayesian inference in frailty models.     

Kernel-based global MLE of partial linear random effects models for longitudinal data

Random effects models have been playing a critical role for modelling longitudinal data. However, there are little studies on the kernel-based maximum likelihood method for semiparametric random effects models. In this paper, based on kernel and likelihood methods, we propose a pooled global maximum likelihood method for the partial linear random effects models. The pooled global maximum likelihood method employs the local approximations of the nonparametric function at a group of grid points simultaneously, instead of one point. Gaussian quadrature is used to approximate the integration of likelihood with respect to random effects. The asymptotic properties of the proposed estimators are rigorously studied. Simulation studies are conducted to demonstrate the performance of the proposed approach. We also apply the proposed method to analyse correlated medical costs in the Medical Expenditure Panel Survey data set.     

Effect of adding regressors on the equality of the BLUEs under two linear models

In this paper we consider the estimation of regression coefficients in two partitioned linear models, shortly denoted as , and , which differ only in their covariance matrices. We call and full models, and correspondingly, and small models. We give a necessary and sufficient condition for the equality between the best linear unbiased estimators (BLUEs) of X₁β₁ under and . In particular, we consider the equality of the BLUEs under the full models assuming that they are equal under the small models.     

Bias‐reduced marginal Akaike information criteria based on a Monte Carlo method for linear mixed‐effects models

In linear mixed‐effects (LME) models, if a fitted model has more random‐effect terms than the true model, a regularity condition required in the asymptotic theory may not hold. In such cases, the marginal Akaike information criterion (AIC) is positively biased for (?2) times the expected log‐likelihood. The asymptotic bias of the maximum log‐likelihood as an estimator of the expected log‐likelihood is evaluated for LME models with balanced design in the context of parameter‐constrained models. Moreover, bias‐reduced marginal AICs for LME models based on a Monte Carlo method are proposed. The performance of the proposed criteria is compared with existing criteria by using example data and by a simulation study. It was found that the bias of the proposed criteria was smaller than that of the existing marginal AIC when a larger model was fitted and that the probability of choosing a smaller model incorrectly was decreased.     

On quasi‐likelihood inference in generalized linear mixed models with two components of dispersion

The authors propose a quasi‐likelihood approach analogous to two‐way analysis of variance for the estimation of the parameters of generalized linear mixed models with two components of dispersion. They discuss both the asymptotic and small‐sample behaviour of their estimators, and illustrate their use with salamander mating data.