Interpretation of the four types of analysis of variance tables in sas

Various computational methods exist for generating sums of squares in an analysis of variance table. When the ANOVA design is balanced, most of these computational methods will produce equivalent sums of squares for testing the significance of the ANOVA model parameters. However, when the design is unbalanced, as is frequently the case in practice, these sums of squares depend on the computational method used.- The basic reason for the difference in these sums of squares is that different hypotheses are being tested. The purpose of this paper is to describe these hypotheses in terms of population or cell means. A numerical example is given for the two factor model with interaction. The hypotheses that are tested by the four computational methods of the SAS general linear model procedure are specified.

Although the ultimate choice of hypotheses should be made by the researcher before conducting the experiment, this paper

PENDLETON,VON TRESS,AND BREMER

presents the following guidelines in selecting these hypotheses:

When the design is balanced, all of the SAS procedures will agree.

In unbalanced ANOVA designs when there are no missing cells. SAS Type III should be used. SAS Type III tests an unweighted hypothesis about cell means. SAS Types I and II test hypotheses that are functions of the ceil frequencies. These frequencies are often merely arti¬facts of the experimental process and not reflective of any underlying frequencies in the population.

When there are missing cells, i.e. no observations for some factor level combinations. Type IV should be used with caution. SAS Type IV tests hypotheses which depend     

On the role of minque in testing of hypotheses under hiked linear models

Testing of hypotheses under balanced ANOVA models is fairly simple and generally based on the usual ANOVA sums of squares. Difficulties may arise in special cases when these sums of squares do not form a complete sufficient statistic. There is a huge literature on this subject which was recently surveyed in Seifert's contribution to the book of Mumak (1904). But there are only a few results about unbalanced models. In such models the consideration of likelihood ratios leads to more complex sums of squares known from MINQUE theory.

Uniform optimality of testsusually reduces to local optimality. Here we prespnt a small review of methods proposed for testing of hypotheses in unbalanced models. where MINQUEI playb a major role. We discuss the use of iterated MINQUE for the construction of asymptotically optimal tests described in Humak (1984) and approximate tests based on locally uncorrelated linear combinations of MINQUE estimators by Seifert (1985), We show that the latter tests coincide with robust locally optimal invariant tests proposeci by Kariya and Sinha and Das and Sinha, if the number of variance components is two. Explicit expressions for corresponding tests are given for the unbalanced two-way cross classification random model, which covers some other models as special cases. A simulation study under lines the relevance of MINQUE for testing of hypotheses problems.     

Resolving Current Controversies in Analysis of Variance

Definition of effects and calculation of sums of squares for various tests of hypotheses in unbalanced analysis of variance has been a topic of considerable interest for at least 10 years. Conceptually, these concerns apply to balanced cases as well. It is suggested that proceeding logically from highest-order effects to lowest-order effects in a careful fashion helps to resolve the difficulties pointed out by various writers, including those concerned about completely missing cells.     

On unweighted sums of squares in unbalanced analysis of variance

The well-known method of unweighted sums of squares (USSs) is examined using, as an example, a random two-way classification model with interaction. In particular, a better motivation is given to the association between the harmonic mean of the cell frequencies and the USSs. Furthermore, a procedure is developed for determining the adequacy of the USSs as approximate balanced analysis of variance (ANOVA) sums of squares. This procedure is easy to apply and provides a better insight into the effects of design and model’s variance components on such an approximation. The proposed methodology can be extended to higher-order models and other types of sums of squares.     

ANOVA for unbalanced data: Use Type II instead of Type III sums of squares

Methods for analyzing unbalanced factorial designs can be traced back to Yates (1934). Today, most major statistical programs perform, by default, unbalanced ANOVA based on Type III sums of squares (Yates's weighted squares of means). As criticized by Nelder and Lane (1995), this analysis is founded on unrealistic models—models with interactions, but without all corresponding main effects. The Type II analysis (Yates's method of fitting constants) is usually not preferred because of the underlying assumption of no interactions. This argument is, however, also founded on unrealistic models. Furthermore, by considering the power of the two methods, it is clear that Type II is preferable.     

Generalized staggered nested designs for variance components estimation

Staggered nested experimental designs are the most popular class of unbalanced nested designs in practical fields. The most important features of the staggered nested design are that it has a very simple open-ended structure and each sum of squares in the analysis of variance has almost the same degrees of freedom. Based on the features, a class of unbalanced nested designs that is a generalization of the staggered nested design is proposed in this paper. Formulae for the estimation of variance components and their sums are provided. Comparing the variances of the estimators to the staggered nested designs, it is found that some of the generalized staggered nested designs are more efficient than the traditional staggered nested design in estimating some of the variance components and their sums. An example is provided for illustration.     

The present status of confidence interval estimation on variance components in balanced and unbalanced random models

Much research has been conducted to develop confidence Intervals on linear combinations and ratios of variance components in balanced and unbalanced random models.This paper first presents confidence intervals on functions of variance components in balanced designs.These results assume that classical analysis of variance sums of squares are independent and have exact scaled chi-squared distributions.In unbalanced designs, either one or both of these assumptions are violated, and modifications to the balanced model intervals are required.We report results of some recent work that examines various modifications for some particular unbalanced designs.     

Statistical inference on partial linear additive models with distortion measurement errors

We consider statistical inference for partial linear additive models (PLAMs) when the linear covariates are measured with errors and distorted by unknown functions of commonly observable confounding variables. A semiparametric profile least squares estimation procedure is proposed to estimate unknown parameter under unrestricted and restricted conditions. Asymptotic properties for the estimators are established. To test a hypothesis on the parametric components, a test statistic based on the difference between the residual sums of squares under the null and alternative hypotheses is proposed, and we further show that its limiting distribution is a weighted sum of independent standard chi-squared distributions. A bootstrap procedure is further proposed to calculate critical values. Simulation studies are conducted to demonstrate the performance of the proposed procedure and a real example is analyzed for an illustration.     

A Weighted Least Squares Approach to Levene's Test of Homogeneity of Variance

In 1960 Levene suggested a potentially robust test of homogeneity of variance based on an ordinary least squares analysis of variance of the absolute values of mean-based residuals. Levene's test has since been shown to have inflated levels of significance when based on the F-distribution, and tests a hypothesis other than homogeneity of variance when treatments are unequally replicated, but the incorrect formulation is now standard output in several statistical packages. This paper develops a weighted least squares analysis of variance of the absolute values of both mean-based and median-based residuals. It shows how to adjust the residuals so that tests using the F -statistic focus on homogeneity of variance for both balanced and unbalanced designs. It shows how to modify the F -statistics currently produced by statistical packages so that the distribution of the resultant test statistic is closer to an F-distribution than is currently the case. The weighted least squares approach also produces component mean squares that are unbiased irrespective of which variable is used in Levene's test. To complete this aspect of the investigation the paper derives exact second-order moments of the component sums of squares used in the calculation of the mean-based test statistic. It shows that, for large samples, both ordinary and weighted least squares test statistics are equivalent; however they are over-dispersed compared to an F variable.     

A Test for Slope Heterogeneity in Fixed Effects Models

Typical panel data models make use of the assumption that the regression parameters are the same for each individual cross-sectional unit. We propose tests for slope heterogeneity in panel data models. Our tests are based on the conditional Gaussian likelihood function in order to avoid the incidental parameters problem induced by the inclusion of individual fixed effects for each cross-sectional unit. We derive the Conditional Lagrange Multiplier test that is valid in cases where N → ∞ and T is fixed. The test applies to both balanced and unbalanced panels. We expand the test to account for general heteroskedasticity where each cross-sectional unit has its own form of heteroskedasticity. The modification is possible if T is large enough to estimate regression coefficients for each cross-sectional unit by using the MINQUE unbiased estimator for regression variances under heteroskedasticity. All versions of the test have a standard Normal distribution under general assumptions on the error distribution as N → ∞. A Monte Carlo experiment shows that the test has very good size properties under all specifications considered, including heteroskedastic errors. In addition, power of our test is very good relative to existing tests, particularly when T is not large.     

Nonparametric rank-based test procedures for non-additive models in the two-way layout I. no replications

One of the major unresolved problems in the area of nonparametric statistics is the need for satisfactory rank-based test procedures for non-additive models in the two-way layout, especially when there is only one observation on each combination of the levels of the experimental factors. In this paper we consider an arbitrary non-additive model for the two-way layout with n levels of each factor. We utilize both alignment and ranking of the data together with basic properties of Latin squares to develop rank tests for interaction (non-additivity). Our technique involves first aligning within one of the main effects, ranking within the other main effects (columns and rows) and then adding the resulting ranks within “interaction bands” corresponding to orthogonal partitions of the interaction for the model, as denoted by the letters of an n × n Latin square. A Friedman-type statistic is then computed on the resulting sums. This is repeated for each of (n?1) mutually orthogonal Latin squares (thus accounting for all the interaction degrees of freedom). The resulting (n?1) Friedman-type statistics are finally combined to obtain an overall test statistic. The necessary null distribution tables for applying the proposed test for non-additivity are presented and we discuss the results of a Monte Carlo simulation study of the relative powers of this new procedure and other (parametric and nonparametric) procedures designed to detect interaction in a two-way layout with one observation per cell.     

Sweeping,alignment and the analysis of unbalanced data

The terms sweeping and alignment refer to the same process. Sweeping/alignment is used by data analysts as a technique for describing the effects of a model factor (e.g., treatments in a randomized block design) after the effects of nuisance parameters (e.g., blocks) have been removed from the data. In this paper sweeping/alignment is used as the basis for developing tests of factors in unbalanced experimental design models. Formulas are presented for treatment effects in randomized block designs with missing observations, and for interaction and main effects in unbalanced two-way factorial designs with empty cells.     

New Section on Social Statistics

The analysis of a general k-factor factorial experiment having unequal numbers of observations per cell is complex. For the special case of a 2 ^k experiment with unequal numbers of observations per cell, the method of unweighted means provides a simple vehicle for analysis that requires no matrix inversion and can be used with existing software programs for the analysis of balanced data. All numerator sums of squares for testing main effects and interactions are χ² with one degree of freedom. In addition, for tests having one degree of freedom in any factorial experiment, the method of unweighted means may be modified to yield exact tests.     

Statistical inference for restricted partially linear varying coefficient errors-in-variables models

As a useful extension of partially linear models and varying coefficient models, the partially linear varying coefficient model is useful in statistical modelling. This paper considers statistical inference for the semiparametric model when the covariates in the linear part are measured with additive error and some additional linear restrictions on the parametric component are available. We propose a restricted modified profile least-squares estimator for the parametric component, and prove the asymptotic normality of the proposed estimator. To test hypotheses on the parametric component, we propose a test statistic based on the difference between the corrected residual sums of squares under the null and alterative hypotheses, and show that its limiting distribution is a weighted sum of independent chi-square distributions. We also develop an adjusted test statistic, which has an asymptotically standard chi-squared distribution. Some simulation studies are conducted to illustrate our approaches.     

Improved bonferroni procedures for testing overall and pairwise homogeneity hypotheses

Simes' (1986) improved Bonferroni test is verified by simulations ^?to control the α-level when testing the overall homogeneity hypothesis with all pairwise t statistics in a balanced parallel group design. Similarly, this result was found to hold (for practical purposes) in various underlying distributions other than the normal and in some unbalanced designs. To allow the use of step-up procedures based on pairwise t statistics, simulations were used to verify that Simes' test, when applied to testing multiple subset homogeneity hypotheses with pairwise t statistics also keeps the level ? α. Some robustness as above was found here too. Tables of the simulation results are provided and an example of a step-up Hommel-Shaffer type procedure with pairwise comparisons is given.     

Confidence intervals on the intraclass correlation in the unbalanced one-way classification

Several methods are compared for constructing confidence intervals on the intraclass correlation coefficient in the unbalanced one-way classification. The results suggest that a conservative approximation of the exact procedure developed by Wald (1940) can be used for hand calculations, When the exact solution is desired, a solution procedure is recommended that is computationally convenient and allows the investigator to determine the precision of the estimate. In cases where a prior estimate of the correlation is available, researchers may select intervals based on either the analysis of variance or unweighted sums of squares estimator.     

A nonparametric procedure for the analysis of balanced crossover designs

The authors propose nonparametric tests for the hypothesis of no direct treatment effects, as well as for the hypothesis of no carryover effects, for balanced crossover designs in which the number of treatments equals the number of periods p, where p ≥ 3. They suppose that the design consists of n replications of balanced crossover designs, each formed by m Latin squares of order p. Their tests are permutation tests which are based on the n vectors of least squares estimators of the parameters of interest obtained from the n replications of the experiment. They obtain both the exact and limiting distribution of the test statistics, and they show that the tests have, asymptotically, the same power as the F‐ratio test.     

On the distributions of components sums of squares in one-way unbalanced random model under heter06ene0us error variances

Exact sampling distributions of sums of squares in the unbalanced one-way random model are obtained under heterogeneous error variances. These distributions are used to investigate the effect of heteroscedasticity and unbalancedness on the probability of negative estimate of the group variance component. The computed results reveal that heteroscedasticity affects the probability of negative estimate in all situations of group sizes. Further, the probability decreases with heterogeneity of error variances for balanced situations and increases with variability among group size for equal error variances case.     

The analysis of non-orthogonal designs with many classifications

The least squares analysis of non-orthogonal designs with many classifications is considered. A unified simpler approach than the existing methods is derived and simple expressions for the various sums of squares are given. The paper also generalizes the canonical forms of Pearce Jeffers (1971) for the adjusted treatment sum of squares and the error sum of squares in block designs to designs with several non-orthogonal classifications.     

Kronecker Products in ANOVA—A First Step

In the complete balanced model for the analysis of variance, the equivalence of sums of squares and quadratic forms is seen to imply well-fitting patterns involving Kronecker products of identity matrices and scalar multiples of matrices with all elements equal to 1. The questions of symmetry, idempotency, and orthogonality so central to this topic are answered by simple multiplications; ranks are determined from simple traces. The associations between the forms of the two-factor model are presented here in a way that is accessible to first-year students and makes generalizations to higher order models transparent. The lack of patterns in incomplete or unbalanced models is noted. Additional steps in design and analysis are suggested in the references.