Generalized staggered nested designs for variance components estimation

Staggered nested experimental designs are the most popular class of unbalanced nested designs in practical fields. The most important features of the staggered nested design are that it has a very simple open-ended structure and each sum of squares in the analysis of variance has almost the same degrees of freedom. Based on the features, a class of unbalanced nested designs that is a generalization of the staggered nested design is proposed in this paper. Formulae for the estimation of variance components and their sums are provided. Comparing the variances of the estimators to the staggered nested designs, it is found that some of the generalized staggered nested designs are more efficient than the traditional staggered nested design in estimating some of the variance components and their sums. An example is provided for illustration.     

On invariant quadratic unbiased estimation of variance components

The present study deals with three different invarint quadratic unbiased estimators (IQUE) for variance components namely quadratic least squares estimators (QLSE), weighted quadratic least squares estimators (WQLSE) and Mitra type estimators (MTE). The variance and covariances of these three different estimators are presented for unbalanced one-way random model. The relative performances of these estimators are assessed based on different optimality criteria like, D-optimality, T-optimality and M-optimality together with variances of these estimators. As a result, it has been shown that MTE has optimal properties.     

Improved estimation of variance components in balanced hierarchical mixed models

The problem of simultaneous estimation of variance components is considered for a balanced hierarchical mixed model under a sum of squared error loss. A new class of estimators is suggested which dominate the usual sensible estimators. These estimators shrink towards the geometric mean of the component mean squares that appear in the ANOVA table. Numerical results are tabled to exhibit the improvement in risk under a simple model.     

A new approach to variance component estimation with diagnostic implications

Closed form expressions are developed for the estimators of functions of the variance components in balanced, mixed, linear models. These estimators are averages of sample covariances (variances) which offer diagnostic information on the data and the model. The cause of negative estimates may be revealed. Examples illustrate the basic concepts.     

Comparison of designs for the three-fold nested random model

The quality of estimation of variance components depends on the design used as well as on the unknown values of the variance components. In this article, three designs are compared, namely, the balanced, staggered, and inverted nested designs for the three-fold nested random model. The comparison is based on the so-called quantile dispersion graphs using analysis of variance (ANOVA) and maximum likelihood (ML) estimates of the variance components. It is demonstrated that the staggered nested design gives more stable estimates of the variance component for the highest nesting factor than the balanced design. The reverse, however, is true in case of lower nested factors. A comparison between ANOVA and ML estimation of the variance components is also made using each of the aforementioned designs.     

Generalized and oxdinary least squakes with estimated and unequal variances

An assumption which is often violated in the application of experimental designs is equality of variances. There are several methods available for estimating the unequal variances. This paper covers incorporating different estimators of the variances with the ordinary least squares and generalized least squares. A Monte Carlo study provides more insight into the behavior of these procedures. For some small sample sizes, the incorporations with the ordinary least squares perform satisfactorily, but with the generalized least squares they do not.     

On the unbiased estimation of fixed effects in a mixed model for growth curves

A mixed model for growth curves is introduced. A method of estimating the variance components is indicated. It is shown that the generalised least squares estimates of the fixed effects using estimates of variance components are unbiased and an expression is obtained for the increase in variance due to the substitution of the variances by their estimates. These results are directly applied to designs with two-way elimination of heterogeneity.     

Interval estimation of the mean in a two-stage nested model

The problem of constructing confidence intervals to estimate the mean in a two-stage nested model is considered. Several approximate intervals, which are based on both linear and nonlinear estimators of the mean are investigated. In particular, the method of bootstrap is used to correct the bias in the ‘usual’ variance of the nonlinear estimators. It is found that the intervals based on the nonlinear estimators did not achieve the nominal confidence coefficient for designs involving a small number of groups. Further, it turns out that the intervals are generally conservative, especially at small values of the intraclass correlation coefficient, and that the intervals based on the nonlinear estimators are more conservative than those based on the linear estimators. Compared with the others, the intervals based on the unweighted mean of the group means performed well in terms of coverage and length. For small values of the intraclass correlation coefficient, the ANOVA estimators of the variance components are recommended, otherwise the unweighted means estimator of the between groups variance component should be used. If one is fortunate enough to have control over the design, he is advised to increase the number of groups, as opposed to increasing group sizes, while avoiding groups of size one or two.     

Does sequential augmenting of simple linear heteroscedastic regression reduce variances of ordinary least-squares estimators?

If uncorrelated random variables have a common expected value and decreasing variances, then the variance of a sample mean is decreasing with the number of observations. Unfortunately, this natural and desirable variance reduction property (VRP) by augmenting data is not automatically inherited by ordinary least-squares (OLS) estimators of parameters. We derive a new decomposition for updating the covariance matrices of the OLS which implies conditions for the OLS to have the VRP. In particular, in the case of a straight-line regression, we show that the OLS estimators of intercept and slope have the VRP if the values of the explanatory variable are increasing. This also holds true for alternating two-point experimental designs.     

Variance component estimation in multiple regression models having a nested error structure

Multiple regression when regressors are measured on two different sized experimental units involves a nested error structure. This nested error structure consists of two variance components. Sufficient conditions are presented under which UMVU estimators of these variance components exist. When these conditions are not met, two alternative estimators for the two variance components are considered and compared when possible.

This paper considers multiple regression models when regressor variables are associated with different sized experimental units resulting in a nested error structure. Nested error structures occur because of restrictions placed on randomizations. This results in experiments similar to splitplot type experiments which involove two different sizes of experimental units. Data resulting from these type of experiments consists of measurements made on larger sized experimental units as well as measurements made on smaller sized experimental units. Split-plot type experiments occur when certain combinations of the treatment factors are randomly assigned to larger sized experimental units after which these units are split or divided and other combinations of the treatment factors are randomly assigned to the split units.     

The three-fold nested random effects model

Estimation of the variance components and the mean of the balanced and unbalanced threefold nested design is considered. The relative merits of the following procedures are evaluated: Analysis of variance (ANOVA), maximum likelihood (ML), restricted maximum likelihood (REML), and minimum variance quadratic unbiased estimator (MIVQUE). A new procedure called the weighted analysis of means (WAM) estimator which utilizes prior information on the variance components is proposed. It is found to have optimum properties similar to the REML and MIVQUE, and it is also computationally simpler. For the mean, the overall sample average, grand mean, unweighted mean, and generalized least-squares (GLS) estimator with its weights obtained from the above estimators for the variance components are considered. Comparisons of the above procedures for the variance components and the mean are made from exact expressions for the biases and mean square errors (MSEs) of the estimators and from empirical investigations.     

Optimal domain estimation under summation restriction

The domain estimators that do not sum up to the population total (estimated or known) are considered. In order to achieve their additivity, the theory of the general restriction (GR)-estimator [Knottnerus P., 2003. Sample Survey Theory: Some Pythagorean Perspectives. Springer, New York] is used. The elaborated domain GR-estimators are optimal, they have the minimum variance in a class of estimators that satisfy summation restriction. Furthermore, their variances are smaller than the variances of the corresponding initial domain estimators. The variance/covariance formulae of the domain GR-estimators are explicitly given.The ratio estimators as representatives of the non-additive domain estimators are considered. Their design-based covariance matrix, being crucial for the GR-estimator, is presented. Its structure simplifies under certain assumptions on sampling design (and population model). The corresponding simpler forms of the domain GR-estimators are elaborated as well. The hypergeometric [Traat I., Ilves M., 2007. The hypergeometric sampling design, theory and practice. Acta Appl. Math. 97, 311–321] and the simple random sampling designs are considered in more detail. The results are illustrated in a simulation study where the optimal domain estimator displays its superiority among other meaningful domain estimators. It is noteworthy that due to the imposed restrictions also these other estimators, though not optimal, can be much more precise than the initial estimators.     

Semiparametric statistical inferences for longitudinal data with nonparametric covariance modelling

In this paper, semiparametric modelling for longitudinal data with an unstructured error process is considered. We propose a partially linear additive regression model for longitudinal data in which within-subject variances and covariances of the error process are described by unknown univariate and bivariate functions, respectively. We provide an estimating approach in which polynomial splines are used to approximate the additive nonparametric components and the within-subject variance and covariance functions are estimated nonparametrically. Both the asymptotic normality of the resulting parametric component estimators and optimal convergence rate of the resulting nonparametric component estimators are established. In addition, we develop a variable selection procedure to identify significant parametric and nonparametric components simultaneously. We show that the proposed SCAD penalty-based estimators of non-zero components have an oracle property. Some simulation studies are conducted to examine the finite-sample performance of the proposed estimation and variable selection procedures. A real data set is also analysed to demonstrate the usefulness of the proposed method.     

A Note on the Canonical Correlations From Contingency Tables

Explicit formulae are obtained for the asymptotic variances and covariances of canonical correlations which correspond to non-zero theoretical correlations in (p+ 1) x (q+1) contingency tables, with p≤q. The moments of the roots of a central Wishart matrix distributed as Wp(q; I ) are also given in general, with means, variances and covariances tabulated for p= 2, 3, 4: these may apply to canonical correlations corresponding to zeros.     

Asymptotic distributions of functions of a sample covariance matrix under the elliptical distribution

This paper is concerned with asymptotic distributions of functions of a sample covariance matrix under the elliptical model. Simple but useful formulae for calculating asymptotic variances and covariances of the functions are derived. Also, an asymptotic expansion formula for the expectation of a function of a sample covariance matrix is derived; it is given up to the second-order term with respect to the inverse of the sample size. Two examples are given: one of calculating the asymptotic variances and covariances of the stepdown multiple correlation coefficients, and the other of obtaining the asymptotic expansion formula for the moments of sample generalized variance.     

A simulation study of five biased estimators for straight line regression

Five biased estimators of the slope in straight line regression are considered. For each, the estimate of the “bias parameter”, k, is a function of N, the number of observations, and [rcirc]² , the square of the least squares estimate of the standardized slope, β. The estimators include that of Farebrother, the ridge estimator of Hoerl, Kennard, and Baldwin, Vinod's shrunken estimators., and a new modification of one of the latter. Properties of the estimators are studied for 13 combinations of N and 3. Results of simulation experiments provide empirical evidence concerning the values of means and variances of the biased estimators of the slope and estimates of the “bias parameter”, the mean square errors of the estimators, and the frequency of improvement relative to least squares. Adjustments to degrees of freedom in the biased regression analysis of variance table are also considered. An extension of the new modification to the case of p> 1 independent variables is presented in an Appendix.     

Asymptotic variances for the multiplicative interaction model

When modelling two-way analysis of variance interactions by a multiplicative term-[Formula] asymptotic variances and covariances are derived for the parameters p, yi and Sj using maximum likelihood theory. The asymptotic framework is defined by a2/K where K is the number of observations per combination of the two factors and a2 the common variance of the eijk values. The results can be applied when K = 1. Two Monte Carlo studies were carried out to check the validity of the formulae for small values of 02/K and to assess their usefulness when replacing the unknown parameters by their estimations. The formulae fit well but the confidence regions produced are too narrow if the interaction term is small. The procedure is illustrated with two examples.     

A GROUP OF SPLIT-PLOT DESIGNS WITH A HETEROSCEDASTIC MODEL

For a group of split-plot designs it is assumed that the error variance is constant for a particular experiment but it varies from experiment to experiment. Assuming error variances to be known, estimators of the treatment parameters are obtained by weighted (generalised) least squares method and the corresponding analysis is given. For unknown error variances, an adjustment of the statistics using estimated weights is proposed for removing much of the resulting bias. The adjustment stems from a theorem due to Meier (1953).     

Surrogate models in ill-conditioned systems

Ridge versions of an ill-conditioned system are alleged to “act more like an orthogonal system” than the system itself. Alternatives, called surrogates and based on the conditioning of linear systems, are shown to yield smaller expected mean squares than OLS, and uniformly smaller residual sums of squares than ridge. Ridge and surrogate solutions are compared on several marques of orthogonality to include conditioning of dispersion arrays, variance inflation factors, isotropy of variances, and sphericity of contours of the estimators. For these, ridge typically exhibits erratic divergence from orthogonality as the ridge scalar evolves, often reverting back to OLS in the limit. In contrast, surrogate solutions converge monotonically to those from orthogonal systems. Invariance considerations constrain the computations to models in canonical form. Case studies serve to illustrate the central issues.     

The analysis of non-orthogonal designs with many classifications

The least squares analysis of non-orthogonal designs with many classifications is considered. A unified simpler approach than the existing methods is derived and simple expressions for the various sums of squares are given. The paper also generalizes the canonical forms of Pearce Jeffers (1971) for the adjusted treatment sum of squares and the error sum of squares in block designs to designs with several non-orthogonal classifications.