Confidence intervals for the between group variance in the unbalanced one-way random effects model of anaylsis of variance

A confidence interval for the between group variance is proposed which is deduced from Wald'sexact confidence interval for the rtio of the two variance components in the one-way random effects model and the exact confidence interval for the error variance resp.an unbiased estimator of the error variance. In a simulation study the confidence coeffecients for these two intervals are compared with the confidence coefficients of two other commonly used confidence intervals. There the confidence interval derived here yields confidence coefficiends which are always greater than the prescriped level.     

Interval estimates for variance components

The fiducial approach to the two components of variance random effects model developed by Venables and James (1978) is related to the Bayesian approach of Box and Tiao (1973). The operating characteristics, under repeated sampling, of the resulting interval estimators for the “within classes” variance component are investigated, and the behaviour of the two sets of intervals is found to be very similar, the coverage frequency of 95% probability intervals being approximately 91% when the “between classes” variance component is zero but rising rapidly to 95% as the between component increases. The probability intervals are shown to be shorter on average than a comparable confidence interval based upon the within classes sum of squares, and to be robust against nonnormality in the class means.     

Alternative Confidence Intervals on Variance Components in a Simple Regression Model with a Balanced Two-Fold Nested Error Structure

In applications using a linear regression model with a balanced two-fold nested error structure, interest focuses on inferences concerning variability of the effects associated with the levels of nesting. This article proposes confidence intervals on the variance components associated with the primary and secondary levels in the model. In order to construct the confidence intervals we use a modified large sample method, generalized inference method, and Satterthwaite approximation. Computer simulation is performed to compare the proposed confidence intervals. A numerical example is provided to demonstrate the intervals.     

Approximate confidence intervals for a ratio of two variance components

New approximate confidence intervals for the ratio of two variance components in an unbalanced mixed .linear model with a single set of random effects are proposed. Contrary to the confidence intervals known in the literature the new intervals preserve the confidence coefficient and cover the exact confidence interval which, however, is not easy to establish as it requires the solution of complicated nonlinear equations.     

ROBUSTNESS PROPERTIES OF LOGNORMAL CONFIDENCE INTERVALS FOR LOGNORMAL AND GAMMA DISTRIBUTED DATA

ABSTRACT

The performances of six confidence intervals for estimating the arithmetic mean of a lognormal distribution are compared using simulated data. The first interval considered is based on an exact method and is recommended in U.S. EPA guidance documents for calculating upper confidence limits for contamination data. Two intervals are based on asymptotic properties due to the Central Limit Theorem, and the other three are based on transformations and maximum likelihood estimation. The effects of departures from lognormality on the performance of these intervals are also investigated. The gamma distribution is considered to represent departures from the lognormal distribution. The average width and coverage of each confidence interval is reported for varying mean, variance, and sample size. In the lognormal case, the exact interval gives good coverage, but for small sample sizes and large variances the confidence intervals are too wide. In these cases, an approximation that incorporates sampling variability of the sample variance tends to perform better. When the underlying distribution is a gamma distribution, the intervals based upon the Central Limit Theorem tend to perform better than those based upon lognormal assumptions.     

Confidence intervals for coefficients of variation in two-parameter exponential distributions

This article examines confidence intervals for the single coefficient of variation and the difference of coefficients of variation in the two-parameter exponential distributions, using the method of variance of estimates recovery (MOVER), the generalized confidence interval (GCI), and the asymptotic confidence interval (ACI). In simulation, the results indicate that coverage probabilities of the GCI maintain the nominal level in general. The MOVER performs well in terms of coverage probability when data only consist of positive values, but it has wider expected length. The coverage probabilities of the ACI satisfy the target for large sample sizes. We also illustrate our confidence intervals using a real-world example in the area of medical science.     

A new confidence interval in errors-in-variables model with known error variance

This paper considers constructing a new confidence interval for the slope parameter in the structural errors-in-variables model with known error variance associated with the regressors. Existing confidence intervals are so severely affected by Gleser–Hwang effect that they are subject to have poor empirical coverage probabilities and unsatisfactory lengths. Moreover, these problems get worse with decreasing reliability ratio which also result in more frequent absence of some existing intervals. To ease these issues, this paper presents a fiducial generalized confidence interval which maintains the correct asymptotic coverage. Simulation results show that this fiducial interval is slightly conservative while often having average length comparable or shorter than the other methods. Finally, we illustrate these confidence intervals with two real data examples, and in the second example some existing intervals do not exist.     

Setting confidence intervals by ratio estimator

For the survey population total of a variable y when values of an auxiliary variable x are available a popular procedure is to employ the ratio estimator on drawing a simple random sample without replacement (SRSWOR) especially when the size of the sample is large. To set up a confidence interval for the total, various variance estimators are available to pair with the ratio estimator. We add a few more variance estimators studded with asymptotic design-cum-model properties. The ratio estimator is traditionally known to be appropriate when the regression of y on x is linear through the origin and the conditional variance of y given x is proportional to x. But through a numerical exercise by simulation we find the confidence intervals to fare better if the regression line deviates from the origin or if the conditional variance is disproportionate with x. Also, comparing the confidence intervals using alternative variance estimators we find our newly proposed variance estimators to yield favourably competitive results.     

Generalized confidence intervals for proportions of total variance in mixed linear models

Exact confidence intervals for a proportion of total variance, based on pivotal quantities, only exist for mixed linear models having two variance components. Generalized confidence intervals (GCIs) introduced by Weerahandi [1993. Generalized confidence intervals (Corr: 94V89 p726). J. Am. Statist. Assoc. 88, 899–905] are based on generalized pivotal quantities (GPQs) and can be constructed for a much wider range of models. In this paper, the author investigates the coverage probabilities, as well as the utility of GCIs, for a proportion of total variance in mixed linear models having more than two variance components. Particular attention is given to the formation of GPQs and GCIs in mixed linear models having three variance components in situations where the data exhibit complete balance, partial balance, and partial imbalance. The GCI procedure is quite general and provides a useful method to construct confidence intervals in a variety of applications.     

A note on fiducial generalized pivots for in one-way heteroscedastic ANOVA with random effects

The paper deals with generalized confidence intervals for the between-group variance in one-way heteroscedastic (unbalanced) ANOVA with random effects. The approach used mimics the standard one applied in mixed linear models with two variance components, where interval estimators are based on a minimal sufficient statistic derived after an initial reduction by the principle of invariance. A minimal sufficient statistic under heteroscedasticity is found to resemble its homoscedastic counterpart and further analogies between heteroscedastic and homoscedastic cases lead us to two classes of fiducial generalized pivots for the between-group variance. The procedures suggested formerly by Wimmer and Witkovský [Between group variance component interval estimation for the unbalanced heteroscedastic one-way random effects model, J. Stat. Comput. Simul. 73 (2003), pp. 333–346] and Li [Comparison of confidence intervals on between group variance in unbalanced heteroscedastic one-way random models, Comm. Statist. Simulation Comput. 36 (2007), pp. 381–390] are found to belong to these two classes. We comment briefly on some of their properties that were not mentioned in the original papers. In addition, properties of another particular generalized pivot are considered.     

Inferences on the Among-Group Variance Component in Unbalanced Heteroscedastic One-Fold Nested Design

This article studies the hypothesis testing and interval estimation for the among-group variance component in unbalanced heteroscedastic one-fold nested design. Based on the concepts of generalized p-value and generalized confidence interval, tests and confidence intervals for the among-group variance component are developed. Furthermore, some simulation results are presented to compare the performance of the proposed approach with those of existing approaches. It is found that the proposed approach and one of the existing approaches can maintain the nominal confidence level across a wide array of scenarios, and therefore are recommended to use in practical problems. Finally, a real example is illustrated.     

The Analysis of Designed Experiments and Longitudinal Data by Using Smoothing Splines

In designed experiments and in particular longitudinal studies, the aim may be to assess the effect of a quantitative variable such as time on treatment effects. Modelling treatment effects can be complex in the presence of other sources of variation. Three examples are presented to illustrate an approach to analysis in such cases. The first example is a longitudinal experiment on the growth of cows under a factorial treatment structure where serial correlation and variance heterogeneity complicate the analysis. The second example involves the calibration of optical density and the concentration of a protein DNase in the presence of sampling variation and variance heterogeneity. The final example is a multienvironment agricultural field experiment in which a yield–seeding rate relationship is required for several varieties of lupins. Spatial variation within environments, heterogeneity between environments and variation between varieties all need to be incorporated in the analysis. In this paper, the cubic smoothing spline is used in conjunction with fixed and random effects, random coefficients and variance modelling to provide simultaneous modelling of trends and covariance structure. The key result that allows coherent and flexible empirical model building in complex situations is the linear mixed model representation of the cubic smoothing spline. An extension is proposed in which trend is partitioned into smooth and non-smooth components. Estimation and inference, the analysis of the three examples and a discussion of extensions and unresolved issues are also presented.     

The modification of confidence intervals for variance components in one-way random model using Stein's approach

This paper concerns the problem of “improving” interval estimators of variance components in one-way random model. The traditional method of construction relies on the establishment of confidence intervals, depending on corresponding sums of squares, from the analysis of variance. It has been shown in the paper how information on the estimator for a population mean can be used to “improve” the estimation of variance components.     

On confidence intervals for the among-group variance in the one-way random effects model with unequal error variances

Based on a quadratic form of the group means, we consider two different approaches to construct a confidence interval for the among-group variance in the one-way random effects model with unequal error variances. In one approach the limits of the interval are determined by solving non-linear equations whereas in the second approach the bounds are given explicitly. By using correction terms for convexity in both approaches, we improve the primary intervals and obtain intervals whose actual confidence coefficients are closer to the nominal confidence coefficient. By means of a simulation study, we show that an improved confidence interval from each approach can be recommended for the practical use.     

Estimating kurtosis and confidence intervals for the variance under nonnormality

Exact confidence intervals for variances rely on normal distribution assumptions. Alternatively, large-sample confidence intervals for the variance can be attained if one estimates the kurtosis of the underlying distribution. The method used to estimate the kurtosis has a direct impact on the performance of the interval and thus the quality of statistical inferences. In this paper the author considers a number of kurtosis estimators combined with large-sample theory to construct approximate confidence intervals for the variance. In addition, a nonparametric bootstrap resampling procedure is used to build bootstrap confidence intervals for the variance. Simulated coverage probabilities using different confidence interval methods are computed for a variety of sample sizes and distributions. A modification to a conventional estimator of the kurtosis, in conjunction with adjustments to the mean and variance of the asymptotic distribution of a function of the sample variance, improves the resulting coverage values for leptokurtically distributed populations.     

Sample Size Determination for a Two-Sided Multiple Components Tolerance Interval

In the conventional concept, the variance of a tolerance interval from the measurements is a single component, and the sample size for quality control process was estimated by the variance of a single component. However, we can find examples in recent about several components that could vary in their measurements, so an approximate method must be found to modify the conventional tolerance interval. In our paper, we develop an approach to calculate the sample size for a two-sided tolerance interval including several components in the variance from the measurements. An example is presented to illustrate our proposed method.     

ON THE COVERAGE PROBABILITY OF CONFIDENCE INTERVALS IN REGRESSION AFTER VARIABLE SELECTION

This paper considers a linear regression model with regression parameter vector β. The parameter of interest is θ= a^Tβ where a is specified. When, as a first step, a data‐based variable selection (e.g. minimum Akaike information criterion) is used to select a model, it is common statistical practice to then carry out inference about θ, using the same data, based on the (false) assumption that the selected model had been provided a priori. The paper considers a confidence interval for θ with nominal coverage 1 ‐ α constructed on this (false) assumption, and calls this the naive 1 ‐ α confidence interval. The minimum coverage probability of this confidence interval can be calculated for simple variable selection procedures involving only a single variable. However, the kinds of variable selection procedures used in practice are typically much more complicated. For the real‐life data presented in this paper, there are 20 variables each of which is to be either included or not, leading to 2²⁰ different models. The coverage probability at any given value of the parameters provides an upper bound on the minimum coverage probability of the naive confidence interval. This paper derives a new Monte Carlo simulation estimator of the coverage probability, which uses conditioning for variance reduction. For these real‐life data, the gain in efficiency of this Monte Carlo simulation due to conditioning ranged from 2 to 6. The paper also presents a simple one‐dimensional search strategy for parameter values at which the coverage probability is relatively small. For these real‐life data, this search leads to parameter values for which the coverage probability of the naive 0.95 confidence interval is 0.79 for variable selection using the Akaike information criterion and 0.70 for variable selection using Bayes information criterion, showing that these confidence intervals are completely inadequate.     

Confidence intervals and tests on the variance ratio in random models with two variance components

The LM test is modified to test any value of the ratio of two variance components in a mixed effects linear model with two variance components. The test is exact, so it can be used to construct exact confidence intervals on this ratio.Exact Neyman-Pearson (NP) tests on the variance ratio are described.Their powers provide attainable upper bounds on powers of tests on the variance ratio.Efficiencies of LM tests, which include ANOVA tests, and NP tests are compared for unbalanced, random, one-way ANOVA models.Confidence intervals corresponding to LM tests and NP tests are described.     

Comparison of confidence intervals for the Behrens-Fisher problem

The Behrens–Fisher problem concerns the inferences for the difference between means of two independent normal populations without the assumption of equality of variances. In this article, we compare three approximate confidence intervals and a generalized confidence interval for the Behrens–Fisher problem. We also show how to obtain simultaneous confidence intervals for the three population case (analysis of variance, ANOVA) by the Bonferroni correction factor. We conduct an extensive simulation study to evaluate these methods in respect to their type I error rate, power, expected confidence interval width, and coverage probability. Finally, the considered methods are applied to two real dataset.     

Confidence intervals for the mean of a normal distribution with restricted parameter space

For a normal distribution with known variance, the standard confidence interval of the location parameter is derived from the classical Neyman procedure. When the parameter space is known to be restricted, the standard confidence interval is arguably unsatisfactory. Recent articles have addressed this problem and proposed confidence intervals for the mean of a normal distribution where the parameter space is not less than zero. In this article, we propose a new confidence interval, rp interval, and derive the Bayesian credible interval and likelihood ratio interval for general restricted parameter space. We compare these intervals with the standard interval and the minimax interval. Simulation studies are undertaken to assess the performances of these confidence intervals.