Improved simultaneous confidence intervals for linear contrasts and regression parameters

A well known method for obtaining conservative simultaneous confidence intervals for the K parameters in a linear regression model, or for K linear contrasts, is based on the percentage points of the Studentized maximum modulus distribution. From an inequality due to Sidak, conservative yet uniformly shorter confidence intervals would be possible if the percentage points of a particular form of the multivariate t distribution were available. The purpose of this paper is to provide the required percentage points. For K<8 the resulting confidence intervals can be substantially shorter.     

An evaluation of bootstrap methods for outlier detection in least squares regression

Outlier detection is a critical part of data analysis, and the use of Studentized residuals from regression models fit using least squares is a very common approach to identifying discordant observations in linear regression problems. In this paper we propose a bootstrap approach to constructing critical points for use in outlier detection in the context of least-squares Studentized residuals, and find that this approach allows naturally for mild departures in model assumptions such as non-Normal error distributions. We illustrate our methodology through both a real data example and simulated data.     

Using the studentized range to assess kurtosis

Because it is easy to compute from three common statistics (minimum, maximum, standard deviation) the studentized range is a useful test for non-normality when the original data are unavailable. For samples from symmetric populations, the studentized range allows an assessment of kurtosis with Type I and II error rates similar to those obtained from the moment coefficients.     

The optimal size of choice sets in choice experiments

In this paper, we establish the optimal size of the choice sets in generic choice experiments for asymmetric attributes when estimating main effects only. We give an upper bound for the determinant of the information matrix when estimating main effects and all two-factor interactions for binary attributes. We also derive the information matrix for a choice experiment in which the choice sets are of different sizes and use this to determine the optimal sizes for the choice sets.     

Bootstrapping regression models with BLUS residuals

To bootstrap a regression problem, pairs of response and explanatory variables or residuals can be resam‐pled, according to whether we believe that the explanatory variables are random or fixed. In the latter case, different residuals have been proposed in the literature, including the ordinary residuals (Efron 1979), standardized residuals (Bickel & Freedman 1983) and Studentized residuals (Weber 1984). Freedman (1981) has shown that the bootstrap from ordinary residuals is asymptotically valid when the number of cases increases and the number of variables is fixed. Bickel & Freedman (1983) have shown the asymptotic validity for ordinary residuals when the number of variables and the number of cases both increase, provided that the ratio of the two converges to zero at an appropriate rate. In this paper, the authors introduce the use of BLUS (Best Linear Unbiased with Scalar covariance matrix) residuals in bootstrapping regression models. The main advantage of the BLUS residuals, introduced in Theil (1965), is that they are uncorrelated. The main disadvantage is that only n —p residuals can be computed for a regression problem with n cases and p variables. The asymptotic results of Freedman (1981) and Bickel & Freedman (1983) for the ordinary (and standardized) residuals are generalized to the BLUS residuals. A small simulation study shows that even though only n — p residuals are available, in small samples bootstrapping BLUS residuals can be as good as, and sometimes better than, bootstrapping from standardized or Studentized residuals.     

Considerations for Effective Simulation Study Analysis

This article discusses estimation of several percentiles simultaneously, develops a simple test to compare the sizes of two test statistics, and considers the use of logit models to adjust power curves to have the same null hypothesis level.     

Partial Saddlepoint Approximations for Transformed Means

The full saddlepoint approximation for real valued smooth functions of means requires the existence of the joint cumulant generating function for the entire vector of random variables which are being transformed. We propose a mixed saddlepoint-Edgeworth approximation requiring the existence of a cumulant generating function for only part of the random vector considered, while retaining partially the relative nature of the errors. Tail probability approximations are obtained under conditions which enable the approximations to be used in resampling situations and hence to obtain a result on the relative error of coverage in the case of the bootstrap approximation to the confidence interval for the Studentized mean.     

Asymptotic Distribution of Studentized Contribution Ratio in High-Dimensional Principal Component Analysis

In this article, we develop a nonparametric estimator for the Hölder constant of a density function. We consider a simulation study to evaluate the performance of the proposal and construct smooth bootstrap confidence intervals. Also, we give a brief review over the impossibility to decide whether a density function is Hölder.     

Outlier detection in linear models: a comparative study in simple linear regression

Five widely used test statistics for detecting outliers and influential observations were studied using Monte Carlo method . The test statistic based on Studentized residuals, with critical values given by Tietjen, Moore and Beckman (1973), appears to be the best procedure for detecting a single outlier in simple linear regression.     

Critical point and power calculations for the studentized range test for generally correlated means

The studentized range test is a widely applied statistical procedure to compare several normal means within the analysis of variance. However, up to now no general methodology is available to perform the all-pair comparisons precisely, such as the computation of p-values or quantiles in the simple unbalanced one-way layout. Instead, a variety of approximations have been proposed in the past. This article focuses on exact computations of simultaneous confidence intervals and exact sample size determinations for all-pair comparisons in the analysis of variance involving arbitrary variance-covariance matrices. General power expressions in closed form are developed and numerical issues concerning the arising multivariate central and noncentral t-distributions are discussed. An application to the usual fixed effects analysis of covariance illustrates the use of the obtained results.     

A sample size selection procedure for pairwise comparisons of means with unequal variances

A sample size selection procedure for paired comparisons of means is presented which controls the half width of the confidence intervals while allowing for unequal variances of treatment means.     

On Testing the Mean Equivalence of Treatments from Correlated Normal Populations

Let there be k equally correlated treatment populations under consideration, a Studentized range test is proposed to test the hypothesis of average mean equivalence against the alternative hypothesis of inequivalence. The maximum level and minimum power at some least favorable configurations of means are used to calculate the critical value and the required sample size simultaneously when testing a null against an alternative hypothesis. The range test is applied to a real world problem to find out if the stress levels among children at four time periods due to a newly built nearby airport are equivalent.     

Choosing the best pairwise comparisons of means from non-normal populations,with unequal variances,but equal sample sizes

A Monte Carlo simulation evaluated five pairwise multiple comparison procedures for controlling Type I error rates, any-pair power, and all-pairs power. Realistic conditions of non-normality were based on a previous survey. Variance ratios were varied from 1:1 to 64:1. Procedures evaluated included Tukey's honestly significant difference (HSD) preceded by an F test, the Hayter–Fisher, the Games–Howell preceded by an F test, the Pertiz with F tests, and the Peritz with Alexander–Govern tests. Tukey's procedure shows the greatest robustness in Type I error control. Any-pair power is generally best with one of the Peritz procedures. All-pairs power is best with the Pertiz F test procedure. However, Tukey's HSD preceded by the Alexander–Govern F test may provide the best combination for controlling Type I and power rates in a variety of conditions of non-normality and variance heterogeneity.     

Expanded confidence intervals

Confidence intervals for location parameters are expanded (in either direction) to some “crucial” points and the resulting increase in the confidence coefficient investigated.Particaular crucial points are chosen to illuminate some hypothesis testing problems.Special results are dervied for the normal distribution with estimated variance and, in particular, for the problem of classifiying treatments as better or worse than a control.For this problem the usual two-sided Dunnett procedure is seen to be inefficient.Suggestions are made for the use of already published tables for this problem.Mention is made of the use of expanded confidence intervals for all pairwise comparisons of treatments using an “honest ordering difference” rather than Tukey's “honest siginificant difference”.     

Saddlepoint Approximations for the Difference of Order Statistics and Studentized Sample Quantiles

For a sample from a given distribution the difference of two order statistics and the Studentized quantile are statistics whose distribution is needed to obtain tests and confidence intervals for quantiles and quantile differences. This paper gives saddlepoint approximations for densities and saddlepoint approximations of the Lugannani–Rice form for tail probabilities of these statistics. The relative errors of the approximations are n ⁻¹ uniformly in a neighbourhood of the parameters and this uniformity is global if the densities are log-concave.     

The Berry-Esseen bound for Studentized U-statistics

Callaert and Veraverbeke (1981) recently obtained a Berry-Esseen-type bound of order n^–1/2 for Studentized nondegenerate U-statistics of degree two. The condition these authors need to obtain this order bound is the finiteness of the 4.5th absolute moment of the kernel h. In this note it is shown that this assumption can be weakened to that of a finite (4 + ?)th absolute moment of the kernel h, for some ? > 0. Our proof resembles part of Helmers and van Zwet (1982), where an analogous result is obtained for the Student t-statistic. The present note extends this to Studentized U-statistics.     

Critical values for testing for a single outlier in a nonlinear regression model

The maximum absolute studentized residual is commonly used for testing for a single outlier in a linear regression model. This test statistic, however, is seldom discussed in a nonlinear regression setting. We simulate the critical values for the tests under various nonlinear models. The associated critical values are found to be very close to one another. Moreover, they are very well approximated using the critical values obtained from F-distributions based on the Bonferroni equations in linear models. The results are promising even in samples of size 6.     

Book Reviews

The diagnostic tools examined in this article are applicable to regressions estimated with panel data or cross-sectional data drawn from a population with grouped structure. The diagnostic tools considered include (a) tests for the existence of group effects under both fixed and random effects models, (b) checks for outlying groups, and (c) specification tests for comparing the fixed and random effects models. A group-specific counterpart to the studentized residual is introduced. The methods are illustrated using a hedonic housing price regression.     

Influence and residuals in restricte generalized linear models

A particular influence measure for restricted regression models is reviewed in this paper. We give em- phasis on establishing regularity conditions to apply the proposed influence measure in restricted gen- eralized linear models. The development of conditional residuals is also discussed. In particular, a sim- ulation study was conducted in order to compare the distributions of the proposed residuals for various generalized linear models. Finally, an application is given.