Optimal simultaneous confidence bands in simple linear regression

A simultaneous confidence band provides useful information on the plausible range of an unknown regression model. For simple linear regression models, the most frequently quoted bands in the statistical literature include the hyperbolic band and the three-segment bands. One interesting question is whether one can construct confidence bands better than the hyperbolic and three-segment bands. The optimality criteria for confidence bands include the average width criterion considered by Gafarian (1964) and Naiman (1984) among others, and the minimum area confidence set (MACS) criterion of Liu and Hayter (2007). In this paper, two families of exact 1−α$1-\alpha$ confidence bands, the inner-hyperbolic bands and the outer-hyperbolic bands, which include the hyperbolic and three-segment bands as special cases, are introduced in simple linear regression. Under the MACS criterion, the best confidence band within each family is found by numerical search and compared with the hyperbolic band, the best three-segment band and with each other. The methodologies are illustrated with a numerical example and the Matlab programs used are available upon request.     

Exact Simultaneous Confidence Bands for Quadratic and Cubic Polynomial Regression with Applications in Dose Response Study

Exact simultaneous confidence bands (SCBs) for a polynomial regression model are available only in some special situations. In this paper, simultaneous confidence levels for both hyperbolic and constant width bands for a polynomial function over a given interval are expressed as multidimensional integrals. The dimension of these integrals is equal to the degree of the polynomial. Hence the values can be calculated quickly and accurately via numerical quadrature provided that the degree of the polynomial is small (e.g. 2 or 3). This allows the construction of exact SCBs for quadratic and cubic regression functions over any given interval and for any given design matrix. Quadratic and cubic regressions are frequently used to characterise dose response relationships in addition to many other applications. Comparison between the hyperbolic and constant width bands under both the average width and minimum volume confidence set criteria shows that the constant width band can be much less efficient than the hyperbolic band. For hyperbolic bands, comparison between the exact critical constant and conservative or approximate critical constants indicates that the exact critical constant can be substantially smaller than the conservative or approximate critical constants. Numerical examples from a dose response study are used to illustrate the methods.     

Simultaneous Confidence Bands for Linear Regression with Covariates Constrained in Intervals

Abstract. The focus of this article is on simultaneous confidence bands over a rectangular covariate region for a linear regression model with k>1 covariates, for which only conservative or approximate confidence bands are available in the statistical literature stretching back to Working & Hotelling (J. Amer. Statist. Assoc. 24 , 1929; 73–85). Formulas of simultaneous confidence levels of the hyperbolic and constant width bands are provided. These involve only a k‐dimensional integral; it is unlikely that the simultaneous confidence levels can be expressed as an integral of less than k‐dimension. These formulas allow the construction for the first time of exact hyperbolic and constant width confidence bands for at least a small k(>1) by using numerical quadrature. Comparison between the hyperbolic and constant width bands is then addressed under both the average width and minimum volume confidence set criteria. It is observed that the constant width band can be drastically less efficient than the hyperbolic band when k>1. Finally it is pointed out how the methods given in this article can be applied to more general regression models such as fixed‐effect or random‐effect generalized linear regression models.     

Exact Uniform Confidence Bands for Periodic Regression

Exact uniform confidence bands are presented for a sinusoidal regression model with known period. A table of probability points is presented for an important special case. A comparsion is made with the Working - Hotelling - Scheffé confidence bands.     

Confidence band for percentile line in multiple linear regression

We deal with the problem of estimating constructing a confidence band for the 100γth percentile line in the multiple linear regression model with independent identically normally distributed errors. A method for computing the exact Scheffé type confidence band over a limited space of the particular covariates region is suggested. A confidence band depends on an estimator of the percentile line. The confidence bands based on the different estimators of the percentile line are compared with respect to the average bandwidth.     

A Note on Confidence Bands for the Logistic Response Curve

A problem in logit analysis is the interval estimation of the logistic response curve. Scheffé's method is used to obtain confidence bands for the logistic response function for any number of explanatory variables. This method is computationally easier and more general than a previously reported method.     

A comparison of confidence intervals generated by the scheffé and bonferroni methods

Simultaneous confidence intervals for the p means of a multivariate normal random variable with known variances may be generated by the projection method of Scheffé and by the use of Bonferroni's inequality. It has been conjectured that the Bonferroni intervals are shorter than the Scheffé intervals, at least for the usual confidence levels. This conjecture is proved for all p≥2 and all confidence levels above 50%. It is shown, incidentally, that for all p≥2 Scheffé's intervals are shorter for sufficiently small confidence levels. The results are also applicable to the Bonferroni and Scheffé intervals generated for multinomial proportions.     

Optimal Simultaneous Confidence Bands in Multiple Linear Regression with Predictor Variables Constrained in an Ellipsoidal Region

A simultaneous confidence band provides useful information on the plausible range of an unknown regression model function, just as a confidence interval gives the plausible range of an unknown parameter. For a multiple linear regression model, confidence bands of different shapes, such as the hyperbolic band and the constant width band, can be constructed and the predictor variable region over which a confidence band is constructed can take various forms. One interesting but unsolved problem is to find the optimal (shape) confidence band over an ellipsoidal region χ_E under the Minimum Volume Confidence Set (MVCS) criterion of Liu and Hayter (2007 Liu, W., Hayter, A.J. (2007). Minimum area confidence set optimality for confidence bands in simple linear regression. J. Amer. Statist. Assoc. 102:181–190.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and Liu et al. (2009 Liu, W., Bretz, F., Hayter, A.J., Wynn, H.P. (2009). Assessing non-superiority, non-inferiority or equivalence when comparing two regression models over a restricted covariate region. Biometrics 65:1279–1287.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). This problem is challenging as it involves optimization over an unknown function that determines the shape of the confidence band over χ_E. As a step towards solving this difficult problem, in this paper, we introduce a family of confidence bands over χ_E, called the inner-hyperbolic bands, which includes the hyperbolic and constant-width bands as special cases. We then search for the optimal confidence band within this family under the MVCS criterion. The conclusion from this study is that the hyperbolic band is not optimal even within this family of inner-hyperbolic bands and so cannot be the overall optimal band. On the other hand, the constant width band can be optimal within the family of inner-hyperbolic bands when the region χ_E is small and so might be the overall optimal band.     

Simultaneous Confidence Tubes in Multivariate Linear Regression

Simultaneous confidence bands have been shown in the statistical literature as powerful inferential tools in univariate linear regression. While the methodology of simultaneous confidence bands for univariate linear regression has been extensively researched and well developed, no published work seems available for multivariate linear regression. This paper fills this gap by studying one particular simultaneous confidence band for multivariate linear regression. Because of the shape of the band, the word ‘tube’ is more pertinent and so will be used to replace the word ‘band’. It is shown that the construction of the tube is related to the distribution of the largest eigenvalue. A simulation‐based method is proposed to compute the 1 ? α quantile of this eigenvalue. With the computation power of modern computers, the simultaneous confidence tube can be computed fast and accurately. A real‐data example is used to illustrate the method, and many potential research problems have been pointed out.     

Confidence bands for the logistic and probit regression models over intervals

This article presents methods for the construction of two-sided and one-sided simultaneous hyperbolic bands for the logistic and probit regression models when the predictor variable is restricted to a given interval. The bands are constructed based on the asymptotic properties of the maximum likelihood estimators. Past articles have considered building two-sided asymptotic confidence bands for the logistic model, such as Piegorsch and Casella (1988 Piegorsch, W.W., Casella, G. (1988). Confidence bands for logistic regression with restricted predictor variables. Biometrics 44:739–750.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). However, the confidence bands given by Piegorsch and Casella are conservative under a single interval restriction, and it is shown in this article that their bands can be sharpened using the methods proposed here. Furthermore, no method has yet appeared in the literature for constructing one-sided confidence bands for the logistic model, and no work has been done for building confidence bands for the probit model, over a limited range of the predictor variable. This article provides methods for computing critical points in these areas.     

Confidence Bands for the Difference of Two Survival Curves Under Proportional Hazards Model

A common approach to testing for differences between the survival rates of two therapies is to use a proportional hazards regression model which allows for an adjustment of the two survival functions for any imbalance in prognostic factors in the comparison. When the relative risk of one treatment to the other is not constant over time the question of which therapy has a survival advantage is difficult to determine from the Cox model. An alternative approach to this problem is to plot the difference between the two predicted survival functions with a confidence band that provides information about when these two treatments differ. Such a band will depend on the covariate values of a given patient. In this paper we show how to construct a confidence band for the difference of two survival functions based on the proportional hazards model. A simulation approach is used to generate the bands. This approach is used to compare the survival probabilities of chemotherapy and allogeneic bone marrow transplants for chronic leukemia.     

An Independence Point Method of Confidence Band Construction for Multiple Linear Regression Models

This article addresses the problem of confidence band construction for a standard multiple linear regression model. An “independence point” method of construction is developed which generalizes the method of Gafarian (1964) for a simple linear regression model to a multiple linear regression model. Wynn (1984 Wynn , H. P. ( 1984 ). An exact confidence band for one-dimensional polynomial regression . Biometrika 71 : 375 – 9 .[Crossref], [Web of Science ®] , [Google Scholar]) pioneered the approach of basing confidence bands for a polynomial regression on a set of nodes where the function estimates are independent, and this approach is exploited in this article. This method requires only critical points from t-distributions so that the confidence bands are easy to construct. Both one-sided and two-sided confidence bands can be constructed using this method. An illustration of the new method is provided, and comparisons are made with other procedures.     

Simultaneous confidence bands and regions for log-location-scale distributions with censored data

In many areas of application, especially life testing and reliability, it is often of interest to estimate an unknown cumulative distribution (cdf). A simultaneous confidence band (SCB) of the cdf can be used to assess the statistical uncertainty of the estimated cdf over the entire range of the distribution. Cheng and Iles [1983. Confidence bands for cumulative distribution functions of continuous random variables. Technometrics 25 (1), 77–86] presented an approach to construct an SCB for the cdf of a continuous random variable. For the log-location-scale family of distributions, they gave explicit forms for the upper and lower boundaries of the SCB based on expected information. In this article, we extend the work of Cheng and Iles [1983. Confidence bands for cumulative distribution functions of continuous random variables. Technometrics 25 (1), 77–86] in several directions. We study the SCBs based on local information, expected information, and estimated expected information for both the “cdf method” and the “quantile method.” We also study the effects of exceptional cases where a simple SCB does not exist. We describe calibration of the bands to provide exact coverage for complete data and type II censoring and better approximate coverage for other kinds of censoring. We also discuss how to extend these procedures to regression analysis.     

Percentage points of a weighted Kolmogorov-Smirnov statistic

Let F and G be the cumulative distribution functions corresponding to two independent random variables. Define the shift function, Δ(x), by F(x)=G(x+Δ(x)). Doksum and Sievers (1976) compared two confidence bands for Δ(x). The confidence band they found to be best requires the percentage points of a weighted form of the Kolmogorov-Smirnov statistic. The goal in this paper is to supply a table of some of the exact percentage points.     

A note on scheffé's method of deriving confidence sets for directions and ratios of normals

Scheffé (1970) introduced a method for deriving confidence sets for directions and ratios of normals. The procedure requires use of an approximation and Scheffé provided evidence that the method performs well for cases in which the variances of the random deviates are known. This paper extends Scheffé's numerical integrations to the case of unknown variances. Our results indicate that Scheffé's method works well when variances are unknown     

Minimum-area confidence sets for a normal distribution

When making inference on a normal distribution, one often seeks either a joint confidence region for the two parameters or a confidence band for the cumulative distribution function. A number of methods for constructing such confidence sets are available, but none of these methods guarantees a minimum-area confidence set. In this paper, we derive both a minimum-area joint confidence region for the two parameters and a minimum-area confidence band for the cumulative distribution function. The minimum-area joint confidence region is asymptotically equivalent to other confidence regions in the literature, but the minimum-area confidence band improves on existing confidence bands even asymptotically.     

Simultaneous confidence bands for growth incidence curves in weighted sup-norm metrics

ABSTRACT

The so-called growth incidence curve (GIC) is a popular way to evaluate the distributional pattern of economic growth and pro-poorness of growth in development economics. The log-transformation of the the GIC is related to the sum of empirical quantile processes which allows for constructions of simultaneous confidence bands for the GIC. However, standard constructions of these bands tend to be too wide at the extreme points 0 and 1 because the estimator of the quantile function can be very volatile at the extreme points. In order to construct simultaneous confidence bands which are narrower at the ends, we consider the convergence of quantile processes with weight functions. In particular, we investigate the asymptotic convergence under specific weighted sup-norm metrics and compare different kinds of qualified weight functions. This implies simultaneous confidence bands that are narrower at the boundaries 0 and 1. We show in simulations that these bands have a more regular shape. Finally, we evaluate real data from Uganda with the improved confidence bands.     

Confidence bands for the Michaelis-Menten kinetic model

The maximization and minimization procedure for constructing confidence bands for the general nonlinear regression model is explained. Then, using the maximization and minimization procedure, a conservative confidence band for the Michaelis-Menten kinetic model used in enzyme kinetics is constructed.