Constant width simultaneous confidence bands in multiple linear regression with predictor variables constrained in intervals

In the last fifty years, a great deal of research effort has been made on the construction of simultaneous confidence bands for a linear regression function. Two most frequently quoted confidence bands in the statistics literature are the Scheffé type and constant width bands over a given rectangular region of the predictor variables. For the constant width bands, a method is given by Gafarian [Gafarian, A.V., 1964, Confidence bands in straight line regression. Journal of the American Statistical Association, 59, 182–213.] for the calculation of critical constants only for the special case of one predictor variable. In this article, a method is proposed to construct constant width bands when there are any number of predictor variables. A new criterion for assessing a confidence band is also proposed; it is the probability that a confidence band excludes a false regression function and can be viewed as the power function of a test associated, naturally, with a confidence band. Under this criterion, a numerical comparison between the Scheffé type and constant width bands is then carried out. It emerges from this comparison that the constant width bands can be better than the Scheffé type bands for certain designs.     

Easy-to-construct confidence bands for comparing two simple linear regression lines

This paper shows how to construct confidence bands for the difference between two simple linear regression lines. These confidence bands provide directly the information on the magnitude of the difference between the regression lines over an interval of interest and, as a by-product, can be used as a formal test of the difference between the two regression lines. Various different shapes of confidence bands are illustrated, and particular attention is paid towards confidence bands whose construction only involves critical points from standard distributions so that they are consequently easy to construct.     

Slope modified confidence bands for a simple linear regression model

Considerable attention has been directed in the statistical literature towards the construction of confidence bands for a simple linear regression model. These confidence bands allow the experimenter to make inferences about the model over a particular region of interest. However, in practice an experimenter will usually first check the significance of the regression line before proceeding with any further inferences such as those provided by the confidence bands. From a theoretical point of view, this raises the question of what the conditional confidence level of the confidence bands might be, and from a practical point of view it is unsatisfactory if the confidence bands contain lines that are inconsistent with the directional decision on the slope. In this paper it is shown how confidence bands can be modified to alleviate these two problems.     

A ray method of confidence band construction for multiple linear regression models

This paper addresses the problem of confidence band construction for a standard multiple linear regression model. A “ray” method of construction is developed which generalizes the method of Graybill and Bowden [1967. Linear segment confidence bands for simple linear regression models. J. Amer. Statist. Assoc. 62, 403–408] for a simple linear regression model to a multiple linear regression model. By choosing suitable directions for the rays this method requires only critical points from t-distributions so that the confidence bands are easy to construct. Both one-sided and two-sided confidence bands can be constructed using this method. An illustration of the new method is provided.     

Optimal Simultaneous Confidence Bands in Multiple Linear Regression with Predictor Variables Constrained in an Ellipsoidal Region

A simultaneous confidence band provides useful information on the plausible range of an unknown regression model function, just as a confidence interval gives the plausible range of an unknown parameter. For a multiple linear regression model, confidence bands of different shapes, such as the hyperbolic band and the constant width band, can be constructed and the predictor variable region over which a confidence band is constructed can take various forms. One interesting but unsolved problem is to find the optimal (shape) confidence band over an ellipsoidal region χ_E under the Minimum Volume Confidence Set (MVCS) criterion of Liu and Hayter (2007 Liu, W., Hayter, A.J. (2007). Minimum area confidence set optimality for confidence bands in simple linear regression. J. Amer. Statist. Assoc. 102:181–190.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and Liu et al. (2009 Liu, W., Bretz, F., Hayter, A.J., Wynn, H.P. (2009). Assessing non-superiority, non-inferiority or equivalence when comparing two regression models over a restricted covariate region. Biometrics 65:1279–1287.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). This problem is challenging as it involves optimization over an unknown function that determines the shape of the confidence band over χ_E. As a step towards solving this difficult problem, in this paper, we introduce a family of confidence bands over χ_E, called the inner-hyperbolic bands, which includes the hyperbolic and constant-width bands as special cases. We then search for the optimal confidence band within this family under the MVCS criterion. The conclusion from this study is that the hyperbolic band is not optimal even within this family of inner-hyperbolic bands and so cannot be the overall optimal band. On the other hand, the constant width band can be optimal within the family of inner-hyperbolic bands when the region χ_E is small and so might be the overall optimal band.     

Bias-corrected confidence bands in nonparametric regression

Bias-corrected confidence bands for general nonparametric regression models are considered. We use local polynomial fitting to construct the confidence bands and combine the cross-validation method and the plug-in method to select the bandwidths. Related asymptotic results are obtained. Our simulations show that confidence bands constructed by local polynomial fitting have much better coverage than those constructed by using the Nadaraya–Watson estimator. The results are also applicable to nonparametric autoregressive time series models.     

Adaptive confidence bands in the nonparametric fixed design regression model

In this note, we consider the problem of the existence of adaptive confidence bands in the fixed design regression model, adapting ideas in Hoffmann and Nickl [(2011), ‘On Adaptive Inference and Confidence Bands’, Annals of Statistics, 39, 2383–2409] to the present case. In the course of the proof, we show that sup-norm adaptive estimators exist as well in the regression setting.     

Exact simultaneous confidence segments for all contrast comparisons

This paper provides an exact method to construct simultaneous confidence bands for all contrasts of several regression lines over a restricted explanatory variable. Due to the lack of exact methods in the literature, currently existing approaches consist mainly of simulation based approaches. Using confidence bands for regression analysis occurs ubiquitously in practice, for example, inference on the shelf-life or stability of a drug, on the reliability of an engineering system over time, on the environmental impact of a fertilizer in a field over time, to list just a few. The new method enhances currently existing approaches that are based on simulations.     

Effective simultaneous confidence bands for repeated measurements in linear mixed-effect models

Linear mixed-effect (LME) models have been extensively accepted to analyse repeated measurements due to their flexibility and ability to handle subject-specific matters. The inclusion of random effects has resulted in much benefit with respect to estimation, but it is complicated to measure their impact on hypothesis testing. While the same complication is present in the construction of simultaneous confidence bands (SCBs), degrees of freedom (df) for SCBs have rarely been discussed unlike those for test statistics. This motivates us to propose the adoption of approximate df to construct SCBs in LME models. Simulation studies were performed to compare the performances of different calculations for the df. The results of simulations demonstrate the efficacy of the use of approximate df. In addition, our proposal allows line-segment SCBs developed under covariance models to function with LME models. Applications with real longitudinal datasets present consistent results with the simulation study.     

Confidence bands for the logistic and probit regression models over intervals

This article presents methods for the construction of two-sided and one-sided simultaneous hyperbolic bands for the logistic and probit regression models when the predictor variable is restricted to a given interval. The bands are constructed based on the asymptotic properties of the maximum likelihood estimators. Past articles have considered building two-sided asymptotic confidence bands for the logistic model, such as Piegorsch and Casella (1988 Piegorsch, W.W., Casella, G. (1988). Confidence bands for logistic regression with restricted predictor variables. Biometrics 44:739–750.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). However, the confidence bands given by Piegorsch and Casella are conservative under a single interval restriction, and it is shown in this article that their bands can be sharpened using the methods proposed here. Furthermore, no method has yet appeared in the literature for constructing one-sided confidence bands for the logistic model, and no work has been done for building confidence bands for the probit model, over a limited range of the predictor variable. This article provides methods for computing critical points in these areas.     

Simultaneous confidence bands for nonlinear regression models

The maximization and minimization procedure for constructing confidence bands about general regression models is explained. Then, using an existing confidence region about the parameters of a nonlinear regression model and the maximization and minimization procedure, a generally conservative simultaneous confidence band is constructed about the model. Two examples are given, and some problems with the procedure are discussed     

Confidence sets in a linear regression model for interval data

The construction of confidence sets for the parameters of a flexible simple linear regression model for interval-valued random sets is addressed. For that purpose, the asymptotic distribution of the least-squares estimators is analyzed. A simulation study is conducted to investigate the performance of those confidence sets. In particular, the empirical coverages are examined for various interval linear models. The applicability of the procedure is illustrated by means of a real-life case study.     

Normal probability plots with confidence for the residuals in linear regression

Normal probability plots for a simple random sample and normal probability plots for residuals from linear regression are not treated differently in statistical text books. In the statistical literature, 1 ? α simultaneous probability intervals for augmenting a normal probability plot for a simple random sample are available. The first purpose of this article is to demonstrate that the tests associated with the 1 ? α simultaneous probability intervals for a simple random sample may have a size substantially different from α when applied to the residuals from linear regression. This leads to the second purpose of this article: construction of four normal probability plot-based tests for residuals, which have size α exactly. We then compare the powers of these four graphical tests and a non-graphical test for residuals in order to assess the power performances of the graphical tests and to identify the ones that have better power. Finally, an example is provided to illustrate the methods.     

Confidence band for percentile line in multiple linear regression

We deal with the problem of estimating constructing a confidence band for the 100γth percentile line in the multiple linear regression model with independent identically normally distributed errors. A method for computing the exact Scheffé type confidence band over a limited space of the particular covariates region is suggested. A confidence band depends on an estimator of the percentile line. The confidence bands based on the different estimators of the percentile line are compared with respect to the average bandwidth.     

Model robust confidence intervals

Confidence intervals are constructed for real-valued parameter estimation in a general regression model with normal errors. When the error variance is known these intervals are optimal (in the sense of minimizing length subject to guaranteed probability of coverage) among all intervals estimates which are centered at a linear estimate of the parameter. When the error variance is unknown and the regression model is an approximately linear model (a class of models which permits bounded systematic departures from an underlying ideal model) then an independent estimate of variance is found and the intervals can then be appropriately scaled.     

Optimal designs based on exact confidence regions for parameter estimation of a nonlinear regression model

This paper is concerned with the proposal of optimality criteria, referred to as X  - and X^′$X^{\prime }$-optimality criteria, and the construction of X  - and X^′$X^{\prime }$-optimal designs, for nonlinear regression models. These optimal designs aim at improving the estimation of parameters of this class of models. The principle of these criteria is the minimization, with respect to the design, of the expected volume of a particular exact parametric confidence region. In this paper we give detailed definitions, properties, and computation methods of X  - and X^′$X^{\prime }$-optimal designs. We also compare these designs with the classic local D-optimal designs, with regard to robustness and efficiency, for two very well-known academic models (Box–Lucas and Michaelis–Menten models).