Simultaneous confidence bands for nonlinear regression models

The maximization and minimization procedure for constructing confidence bands about general regression models is explained. Then, using an existing confidence region about the parameters of a nonlinear regression model and the maximization and minimization procedure, a generally conservative simultaneous confidence band is constructed about the model. Two examples are given, and some problems with the procedure are discussed     

On an asymptotic relative efficiency concept based on expected volumes of confidence regions

ABSTRACT

The paper deals with an asymptotic relative efficiency concept for confidence regions of multidimensional parameters that is based on the expected volumes of the confidence regions. Under standard conditions the asymptotic relative efficiencies of confidence regions are seen to be certain powers of the ratio of the limits of the expected volumes. These limits are explicitly derived for confidence regions associated with certain plugin estimators, likelihood ratio tests and Wald tests. Under regularity conditions, the asymptotic relative efficiency of each of these procedures with respect to each one of its competitors is equal to 1. The results are applied to multivariate normal distributions and multinomial distributions in a fairly general setting.     

Simultaneous confidence regions for the parameters of a Poisson INAR(1) model

The INAR(1) model (integer-valued autoregressive) is commonly used to model serially dependent processes of Poisson counts. We propose several asymptotic simultaneous confidence regions for the two parameters of a Poisson INAR(1) model, and investigate their performance and robustness for finite-length time series in a simulation study. Practical recommendations are derived, and the application of the confidence regions is illustrated by a real-data example.     

Ellipsoidal confidence regions for a normal covariance matrix

We obtain an asymptotic expansion of the confidence coefficient for an ellipsoidal confidence region on the elements of a normal covariance matrix. This leads to simultaneous confidence intervals on all linear functions of the elements of this matrix, which are compared with those of Roy (1954).     

Simultaneous confidence sets and confidence intervals for multiple ratios

This paper deals with the problem of simultaneously estimating multiple ratios. In the simplest case of only one ratio parameter, Fieller's theorem (J. Roy. Statist. Soc. Ser. B 16 (1954) 175) provides a confidence interval for the single ratio. For multiple ratios, there is no method available to construct simultaneous confidence intervals that exactly satisfy a given familywise confidence level. Many of the methods in use are conservative since they are based on probability inequalities. In this paper, first we consider exact simultaneous confidence sets based on the multivariate t-distribution. Two approaches of determining the exact simultaneous confidence sets are outlined. Second, approximate simultaneous confidence intervals based on the multivariate t-distribution with estimated correlation matrix and a resampling approach are discussed. The methods are applied to ratios of linear combinations of the means in the one-way layout and ratios of parameter combinations in the general linear model. Extensive Monte Carlo simulation is carried out to compare the performance of the various methods with respect to the stability of the estimated critical points and of the coverage probabilities.     

Simultaneous pseudo confidence regions for ratios of the discriminant coefficients

We consider simultaneous confidence regions for some hypotheses on ratios of the discriminant coefficients of the linear discriminant function when the population means and common covariance matrix are unknown. This problem, involving hypotheses on ratios, yields the so-called ‘pseudo’ confidence regions valid conditionally in subsets of the parameter space. We obtain the explicit formulae of the regions and give further discussion on the validity of these regions. Illustrations of the pseudo confidence regions are given.     

Joint confidence regions in the multivariate calibration problem

Consider a vector valued response variable related to a vector valued explanatory variable through a normal multivariate linear model. The multivariate calibration problem deals with statistical inference on unknown values of the explanatory variable. The problem addressed is the construction of joint confidence regions for several unknown values of the explanatory variable. The problem is investigated when the variance covariance matrix is a scalar multiple of the identity matrix and also when it is a completely unknown positive definite matrix. The problem is solved in only two cases: (i) the response and explanatory variables have the same dimensions, and (ii) the explanatory variable is a scalar. In the former case, exact joint confidence regions are derived based on a natural pivot statistic. In the latter case, the joint confidence regions are only conservative. Computational aspects and the practical implementation of the confidence regions are discussed and illustrated using an example.     

Generalized simultaneous confidence regions for regression coefficients and their ratios

This study constructs a simultaneous confidence region for two combinations of coefficients of linear models and their ratios based on the concept of generalized pivotal quantities. Many biological studies, such as those on genetics, assessment of drug effectiveness, and health economics, are interested in a comparison of several dose groups with a placebo group and the group ratios. The Bonferroni correction and the plug-in method based on the multivariate-t distribution have been proposed for the simultaneous region estimation. However, the two methods are asymptotic procedures, and their performance in finite sample sizes has not been thoroughly investigated. Based on the concept of generalized pivotal quantity, we propose a Bonferroni correction procedure and a generalized variable (GV) procedure to construct the simultaneous confidence regions. To address a genetic concern of the dominance ratio, we conduct a simulation study to empirically investigate the probability coverage and expected length of the methods for various combinations of sample sizes and values of the dominance ratio. The simulation results demonstrate that the simultaneous confidence region based on the GV procedure provides sufficient coverage probability and reasonable expected length. Thus, it can be recommended in practice. Numerical examples using published data sets illustrate the proposed methods.     

The automatic percentile method: Accurate confidence limits in parametric models

The problem of constructing confidence limits for a scalar parameter is considered. Under weak conditions, Efron's accelerated bias-corrected bootstrap confidence limits are correct to second order in parametric familles. In this article, a new method, called the automatic percentile method, for setting approximate confidence limits is proposed as an attempt to alleviate two problems inherent in Efron's method. The accelerated bias-corrected method is not fully automatic, since it requires the calculation of an analytical adjustment; furthermore, it is typically not exact, though for many situations, particularly scalar-parameter familles, exact answers are available. In broader generality, the proposed method is exact when exact answers exist, and it is second-order accurate otherwise. The automatic percentile method is automatic, and for scalar parameter models it can be iterated to achieve higher accuracy, with the number of computations being linear in the number of iterations. However, when nuisance parameters are present, only second-order accuracy seems obtainable.     

Further results on simultaneous confidence bounds in normal models with restricted alternatives

Consider a setup where one-sided simultaneous confidence bounds for linear parametric functions are desired. Here we improve the Bohrer and Francis (1972) bounds for situations where apriori information on the parameters is available in form of some restrictions on the parameter space. Application is made essentially to ordered ANOVA models and simple-tree ANOVA models.     

Minimum-area confidence sets for a normal distribution

When making inference on a normal distribution, one often seeks either a joint confidence region for the two parameters or a confidence band for the cumulative distribution function. A number of methods for constructing such confidence sets are available, but none of these methods guarantees a minimum-area confidence set. In this paper, we derive both a minimum-area joint confidence region for the two parameters and a minimum-area confidence band for the cumulative distribution function. The minimum-area joint confidence region is asymptotically equivalent to other confidence regions in the literature, but the minimum-area confidence band improves on existing confidence bands even asymptotically.     

Simultaneous confidence band for the difference of segmented linear models

Consider comparing between two treatments a response variable, whose expectation depends on the value of a continuous covariate in some nonlinear fashion. We fit separate segmented linear models to each treatment to approximate the nonlinear relationship. For this setting, we provide a simultaneous confidence band for the difference between treatments of the expected value functions. The treatments are said to differ significantly on intervals of the covariate where the simultaneous confidence band does not contain zero. We consider segmented linear models where the locations of the changepoints are both known and unknown. The band is obtained from asymptotic results.     

A stein two-sample procedure for the general linear model with unequal error variances

The pronerties of the tests and confidence regions for the parameters in the classical general linear model depend upon the equality of the variances of the error terms. The level and power of tests and the confidence coefficients associated with confidence regions are vitiated when the assumption of equality is not true. Even when the error variances are equal the power of tests and the size of confidence regions depend upon the unknown common variance and hence are uncontrollable. This paper presents a two-stage procedure which yields tests and confidence regions which are completely independent of the variances of the errors and hence tests with controllable power and confidence regions of fixed controllable size are obtained.     

Confidence regions for Pareto parameters from a single and independent samples

[Abstract] Based on a single and on two independent samples, joint confidence regions for parameters of Pareto distributions are proposed with minimum volume properties and without assigning the confidence level to dimensions. In the one-sample case, comparisons are made to former simultaneous confidence sets for Pareto parameters by means of simulation and a real data set. The two-sample case is studied in various set-ups and comprises simultaneous confidence regions for the shape parameters, the scale parameters, and higher-dimensional vectors of these parameters, where common shape and common scale models are also considered.     

Optimal simultaneous confidence bands in simple linear regression

A simultaneous confidence band provides useful information on the plausible range of an unknown regression model. For simple linear regression models, the most frequently quoted bands in the statistical literature include the hyperbolic band and the three-segment bands. One interesting question is whether one can construct confidence bands better than the hyperbolic and three-segment bands. The optimality criteria for confidence bands include the average width criterion considered by Gafarian (1964) and Naiman (1984) among others, and the minimum area confidence set (MACS) criterion of Liu and Hayter (2007). In this paper, two families of exact 1−α$1-\alpha$ confidence bands, the inner-hyperbolic bands and the outer-hyperbolic bands, which include the hyperbolic and three-segment bands as special cases, are introduced in simple linear regression. Under the MACS criterion, the best confidence band within each family is found by numerical search and compared with the hyperbolic band, the best three-segment band and with each other. The methodologies are illustrated with a numerical example and the Matlab programs used are available upon request.     

On confidence limits for the difference of two binomial parameters

In the present article we suggest two new methods for calculating approximate confidence limits for the differences of the two binomial parameters. Different methods for determining the confidence interval are compared.     

A quadratic programming approach to the construction of simultaneous confidence intervals

Richmond (1982) uses a linear programming approach to the construction of simultaneous confidence intervals for a set of linear estimable parametric functions of the normal mean vector. We present a quadratic programming approach which constructs narrower confidence intervals than the linear programming approach given by Richmond (1982).     

A comparison of two exact confidence regions for partially nonlinear regression models

Exact confidence regions for all the parameters in nonlinear regression models can be obtained by comparing the lengths of projections of the error vector into orthogonal subspaces of the sample space. In certain partially nonlinear models an alternative exact region is obtained by replacing the linear parameters by their conditional estimates in the projection matrices. An ellipsoidal approximation to the alternative region is obtained in terms of the tangent-plane coordinates, similar to one previously obtained for the more usual region. This ellipsoid can be converted to an approximate region for the original parameters and can be used to compare the two types of exact confidence regions.     

Simultaneous confidence intervals for one-way layout based on generalized pivotal quantities

In this paper, we consider simultaneous confidence intervals for all-pairwise comparisons of treatment means in a one-way layout under heteroscedasticity. Two kinds of simultaneous intervals are provided based on the fiducial generalized pivotal quantities of the interest parameters. We prove that they both have asymptotically correct coverage. Simulation results and an example are also reported. It is concluded from calculational evidence that the second kind of simultaneous confidence intervals, which we provide, performs better than existing methods.     

Non-Normal Bivariate Distributions with Normal Marginals

The purpose of this note is to indicate that Fieller's Theorem can be expressed in the matrix formulation of the general linear model. The practical consequence is that one general computer program which can estimate the parameters and test the validity of a pertinent model, can also compute confidence limits for the ratios of any linear combinations of the parameters.