Optimal designs based on exact confidence regions for parameter estimation of a nonlinear regression model

This paper is concerned with the proposal of optimality criteria, referred to as X  - and X^′$X^{\prime }$-optimality criteria, and the construction of X  - and X^′$X^{\prime }$-optimal designs, for nonlinear regression models. These optimal designs aim at improving the estimation of parameters of this class of models. The principle of these criteria is the minimization, with respect to the design, of the expected volume of a particular exact parametric confidence region. In this paper we give detailed definitions, properties, and computation methods of X  - and X^′$X^{\prime }$-optimal designs. We also compare these designs with the classic local D-optimal designs, with regard to robustness and efficiency, for two very well-known academic models (Box–Lucas and Michaelis–Menten models).     

Exact tests and confidence regions in nonlinear regression

Nonlinear regression models with spherically symmetric error vectors and a single nonlinear parameter are considered. On the basis of a new geometric approach, exact one- and two-sided tests and confidence regions for the nonlinear parameter are derived in the cases of known and unknown error variances. A geometric measure representation formula is used to determine the power functions of the tests if the error variance is known and to derive different lower bounds for the power function of a one-sided test in the case of an unknown error variance. The latter can be done quite effectively by constructing and measuring several balls inside the critical region. A numerical study compares the results for different density generating functions of the error distribution.     

A comparison of two exact confidence regions for partially nonlinear regression models

Exact confidence regions for all the parameters in nonlinear regression models can be obtained by comparing the lengths of projections of the error vector into orthogonal subspaces of the sample space. In certain partially nonlinear models an alternative exact region is obtained by replacing the linear parameters by their conditional estimates in the projection matrices. An ellipsoidal approximation to the alternative region is obtained in terms of the tangent-plane coordinates, similar to one previously obtained for the more usual region. This ellipsoid can be converted to an approximate region for the original parameters and can be used to compare the two types of exact confidence regions.     

Empirical likelihood based confidence regions for first order parameters of heavy-tailed distributions

Let X₁,…,X_n be some i.i.d. observations from a heavy-tailed distribution F, i.e. the common distribution of the excesses over a high threshold u_n can be approximated by a generalized Pareto distribution G_γ,σn with γ>0. This paper deals with the problem of finding confidence regions for the couple (γ,σ_n): combining the empirical likelihood methodology with estimation equations (close but not identical to the likelihood equations) introduced by Zhang (2007), asymptotically valid confidence regions for (γ,σ_n) are obtained and proved to perform better than Wald-type confidence regions (especially those derived from the asymptotic normality of the maximum likelihood estimators). By profiling out the scale parameter, confidence intervals for the tail index are also derived.     

On confidence regions of semiparametric nonlinear reproductive dispersion models

This article investigates the confidence regions for semiparametric nonlinear reproductive dispersion models (SNRDMs), which is an extension of nonlinear regression models. Based on local linear estimate of nonparametric component and generalized profile likelihood estimate of parameter in SNRDMs, a modified geometric framework of Bates and Wattes is proposed. Within this geometric framework, we present three kinds of improved approximate confidence regions for the parameters and parameter subsets in terms of curvatures. The work extends the previous results of Hamilton et al. [in Accounting for intrinsic nonlinearity in nonlinear regression parameter inference regions, Ann. Statist. 10, pp. 386–393, 1982], Hamilton [in Confidence regions for parameter subset in nonlinear regression, Biometrika, 73, pp. 57–64, 1986], Wei [in On confidence regions of embedded models in regular parameter families (a geometric approch), Austral. J. Statist. 36, pp. 327–338, 1994], Tang et al. [in Confidence regions in quasi-likelihood nonlinear models: a geometric approach, J. Biomath. 15, pp. 55–64, 2000b] and Zhu et al. [in On confidence regions of semiparametric nonlinear regression models, Acta. Math. Scient. 20, pp. 68–75, 2000].     

Confidence intervals for secondary parameters following a sequential test

In sequential studies, formal interim analyses are usually restricted to a consideration of a single null hypothesis concerning a single parameter of interest. Valid frequentist methods of hypothesis testing and of point and interval estimation for the primary parameter have already been devised for use at the end of such a study. However, the completed data set may warrant a more detailed analysis, involving the estimation of parameters corresponding to effects that were not used to determine when to stop, and yet correlated with those that were. This paper describes methods for setting confidence intervals for secondary parameters in a way which provides the correct coverage probability in repeated frequentist realizations of the sequential design used. The method assumes that information accumulates on the primary and secondary parameters at proportional rates. This requirement will be valid in many potential applications, but only in limited situations in survival analysis.     

Smoothed empirical likelihood confidence intervals for quantile regression parameters with auxiliary information

This paper develops a smoothed empirical likelihood (SEL)-based method to construct confidence intervals for quantile regression parameters with auxiliary information. First, we define the SEL ratio and show that it follows a Chi-square distribution. We then construct confidence intervals according to this ratio. Finally, Monte Carlo experiments are employed to evaluate the proposed method.     

Confidence regions for parameters in linear models with additional information

Using given significant additional information it is possible to improve different confidence regions for the regression parameters in a linear model. Thereby, the given informations may concern the expectation and (or) the variance of the observations, and an improvement is possible in the sense of the decrease of the confidence regions' size. In particular it is possible to improve the so called confidence ellipsoids which are often used to estimate the considered parameters.     

Robust confidence regions for the semi-parametric regression model with responses missing at random

In this paper, a regression semi-parametric model is considered where responses are assumed to be missing at random. From the empirical likelihood function defined based on the rank-based estimating equation, robust confidence intervals/regions of the true regression coefficient are derived. Monte Carlo simulation experiments show that the proposed approach provides more accurate confidence intervals/regions compared to its normal approximation counterpart under different model error structure. The approach is also compared with the least squares approach, and its superiority is shown whenever the error distribution in the simulation study is heavy tailed or contaminated. Finally, a real data example is given to illustrate our proposed method.     

Pseudo confidence regions for the solution of a multivariate linear functional relationship

The problem of finding confidence regions (CR) for a q-variate vector γ given as the solution of a linear functional relationship (LFR) Λγ = μ is investigated. Here an m-variate vector μ and an m × q matrix Λ = (Λ₁, Λ₂,…, Λ_q) are unknown population means of an m(q+1)-variate normal distribution $\text{N}{}_{\mathrm{m(q+1)}}\text{(ζΩ?Σ)}$, where ζ′ = (μ′, Λ₁′, Λ₂′,…, Λ_q′Σ is an unknown, symmetric and positive definite m × m matrix and Ω is a known, symmetric and positive definite (q+1) × (q+1) matrix and ? denotes the Kronecker product. This problem is a generalization of the univariate special case for the ratio of normal means.A CR for γ with level of confidence 1 ? α, is given by a quadratic inequality, which yields the so-called ‘pseudo’ confidence regions (PCR) valid conditionally in subsets of the parameter space. Our discussion is focused on the ‘bounded pseudo’ confidence region (BPCR) given by the interior of a hyperellipsoid. The two conditions necessary for a BPCR to exist are shown to be the consistency conditions concerning the multivariate LFR. The probability that these conditions hold approaches one under ‘reasonable circumstances’ in many practical situations. Hence, we may have a BPCR with confidence approximately 1 ? α. Some simulation results are presented.     

Subsampling confidence intervals for parameters of atmospheric time series: block size choice and calibration

Problems of practical implementation of the computer intensive subsampling methodology are addressed by Monte Carlo simulations of a situation typical for atmospheric time series. The motivating data were collected under Lake-Effect Snow Studies Project in the winter of 1983–1984 over Lake Michigan. Certain enhancements of subsampling methodology are suggested specifically on the issue of optimal block size choice.     

A note on nonlinear regression for the autoregressive moving average with non-hd errors

Estimation by nonlinear regression of the parameters for the stationary and invertible autoregressive moving average (ARMA) model with mixing or martingale difference errors is considered. Simple proofs of consistency and asymptotic normality for the nonlinear least squares estimator are given by exploiting results from nonlinear estimation theory and mixing and mixingale theory.     

Simultaneous confidence regions for the parameters of a Poisson INAR(1) model

The INAR(1) model (integer-valued autoregressive) is commonly used to model serially dependent processes of Poisson counts. We propose several asymptotic simultaneous confidence regions for the two parameters of a Poisson INAR(1) model, and investigate their performance and robustness for finite-length time series in a simulation study. Practical recommendations are derived, and the application of the confidence regions is illustrated by a real-data example.     

On confidence regions for the mean of a multivariate time series

We consider the problem of setting up a confidence region for the mean of amultivariate timeseries ont he basis of a part-realisation of that series.A procedure for setting up a confidence interval for the mean of a univariate time series Is implicitin Jones(1976).We present an analogous procedure for setting up a confidence region for the mean of a multivariatet ime series.This procedure is base donastatistic which is an analogue of Hotelling'sT'.Our results are applied to a comparison of climate means obtained from experiments with a General Circulation Model of the earth's atmosphere.     

Stein type confidence interval of the disturbance variance in a linear regression model with multivariate student-t distributed errors

This paper considers the interval estimation of the disturbance variance in a linear regression model with multivariate Student-t errors. The distribution function of the Stein type estimator under multivariate Student-t errors is derived, and the coverage probability of the Stein type confidence interval which is constructed under the normality assumption is numerically calculated under the multivariate Student-t distribution. It is shown that the coverage probability of the Stein type confidence interval is sometimes much smaller than the nominal level, and that it is larger than that of the usual confidence interval in almost all cases. For the case when it is known that errors have a multivariate Student-t distribution, sufficient conditions under which the Stein type confidence interval improves on the usual confidence interval are given, and the coverage probability of the stein type confidence interval is numerically evaluated.     

A set of independent sequential residuals for the multivariate regression model

In this paper a set of residuals for the multivariate linear regression model is introduced. These residuals are shown to be independent with known distributions which do not depend on the parameters of the model. Transformations of the mentioned residuals may be used to construct exact α goodness-of-fit tests for the multivariate regression model.     

Approximated non parametric confidence regions for the ratio of two percentiles

In the wood industry, it is common practice to compare in terms of the ratio of the same-strength properties for lumber of two different dimensions, grades, or species. Because United States lumber standards are given in terms of population fifth percentile, and strength problems arise from the weaker fifth percentile rather than the stronger mean, so the ratio should be expressed in terms of the fifth percentiles rather than the means of two strength distributions. Percentiles are estimated by order statistics. This paper assumes small samples to derive new non parametric methods such as percentile sign test and percentile Wilcoxon signed rank test, construct confidence intervals with covergage rate 1 – αx for single percentiles, and compute confidence regions for ratio of percentiles based on confidence intervals for single percentiles. Small 1 – αx is enough to obtain good coverage rates of confidence regions most of the time.     

Simultaneous pseudo confidence regions for ratios of the discriminant coefficients

We consider simultaneous confidence regions for some hypotheses on ratios of the discriminant coefficients of the linear discriminant function when the population means and common covariance matrix are unknown. This problem, involving hypotheses on ratios, yields the so-called ‘pseudo’ confidence regions valid conditionally in subsets of the parameter space. We obtain the explicit formulae of the regions and give further discussion on the validity of these regions. Illustrations of the pseudo confidence regions are given.