Efficient estimation in a nonlinear counting-process regression model

Suppose we observe i.i.d. copies of X, C, Y, where X is a counting process, C is a censoring process talcing only values 0 and 1, and Y is a covariate process. Assume that the intensity process of X is of the form C(s)a(s, Y(s)) with a unknown, but that the distribution of X, C, Y is unspecified otherwise. McKeague and Utikal proposed an estimator for the doubly cumulative hazard f f a(s, y) ds dy and determined its asymptotic distribution. We show that the estimator is regular and efficient in the sense of a Hájek-Inagaki convolution theorem for partially specified models.     

Simultaneous confidence bands for nonlinear regression models

The maximization and minimization procedure for constructing confidence bands about general regression models is explained. Then, using an existing confidence region about the parameters of a nonlinear regression model and the maximization and minimization procedure, a generally conservative simultaneous confidence band is constructed about the model. Two examples are given, and some problems with the procedure are discussed     

Empirical likelihood inferences for varying coefficient partially nonlinear models

In this article, empirical likelihood inferences for the varying coefficient partially nonlinear models are investigated. An empirical log-likelihood ratio function for the unknown parameter vector in the nonlinear function part and a residual-adjusted empirical log-likelihood ratio function for the nonparametric component are proposed. The corresponding Wilks phenomena are proved and the confidence regions for parametric component and nonparametric component are constructed. Simulation studies indicate that, in terms of coverage probabilities and average areas of the confidence regions, the empirical likelihood method performs better than the normal approximation-based method. Furthermore, a real data set application is also provided to illustrate the proposed empirical likelihood estimation technique.     

Block empirical likelihood for longitudinal partially linear regression models

The authors propose a block empirical likelihood procedure to accommodate the within‐group correlation in longitudinal partially linear regression models. This leads them to prove a nonparametric version of the Wilks theorem. In comparison with normal approximations, their method does not require a consistent estimator for the asymptotic covariance matrix, which makes it easier to conduct inference on the parametric component of the model. An application to a longitudinal study on fluctuations of progesterone level in a menstrual cycle is used to illustrate the procedure developed here.     

Quantile regression for robust inference on varying coefficient partially nonlinear models

In this paper, we propose a robust statistical inference approach for the varying coefficient partially nonlinear models based on quantile regression. A three-stage estimation procedure is developed to estimate the parameter and coefficient functions involved in the model. Under some mild regularity conditions, the asymptotic properties of the resulted estimators are established. Some simulation studies are conducted to evaluate the finite performance as well as the robustness of our proposed quantile regression method versus the well known profile least squares estimation procedure. Moreover, the Boston housing price data is given to further illustrate the application of the new method.     

On confidence regions of semiparametric nonlinear reproductive dispersion models

This article investigates the confidence regions for semiparametric nonlinear reproductive dispersion models (SNRDMs), which is an extension of nonlinear regression models. Based on local linear estimate of nonparametric component and generalized profile likelihood estimate of parameter in SNRDMs, a modified geometric framework of Bates and Wattes is proposed. Within this geometric framework, we present three kinds of improved approximate confidence regions for the parameters and parameter subsets in terms of curvatures. The work extends the previous results of Hamilton et al. [in Accounting for intrinsic nonlinearity in nonlinear regression parameter inference regions, Ann. Statist. 10, pp. 386–393, 1982], Hamilton [in Confidence regions for parameter subset in nonlinear regression, Biometrika, 73, pp. 57–64, 1986], Wei [in On confidence regions of embedded models in regular parameter families (a geometric approch), Austral. J. Statist. 36, pp. 327–338, 1994], Tang et al. [in Confidence regions in quasi-likelihood nonlinear models: a geometric approach, J. Biomath. 15, pp. 55–64, 2000b] and Zhu et al. [in On confidence regions of semiparametric nonlinear regression models, Acta. Math. Scient. 20, pp. 68–75, 2000].     

Empirical likelihood-based inference in nonlinear regression models with missing responses at random

This paper investigates the estimations of regression parameters and response mean in nonlinear regression models in the presence of missing response variables that are missing with missingness probabilities depending on covariates. We propose four empirical likelihood (EL)-based estimators for the regression parameters and the response mean. The resulting estimators are shown to be consistent and asymptotically normal under some general assumptions. To construct the confidence regions for the regression parameters as well as the response mean, we develop four EL ratio statistics, which are proven to have the χ² distribution asymptotically. Simulation studies and an artificial data set are used to illustrate the proposed methodologies. Empirical results show that the EL method behaves better than the normal approximation method and that the coverage probabilities and average lengths depend on the selection probability function.     

Bias-corrected estimations in varying-coefficient partially nonlinear models with measurement error in the nonparametric part

In this paper, we consider the statistical inference for the varying-coefficient partially nonlinear model with additive measurement errors in the nonparametric part. The local bias-corrected profile nonlinear least-squares estimation procedure for parameter in nonlinear function and nonparametric function is proposed. Then, the asymptotic normality properties of the resulting estimators are established. With the empirical likelihood method, a local bias-corrected empirical log-likelihood ratio statistic for the unknown parameter, and a corrected and residual adjusted empirical log-likelihood ratio for the nonparametric component are constructed. It is shown that the resulting statistics are asymptotically chi-square distribution under some suitable conditions. Some simulations are conducted to evaluate the performance of the proposed methods. The results indicate that the empirical likelihood method is superior to the profile nonlinear least-squares method in terms of the confidence regions of parameter and point-wise confidence intervals of nonparametric function.     

Optimal designs based on exact confidence regions for parameter estimation of a nonlinear regression model

This paper is concerned with the proposal of optimality criteria, referred to as X  - and X^′$X^{\prime }$-optimality criteria, and the construction of X  - and X^′$X^{\prime }$-optimal designs, for nonlinear regression models. These optimal designs aim at improving the estimation of parameters of this class of models. The principle of these criteria is the minimization, with respect to the design, of the expected volume of a particular exact parametric confidence region. In this paper we give detailed definitions, properties, and computation methods of X  - and X^′$X^{\prime }$-optimal designs. We also compare these designs with the classic local D-optimal designs, with regard to robustness and efficiency, for two very well-known academic models (Box–Lucas and Michaelis–Menten models).     

Markov chain Monte Carlo exact inference for binomial and multinomial logistic regression models

We develop Metropolis-Hastings algorithms for exact conditional inference, including goodness-of-fit tests, confidence intervals and residual analysis, for binomial and multinomial logistic regression models. We present examples where the exact results, obtained by enumeration, are available for comparison. We also present examples where Monte Carlo methods provide the only feasible approach for exact inference.     

Estimation and inference for varying coefficient partially nonlinear models

In this paper, we extend the varying coefficient partially linear model to the varying coefficient partially nonlinear model in which the linear part of the varying coefficient partially linear model is replaced by a nonlinear function of the covariates. A profile nonlinear least squares estimation procedure for the parameter vector and the coefficient function vector of the varying coefficient partially nonlinear model is proposed and the asymptotic properties of the resulting estimators are established. We further propose a generalized likelihood ratio (GLR) test to check whether or not the varying coefficients in the model are constant. The asymptotic null distribution of the GLR statistic is derived and a residual-based bootstrap procedure is also suggested to derive the p-value of the GLR test. Some simulations are conducted to assess the performance of the proposed estimating and testing procedures and the results show that both the procedures perform well in finite samples. Furthermore, a real data example is given to demonstrate the application of the proposed model and its estimating and testing procedures.     

Using jackknife in nonlinear models - confidence regions for a function of the structural parameter

A method of constructing jackknife confidence regions for a function of the structural parameter of a nonlinear model is investigated. The method is available for nonlinear regression models as well as for models with errors in the variables. Properties are discussed in comparison with traditional methods. This is supported by a simulation study.     

Corrected confidence intervals for adaptive nonlinear regression models

A nonlinear regression model is considered in which the design variable may be a function of the previous responses. The aim is to construct confidence intervals for the parameter which are asymptotically valid to a high order. This is accomplished by using a tilting argument to construct a first approximation to a pivotal quantity, and then by using a version of Stein's identity and very weak expansions to determine the correction terms. The accuracy of the approximations is assessed by simulation for two well-known nonlinear regression models—the first-order growth or decay model and the Michaelis–Menten model, when one of the two parameters is known. Detailed proofs of the expansions are given.     

Semiparametric partially linear regression models for functional data

In the context of longitudinal data analysis, a random function typically represents a subject that is often observed at a small number of time point. For discarding this restricted condition of observation number of each subject, we consider the semiparametric partially linear regression models with mean function x^?β$x^{?}\beta$ + g(z), where x and z   are functional data. The estimations of β$\beta$ and g(z) are presented and some asymptotic results are given. It is shown that the estimator of the parametric component is asymptotically normal. The convergence rate of the estimator of the nonparametric component is also obtained. Here, the observation number of each subject is completely flexible. Some simulation study is conducted to investigate the finite sample performance of the proposed estimators.     

An asymptotic theory for semiparametric generalized least squares estimation in partially linear regression models

Consider a partially linear regression model with an unknown vector parameter β, an unknown functiong(·), and unknown heteroscedastic error variances. In this paper we develop an asymptotic semiparametric generalized least squares estimation theory under some weak moment conditions. These moment conditions are satisfied by many of the error distributions encountered in practice, and our theory does not require the number of replications to go to infinity.     

A new estimation procedure for a partially nonlinear model via a mixed‐effects approach

The authors consider the estimation of the parametric component of a partially nonlinear semiparametric regression model whose nonparametric component is viewed as a nuisance parameter. They show how estimation can proceed through a nonlinear mixed‐effects model approach. They prove that under certain regularity conditions, the proposed estimate is consistent and asymptotically Gaussian. They investigate its finite‐sample properties through simulations and illustrate its use with data on the relation between the photosynthetically active radiation and the net ecosystem‐atmosphere exchange of carbon dioxide.     

Assessing case influence on confidence intervals in nonlinear regression

Diagnostic techniques are proposed for assessing the influence of individual cases on confidence intervals in nonlinear regression. The technique proposed uses the method of profile t-plots applied to the case-deletion model. The effect of the geometry of the statistical model on the influence measures is assessed, and an algorithm for computing case-deleted confidence intervals is described. This algorithm provides a direct method for constructing a simple diagnostic measure based on the ratio of the lengths of confidence intervals. The generalization of these methods to multiresponse models is discussed.     

Quantile regression estimation of partially linear additive models

In this paper, we consider the estimation of partially linear additive quantile regression models where the conditional quantile function comprises a linear parametric component and a nonparametric additive component. We propose a two-step estimation approach: in the first step, we approximate the conditional quantile function using a series estimation method. In the second step, the nonparametric additive component is recovered using either a local polynomial estimator or a weighted Nadaraya–Watson estimator. Both consistency and asymptotic normality of the proposed estimators are established. Particularly, we show that the first-stage estimator for the finite-dimensional parameters attains the semiparametric efficiency bound under homoskedasticity, and that the second-stage estimators for the nonparametric additive component have an oracle efficiency property. Monte Carlo experiments are conducted to assess the finite sample performance of the proposed estimators. An application to a real data set is also illustrated.     

Empirical likelihood-based inference for parameter and nonparametric function in partially nonlinear models

This paper is concerned with statistical inference for partially nonlinear models. Empirical likelihood method for parameter in nonlinear function and nonparametric function is investigated. The empirical log-likelihood ratios are shown to be asymptotically chi-square and then the corresponding confidence intervals are constructed. By the empirical likelihood ratio functions, we also obtain the maximum empirical likelihood estimators of the parameter in nonlinear function and nonparametric function, and prove the asymptotic normality. A simulation study indicates that, compared with normal approximation-based method and the bootstrap method, the empirical likelihood method performs better in terms of coverage probabilities and average length/widths of confidence intervals/bands. An application to a real dataset is illustrated.