Local influence in multivariate regression

The method of local influence is generalized to the multivariate regression. The scheme of perturbations adopted in multivariate regression is similar in spirit to the perturbation of case-weights in univariate regression case. The method developed here is useful for identifying influential observations in multivariate regression as an exploratory or confirmatory data analysis. An illustrative example is given for the effectiveness of the local influence approach in multivariate regression.     

Corrected confidence intervals for adaptive nonlinear regression models

A nonlinear regression model is considered in which the design variable may be a function of the previous responses. The aim is to construct confidence intervals for the parameter which are asymptotically valid to a high order. This is accomplished by using a tilting argument to construct a first approximation to a pivotal quantity, and then by using a version of Stein's identity and very weak expansions to determine the correction terms. The accuracy of the approximations is assessed by simulation for two well-known nonlinear regression models—the first-order growth or decay model and the Michaelis–Menten model, when one of the two parameters is known. Detailed proofs of the expansions are given.     

A comparison of two exact confidence regions for partially nonlinear regression models

Exact confidence regions for all the parameters in nonlinear regression models can be obtained by comparing the lengths of projections of the error vector into orthogonal subspaces of the sample space. In certain partially nonlinear models an alternative exact region is obtained by replacing the linear parameters by their conditional estimates in the projection matrices. An ellipsoidal approximation to the alternative region is obtained in terms of the tangent-plane coordinates, similar to one previously obtained for the more usual region. This ellipsoid can be converted to an approximate region for the original parameters and can be used to compare the two types of exact confidence regions.     

Modified profile likelihood estimation for the Weibull regression models in survival analysis

In this study, adjustment of profile likelihood function of parameter of interest in presence of many nuisance parameters is investigated for survival regression models. Our objective is to extend the Barndorff–Nielsen’s technique to Weibull regression models for estimation of shape parameter in presence of many nuisance and regression parameters. We conducted Monte-Carlo simulation studies and a real data analysis, all of which demonstrate and suggest that the modified profile likelihood estimators outperform the profile likelihood estimators in terms of three comparison criterion: mean squared errors, bias and standard errors.     

Smoothed empirical likelihood confidence intervals for quantile regression parameters with auxiliary information

This paper develops a smoothed empirical likelihood (SEL)-based method to construct confidence intervals for quantile regression parameters with auxiliary information. First, we define the SEL ratio and show that it follows a Chi-square distribution. We then construct confidence intervals according to this ratio. Finally, Monte Carlo experiments are employed to evaluate the proposed method.     

The geometry of case deletion and the assessment of influence in nonlinear regression

Numerous influence measures are available for use in linear regression. By contrast, very little has been done for nonlinear models. A notable exception is Chapter 4 of Cook and Weisberg (1982). The extension of measures based on case deletion from the linear to the nonlinear model usually involve linear approximation. In this paper, the geometry of case deletion is studied with a view to assessing the adequacy of linear approximation in the construction of influence measures for nonlinear regression. Of particular interest is the adequacy of the one-step estimator for the jack-knifed pseudoestimates of the unknown parameter vector.     

Nonstationary nonlinear quantile regression

This study examines estimation and inference based on quantile regression for parametric nonlinear models with an integrated time series covariate. We first derive the limiting distribution of the nonlinear quantile regression estimator and then consider testing for parameter restrictions, when the regression function is specified as an asymptotically homogeneous function. We also study linear-in-parameter regression models when the regression function is given by integrable regression functions as well as asymptotically homogeneous regression functions. We, furthermore, propose a fully modified estimator to reduce the bias in the original estimator under a certain set of conditions. Finally, simulation studies show that the estimators behave well, especially when the regression error term has a fat-tailed distribution.     

Simultaneous transformations and influence in regression

Influence of simultaneous transformations on the response and some of explanatory variables to the same level in the linear regression is considered. An approximate, but useful diagnostic procedure is developed for practical use. An example is then given for illustrations.     

Simultaneous confidence bands for nonlinear regression models

The maximization and minimization procedure for constructing confidence bands about general regression models is explained. Then, using an existing confidence region about the parameters of a nonlinear regression model and the maximization and minimization procedure, a generally conservative simultaneous confidence band is constructed about the model. Two examples are given, and some problems with the procedure are discussed     

Local influence in binary regression models,and its correspondence with global influence

We develop local influence diagnostics for a general binary regression model,and apply these methods to case-weight perturbations in four examples. In addition, we illustrate the correspondence between case-deletion diagnostics and local case-weight perturbation slopes and curvatures. We demonstrate that local influence diagnostics can provide a more computationally efficient means for obtaining analogous information to that yielded by case-deletion diagnostics, which can be thought of as global influence perturbations. We also assess the global consistency of patterns of local influence using these data examples.     

A robust class of homoscedastic nonlinear regression models

In this paper, we examine a nonlinear regression (NLR) model with homoscedastic errors which follows a flexible class of two-piece distributions based on the scale mixtures of normal (TP-SMN) family. The objective of using this family is to develop a robust NLR model. The TP-SMN is a rich class of distributions that covers symmetric/asymmetric and lightly/heavy-tailed distributions and is an alternative family to the well-known scale mixtures of skew-normal (SMSN) family studied by Branco and Dey [35]. A key feature of this study is using a new suitable hierarchical representation of the family to obtain maximum-likelihood estimates of model parameters via an EM-type algorithm. The performances of the proposed robust model are demonstrated using simulated and some natural real datasets and also compared to other well-known NLR models.     

Empirical likelihood for nonlinear regression models with nonignorable missing responses

This article develops three empirical likelihood (EL) approaches to estimate parameters in nonlinear regression models in the presence of nonignorable missing responses. These are based on the inverse probability weighted (IPW) method, the augmented IPW (AIPW) method and the imputation technique. A logistic regression model is adopted to specify the propensity score. Maximum likelihood estimation is used to estimate parameters in the propensity score by combining the idea of importance sampling and imputing estimating equations. Under some regularity conditions, we obtain the asymptotic properties of the maximum EL estimators of these unknown parameters. Simulation studies are conducted to investigate the finite sample performance of our proposed estimation procedures. Empirical results provide evidence that the AIPW procedure exhibits better performance than the other two procedures. Data from a survey conducted in 2002 are used to illustrate the proposed estimation procedure. The Canadian Journal of Statistics 48: 386–416; 2020 © 2020 Statistical Society of Canada     

Efficient estimation in a nonlinear counting-process regression model

Suppose we observe i.i.d. copies of X, C, Y, where X is a counting process, C is a censoring process talcing only values 0 and 1, and Y is a covariate process. Assume that the intensity process of X is of the form C(s)a(s, Y(s)) with a unknown, but that the distribution of X, C, Y is unspecified otherwise. McKeague and Utikal proposed an estimator for the doubly cumulative hazard f f a(s, y) ds dy and determined its asymptotic distribution. We show that the estimator is regular and efficient in the sense of a Hájek-Inagaki convolution theorem for partially specified models.     

Empirical likelihood-based inference in nonlinear regression models with missing responses at random

This paper investigates the estimations of regression parameters and response mean in nonlinear regression models in the presence of missing response variables that are missing with missingness probabilities depending on covariates. We propose four empirical likelihood (EL)-based estimators for the regression parameters and the response mean. The resulting estimators are shown to be consistent and asymptotically normal under some general assumptions. To construct the confidence regions for the regression parameters as well as the response mean, we develop four EL ratio statistics, which are proven to have the χ² distribution asymptotically. Simulation studies and an artificial data set are used to illustrate the proposed methodologies. Empirical results show that the EL method behaves better than the normal approximation method and that the coverage probabilities and average lengths depend on the selection probability function.     

Convergence rates for uniform confidence intervals based on local polynomial regression estimators

We investigate the convergence rates of uniform bias-corrected confidence intervals for a smooth curve using local polynomial regression for both the interior and boundary region. We discuss the cases when the degree of the polynomial is odd and even. The uniform confidence intervals are based on the volume-of-tube formula modified for biased estimators. We empirically show that the proposed uniform confidence intervals attain, at least approximately, nominal coverage. Finally, we investigate the performance of the volume-of-tube based confidence intervals for independent non-Gaussian errors.     

Influence analysis of additive mixed-effects nonlinear regression models via EM algorithm

This paper presents a unified method for influence analysis to deal with random effects appeared in additive nonlinear regression models for repeated measurement data. The basic idea is to apply the Q-function, the conditional expectation of the complete-data log-likelihood function obtained from EM algorithm, instead of the observed-data log-likelihood function as used in standard influence analysis. Diagnostic measures are derived based on the case-deletion approach and the local influence approach. Two real examples and a simulation study are examined to illustrate our methodology.     

Asymptotic normality of the lengths of a class of nonparametric confidence intervals for a regression parameter

In the linear regression model, the asymptotic distributions of certain functions of confidence bounds of a class of confidence intervals for the regression parameter arc investigated. The class of confidence intervals we consider in this paper are based on the usual linear rank statistics (signed as well as unsigned). Under suitable assumptions, if the confidence intervals are based on the signed linear rank statistics, it is established that the lengths, properly normalized, of the confidence intervals converge in law to the standard normal distributions; if the confidence intervals arc based on the unsigned linear rank statistics, it is then proved that a linear function of the confidence bounds converges in law to a normal distribution.     

A generalized semiparametric regression and its efficient estimation

We investigate a generalized semiparametric regression. Such a model can avoid the risk of wrongly choosing the base measure function. We propose a profile likelihood to efficiently estimate both parameter and nonparametric function. The main difference from the classical profile likelihood is that the profile likelihood proposed is a functional of the base measure function, instead of a function of a real variable. By making the most of the structure information of the semiparametric exponential family, we get an explicit expression of the estimator of the least favorable curve. It ensures that the new profile likelihood is computationally simple. Due to the use of the least favorable curve, the semiparametric efficiency is achieved successfully and the estimation bias is reduced significantly. Simulation studies can illustrate that our proposal is much better than the existing methodologies for most cases under study, and is robust to the different model conditions.     

Computation of determinantal subset influence in regression

One of the important goals of regression diagnostics is the detection of cases or groups of cases which have an inordinate impact on the regression results. Such observations are generally described as influential. A number of influence measures have been proposed, each focusing on a different aspect of the regression. For single cases, these measures are relatively simple and inexpensive to calculate. However, the detection of multiple-case or joint influence is more difficult on two counts. First, calculation of influence for a single subset is more involved than for an individual case, and second, the sheer number of subsets of cases makes the computation overwhelming for all but the smallest data sets.Barrett and Gray (1992) described methods for efficiently examining subset influence for those measures that can be expressed as the trace of a product of positive semidefinite (psd) matrices. There are, however, other popular measures that do not take this form, but rather are expressible as the ratio of determinants of psd matrices. This article focuses on reducing the computation for the determinantal ratio measures by making use of upper and lower bounds on the influence to limit the number of subsets for which the actual influence must be explicitly determined.