Local influence of nonlinear mixed effects model based on M-estimation

Abstract

In this work we mainly study the local influence in nonlinear mixed effects model with M-estimation. A robust method to obtain maximum likelihood estimates for parameters is presented, and the local influence of nonlinear mixed models based on robust estimation (M-estimation) by use of the curvature method is systematically discussed. The counting formulas of curvature for case weights perturbation, response variable perturbation and random error covariance perturbation are derived. Simulation studies are carried to access performance of the methods we proposed. We illustrate the diagnostics by an example presented in Davidian and Giltinan, which was analyzed under the non-robust situation.     

Influential observations in GARCH models

This paper examines local influence assessment in generalized autoregressive conditional heteroscesdasticity models with Gaussian and Student-t errors, where influence is examined via the likelihood displacement. The analysis of local influence is discussed under three perturbation schemes: data perturbation, innovative model perturbation and additive model perturbation. For each case, expressions for slope and curvature diagnostics are derived. Monte Carlo experiments are presented to determine the threshold values for locating influential observations. The empirical study of daily returns of the New York Stock Exchange composite index shows that local influence analysis is a useful technique for detecting influential observations; most of the observations detected as influential are associated with historical shocks in the market. Finally, based on this empirical study and the analysis of simulated data, some advice is given on how to use the discussed methodology.     

Local Influence in Generalized Estimating Equations

Abstract.  We investigate the influence of subjects or observations on regression coefficients of generalized estimating equations (GEEs) using local influence. The GEE approach does not require the full multivariate distribution of the response vector. We extend the likelihood displacement to a quasi-likelihood displacement, and propose local influence diagnostics under several perturbation schemes. An illustrative example in GEEs is given and we compare the results using the local influence and deletion methods.     

Local influence in binary regression models,and its correspondence with global influence

We develop local influence diagnostics for a general binary regression model,and apply these methods to case-weight perturbations in four examples. In addition, we illustrate the correspondence between case-deletion diagnostics and local case-weight perturbation slopes and curvatures. We demonstrate that local influence diagnostics can provide a more computationally efficient means for obtaining analogous information to that yielded by case-deletion diagnostics, which can be thought of as global influence perturbations. We also assess the global consistency of patterns of local influence using these data examples.     

Influence measure in maximum likelihood estimate for models of lifetime data

We use the local influence approach to develop influence measures for identifying observations that strike a disproportionate effect on the maximum likelihood estimate of parameters in models for lifetime data. The proposed method for developing influence measures can be applied to a wide variety of models and we use the exponential model to illustrate the details. In particular, we show that the proposed measure is equivalent to the martingale residual under the exponential model.     

Heteroscedastic log-exponentiated Weibull regression model

We introduce a new class of heteroscedastic log-exponentiated Weibull (LEW) regression models. The class of regression models can be applied to censored data and be used more effectively in survival analysis. Maximum likelihood estimation of the model parameters with censored data as well as influence diagnostics for the new regression model is investigated. For different parameter settings, sample sizes and censoring percentages, various simulation studies are performed and compared to the performance of the heteroscedastic LEW regression model. The normal curvatures for studying local influence are derived under various perturbation schemes. An empirical application to a real data set is provided to illustrate the usefulness of the new class of heteroscedastic regression models.     

Influence diagnostics and outlier tests for semiparametric mixed models

Summary. Semiparametric mixed models are useful in biometric and econometric applications, especially for longitudinal data. Maximum penalized likelihood estimators (MPLEs) have been shown to work well by Zhang and co-workers for both linear coefficients and nonparametric functions. This paper considers the role of influence diagnostics in the MPLE by extending the case deletion and subject deletion analysis of linear models to accommodate the inclusion of a nonparametric component. We focus on influence measures for the fixed effects and provide formulae that are analogous to those for simpler models and readily computable with the MPLE algorithm. We also establish an equivalence between the case or subject deletion model and a mean shift outlier model from which we derive tests for outliers. The influence diagnostics proposed are illustrated through a longitudinal hormone study on progesterone and a simulated example.     

INFLUENCE DIAGNOSTICS IN PROPER DISPERSION MODELS

This paper discusses the application of influence diagnostic methods in univariate proper dispersion models. This class includes, in particular, continuous generalized linear models as well as other subclasses of continuous regression models. We emphasize the study of the local influence on the likelihood displacement and predictions from the models. Some of the diagnostics are illustrated by an example on directional data.     

Estimation and diagnostic analysis in skew-generalized-normal regression models

The skew-generalized-normal distribution [Arellano-Valle, RB, Gómez, HW, Quintana, FA. A new class of skew-normal distributions. Comm Statist Theory Methods 2004;33(7):1465–1480] is a class of asymmetric normal distributions, which contains the normal and skew-normal distributions as special cases. The main virtues of this distribution is that it is easy to simulate from and it also supplies a genuine expectation–maximization (EM) algorithm for maximum likelihood estimation. In this paper, we extend the EM algorithm for linear regression models assuming skew-generalized-normal random errors and we develop a diagnostics analyses via local influence and generalized leverage, following Zhu and Lee's approach. This is because Cook's well-known approach would be more complicated to use to obtain measures of local influence. Finally, results obtained for a real data set are reported, illustrating the usefulness of the proposed method.     

On a tobit–Birnbaum–Saunders model with an application to medical data

The tobit model allows a censored response variable to be described by covariates. Its applications cover different areas such as economics, engineering, environment and medicine. A strong assumption of the standard tobit model is that its errors follow a normal distribution. However, not all applications are well modeled by this distribution. Some efforts have relaxed the normality assumption by considering more flexible distributions. Nevertheless, the presence of asymmetry could not be well described by these flexible distributions. A real-world data application of measles vaccine in Haiti is explored, which confirms this asymmetry. We propose a tobit model with errors following a Birnbaum–Saunders (BS) distribution, which is asymmetrical and has shown to be a good alternative for describing medical data. Inference based on the maximum likelihood method and a type of residual are derived for the tobit–BS model. We perform global and local influence diagnostics to assess the sensitivity of the maximum likelihood estimators to atypical cases. A Monte Carlo simulation study is carried out to empirically evaluate the performance of these estimators. We conduct a data analysis for the mentioned application of measles vaccine based on the proposed model with the help of the R software. The results show the good performance of the tobit–BS model.     

Log-Weibull extended regression model: Estimation,sensitivity and residual analysis

The failure rate function commonly has a bathtub shape in practice. In this paper we discuss a regression model considering new Weibull extended distribution developed by Xie et al. (2002) that can be used to model this type of failure rate function. Assuming censored data, we discuss parameter estimation: maximum likelihood method and a Bayesian approach where Gibbs algorithms along with Metropolis steps are used to obtain the posterior summaries of interest. We derive the appropriate matrices for assessing the local influence on the parameter estimates under different perturbation schemes, and we also present some ways to perform global influence. Also, some discussions on case deletion influence diagnostics are developed for the joint posterior distribution based on the Kullback–Leibler divergence. Besides, for different parameter settings, sample sizes and censoring percentages, are performed various simulations and display and compare the empirical distribution of the Martingale-type residual with the standard normal distribution. These studies suggest that the residual analysis usually performed in normal linear regression models can be straightforwardly extended to the martingale-type residual in log-Weibull extended models with censored data. Finally, we analyze a real data set under a log-Weibull extended regression model. We perform diagnostic analysis and model check based on the martingale-type residual to select an appropriate model.     

Asymmetric Forecast Densities for U.S. Macroeconomic Variables from a Gaussian Copula Model of Cross-Sectional and Serial Dependence

Most existing reduced-form macroeconomic multivariate time series models employ elliptical disturbances, so that the forecast densities produced are symmetric. In this article, we use a copula model with asymmetric margins to produce forecast densities with the scope for severe departures from symmetry. Empirical and skew t distributions are employed for the margins, and a high-dimensional Gaussian copula is used to jointly capture cross-sectional and (multivariate) serial dependence. The copula parameter matrix is given by the correlation matrix of a latent stationary and Markov vector autoregression (VAR). We show that the likelihood can be evaluated efficiently using the unique partial correlations, and estimate the copula using Bayesian methods. We examine the forecasting performance of the model for four U.S. macroeconomic variables between 1975:Q1 and 2011:Q2 using quarterly real-time data. We find that the point and density forecasts from the copula model are competitive with those from a Bayesian VAR. During the recent recession the forecast densities exhibit substantial asymmetry, avoiding some of the pitfalls of the symmetric forecast densities from the Bayesian VAR. We show that the asymmetries in the predictive distributions of GDP growth and inflation are similar to those found in the probabilistic forecasts from the Survey of Professional Forecasters. Last, we find that unlike the linear VAR model, our fitted Gaussian copula models exhibit nonlinear dependencies between some macroeconomic variables. This article has online supplementary material.     

Influence diagnostics for the structural errors-in-variables model under the Student-t distribution

The influence of observations on the parameter estimates for the simple structural errors-in-variables model with no equation error, under the Student-t distribution, is investigated using the local influence approach. The main conclusion is that the Student-t model with small degrees of freedom is able to incorporate possible outliers and influential observations in the data. The likelihood displacement approach is useful for outlier detection, especially when a masking phenomenon is present and the degrees of freedom parameter is large. The diagnostics are illustrated with two examples.     

Local Influence Analysis for Penalized Gaussian Likelihood Estimators in Partially Linear Models

Abstract. Partially linear models are extensions of linear models to include a non-parametric function of some covariate. They have been found to be useful in both cross-sectional and longitudinal studies. This paper provides a convenient means to extend Cook's local influence analysis to the penalized Gaussian likelihood estimator that uses a smoothing spline as a solution to its non-parametric component. Insight is also provided into the interplay of the influence or leverage measures between the linear and the non-parametric components in the model. The diagnostics are applied to a mouthwash data set and a longitudinal hormone study with informative results.     

On local influence for elliptical linear models

The local influence method plays an important role in regression diagnostics and sensitivity analysis. To implement it, we need the Delta matrix for the underlying scheme of perturbations, in addition to the observed information matrix under the postulated model. Galea, Paula and Bolfarine (1997) has recently given the observed information matrix and the Delta matrix for a scheme of scale perturbations and has assessed of local influence for elliptical linear regression models. In the present paper, we consider the same elliptical linear regression models. We study the schemes of scale, predictor and response perturbations, and obtain their corresponding Delta matrices, respectively. To illustrate the methodology for assessment of local influence for these schemes and the implementation of the obtained results, we give an example.     

Likelihood Function and Canonical Correlation Analysis of the Peña–Box Model

The Peña–Box model is a type of dynamic factor model whose factors try to capture the time-effect movements of a multiple time series. The Peña–Box model can be expressed as a vector autoregressive (VAR) model with constraints. This article derives the maximum likelihood estimates and the likelihood ratio test of the VAR model for Gaussian processes. Then a test statistic constructed by canonical correlation coefficients is presented and adjusted for conditional heteroscedasticity. Simulations confirm the validity of adjustments for conditional heteroscedasticity, and show that the proposed statistics perform better than the statistics used in the existing literature.     

空间自回归模型的局部影响分析和运用

由于空间数据的相依特性，使得通常的删除点诊断异常值的方法不适合采用。为了寻找数据中的异常点和影响点，采用局部影响分析技术，通过引入扰动的方法来发现影响点，最后通过实例说明局部影响分析技术能够有效地发现模型中可能的影响点，并且能够揭示更多的细节信息。     

Influence diagnostic analysis in the possibly heteroskedastic linear model with exact restrictions

The local influence method has proven to be a useful and powerful tool for detecting influential observations on the estimation of model parameters. This method has been widely applied in different studies related to econometric and statistical modelling. We propose a methodology based on the Lagrange multiplier method with a linear penalty function to assess local influence in the possibly heteroskedastic linear regression model with exact restrictions. The restricted maximum likelihood estimators and information matrices are presented for the postulated model. Several perturbation schemes for the local influence method are investigated to identify potentially influential observations. Three real-world examples are included to illustrate and validate our methodology.     

Inference and diagnostics in skew scale mixtures of normal regression models

Skew scale mixtures of normal distributions are often used for statistical procedures involving asymmetric data and heavy-tailed. The main virtue of the members of this family of distributions is that they are easy to simulate from and they also supply genuine expectation-maximization (EM) algorithms for maximum likelihood estimation. In this paper, we extend the EM algorithm for linear regression models and we develop diagnostics analyses via local influence and generalized leverage, following Zhu and Lee's approach. This is because Cook's well-known approach cannot be used to obtain measures of local influence. The EM-type algorithm has been discussed with an emphasis on the skew Student-t-normal, skew slash, skew-contaminated normal and skew power-exponential distributions. Finally, results obtained for a real data set are reported, illustrating the usefulness of the proposed method.