Stepwise local influence in generalized autoregressive conditional heteroskedasticity models

Detection of outliers or influential observations is an important work in statistical modeling, especially for the correlated time series data. In this paper we propose a new procedure to detect patch of influential observations in the generalized autoregressive conditional heteroskedasticity (GARCH) model. Firstly we compare the performance of innovative perturbation scheme, additive perturbation scheme and data perturbation scheme in local influence analysis. We find that the innovative perturbation scheme give better result than other two schemes although this perturbation scheme may suffer from masking effects. Then we use the stepwise local influence method under innovative perturbation scheme to detect patch of influential observations and uncover the masking effects. The simulated studies show that the new technique can successfully detect a patch of influential observations or outliers under innovative perturbation scheme. The analysis based on simulation studies and two real data sets show that the stepwise local influence method under innovative perturbation scheme is efficient for detecting multiple influential observations and dealing with masking effects in the GARCH model.     

Bayesian local influence for survival models

The aim of this paper is to develop a Bayesian local influence method (Zhu et al. 2009, submitted) for assessing minor perturbations to the prior, the sampling distribution, and individual observations in survival analysis. We introduce a perturbation model to characterize simultaneous (or individual) perturbations to the data, the prior distribution, and the sampling distribution. We construct a Bayesian perturbation manifold to the perturbation model and calculate its associated geometric quantities including the metric tensor to characterize the intrinsic structure of the perturbation model (or perturbation scheme). We develop local influence measures based on several objective functions to quantify the degree of various perturbations to statistical models. We carry out several simulation studies and analyze two real data sets to illustrate our Bayesian local influence method in detecting influential observations, and for characterizing the sensitivity to the prior distribution and hazard function.     

Local influence for functional comparative calibration models with replicated data

We investigate local influence analysis in functional comparative calibration models with replicated data. A method for selecting appropriate perturbation schemes based on the expected Fisher information matrix with respect to the perturbation vector is proposed. It is shown that arbitrarily perturbing these models may result in misleading inference about the influential subjects. First-order influence measures for identifying the correct influential subjects and replicates on corrected score estimators are defined. We introduce different perturbation schemes including perturbation of subjects and replicates on the corrected likelihood function and obtain the density of the perturbed model from which the methodology is based. Particularly, three perturbation of variances schemes could be a better way to handle badly modeled subjects or replicates. Two real data sets are analyzed to illustrate the use of our local influence measures.     

Local influence of nonlinear mixed effects model based on M-estimation

Abstract

In this work we mainly study the local influence in nonlinear mixed effects model with M-estimation. A robust method to obtain maximum likelihood estimates for parameters is presented, and the local influence of nonlinear mixed models based on robust estimation (M-estimation) by use of the curvature method is systematically discussed. The counting formulas of curvature for case weights perturbation, response variable perturbation and random error covariance perturbation are derived. Simulation studies are carried to access performance of the methods we proposed. We illustrate the diagnostics by an example presented in Davidian and Giltinan, which was analyzed under the non-robust situation.     

Error bounds for the perturbation solution of the transition density under a multi-factor CIR term structure model with weak mean-reversion effect

Abstract

We consider a multi-factor Cox-Ingersoll-Ross (CIR) model of the term structure of interest rates with weak mean-reversion effect. We use perturbation theory to analyze its conditional characteristic function illustrated by a system of Riccati equations and derive the error bounds for the perturbation approximations. Using the Fourier inversion theorem, we clarify that the perturbation approximation of the conditional characteristic function can be applied to estimate the transition density and likelihood function. We provide their error bounds and accuracy orders. Finally, we discuss the performance of the perturbation approximation in estimating the transition density via simulation.     

A performance counterexample of Billor–Chatterjee–Hadi procedure and an improvement proposal for robust regression

The BCH procedure introduced by Billor, Chatterjee, and Hadi for fitting linear models was found to be inefficient for y-outliers in the presence of a high perturbation level. We propose to modify the first step of the BCH procedure, so that the robust distances are computed on the matrix Z = (y, X) of the basic subset. The performance of the present note procedure (PNP), as compared to the BCH procedure and the ordinary least-square (OLS) method, was studied by processing several datasets used in the literature for robust regression and by performing a Monte Carlo experiment. PNP performs better particularly with datasets having high perturbation.     

Local influence assessment in canonical correlation analysis

The local influence method is adapted to canonical correlation analysis for the purpose of investigating the influence of observations. We consider a perturbation based on the empirical distribution function. An illustrative example is given to show the effectiveness of the local influence method for the identification of influential observations.     

Adaptive Modeling Procedure Selection by Data Perturbation

Many procedures have been developed to deal with the high-dimensional problem that is emerging in various business and economics areas. To evaluate and compare these procedures, modeling uncertainty caused by model selection and parameter estimation has to be assessed and integrated into a modeling process. To do this, a data perturbation method estimates the modeling uncertainty inherited in a selection process by perturbing the data. Critical to data perturbation is the size of perturbation, as the perturbed data should resemble the original dataset. To account for the modeling uncertainty, we derive the optimal size of perturbation, which adapts to the data, the model space, and other relevant factors in the context of linear regression. On this basis, we develop an adaptive data-perturbation method that, unlike its nonadaptive counterpart, performs well in different situations. This leads to a data-adaptive model selection method. Both theoretical and numerical analysis suggest that the data-adaptive model selection method adapts to distinct situations in that it yields consistent model selection and optimal prediction, without knowing which situation exists a priori. The proposed method is applied to real data from the commodity market and outperforms its competitors in terms of price forecasting accuracy.     

Outlier Detection in Time Series Models Using Local Influence Method

We propose a new procedure for detecting a patch of outliers or influential observations for autoregressive integrated moving average (ARIMA) model using local influence analysis. It is shown that the dependency aspects of time series data gives rise to masking or smearing effects when the local influence analysis is performed using current perturbation schemes. We suggest a new perturbation scheme to take into account the dependent structure of time series data, and employ the stepwise local influence method to give a diagnostic procedure. We show that the new perturbation scheme can avoid the smearing effects, and the stepwise technique of local influence can successfully deal with masking effects. Various simulation studies are performed to show the efficiency of proposed methodology and a real example is used for illustrations.     

Corrected Phase-Type Approximations of Heavy-Tailed Queueing Models in a Markovian Environment

We develop accurate approximations for the delay distribution of the MArP/G/1 queue that capture the exact tail behavior and provide bounded relative errors. Motivated by statistical analysis, we consider the service times as a mixture of a phase-type and a heavy-tailed distribution. With the aid of perturbation analysis, we derive corrected phase-type approximations as a sum of the delay in a MArP/PH/1 queue and a heavy-tailed component depending on the perturbation parameter. We exhibit their performance with numerical examples.     

A note on influence diagnostics in AR(1) time series models

The purpose of this paper is to develop influence diagnostics for AR(1) models under the innovative and the data perturbation schemes. There are four main contributions. First, we derive analytical expressions for the slope and curvature statistics. Second, we establish a relationship between the slope and curvature showing that the standardised slope and standardised curvature are equal for the innovative perturbation scheme, and these vectors are nearly identical for several values of the autoregressive parameter, for the data perturbation scheme. Third, we present a connection between the influence statistics and the tests for outlier detection. Fourth, for the innovative perturbation scheme, we derive the asymptotic distribution of a new influence statistic, whereas for the data perturbation scheme, the distribution of the influence statistics is obtained via Monte Carlo simulation. We additionally discuss practical guidelines for the use of local influence statistics, which are illustrated on a chemical process data set.     

Influence diagnostics in nonlinear reproductive dispersion mixed models

The class of nonlinear reproductive dispersion mixed models (NRDMMs) is an extension of nonlinear reproductive dispersion models and generalized linear mixed models. This paper discusses the influence analysis of the model based on Laplace approximation. The equivalence of case-deletion models and mean-shift outlier models in NRDMMs is investigated, and some diagnostic measures are proposed via the case-deletion method. We also investigate the assessment of local influence of various perturbation schemes. The proposed method is illustrated with an example.     

Bayesian Analysis of DSGE Models

This paper reviews Bayesian methods that have been developed in recent years to estimate and evaluate dynamic stochastic general equilibrium (DSGE) models. We consider the estimation of linearized DSGE models, the evaluation of models based on Bayesian model checking, posterior odds comparisons, and comparisons to vector autoregressions, as well as the non-linear estimation based on a second-order accurate model solution. These methods are applied to data generated from correctly specified and misspecified linearized DSGE models and a DSGE model that was solved with a second-order perturbation method.     

Diagnostics in elliptical regression models with stochastic restrictions applied to econometrics

We propose an influence diagnostic methodology for linear regression models with stochastic restrictions and errors following elliptically contoured distributions. We study how a perturbation may impact on the mixed estimation procedure of parameters in the model. Normal curvatures and slopes for assessing influence under usual schemes are derived, including perturbations of case-weight, response variable, and explanatory variable. Simulations are conducted to evaluate the performance of the proposed methodology. An example with real-world economy data is presented as an illustration.     

Assessment of influence in non-linear measurement error models

We consider the assessment of outliers and influential observation in non-linear measurement error models. Residuals, leverage measures and case-deletiondiagonostics are examined. The method of local influence is also applied to the models. In particular, the perturbation of measurement error variances has been found useful in assessing the adequancy of the model assumptions. A numerical example is given to illustrate the application of the diagonostics.     

Likelihood estimation for longitudinal zero-inflated power series regression models

In this paper, a zero-inflated power series regression model for longitudinal count data with excess zeros is presented. We demonstrate how to calculate the likelihood for such data when it is assumed that the increment in the cumulative total follows a discrete distribution with a location parameter that depends on a linear function of explanatory variables. Simulation studies indicate that this method can provide improvements in obtaining standard errors of the estimates. We also calculate the dispersion index for this model. The influence of a small perturbation of the dispersion index of the zero-inflated model on likelihood displacement is also studied. The zero-inflated negative binomial regression model is illustrated on data regarding joint damage in psoriatic arthritis.     

Influence diagnostic analysis in the possibly heteroskedastic linear model with exact restrictions

The local influence method has proven to be a useful and powerful tool for detecting influential observations on the estimation of model parameters. This method has been widely applied in different studies related to econometric and statistical modelling. We propose a methodology based on the Lagrange multiplier method with a linear penalty function to assess local influence in the possibly heteroskedastic linear regression model with exact restrictions. The restricted maximum likelihood estimators and information matrices are presented for the postulated model. Several perturbation schemes for the local influence method are investigated to identify potentially influential observations. Three real-world examples are included to illustrate and validate our methodology.     

Natural (Non‐)Informative Priors for Skew‐symmetric Distributions

In this paper, we present an innovative method for constructing proper priors for the skewness (shape) parameter in the skew‐symmetric family of distributions. The proposed method is based on assigning a prior distribution on the perturbation effect of the shape parameter, which is quantified in terms of the total variation distance. We discuss strategies to translate prior beliefs about the asymmetry of the data into an informative prior distribution of this class. We show via a Monte Carlo simulation study that our non‐informative priors induce posterior distributions with good frequentist properties, similar to those of the Jeffreys prior. Our informative priors yield better results than their competitors from the literature. We also propose a scale‐invariant and location‐invariant prior structure for models with unknown location and scale parameters and provide sufficient conditions for the propriety of the corresponding posterior distribution. Illustrative examples are presented using simulated and real data.     

Influence diagnostics in a vector autoregressive model

In this paper, we use a likelihood approach and the local influence method introduced by Cook [Assessment of local influence (with discussion). J Roy Statist Soc Ser B. 1986;48:133–149] to study a vector autoregressive (VAR) model. We present the maximum likelihood estimators and the information matrix. We establish the normal curvature and slope diagnostics for the VAR model under several perturbation schemes and use the Monte Carlo method to obtain benchmark values for determining the influence of directional diagnostics and possible influential observations. An empirical study using the VAR model to fit real data of monthly returns of IBM and S&P500 index illustrates the effectiveness of our proposed diagnostics.