Influence diagnostics in a vector autoregressive model

In this paper, we use a likelihood approach and the local influence method introduced by Cook [Assessment of local influence (with discussion). J Roy Statist Soc Ser B. 1986;48:133–149] to study a vector autoregressive (VAR) model. We present the maximum likelihood estimators and the information matrix. We establish the normal curvature and slope diagnostics for the VAR model under several perturbation schemes and use the Monte Carlo method to obtain benchmark values for determining the influence of directional diagnostics and possible influential observations. An empirical study using the VAR model to fit real data of monthly returns of IBM and S&P500 index illustrates the effectiveness of our proposed diagnostics.     

Multivariate elliptical models with general parameterization

In this paper we introduce a general elliptical multivariate regression model in which the mean vector and the scale matrix have parameters (or/and covariates) in common. This approach unifies several important elliptical models, such as nonlinear regressions, mixed-effects model with nonlinear fixed effects, errors-in-variables models, and so forth. We discuss maximum likelihood estimation of the model parameters and obtain the information matrix, both observed and expected. Additionally, we derived the generalized leverage as well as the normal curvatures of local influence under some perturbation schemes. An empirical application is presented for illustrative purposes.     

Multivariate Birnbaum–Saunders regression model

In this paper, we propose a multivariate log-linear Birnbaum–Saunders regression model. We discuss maximum-likelihood estimation of the model parameters and provide closed-form expressions for the score function and for Fisher's information matrix. Hypothesis testing is performed using approximations obtained from the asymptotic normality of the maximum-likelihood estimator. Some influence methods, such as the local influence and generalized leverage are discussed and the normal curvatures for studying local influence are derived under some perturbation schemes. Further, a test for the homogeneity of the shape parameter of the multivariate regression model is investigated. A real data set is presented for illustrative purposes.     

Local predictive influence in bayesian linear models with conjugate priors

Cook (1986) presented the idea of local influence to study the sensitivity of inferences to model assumptions:introduce a vector δ of perturbations to the model; choose a discrepancy function D to measure differences between the original inference and the inference under the perturbed model; study the behavior of D near δ = 0, the original model, usually by taking derivatives. Johnson and Geisser (1983) measure influence in Bayesian inference by the Kullback-Leibler divergence between predictive distributions. I~IcCulloch (1989) is a synthesis of Cook and Johnson and Geisser, using Kullback-Leibler divergence between posterior or predictive distributions as the discrepancy function in Bayesian local influence analyses. We analyze a special case for which McCulloch gives the general theory; namely, the linear model with conjugate prior. We present specific formulae for local influence measures for 1) changes in the parameters of the gamma prior for the precision, 2) changes in the mean of the normal prior for the regression coefficients, 3) changes in the covariance matrix of the normal prior for the regression coefficients and 4) changes in the case weights. Our method is an easy way to find locally influential subsets of points without knowing in advance the sizes of the subsets. The techniques are illustrated with a regression example.     

On influence diagnostics in elliptical multivariate regression models with equicorrelated random errors

In this paper we discuss estimation and diagnostic procedures in elliptical multivariate regression models with equicorrelated random errors. Two procedures are proposed for the parameter estimation and the local influence curvatures are derived under some usual perturbation schemes to assess the sensitivity of the maximum likelihood estimates (MLEs). Two motivating examples preliminarily analyzed under normal errors are reanalyzed considering appropriate elliptical distributions. The local influence approach is used to compare the sensitivity of the model estimates.     

On estimation and local influence analysis for measurement errors models under heavy-tailed distributions

Scale mixtures of normal distributions form a class of symmetric thick-tailed distributions that includes the normal one as a special case. In this paper we consider local influence analysis for measurement error models (MEM) when the random error and the unobserved value of the covariates jointly follow scale mixtures of normal distributions, providing an appealing robust alternative to the usual Gaussian process in measurement error models. In order to avoid difficulties in estimating the parameter of the mixing variable, we fixed it previously, as recommended by Lange et al. (J Am Stat Assoc 84:881–896, 1989) and Berkane et al. (Comput Stat Data Anal 18:255–267, 1994). The local influence method is used to assess the robustness aspects of the parameter estimates under some usual perturbation schemes. However, as the observed log-likelihood associated with this model involves some integrals, Cook’s well–known approach may be hard to apply to obtain measures of local influence. Instead, we develop local influence measures following the approach of Zhu and Lee (J R Stat Soc Ser B 63:121–126, 2001), which is based on the EM algorithm. Results obtained from a real data set are reported, illustrating the usefulness of the proposed methodology, its relative simplicity, adaptability and practical usage.     

On diagnostics in multivariate measurement error models under asymmetric heavy-tailed distributions

In this paper, we discuss the extension of some diagnostic procedures to multivariate measurement error models with scale mixtures of skew-normal distributions (Lachos et?al., Statistics 44:541?C556, 2010c). This class provides a useful generalization of normal (and skew-normal) measurement error models since the random term distributions cover symmetric, asymmetric and heavy-tailed distributions, such as skew-t, skew-slash and skew-contaminated normal, among others. Inspired by the EM algorithm proposed by Lachos et?al. (Statistics 44:541?C556, 2010c), we develop a local influence analysis for measurement error models, following Zhu and Lee??s (J R Stat Soc B 63:111?C126, 2001) approach. This is because the observed data log-likelihood function associated with the proposed model is somewhat complex and Cook??s well-known approach can be very difficult to apply to achieve local influence measures. Some useful perturbation schemes are also discussed. In addition, a score test for assessing the homogeneity of the skewness parameter vector is presented. Finally, the methodology is exemplified through a real data set, illustrating the usefulness of the proposed methodology.     

Influence diagnostics for Student-t censored linear regression models

In this paper, we extend the censored linear regression model with normal errors to Student-t errors. A simple EM-type algorithm for iteratively computing maximum-likelihood estimates of the parameters is presented. To examine the performance of the proposed model, case-deletion and local influence techniques are developed to show its robust aspect against outlying and influential observations. This is done by the analysis of the sensitivity of the EM estimates under some usual perturbation schemes in the model or data and by inspecting some proposed diagnostic graphics. The efficacy of the method is verified through the analysis of simulated data sets and modelling a real data set first analysed under normal errors. The proposed algorithm and methods are implemented in the R package CensRegMod.     

A log-Birnbaum–Saunders regression model with asymmetric errors

This paper introduces a skewed log-Birnbaum–Saunders regression model based on the skewed sinh-normal distribution proposed by Leiva et al. [A skewed sinh-normal distribution and its properties and application to air pollution, Comm. Statist. Theory Methods 39 (2010), pp. 426–443]. Some influence methods, such as the local influence and generalized leverage, are presented. Additionally, we derived the normal curvatures of local influence under some perturbation schemes. An empirical application to a real data set is presented in order to illustrate the usefulness of the proposed model.     

Log-Weibull extended regression model: Estimation,sensitivity and residual analysis

The failure rate function commonly has a bathtub shape in practice. In this paper we discuss a regression model considering new Weibull extended distribution developed by Xie et al. (2002) that can be used to model this type of failure rate function. Assuming censored data, we discuss parameter estimation: maximum likelihood method and a Bayesian approach where Gibbs algorithms along with Metropolis steps are used to obtain the posterior summaries of interest. We derive the appropriate matrices for assessing the local influence on the parameter estimates under different perturbation schemes, and we also present some ways to perform global influence. Also, some discussions on case deletion influence diagnostics are developed for the joint posterior distribution based on the Kullback–Leibler divergence. Besides, for different parameter settings, sample sizes and censoring percentages, are performed various simulations and display and compare the empirical distribution of the Martingale-type residual with the standard normal distribution. These studies suggest that the residual analysis usually performed in normal linear regression models can be straightforwardly extended to the martingale-type residual in log-Weibull extended models with censored data. Finally, we analyze a real data set under a log-Weibull extended regression model. We perform diagnostic analysis and model check based on the martingale-type residual to select an appropriate model.     

Diagnostics for Autocorrelated Regression Models

This paper discusses the local influence approach to the linear regression model with AR(1) errors. Diagnostics for the autocorrelation models and for the autocorrelation coefficient only are proposed and developed respectively, when simultaneous perturbations of the response vector are allowed. Furthermore, the direction of maximum curvature of local influence analysis is shown to be exactly the same as that in Tsai & Wu (1992) when only the autocorrelation coefficient is of special interest.     

Influential observations in GARCH models

This paper examines local influence assessment in generalized autoregressive conditional heteroscesdasticity models with Gaussian and Student-t errors, where influence is examined via the likelihood displacement. The analysis of local influence is discussed under three perturbation schemes: data perturbation, innovative model perturbation and additive model perturbation. For each case, expressions for slope and curvature diagnostics are derived. Monte Carlo experiments are presented to determine the threshold values for locating influential observations. The empirical study of daily returns of the New York Stock Exchange composite index shows that local influence analysis is a useful technique for detecting influential observations; most of the observations detected as influential are associated with historical shocks in the market. Finally, based on this empirical study and the analysis of simulated data, some advice is given on how to use the discussed methodology.     

Influence Diagnostics in log-Birnbaum-Saunders Regression Models

In this paper we present various diagnostic methods for a linear regression model under a logarithmic Birnbaum-Saunders distribution for the errors, which may be applied for accelerated life testing or to compare the median lives of several populations. Some influence methods, such as the local influence, total local influence of an individual and generalized leverage are derived, analysed and discussed. We also present a connection between the local influence and generalized leverage methods. A discussion of the computation of the likelihood displacement as well as the normal curvature in the local influence method are presented. Finally, an example with real data is given for illustration.     

Influence diagnostics for the structural sharpe model under normal/independent distributions

A method is proposed in this paper to assess the local influence of minor perturbations for the Sharpe model when the normal distribution is replaced by normal/independent (NI) distributions. The family of NI distributions is an attractive class of symmetric heavy-tailed densities that includes as special cases the normal, t-Student, slash, and the contaminated normal distributions. Since the returns of the market are not observable, the statistical analysis is carried out in the context of an errors-in-variables model. An influence analysis for detecting influential observations (atypical returns) is developed to investigate the sensitivity of the maximum likelihood estimators. Diagnostic measures are obtained based on the conditional expectation of the complete-data log-likelihood function. The results are illustrated by using a set of shares of companies traded in the Chilean stock market.     

Estimation and diagnostic for skew-normal partially linear models

Partially linear models (PLMs) are an important tool in modelling economic and biometric data and are considered as a flexible generalization of the linear model by including a nonparametric component of some covariate into the linear predictor. Usually, the error component is assumed to follow a normal distribution. However, the theory and application (through simulation or experimentation) often generate a great amount of data sets that are skewed. The objective of this paper is to extend the PLMs allowing the errors to follow a skew-normal distribution [A. Azzalini, A class of distributions which includes the normal ones, Scand. J. Statist. 12 (1985), pp. 171–178], increasing the flexibility of the model. In particular, we develop the expectation-maximization (EM) algorithm for linear regression models and diagnostic analysis via local influence as well as generalized leverage, following [H. Zhu and S. Lee, Local influence for incomplete-data models, J. R. Stat. Soc. Ser. B 63 (2001), pp. 111–126]. A simulation study is also conducted to evaluate the efficiency of the EM algorithm. Finally, a suitable transformation is applied in a data set on ragweed pollen concentration in order to fit PLMs under asymmetric distributions. An illustrative comparison is performed between normal and skew-normal errors.     

The Kumaraswamy normal linear regression model with applications

ABSTRACT

For any continuous baseline G distribution, Cordeiro and Castro pioneered the Kumaraswamy-G family of distributions with two extra positive parameters, which generalizes both Lehmann types I and II classes. We study some mathematical properties of the Kumaraswamy-normal (KwN) distribution including ordinary and incomplete moments, mean deviations, quantile and generating functions, probability weighted moments, and two entropy measures. We propose a new linear regression model based on the KwN distribution, which extends the normal linear regression model. We obtain the maximum likelihood estimates of the model parameters and provide some diagnostic measures such as global influence, local influence, and residuals. We illustrate the potentiality of the introduced models by means of two applications to real datasets.     

Estimates of regression coefficients based on the sign covariance matrix

Summary. A new estimator of the regression parameters is introduced in a multivariate multiple-regression model in which both the vector of explanatory variables and the vector of response variables are assumed to be random. The affine equivariant estimate matrix is constructed using the sign covariance matrix (SCM) where the sign concept is based on Oja's criterion function. The influence function and asymptotic theory are developed to consider robustness and limiting efficiencies of the SCM regression estimate. The estimate is shown to be consistent with a limiting multinormal distribution. The influence function, as a function of the length of the contamination vector, is shown to be linear in elliptic cases; for the least squares (LS) estimate it is quadratic. The asymptotic relative efficiencies with respect to the LS estimate are given in the multivariate normal as well as the t -distribution cases. The SCM regression estimate is highly efficient in the multivariate normal case and, for heavy-tailed distributions, it performs better than the LS estimate. Simulations are used to consider finite sample efficiencies with similar results. The theory is illustrated with an example.     

Checking nonlinear heteroscedastic time series models

A procedure for testing simultaneously, the parametric forms of the conditional mean and the conditional variance functions of a real-valued heteroscedastic time series model is proposed. The Wald test statistic is based on a vector whose components are suitable normalized sums of some weighted residual series. The test is consistent under some fixed alternatives. The local power under two sequences of local alternatives is studied. A LAN property for the parametric model of interest is also established. Experiment conducted shows that the test performs well on the examples tested.     

Local influence analysis for regression models with scale mixtures of skew-normal distributions

The robust estimation and the local influence analysis for linear regression models with scale mixtures of multivariate skew-normal distributions have been developed in this article. The main virtue of considering the linear regression model under the class of scale mixtures of skew-normal distributions is that they have a nice hierarchical representation which allows an easy implementation of inference. Inspired by the expectation maximization algorithm, we have developed a local influence analysis based on the conditional expectation of the complete-data log-likelihood function, which is a measurement invariant under reparametrizations. This is because the observed data log-likelihood function associated with the proposed model is somewhat complex and with Cook's well-known approach it can be very difficult to obtain measures of the local influence. Some useful perturbation schemes are discussed. In order to examine the robust aspect of this flexible class against outlying and influential observations, some simulation studies have also been presented. Finally, a real data set has been analyzed, illustrating the usefulness of the proposed methodology.     

Local influence for functional comparative calibration models with replicated data

We investigate local influence analysis in functional comparative calibration models with replicated data. A method for selecting appropriate perturbation schemes based on the expected Fisher information matrix with respect to the perturbation vector is proposed. It is shown that arbitrarily perturbing these models may result in misleading inference about the influential subjects. First-order influence measures for identifying the correct influential subjects and replicates on corrected score estimators are defined. We introduce different perturbation schemes including perturbation of subjects and replicates on the corrected likelihood function and obtain the density of the perturbed model from which the methodology is based. Particularly, three perturbation of variances schemes could be a better way to handle badly modeled subjects or replicates. Two real data sets are analyzed to illustrate the use of our local influence measures.