A multiple-case deletion approach for detecting influential points in high-dimensional regression

ABSTRACT

In high-dimensional regression, the presence of influential observations may lead to inaccurate analysis results so that it is a prime and important issue to detect these unusual points before statistical regression analysis. Most of the traditional approaches are, however, based on single-case diagnostics, and they may fail due to the presence of multiple influential observations that suffer from masking effects. In this paper, an adaptive multiple-case deletion approach is proposed for detecting multiple influential observations in the presence of masking effects in high-dimensional regression. The procedure contains two stages. Firstly, we propose a multiple-case deletion technique, and obtain an approximate clean subset of the data that is presumably free of influential observations. To enhance efficiency, in the second stage, we refine the detection rule. Monte Carlo simulation studies and a real-life data analysis investigate the effective performance of the proposed procedure.     

Local influence of nonlinear mixed effects model based on M-estimation

Abstract

In this work we mainly study the local influence in nonlinear mixed effects model with M-estimation. A robust method to obtain maximum likelihood estimates for parameters is presented, and the local influence of nonlinear mixed models based on robust estimation (M-estimation) by use of the curvature method is systematically discussed. The counting formulas of curvature for case weights perturbation, response variable perturbation and random error covariance perturbation are derived. Simulation studies are carried to access performance of the methods we proposed. We illustrate the diagnostics by an example presented in Davidian and Giltinan, which was analyzed under the non-robust situation.     

Bayesian Analysis of Masked Series System Lifetime Data

The problem of analyzing series system lifetime data with masked or partial information on cause of failure is recent, compared to that of the standard competing risks model. A generic Gibbs sampling scheme is developed in this article towards a Bayesian analysis for a general parametric competing risks model with masked cause of failure data. The masking probabilities are not subjected to the symmetry assumption and independent Dirichlet priors are used to marginalize these nuisance parameters. The developed methodology is illustrated for the case where the components of a series system have independent log-Normal life distributions by employing independent Normal-Gamma priors for these component lifetime parameters. The Gibbs sampling scheme developed for the required analysis can also be used to provide a Bayesian analysis of data arising from the conventional competing risks model of independent log-Normals, which interestingly has so far remained by and large neglected in the literature. The developed methodology is deployed to analyze a masked lifetime data of PS/2 computer systems.     

Jackknife-After-Bootstrap as Logistic Regression Diagnostic Tool

In this study, we propose using Jackknife-after-Bootstrap (JaB) method to detect influential observations in binary logistic regression model. Performance of the proposed method has been compared with the traditional method for standardized Pearson residuals, Cook's distance, change in the Pearson chi-square and change in the deviance statistics by both real world examples and simulation studies. The results reveal that under the various scenarios considered in this article, JaB performs better than the traditional method and is more robust to masking effect especially for Cook's distance.     

农村劳动力流动如何影响农户宅基地退出行为?

使用四川泸县和宁夏平罗县803户农户的微观调研数据,实证探究了农村劳动力流动对农户宅基地退出行为的影响及其内在作用机制。结果表明:农村劳动力流动会促进农户退出宅基地,且劳动力流动对农户宅基地退出行为的正向影响随流动距离的增加而增大。进一步研究发现,农村劳动力流动显著增加了农户家庭收入,但农户家庭收入在劳动力流动影响农户宅基地退出行为中承担的中介作用表现为“遮掩效应”。从农村劳动力流动面临的风险寻求解释机制,结果表明,来自市场、制度及社会等层面的风险均对农户宅基地退出行为产生显著抑制作用,且从社会网络异质性角度看,这些风险对低社会网络农户宅基地退出行为的抑制作用更大。因此,建议积极引导达到城市化要求的高收入群体走出“半城市化”,从市场、制度和社会三个维度破解农户宅基地退出障碍,帮助农户进一步拓展社会网络来弥补城乡分割的社会结构漏洞。     

Influence of groups of observations on bayes factors

A diagnostic for finding groups of observations influential on Bayes factors is discussed, which extends ideas in Pettit & Young (1990). Ways of reducing the combinatorial explosion involved in detecting more than one influential observation are considered. The effect of masking is also examined. Finally new graphical displays to identify these observations will be explored.     

Robust methods for the analysis of spatially autocorrelated data

In this paper we propose a new robust technique for the analysis of spatial data through simultaneous autoregressive (SAR) models, which extends the Forward Search approach of Cerioli and Riani (1999) and Atkinson and Riani (2000). Our algorithm starts from a subset of outlier-free observations and then selects additional observations according to their degree of agreement with the postulated model. A number of useful diagnostics which are monitored along the search help to identify masked spatial outliers and high leverage sites. In contrast to other robust techniques, our method is particularly suited for the analysis of complex multidimensional systems since each step is performed through statistically and computationally efficient procedures, such as maximum likelihood. The main contribution of this paper is the development of joint robust estimation of both trend and autocorrelation parameters in spatial linear models. For this purpose we suggest a novel definition of the elemental sets of the Forward Search, which relies on blocks of contiguous spatial locations.     

Tests for Multiple Outliers in an Exponential Sample

By applying the recursion of Huffer (1988 Huffer, F. 1988. Divided differences and the joint distribution of linear combinations of spacings. Journal of Applied Probability, 25: 346–354. [Crossref], [Web of Science ®] , [Google Scholar]) repeatedly, we propose an algorithm for evaluating the null joint distribution of Dixon-type test statistics for testing discordancy of k upper outliers in exponential samples. By using the critical values of Dixon-type test statistics determined from the proposed algorithm and those of Cochran-type test statistics presented earlier by Lin and Balakrishnan (2009 Lin, C. T. and Balakrishnan, N. 2009. Exact computation of the null distribution of a test for multiple outliers in an exponential sample. Computational Statistics & Data Analysis, 53: 3281–3290. [Crossref], [Web of Science ®] , [Google Scholar]), we carry out an extensive Monte Carlo study to investigate the powers and the error probabilities for the effects of masking and swamping when the number of outliers k = 2 and 3. Based on our empirical findings, we recommend Rosner’s (1975 Rosner, B. 1975. On the detection of many outliers. Technometrics, 17: 221–227. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) sequential test procedure based on Dixon-type test statistics for testing multiple outliers from an exponential distribution.     

Influential subsets on the variable selection

When one or few observations are deleted in the multiple linear regression model, they can affect the variable selection. In this paper we derived the formula for the Mallows C_p criterion when k observations are deleted and express it as a functionn of basic building blocks such as residuals and leverages. Also, two real date sets are used to see how the selected model changes as few observations re deleted.     

Identification of Multiple Outliers in Logistic Regression

The use of logistic regression modeling has seen a great deal of attention in the literature in recent years. This includes all aspects of the logistic regression model including the identification of outliers. A variety of methods for the identification of outliers, such as the standardized Pearson residuals, are now available in the literature. These methods, however, are successful only if the data contain a single outlier. In the presence of multiple outliers in the data, which is often the case in practice, these methods fail to detect the outliers. This is due to the well-known problems of masking (false negative) and swamping (false positive) effects. In this article, we propose a new method for the identification of multiple outliers in logistic regression. We develop a generalized version of standardized Pearson residuals based on group deletion and then propose a technique for identifying multiple outliers. The performance of the proposed method is then investigated through several examples.