A multiple-case deletion approach for detecting influential points in high-dimensional regression

ABSTRACT

In high-dimensional regression, the presence of influential observations may lead to inaccurate analysis results so that it is a prime and important issue to detect these unusual points before statistical regression analysis. Most of the traditional approaches are, however, based on single-case diagnostics, and they may fail due to the presence of multiple influential observations that suffer from masking effects. In this paper, an adaptive multiple-case deletion approach is proposed for detecting multiple influential observations in the presence of masking effects in high-dimensional regression. The procedure contains two stages. Firstly, we propose a multiple-case deletion technique, and obtain an approximate clean subset of the data that is presumably free of influential observations. To enhance efficiency, in the second stage, we refine the detection rule. Monte Carlo simulation studies and a real-life data analysis investigate the effective performance of the proposed procedure.     

Multiple deletion measures and conditional influence in regression model

The joint effect of the deletion of the ith and jih cases is given by Gray and Ling (1984), they discussed the influence measures for influential subsets in linear regression analysis. The present paper is concerned with multiple sets of deletion measures in the linear regression model. In particular we are interested in the effects of the jointly and conditional influence analysis for the detection of two influential subsets.     

Statistical Inference of Adaptive Designs with Binary Responses

Adaptive designs of clinical trials are ethical alternatives when the traditional randomization becomes ethically infeasible in desperate medical situations. However, such a design creates a dependency among trial data and its statistical analysis becomes more complex than the analysis for traditional randomized clinical trials. In this article, we examine adaptive designs with dichotomous responses from two treatments and extend some commonly used statistical methods for independent data. Under a regularity condition, the estimated odds ratio and its logarithm are shown to follow asymptotically normal distributions. Moreover, the ordinary goodness-of-fit test statistic for two-by-two contingency tables with dependent data is shown to be asymptotically chi-square distributed. We also discuss the consistency of maximum likelihood estimators of the unknown parameters for a wide class of adaptive designs.     

Multiplicative Adjustment Method for Semiparametric Regression with Mixing Dependent Data

In this article, we extend a semiparametric regression estimator with multiplicative adjustment to time series context. The asymptotic theory and results from a simulation study are discussed. Theoretical results and numerical comparison show that, in the time series case, the semiparametric estimator is better than the traditional local polynomial estimator in a wide neighbourhood around the true regression function.     

On the analysis of multivariate repeated measures designs

The relationship between the mixed-model analysis and multivariate approach to a repeated measures design with multiple responses is presented. It is shown that by taking the trace of the appropriate submatrix of the hypothesis (error) sums of squares and crossproducts (SSCP) matrix obtained from the multivariate approach, one can get the hypothesis (error) SSCP matrix for the mixed-model analysis. Thus, when analyzing data from a multivariate repeated measures design, it is advantageous to use the multivariate approach because the result of the mixed-model analysis can also be obtained without additional computation.     

A prior-valued estimator applied to multinomial classification

A multinomial classification rule is proposed based on a prior-valued smoothing for the state probabilities. Asymptotically, the proposed rule has an error rate that converges uniformly and strongly to that of the Bayes rule. For a fixed sample size the prior-valued smoothing is effective in obtaining reason¬able classifications to the situations such as missing data. Empirically, the proposed rule is compared favorably with other commonly used multinomial classification rules via Monte Carlo sampling experiments     

Dependence function for continuous bivariate densities

The notion of cross-product ratio for discrete two-way contingency table is extended to the case of continuous bivariate densities. This results in the “local dependence function” that measues the margin-free dependence between bivariate random variables. Properties and examples of the dependence function are discussed. The bivariate normal density plays a special role since it has constant dependence. Continuous bivariate densities can be constructed by specifying the dependence function along with two marginals in analogy to the construction of two-way contingency tables given marginals and patterns of interaction. The dependence function provides a partial ordering on bivariate dependence.     

Alternative covariance estimates in a replicated measurement error model with correlated,heteroscedastic errors

The article concerns covariance estimates in a replicated measurement error model with correlated, heteroscedastic errors. Freedman has conjectured that using more of the data will improve estimates of covariance matrices and result in a more efficient estimate of the coefficient of the regression model. The paper confirms the conjecture asymptotically for the case that all random variables are normally distributed, but the gain is not substantial.     

On the estimation of variance components in stability analysis

Chow and Shao (1989, 1991) indicated that the presence of batch-to-batch variation has an impact on the determination of drug shelf-life in stability studies. In this paper, we propose two unbiased estmators for batch-to-batch variation. The proposed estimators are compared in terms of their corresponding variances. An example concerning a stability study is discussed to illustrate the use of the proposed estimators.