Generalized Leverage and its Applications

The generalized leverage of an estimator is defined in regression models as a measure of the importance of individual observations. We derive a simple but powerful result, developing an explicit expression for leverage in a general M -estimation problem, of which the maximum likelihood problems are special cases. A variety of applications are considered, most notably to the exponential family non-linear models. The relationship between leverage and local influence is also discussed. Numerical examples are given to illustrate our results     

Robust williams trent test

To investigate the biological activities of a new compound or drug, experimenters usually compare a series of increasing doses to a control. Among other objectives, one may try to investigate any possible dose-response trend and to determine the minimum effective dose among all the experimental doses. Williams (1971, 1972) proposed a procedure to test the dose-response trend and also to identify the minimum effective dose based on the normally distributed data. In this paper, we propose a similar test procedure based on the robust estimate'of the average response to perform similar analysis. The proposed method is more resistant to the outliers and more powerful than the Williams procedure when the data distribution deviates from normality. We illustrate the use of this procedure with data arising from a recent study.     

General m-esttmators and applications to bounded influence estimation for non-linear regression

In this paper, we study the M-estimators in the case that λ_F:(β)=E_F:(φ(Z,β))=0 has more than one solution, We show that the numerical iterative procedures converge and that the resulting estimators are consistent and asymptotically normal. We apply them to the non-linear regression models, and then, we find an optimal M-estimate among those that have bounded gross error sensitivity.     

Variance bounds for estimators in autoregressive models with constraints

We consider nonlinear and heteroscedastic autoregressive models whose residuals are martingale increments with conditional distributions that fulfil certain constraints. We treat two classes of constraints: residuals depending on the past through some function of the past observations only, and residuals that are invariant under some finite group of transformations. We determine the efficient influence function for estimators of the autoregressive parameter in such models, calculate variance bounds, discuss information gains, and suggest how to construct efficient estimators. Without constraints, efficient estimators can be given by weighted least squares estimators. With the constraints considered here, efficient estimators are obtained differently, as one-step improvements of some initial estimator, similarly as in autoregressive models with independent increments.     

A Berry–Esséen Bound for M-estimators

We prove a Berry–Esséen bound for general M-estimators under optimal regularity conditions on the score function and the underlying distribution. As an application we obtain Berry–Esséen bounds for the sample median, the L_p -median, p > 1 and Huber's estimator of location     

Sequential procedures based on M-estimators with discontinuous score functions

Bounded-width sequential confidence intervals and sequential tests for regression parameter based on M-estimators are extended to the case where the score-functions generating the M-estimators have jump-discontinuities. In the context of the asymptotic normality of the stopping variable, for the confidence interval problem, it is observed that the jump-discontinuities induce a slower rate of convergence. The proofs of the main theorems rest on the weak convergence of some related processes and this is also studied.     

Diagnostic Checking for GARCH-Type Models

The asymptotic distributions of squared and absolute residual autocorrelations for GARCH model estimated by M-estimators are derived. Two diagnostic tests are developed which can be used to check the adequacy of GARCH model fitted by using M-estimators. Simulation results show that the empirical sizes of both tests are close to the nominal size in most of the cases. The power of test based on absolute residual autocorrelation is found better than test based on squared residual autocorrelations. Our results reveal that there are estimators that can fit GARCH-type models better than the commonly used quasi-maximum likelihood estimator under non normal errors. An application to real data set is also presented.     

An approximation for analyzing a broad class of implicitly and explicitly defined estimators

An approximation is presented that can be used to gain insight into the characteristics – such as outlier sensitivity, bias, and variability – of a wide class of estimators, including maximum likelihood and least squares. The approximation relies on a convenient form for an arbitrary order Taylor expansion in a multivariate setting. The implicit function theorem can be used to construct the expansion when the estimator is not defined in closed form. We present several finite-sample and asymptotic properties of such Taylor expansions, which are useful in characterizing the difference between the estimator and the expansion.     

On the Computation and Finite Sample Behavior of the Constrained M-Estimates for Multivariate Location and Scatter

Abstract

Constrained M (CM) estimates of multivariate location and scatter [Kent, J. T., Tyler, D. E. (1996). Constrained M-estimation for multivariate location and scatter. Ann. Statist. 24:1346–1370] are defined as the global minimum of an objective function subject to a constraint. These estimates combine the good global robustness properties of the S estimates and the good local robustness properties of the redescending M estimates. The CM estimates are not explicitly defined. Numerical methods have to be used to compute the CM estimates. In this paper, we give an algorithm to compute the CM estimates. Using the algorithm, we give a small simulation study to demonstrate the capability of the algorithm finding the CM estimates, and also to explore the finite sample behavior of the CM estimates. We also use the CM estimators to estimate the location and scatter parameters of some multivariate data sets to see the performance of the CM estimates dealing with the real data sets that may contain outliers.     

A consistent simulation-based estimator in generalized linear mixed models

We propose a strongly root-n consistent simulation-based estimator for the generalized linear mixed models. This estimator is constructed based on the first two marginal moments of the response variables, and it allows the random effects to have any parametric distribution (not necessarily normal). Consistency and asymptotic normality for the proposed estimator are derived under fairly general regularity conditions. We also demonstrate that this estimator has a bounded influence function and that it is robust against data outliers. A bias correction technique is proposed to reduce the finite sample bias in the estimation of variance components. The methodology is illustrated through an application to the famed seizure count data and some simulation studies.