Diagnostics of Variance of the Error in Mixed Effects Linear Models Based on M-estimation

Fisher scoring method is applied to get M-estimator (robust estimator) of parameters in mixed effects linear models. Then influence curvature is used to study perturbation diagnostics of variance of the error based on M-estimation. The grape sugar data is used to illustrate the results.     

A hybrid approach based on saddlepoint and importance sampling methods for bootstrap tail probability estimation

We propose a simple hybrid method which makes use of both saddlepoint and importance sampling techniques to approximate the bootstrap tail probability of an M-estimator. The method does not rely on explicit formula of the Lugannani-Rice type, and is computationally more efficient than both uniform bootstrap sampling and importance resampling suggested in earlier literature. The method is also applied to construct confidence intervals for smooth functions of M-estimands.     

Asymptotic expansion for nonparametric M-estimator in a nonlinear regression model with long-memory errors

We consider asymptotic expansion of the nonparametric M-estimator in a fixed-design nonlinear regression model when the errors are generated by long-memory linear processes. Under mild conditions, we show that the nonparametric M-estimator is first-order equivalent to the Nadaraya-Watson (NW) estimator, which implies that the nonparametric M-estimator has the same asymptotic distribution as that of the NW estimator. Furthermore, we study the second-order asymptotic expansion of the nonparametric M-estimator and show that the difference between the nonparametric M-estimator and the NW estimator has a limiting distribution after suitable standardization. The nature of the limiting distribution depends on the range of long-memory parameter α. We also compare the finite sample behavior of the two estimators through a numerical example when the errors are long-memory.     

ROBUST ESTIMATION IN PARAMETRIC TIME SERIES MODELS UNDER LONG- AND SHORT-RANGE-DEPENDENT STRUCTURES

This paper studies the asymptotic behaviour of an M-estimator of regression parameters in the linear model when the design variables are either stationary short-range dependent (SRD), α-mixing or long-range dependent (LRD), and the errors are LRD. The weak consistency and the asymptotic distributions of the M-estimator are established. We present some simulated examples to illustrate the efficiency of the proposed M-estimation method.     

M-estimation for functional linear regression

This paper studies M-estimation in functional linear regression in which the dependent variable is scalar while the covariate is a function. An estimator for the slope function is obtained based on the functional principal component basis. The global convergence rate of the M-estimator of unknown slope function is established. The convergence rate of the mean-squared prediction error for the proposed estimators is also established. Monte Carlo simulation studies are conducted to examine the finite-sample performance of the proposed procedure. Finally, the proposed method is applied to analyze the Berkeley growth data.     

Approximations for marginal densities of M-estimators

We develop a saddle-point approximation for the marginal density of a real-valued function p(), where is a general M-estimator of a p-dimensional parameter, that is, the solution of the system {n^-1_ljl (Y_l,) = 0}_j=1,…,p. The approximation is applied to several regression problems and yields very good accuracy for small samples. This enables us to compare different classes of estimators according to their finite-sample properties and to determine when asymptotic approximations are useful in practice.     

An M-Estimator for Estimating the Extended Burr Type III Parameters with Outliers

In this article, we present an M-estimator to estimate the parameters of the extended three-parameter Burr Type III distribution for complete data with outliers. The confidence intervals for all parameters can be obtained by the M-estimator's normal approximation. The simulation results show that the M-estimator generally outperforms the maximum likelihood and least squares methods in terms of bias and root mean square errors. We also investigate the M-estimator's impact on different quantiles and the mean for the Weibull and normal distributions with outliers. Two numerical examples are used to demonstrate the performance of our proposed method.     

ROBUST RIDGE REGRESSION BASED ON AN M-ESTIMATOR

Consider the linear regression model y =β₀1 +Xβ+ in the usual notation. It is argued that the class of ordinary ridge estimators obtained by shrinking the least squares estimator by the matrix (X¹X + kI)^-1X'X is sensitive to outliers in the ^variable. To overcome this problem, we propose a new class of ridge-type M-estimators, obtained by shrinking an M-estimator (instead of the least squares estimator) by the same matrix. Since the optimal value of the ridge parameter k is unknown, we suggest a procedure for choosing it adaptively. In a reasonably large scale simulation study with a particular M-estimator, we found that if the conditions are such that the M-estimator is more efficient than the least squares estimator then the corresponding ridge-type M-estimator proposed here is better, in terms of a Mean Squared Error criteria, than the ordinary ridge estimator with k chosen suitably. An example illustrates that the estimators proposed here are less sensitive to outliers in the y-variable than ordinary ridge estimators.     

Robust two parameter ridge M-estimator for linear regression

The problem of multicollinearity and outliers in the data set produce undesirable effects on the ordinary least squares estimator. Therefore, robust two parameter ridge estimation based on M-estimator (ME) is introduced to deal with multicollinearity and outliers in the y-direction. The proposed estimator outperforms ME, two parameter ridge estimator and robust ridge M-estimator according to mean square error criterion. Moreover, a numerical example and a Monte Carlo simulation experiment are presented.     

Robust Liu-type estimator for regression based on M-estimator

The problem of multicollinearity and outliers in the dataset can strongly distort ordinary least-square estimates and lead to unreliable results. We propose a new Robust Liu-type M-estimator to cope with this combined problem of multicollinearity and outliers in the y-direction. Our new estimator has advantages over two-parameter Liu-type estimator, Ridge-type M-estimator, and M-estimator. Furthermore, we give a numerical example and a simulation study to illustrate some of the theoretical results.     

Weak consistency of M-estimator in linear regression model with asymptotically almost negatively associated errors

Abstract

This paper studies a linear regression model with asymptotically almost negatively associated (AANA, in short) random errors. Under some mild conditions, the weak consistency of M-estimator of the unknown parameter is investigated, which extend the corresponding results for independent random errors and negatively associated (NA, in short) random errors. At last, two simulation examples are presented to verify the weak consistency of M-estimator in the model.     

Multiple comparisons based on a modified one-step M-estimator

Although many methods are available for performing multiple comparisons based on some measure of location, most can be unsatisfactory in at least some situations, in simulations when sample sizes are small, say less than or equal to twenty. That is, the actual Type I error probability can substantially exceed the nominal level, and for some methods the actual Type I error probability can be well below the nominal level, suggesting that power might be relatively poor. In addition, all methods based on means can have relatively low power under arbitrarily small departures from normality. Currently, a method based on 20% trimmed means and a percentile bootstrap method performs relatively well (Wilcox, in press). However, symmetric trimming was used, even when sampling from a highly skewed distribution and a rigid adherence to 20% trimming can result in low efficiency when a distribution is sufficiently heavy-tailed. Robust M-estimators are more flexible but they can be unsatisfactory in terms of Type I errors when sample sizes are small. This paper describes an alternative approach based on a modified one-step M-estimator that introduces more flexibility than a trimmed mean but provides better control over Type I error probabilities compared with using a one-step M-estimator.     

M-estimation of the accelerated failure time model under a convex discrepancy function

Based on the Kaplan–Meier weight functions, we introduce a class of M-estimators of regression parameters for the accelerated failure time (AFT) model with right censored data. The proposed M-estimator is root-n consistent and asymptotically normal under appropriate assumptions. For robustness analysis, we also derive the corresponding influence functions. Appropriate criteria are developed for tests of hypotheses concerning regression parameters. The results are applied to several particular cases. We evaluate the finite-sample performance of the proposed methods through extensive simulation studies.     

M-Estimation in the partially linear model with Bernstein polynomials under shape constrains

We develope an M-estimator for partially linear models in which the nonparametric component is subject to various shape constraints. Bernstein polynomials are used to approximate the unknown nonparametric function, and shape constraints are imposed on the coefficients. Asymptotic normality of regression parameters and the optimal rate of convergence of the shape-restricted nonparametric function estimator are established under very mild conditions. Some simulation studies and a real data analysis are conducted to evaluate the finite sample performance of the proposed method.     

A modified ridge m-estimator for linear regression model with multicollinearity and outliers

The ordinary least-square estimators for linear regression analysis with multicollinearity and outliers lead to unfavorable results. In this article, we propose a new robust modified ridge M-estimator (MRME) based on M-estimator (ME) to deal with the combined problem resulting from multicollinearity and outliers in the y-direction. MRME outperforms modified ridge estimator, robust ridge estimator and ME, according to mean squares error criterion. Furthermore, a numerical example and a Monte Carlo simulation experiment are given to illustrate some of the theoretical results.     

Some comments on a class of simultaneous inference procedures in ancova

Methods for constructing simultaneous confidence intervals for contrasts of treatment effects in analysis of covariance (ANCOVA) models are discussed and compared. A simple procedure is given by which, under a normality assumption made on the covariates, any method appropriate in an analysis of variance (ANOVA) may be applied to a corresponding ANCOVA by means of a simple adjustment of the required critical values. Some properties of this procedure are noted.     

On Unimodal Regression in the Exponential Family

In this article, we discuss statistical methods for curve-estimation under the assumption of unimodality for variables with distributions belonging to the two-parameter exponential family with known or constant dispersion parameter. An important special case is a one-parameter distribution. We suggest a nonparametric method based on monotonicity properties. The method is applied to Swedish data on laboratory verified diagnoses of influenza and data on inflation from an episode of hyperinflation in Bulgaria.     

Permutational tests for correlation matrices

Permutational tests are proposed for the hypotheses that two population correlation matrices have common eigenvectors, and that two population correlation matrices are equal. The only assumption made in these tests is that the distributional form is the same in the two populations; they should be useful as a prelude either to tests of mean differences in grouped standardised data or to principal component investigation of such data.The performance of the permutational tests is subjected to Monte Carlo investigation, and a comparison is made with the performance of the likelihood-ratio test for equality of covariance matrices applied to standardised data. Bootstrapping is considered as an alternative to permutation, but no particular advantages are found for it. The various tests are applied to several data sets.     

Economic Design of Cumulative Sum Control Charts for Monitoring a Process with Correlated Samples

The underlying assumption for the design of control charts is the measurements within a sample are independently distributed. However, there are many situations where the uncorrelation assumption may be unacceptable in practice. In this paper, the economic design of cumulative sum (CUSUM) control chart for correlated data within a sample is developed. The genetic algorithm is applied to find the optimal design parameters of the CUSUM control chart by minimizing the cost function. An illustrative example is given. A sensitivity analysis is then conducted to evaluate the effects of cost parameters, process parameters, and correlation coefficient on the economic design.