Multivariate τ-estimators for location and scatter

We discuss the robustness and asymptotic behaviour of τ-estimators for multivariate location and scatter. We show that τ-estimators correspond to multivariate M-estimators defined by a weighted average of redescending ψ-functions, where the weights are adaptive. We prove consistency and asymptotic normality under weak assumptions on the underlying distribution, show that τ-estimators have a high breakdown point, and obtain the influence function at general distributions. In the special case of a location-scatter family, τ-estimators are asymptotically equivalent to multivariate S-estimators defined by means of a weighted ψ-function. This enables us to combine a high breakdown point and bounded influence with good asymptotic efficiency for the location and covariance estimator.     

Réduction de la variance dans les sondages en présence d'information auxiliarie: Une approache non paramétrique par splines de régression

The author considers the use of auxiliary information available at population level to improve the estimation of finite population totals. She introduces a new type of model‐assisted estimator based on nonparametric regression splines. The estimator is a weighted linear combination of the study variable with weights calibrated to the B‐splines known population totals. The author shows that the estimator is asymptotically design‐unbiased and consistent under conditions which do not require the superpopulation model to be correct. She proposes a design‐based variance approximation and shows that the anticipated variance is asymptotically equivalent to the Godambe‐Joshi lower bound. She also shows through simulations that the estimator has good properties.     

Deux méthodes d'estimation pour les paramètres de processus moyenne mobile spatiaux

We consider moving average processes, {X_s, s ∈ ??}, where ?? is a triangular lattice in the plane R^2. To estimate the parameters of such processes, Adjengue & Moore (1993) have considered likelihood and gaussian pseudo-likelihood methods. We consider here two other methods. The first one is based on the estimation of the correlations and the relation between these correlations and the parameters of the process. The second relies on a linear approximation of the process. The asymptotic properties of the proposed estimators are analyzed and compared. A simulation study allows us to compare the estimators for fixed sample sizes.     

Cramér‐von Mises regression

Consider a linear regression model with unknown regression parameters β₀ and independent errors of unknown distribution. Block the observations into q groups whose independent variables have a common value and measure the homogeneity of the blocks of residuals by a Cramér‐von Mises q‐sample statistic T_q(β). This statistic is designed so that its expected value as a function of the chosen regression parameter β has a minimum value of zero precisely at the true value β₀. The minimizer β of T_q(β) over all β is shown to be a consistent estimate of β₀. It is also shown that the bootstrap distribution of T_q(β₀) can be used to do a lack of fit test of the regression model and to construct a confidence region for β₀     

Redescending M-estimators

In finite sample studies redescending M-estimators outperform bounded M-estimators (see for example, Andrews et al. [1972. Robust Estimates of Location. Princeton University Press, Princeton]). Even though redescenders arise naturally out of the maximum likelihood approach if one uses very heavy-tailed models, the commonly used redescenders have been derived from purely heuristic considerations. Using a recent approach proposed by Shurygin, we study the optimality of redescending M-estimators. We show that redescending M-estimator can be designed by applying a global minimax criterion to locally robust estimators, namely maximizing over a class of densities the minimum variance sensitivity over a class of estimators. As a particular result, we prove that Smith's estimator, which is a compromise between Huber's skipped mean and Tukey's biweight, provides a guaranteed level of an estimator's variance sensitivity over the class of densities with a bounded variance.     

Robust Estimation for Parameters of the Extended Burr Type III Distribution

We consider various robust estimators for the extended Burr Type III (EBIII) distribution for complete data with outliers. The considered robust estimators are M-estimators, least absolute deviations, Theil, Siegel's repeated median, least trimmed squares, and least median of squares. Before we perform the aforementioned estimators for the EBIII, we adapt the quantiles method to the estimation of the shape parameter k of the EBIII. The simulation results show that the considered robust estimators generally outperform the existing estimation approaches for data with upper outliers, with certain of them retaining a relatively high degree of efficiency for small sample sizes.     

M-Estimates of regression when the scale is unknown and the error distribution is possibly asymmetric: A minimax result

Huber (1964) found the minimax-variance M-estimate of location under the assumption that the scale parameter is known; Li and Zamar (1991) extended this result to the case when the scale is unknown. We consider the robust estimation of the regression coefficients (β₁,…,β_p) when the scale and the intercept parameters are unknown. The minimax-variance estimates of (β₁,…,β_p) with respect to the trace of their asymptotic covariance matrix are derived. The maximum is taken over ?-contamination neighbourhoods of a central regression model with Gaussian errors (asymmetric contamination is allowed), and the minimum is taken over a large class of generalized M-estimates of regression of the Mallow type. The optimal choice of estimates for the nuisance parameters (scale and intercept) is also considered.     

Two‐stage model selection procedures in partially linear regression

The authors propose a two‐stage estimation procedure for the partially linear model Y = f_o(T) + X'β_o + ψ. They show how to estimate consistently the location of the nonzero components of β_o. Their approach turns out to be compatible with minimax adaptive estimation of f_o over Besov balls in the case of penalized least squares. Their proofs are based on a new type of oracle inequality.     

Efficiency of the generalized difference-based Liu estimators in semiparametric regression models with correlated errors

In this paper, a generalized difference-based estimator is introduced for the vector parameter β in the semiparametric regression model when the errors are correlated. A generalized difference-based Liu estimator is defined for the vector parameter β in the semiparametric regression model. Under the linear nonstochastic constraint Rβ=r, the generalized restricted difference-based Liu estimator is given. The risk function for the β?_GRD(η) associated with weighted balanced loss function is presented. The performance of the proposed estimators is evaluated by a simulated data set.     

Testing for autocorrelation and random-effects in nonlinear mixed effects models based on M-estimation

M-estimation (robust estimation) for the parameters in nonlinear mixed effects models using Fisher scoring method is investigated in the article, which shares some of the features of the existing maximum likelihood estimation: consistency and asymptotic normality. Score tests for autocorrelation and random effects based on M-estimation, together with their asymptotic distribution are also studied. The performance of the test statistics are evaluated via simulations and a real data analysis of plasma concentrations data.     

Bias of the lse estimator of the first order autoregressive model under tukey contamination

Results of an exhaustive study of the bias of the least square estimator (LSE) of an first order autoregression coefficient α in a contaminated Gaussian model are presented. The model describes the following situation. The process is defined as X_t = α X_t-1 + Y_t . Until a specified time T, Y_t are iid normal N(0, 1). At the moment T we start our observations and since then the distribution of Y_t, t≥T, is a Tukey mixture T(εσ) = (1 – ε)N(0,1) + εN(0, σ²). Bias of LSE as a function of α and ε, and σ² is considered. A rather unexpected fact is revealed: given α and ε, the bias does not change montonically with σ (“the magnitude of the contaminant”), and similarly, given α and σ, the bias is not growing with ε (“the amount of contaminants”).     

A robust biplot

This paper introduces a robust biplot which is related to multivariate M-estimates. The n × p data matrix is first considered as a sample of size n from some p-variate population, and robust M-estimates of the population location vector and scatter matrix are calculated. In the construction of the biplot, each row of the data matrix is assigned a weight determined in the preliminary robust estimation. In a robust biplot, one can plot the variables in order to represent characteristics of the robust variance-covariance matrix: the length of the vector representing a variable is proportional to its robust standard deviation, while the cosine of the angle between two variables is approximately equal to their robust correlation. The proposed biplot also permits a meaningful representation of the variables in a robust principal-component analysis. The discrepancies between least-squares and robust biplots are illustrated in an example.     

New difference-based estimator of parameters in semiparametric regression models

The paper introduces a new difference-based Liu estimator β?_Ldiff=([Xtilde]′[Xtilde]+I)^?1([Xtilde]′[ytilde]+η β?_diff) of the regression parameters β in the semiparametric regression model, y=Xβ+f+?. Difference-based estimator, β?_diff=([Xtilde]′[Xtilde])^?1[Xtilde]′[ytilde] and difference-based Liu estimator are analysed and compared with respect to mean-squared error (mse) criterion. Finally, the performance of the new estimator is evaluated for a real data set. Monte Carlo simulation is given to show the improvement in the scalar mse of the estimator.     

A Robust Variable Selection to t-type Joint Generalized Linear Models via Penalized t-type Pseudo-likelihood

Although the t-type estimator is a kind of M-estimator with scale optimization, it has some advantages over the M-estimator. In this article, we first propose a t-type joint generalized linear model as a robust extension to the classical joint generalized linear models for modeling data containing extreme or outlying observations. Next, we develop a t-type pseudo-likelihood (TPL) approach, which can be viewed as a robust version to the existing pseudo-likelihood (PL) approach. To determine which variables significantly affect the variance of the response variable, we then propose a unified penalized maximum TPL method to simultaneously select significant variables for the mean and dispersion models in t-type joint generalized linear models. Thus, the proposed variable selection method can simultaneously perform parameter estimation and variable selection in the mean and dispersion models. With appropriate selection of the tuning parameters, we establish the consistency and the oracle property of the regularized estimators. Simulation studies are conducted to illustrate the proposed methods.     

Conditional Least Squares Estimators for the Offspring Mean in a Subcritical Branching Process with Immigration

Consider a Bienayme–Galton–Watson process with generation-dependent immigration, whose mean and variance vary regularly with non negative exponents α and β, respectively. We study the estimation problem of the offspring mean based on an observation of population sizes. We show that if β <2α, the conditional least squares estimator (CLSE) is strongly consistent. Conditions which are sufficient for the CLSE to be asymptotically normal will also be derived. The rate of convergence is faster than n ^?1/2, which is not the case in the process with stationary immigration.     

Robust Linear Calibration

We regard the simple linear calibration problem where only the response y of the regression line y = β₀ + β₁ t is observed with errors. The experimental conditions t are observed without error. For the errors of the observations y we assume that there may be some gross errors providing outlying observations. This situation can be modeled by a conditionally contaminated regression model. In this model the classical calibration estimator based on the least squares estimator has an unbounded asymptotic bias. Therefore we introduce calibration estimators based on robust one-step-M-estimators which have a bounded asymptotic bias. For this class of estimators we discuss two problems: The optimal estimators and their corresponding optimal designs. We derive the locally optimal solutions and show that the maximin efficient designs for non-robust estimation and robust estimation coincide.     

Efficiency of the generalized-difference-based weighted mixed almost unbiased two-parameter estimator in partially linear model

In this paper, a generalized difference-based estimator is introduced for the vector parameter β in partially linear model when the errors are correlated. A generalized-difference-based almost unbiased two-parameter estimator is defined for the vector parameter β. Under the linear stochastic constraint r = Rβ + e, we introduce a new generalized-difference-based weighted mixed almost unbiased two-parameter estimator. The performance of this new estimator over the generalized-difference-based estimator and generalized- difference-based almost unbiased two-parameter estimator in terms of the MSEM criterion is investigated. The efficiency properties of the new estimator is illustrated by a simulation study. Finally, the performance of the new estimator is evaluated for a real dataset.     

ROBUST ESTIMATION UNDER TYPE II CENSORING

The properties of robust M-estimators with type II censored failure time data are considered. The optimal members within two classes of ψ-functions are characterized. The first optimality result is the censored data analogue of the optimality result described in Hampel et al. (1986); the estimators corresponding to the optimal members within this class are referred to as the optimal robust estimators. The second result pertains to a restricted class of ψ-functions which is the analogue of the class of ψ-functions considered in James (1986) for randomly censored data; the estimators corresponding to the optimal members within this restricted class are referred to as the optimal James-type estimators. We examine the usefulness of the two classes of ψ-functions and find that the breakdown point and efficiency of the optimal James-type estimators compare favourably with those of the corresponding optimal robust estimators. From the computational point of view, the optimal James-type ψ-functions are readily obtainable from the optimal ψ-functions in the uncensored case. The ψ-functions for the optimal robust estimators require a separate algorithm which is provided. A data set illustrates the optimal robust estimators for the parameters of the extreme value distribution.     

Combined Bayesian estimates for the equicorrelation coefficient

Combined Bayesian estimates for equicorrelation covariance matrices are considered. The case of a common equicorrelation p and possibly different standard deviations σ_l,σ_k among k experimental groups is examined first, and the Bayesian estimation of (σ, σ₁,σ_k) is discussed. Secondly, under the assumption of a common standard deviation and possibly different equicorrelations, the Bayesian estimation of (ρ₁,ρ_k,σ) is considered.