Bias reduction of a tail index estimator through an external estimation of the second-order parameter

In this paper, we first consider a class of consistent semi-parametric estimators of a positive tail index γ, parameterised in a tuning or control parameter α. Such a control parameter enables us to have access, for any available sample, to an estimator of the tail index γ with a null dominant component of asymptotic bias, and consequently with a reasonably flat mean squared error pattern, as a function of k, the number of top-order statistics considered. Such a control parameter depends on a second-order parameter ρ, which will be adequately estimated so that we may achieve a high efficiency relative to the classical Hill estimator, provided we use a number of top-order statistics larger than the one usually required for the estimation through the Hill estimator. An illustration of the behaviour of the estimators is provided, through the analysis of the daily log-returns on the Euro–US$ exchange rates.     

On tail index estimation based on multivariate data

This article is devoted to the study of tail index estimation based on i.i.d. multivariate observations, drawn from a standard heavy-tailed distribution, that is, of which Pareto-like marginals share the same tail index. A multivariate central limit theorem for a random vector, whose components correspond to (possibly dependent) Hill estimators of the common tail index α, is established under mild conditions. We introduce the concept of (standard) heavy-tailed random vector of tail index α and show how this limit result can be used in order to build an estimator of α with small asymptotic mean squared error, through a proper convex linear combination of the coordinates. Beyond asymptotic results, simulation experiments illustrating the relevance of the approach promoted are also presented.     

Moment-based tail index estimation

A general method of tail index estimation for heavy-tailed time series, based on examining the growth rate of the logged sample second moment of the data was proposed and studied in Meerschaert and Scheffler (1998. A simple robust estimator for the thickness of heavy tails. J. Statist. Plann. Inference 71, 19–34) as well as Politis (2002. A new approach on estimation of the tail index. C. R. Acad. Sci. Paris, Ser. I 335, 279–282). To improve upon the basic estimator, we introduce a scale-invariant estimator that is computed over subsets of the whole data set. We show that the new estimator, under some stronger conditions on the data, has a polynomial rate of consistency for the tail index. Empirical studies explore how the new method compares with the Hill, Pickands, and DEdH estimators.     

Symmetric regression quantile and its application to robust estimation for the nonlinear regression model

Populational conditional quantiles in terms of percentage α are useful as indices for identifying outliers. We propose a class of symmetric quantiles for estimating unknown nonlinear regression conditional quantiles. In large samples, symmetric quantiles are more efficient than regression quantiles considered by Koenker and Bassett (Econometrica 46 (1978) 33) for small or large values of α, when the underlying distribution is symmetric, in the sense that they have smaller asymptotic variances. Symmetric quantiles play a useful role in identifying outliers. In estimating nonlinear regression parameters by symmetric trimmed means constructed by symmetric quantiles, we show that their asymptotic variances can be very close to (or can even attain) the Cramer–Rao lower bound under symmetric heavy-tailed error distributions, whereas the usual robust and nonrobust estimators cannot.     

Formulating robust regression estimation as an optimum allocation problem

The Mallows-type estimator, one of the most reasonable bounded influence estimators, often downweights leverage points regardless of the magnitude of the corresponding residual, and this could imply a loss of efficiency. In this article, we consider whether the efficiency of this bounded influence estimator could be improved by regarding both the robust x -distance and the residual size. We develop a new robust procedure based on the ideas of the Mallows-type estimator and the general robust recipe, where data been cleaned by pulling outliers towards their fitted values. Our basic idea is to formulate the robust estimation as an allocation problem, where the objective function is a Huber-type "loss" function, but the pulling resource is restricted. Using a mathematical programming technique, the pulling resource is optimally allocated to influential points <$>({x}_i, y_i)<$> with respect to residual size and given weights, <$>w({x}_i)<$>. Three previously published approaches are compared to our proposal via simulated experiments. In the case of contaminated data by regression outliers and "good" leverage points, the proposed robust estimator is a reasonable bounded influence estimator concerning both efficiency and norm of bias. In addition, the proposed approach offers the potential to establish constraints for the regression parameters and also may potentially provide insight regarding outlier detection.     

Posterior Bayes factor analysis for an exponential regression model

In the exponential regression model, Bayesian inference concerning the non-linear regression parameter has proved extremely difficult. In particular, standard improper diffuse priors for the usual parameters lead to an improper posterior for the non-linear regression parameter. In a recent paper Ye and Berger (1991) applied the reference prior approach of Bernardo (1979) and Berger and Bernardo (1989) yielding a proper informative prior for . This prior depends on the values of the explanatory variable, goes to 0 as goes to 1, and depends on the specification of a hierarchical ordering of importance of the parameters.This paper explains the failure of the uniform prior to give a proper posterior: the reason is the appearance of the determinant of the information matrix in the posterior density for . We apply the posterior Bayes factor approach of Aitkin (1991) to this problem; in this approach we integrate out nuisance parameters with respect to their conditional posterior density given the parameter of interest. The resulting integrated likelihood for requires only the standard diffuse prior for all the parameters, and is unaffected by orderings of importance of the parameters. Computation of the likelihood for is extremely simple. The approach is applied to the three examples discussed by Berger and Ye and the likelihoods compared with their posterior densities.     

Robust regression through robust covariances

This paper discusses the estimation of regression parameters after summarizing the data by a covariance matrix of the concatenated vector of explanatory variables and response variable. A robust estimate of the covariance matrix leads to a robust regression estimator. An M-estimator at the covariance estimation step is studied in the paper, and the resulting regression estimator is compared to a few previously proposed robust regression estimators.     

Hill's estimator for the tail index of an ARMA model

This paper investigates Hill's estimator for the tail index of an ARMA model with i.i.d. residuals. Based on the estimated residuals, it is shown that Hill's estimator is asymptotically normal. This method can achieve a smaller asymptotic variance than applying Hill's estimator to the original data. These results are the same as those in Resnick and Starica (Commun. Statist.—Stochastic Models 13 (4) (1997) 703) for an AR model. However, Resnick and Starica (Commun. Statist.—Stochastic Models 13 (4) (1997) 703) imposed one more condition on the choice of sample fraction than the i.i.d. case. This condition is removed in this paper so that data-driven methods for choosing optimal sample fraction based on i.i.d. data can be applied to our case. As an auxiliary theorem, we establish the weak convergence of the tail empirical process of the estimated residuals, which may be of independent interest.     

Preliminary estimators for robust non-linear regression estimation

In this paper, the robustness of weighted non-linear least-squares estimation based on some preliminary estimators is examined. The preliminary estimators are the Lnorm estimates proposed by Schlossmacher, by El-Attar et al., by Koenker and Park, and by Lawrence and Arthur. A numerical example is presented to compare the robustness of the weighted non-linear least-squares approach when based on the preliminary estimators of Schlossmacher (HS), El-Attar et al. (HEA), Koenker and Park (HKP), and Lawrence and Arthur (HLA). The study shows that the HEA estimator is as robust as the HKP estimator. However, the HEA estimator posed certain computational problems and required more storage and computing time.     

Regularized robust estimation in binary regression models

In this paper, we investigate robust parameter estimation and variable selection for binary regression models with grouped data. We investigate estimation procedures based on the minimum-distance approach. In particular, we employ minimum Hellinger and minimum symmetric chi-squared distances criteria and propose regularized minimum-distance estimators. These estimators appear to possess a certain degree of automatic robustness against model misspecification and/or for potential outliers. We show that the proposed non-penalized and penalized minimum-distance estimators are efficient under the model and simultaneously have excellent robustness properties. We study their asymptotic properties such as consistency, asymptotic normality and oracle properties. Using Monte Carlo studies, we examine the small-sample and robustness properties of the proposed estimators and compare them with traditional likelihood estimators. We also study two real-data applications to illustrate our methods. The numerical studies indicate the satisfactory finite-sample performance of our procedures.     

Semiparametric lower bounds for tail index estimation

We consider estimation of the tail index parameter from i.i.d. observations in Pareto and Weibull type models, using a local and asymptotic approach. The slowly varying function describing the non-tail behavior of the distribution is considered as an infinite dimensional nuisance parameter. Without further regularity conditions, we derive a local asymptotic normality (LAN) result for suitably chosen parametric submodels of the full semiparametric model. From this result, we immediately obtain the optimal rate of convergence of tail index parameter estimators for more specific models previously studied. On top of the optimal rate of convergence, our LAN result also gives the minimal limiting variance of estimators (regular for our parametric model) through the convolution theorem. We show that the classical Hill estimator is regular for the submodels introduced with limiting variance equal to the induced convolution theorem bound. We also discuss the Weibull model in this respect.     

Asymptotic results for model robust regression

Since the mid 1980's many statisticians have studied methods for combining parametric and nonparametric models to improve the quality of fits in a regression problem. Notably Einsporn (1987) proposed the Model Robust Regression 1 estimate (MRRl) in which the parametric function, f, and the nonparametric functiong were combined in a straightforward fashion via the use of a mixing parameter, λ This technique was studied extensively atsmall samples and was shown to be quite effective at modeling various unusual functions. In this paper we have asymptotic results for the MRRl estimate in the case where λ is theoretically optimal, is asymptotically optimal and data driven, and is chosen with the PRESS statistic (Allen, 1971) We demonstrate that the MRRl estimate with λchosen by the PRESS statistic is slightly inferior asymptotically to the other two estimates, but, nevertheless possesses positive asymptotic qualities.     

Bayes estimation for a bivariate survival model based on exponential distributions

Bayesian analysis of a bivariate survival model based on exponential distributions is discussed using both vague and conjugate prior distributions. Parameter and reliability estimators are given for the maximum likelihood technique and the Bayesian approach using both types of priors. A Monte Carlo study indicates the vague prior Bayes estimator of reliability performs better than its maximum likelihood counterpart.     

A robust estimation method for the linear regression model parameters with correlated error terms and outliers

Independence of error terms in a linear regression model, often not established. So a linear regression model with correlated error terms appears in many applications. According to the earlier studies, this kind of error terms, basically can affect the robustness of the linear regression model analysis. It is also shown that the robustness of the parameters estimators of a linear regression model can stay using the M-estimator. But considering that, it acquires this feature as the result of establishment of its efficiency. Whereas, it has been shown that the minimum Matusita distance estimators, has both features robustness and efficiency at the same time. On the other hand, because the Cochrane and Orcutt adjusted least squares estimators are not affected by the dependence of the error terms, so they are efficient estimators. Here we are using of a non-parametric kernel density estimation method, to give a new method of obtaining the minimum Matusita distance estimators for the linear regression model with correlated error terms in the presence of outliers. Also, simulation and real data study both are done for the introduced estimation method. In each case, the proposed method represents lower biases and mean squared errors than the other two methods.KEYWORDS: Robust estimation method, minimum Matusita distance estimation method, non-parametric kernel density estimation method, correlated error terms, outliers     

Median estimation through a regression transformation

The author considers the problem of constructing confidence intervals for the median of a future observation at certain values of exogenous variables, following a normalizing transformation. He shows that when this transformation is estimated, the usual interval obtained through an inverse transformation needs to be corrected, even when the sample size is large. He then gives a simple analytical solution to this problem and provides simulation results confirming the good small‐sample properties of the corrected interval. He also presents two concrete illustrations.     

A comparison of robust regression techniques for the estimation of weibull parameters

In this paper several alternative robust reqression techniques are compared for estimating parameters of a Weibull distribution . In addition to the usual least squares (L₂) and least absolute deviation (L₁) methods, a number of one-step reweighting schemes based on the L₁residuals are considered. The results of an extensive series of Monte Carlo simulation experiments demonstrate that the Anscmbe reweighting scheme generally produces the best Weibull estimates over the range of sample sizes and parameter values studied.     

Target estimation for the logistic regression model

The method of target estimation developed by Cabrera and Fernholz [(1999). Target estimation for bias and mean square error reduction. The Annals of Statistics, 27(3), 1080–1104.] to reduce bias and variance is applied to logistic regression models of several parameters. The expectation functions of the maximum likelihood estimators for the coefficients in the logistic regression models of one and two parameters are analyzed and simulations are given to show a reduction in both bias and variability after targeting the maximum likelihood estimators. In addition to bias and variance reduction, it is found that targeting can also correct the skewness of the original statistic. An example based on real data is given to show the advantage of using target estimators for obtaining better confidence intervals of the corresponding parameters. The notion of the target median is also presented with some applications to the logistic models.     

A note on estimation in a minimum-type model with an exponential factor

The problem of estimating the parameter Q appearing in the distribution function of a continuous random variable T=min{T₁,T₂} is considered, when T₁,T₂ are non-negative independent random variables such that T₁ has an exponential distribution with scale parameter θ and T₂ has a possibly defective distribution function G₂(t) that is G₂(∞) < 1. It is shown that the estimator proposed by Gertsbach [(1967) Theory of Probability and Its Applications, 12 is weekly consistent and asymptotically normal. The merit of this estimator is that the above properties do not depend even on the form of G₂(t) except that G₂(t) and its derivative vanish at zero.     

Robust estimation of multivariate regression model

This paper studies robust estimation of multivariate regression model using kernel weighted local linear regression. A robust estimation procedure is proposed for estimating the regression function and its partial derivatives. The proposed estimators are jointly asymptotically normal and attain nonparametric optimal convergence rate. One-step approximations to the robust estimators are introduced to reduce computational burden. The one-step local M-estimators are shown to achieve the same efficiency as the fully iterative local M-estimators as long as the initial estimators are good enough. The proposed estimators inherit the excellent edge-effect behavior of the local polynomial methods in the univariate case and at the same time overcome the disadvantages of the local least-squares based smoothers. Simulations are conducted to demonstrate the performance of the proposed estimators. Real data sets are analyzed to illustrate the practical utility of the proposed methodology. This work was supported by the National Natural Science Foundation of China (Grant No. 10471006).     

Adaptive wavelet estimation of a function in an indirect regression model

We consider a nonparametric regression model where m noise-perturbed functions f ₁,…,f _m are randomly observed. For a fixed ν∈{1,…,m}, we want to estimate f _ν from the observations. To reach this goal, we develop an adaptive wavelet estimator based on a hard thresholding rule. Adopting the mean integrated squared error over Besov balls, we prove that it attains a sharp rate of convergence. Simulation results are reported to support our theoretical findings.