Self-weighted least absolute deviation estimation for infinite variance autoregressive models

Summary.  How to undertake statistical inference for infinite variance autoregressive models has been a long-standing open problem. To solve this problem, we propose a self-weighted least absolute deviation estimator and show that this estimator is asymptotically normal if the density of errors and its derivative are uniformly bounded. Furthermore, a Wald test statistic is developed for the linear restriction on the parameters, and it is shown to have non-trivial local power. Simulation experiments are carried out to assess the performance of the theory and method in finite samples and a real data example is given. The results are entirely different from other published results and should provide new insights for future research on heavy-tailed time series.     

Strong convergence rate of the least median absolute estimator in linear regression models

We propose a least median of absolute (LMA) estimator for a linear regression model, based on minimizing the median absolute deviation of the residuals. Under some regularity conditions on the design points and disturbances, the strong convergence rate of the LMA estimator is established.     

Adaptive estimators for parameters of the autoregression function of a Markov chain

Suppose we observe an ergodic Markov chain on the real line, with a parametric model for the autoregression function, i.e. the conditional mean of the transition distribution. If one specifies, in addition, a parametric model for the conditional variance, one can define a simple estimator for the parameter, the maximum quasi-likelihood estimator. It is robust against misspecification of the conditional variance, but not efficient. We construct an estimator which is adaptive in the sense that it is efficient if the conditional variance is misspecified, and asymptotically as good as the maximum quasi-likelihood estimator if the conditional variance is correctly specified. The adaptive estimator is a weighted nonlinear least-squares estimator, with weights given by predictors for the conditional variance.     

Flexible regression modeling

The author proposes a new method for flexible regression modeling of multi‐dimensional data, where the regression function is approximated by a linear combination of logistic basis functions. The method is adaptive, selecting simple or more complex models as appropriate. The number, location, and (to some extent) shape of the basis functions are automatically determined from the data. The method is also affine invariant, so accuracy of the fit is not affected by rotation or scaling of the covariates. Squared error and absolute error criteria are both available for estimation. The latter provides a robust estimator of the conditional median function. Computation is relatively fast, particularly for large data sets, so the method is well suited for data mining applications.     

The mad estimator: when is it non-linear? applications to two-way design models

The mean absolute deviation (MAD) estimator has recently received a great deal of attention as applied to full-rank linear regression models. This paper provides a necessary and sufficient condition for the MAD estimator to be a non-linear estimator, in which case conditions for the variance of the MAD estimator to be larger or smaller than those for OLS are, in general, unknown. The non-linearity of the MAD estimator is examined for several two-way designs; in particular (1) randomized block design (2) two-way nested design (3) two-way classification with interaction and (4) partially balanced incomplete block design     

Median regression model with doubly truncated data

We study the problem of fitting a heteroscedastic median regression model with doubly truncated data. A self-consistency equation is proposed to obtain an estimator. We set up a least absolute deviation estimating function. We establish the consistency and asymptotic normality for the case when covariates are discrete. The finite sample performance of the proposed estimators are investigated through simulation studies. The proposed method is illustrated using the AIDS Blood Transfusion Data.     

Median regression model with left truncated and interval-censored data

We consider the problem of fitting a heteroscedastic median regression model from left-truncated and interval-censored data. It is demonstrated that the adapted Efron’s self-consistency equation of McKeague, Subramanian, and Sun (2001) can be extended to analyze left-truncated and interval-censored data. The asymptotic property of the proposed estimator is established. We evaluate the finite sample performance of the proposed estimators through simulation studies.     

An Equivalence of Conditional and Unconditional Maximum Likelihood Estimators via Infinite Replication of Observations

Motivated by an application with complex survey data, we show that for logistic regression with a simple matched-pairs design, infinitely replicating observations and maximizing the conditional likelihood results in an estimator exactly identical to the unconditional maximum likelihood estimator based on the original sample, which is inconsistent. Therefore, applying conditional likelihood methods to a pseudosample with observations replicated a large number of times can lead to an inconsistent estimator; this casts doubt on one possible approach to conditional logistic regression with complex survey data. We speculate that for more general designs, an asymptotic equivalence holds.     

Notes on Interval Estimation of Odds Ratio in Matched Pairs under Stratified Sampling

We develop four asymptotic interval estimators and one exact interval estimator for the odds ratio (OR) under stratified random sampling with matched pairs. We apply Monte Carlo simulation to evaluate the performance of these five interval estimators. We note that the conditional score test-based interval estimator with a monotonic transformation and the interval estimator based on the Mantel–Haenszel (MH) type point estimator with the logarithmic transformation are generally preferable to the others considered here. We also note that the conditional exact confidence interval can be of use when the total number of matched pairs with discordant responses is small.     

APPROXIMATING VOLATILITIES BY ASYMMETRIC POWER GARCH FUNCTIONS

ARCH/GARCH representations of financial series usually attempt to model the serial correlation structure of squared returns. Although it is undoubtedly true that squared returns are correlated, there is increasing empirical evidence of stronger correlation in the absolute returns than in squared returns. Rather than assuming an explicit form for volatility, we adopt an approximation approach; we approximate the γth power of volatility by an asymmetric GARCH function with the power index γ chosen so that the approximation is optimum. Asymptotic normality is established for both the quasi-maximum likelihood estimator (qMLE) and the least absolute deviations estimator (LADE) in our approximation setting. A consequence of our approach is a relaxation of the usual stationarity condition for GARCH models. In an application to real financial datasets, the estimated values for γ are found to be close to one, consistent with the stylized fact that the strongest autocorrelation is found in the absolute returns. A simulation study illustrates that the qMLE is inefficient for models with heavy-tailed errors, whereas the LADE is more robust.     

Block thresholding wavelet regression using SCAD penalty

This paper concerns wavelet regression using a block thresholding procedure. Block thresholding methods utilize neighboring wavelet coefficients information to increase estimation accuracy. We propose to construct a data-driven block thresholding procedure using the smoothly clipped absolute deviation (SCAD) penalty. A simulation study demonstrates competitive finite sample performance of the proposed estimator compared to existing methods. We also show that the proposed estimator achieves optimal convergence rates in Besov spaces.     

Averaging estimation for conditional covariance models

Estimating conditional covariance matrices is important in statistics and finance. In this paper, we propose an averaging estimator for the conditional covariance, which combines the estimates of marginal conditional covariance matrices by Model Averaging MArginal Regression of Li, Linton, and Lu. This estimator avoids the “curse of dimensionality” problem that the local constant estimator of Yin et al. suffered from. We establish the asymptotic properties of the averaging weights and that of the proposed conditional covariance estimator. The finite sample performances are augmented by simulation. An application to portfolio allocation illustrates the practical superiority of the averaging estimator.     

Recursive M-estimators of location

This paper deals with recursive M-estimators of a location parameter θ in stationary processes when scale is regarded as a nuisance parameter. For the nonrecursive M-estimators, the median absolute deviation is a useful estimator of scale. Two recursive variants of the median absolute deviation are proposed and the performance of the resulting recursive estimators is examined in a numerical study.     

Semiparametric ARCH Models

This article introduces a semiparametric autoregressive conditional heteroscedasticity (ARCH) model that has conditional first and second moments given by autoregressive moving average and ARCH parametric formulations but a conditional density that is assumed only to be sufficiently smooth to be approximated by a nonparametric density estimator. For several particular conditional densities, the relative efficiency of the quasi-maximum likelihood estimator is compared with maximum likelihood under correct specification. These potential efficiency gains for a fully adaptive procedure are compared in a Monte Carlo experiment with the observed gains from using the proposed semiparametric procedure, and it is found that the estimator captures a substantial proportion of the potential. The estimator is applied to daily stock returns from small firms that are found to exhibit conditional skewness and kurtosis and to the British pound to dollar exchange rate.     

Bootstrap unit root test based on least absolute deviation estimation under dependence assumptions

In this paper, a bootstrap test based on the least absolute deviation (LAD) estimation for the unit root test in first-order autoregressive models with dependent residuals is considered. The convergence in probability of the bootstrap distribution function is established. Under the frame of dependence assumptions, the asymptotic behavior of the bootstrap LAD estimator is independent of the covariance matrix of the residuals, which automatically approximates the target distribution.     

Local Estimation of the Second-Order Parameter in Extreme Value Statistics and Local Unbiased Estimation of the Tail Index

We develop and study in the framework of Pareto-type distributions a class of nonparametric kernel estimators for the conditional second order tail parameter. The estimators are obtained by local estimation of the conditional second order parameter using a moving window approach. Asymptotic normality of the proposed class of kernel estimators is proven under some suitable conditions on the kernel function and the conditional tail quantile function. The nonparametric estimators for the second order parameter are subsequently used to obtain a class of bias-corrected kernel estimators for the conditional tail index. In particular it is shown how for a given kernel function one obtains a bias-corrected kernel function, and that replacing the second order parameter in the latter with a consistent estimator does not change the limiting distribution of the bias-corrected estimator for the conditional tail index. The finite sample behavior of some specific estimators is illustrated with a simulation experiment. The developed methodology is also illustrated on fire insurance claim data.     

Weak convergence for the conditional distribution function in a Koziol–Green model under dependent censoring

In this paper we consider the conditional Koziol–Green model of Braekers and Veraverbeke [2008. A conditional Koziol–Green model under dependent censoring. Statist. Probab. Lett., accepted for publication] in which they generalized the Koziol–Green model of Veraverbeke and Cadarso Suárez [2000. Estimation of the conditional distribution in a conditional Koziol–Green model. Test 9, 97–122] by assuming that the association between a censoring time and a time until an event is described by a known Archimedean copula function. They got in this way, an informative censoring model with two different types of informative censoring. Braekers and Veraverbeke [2008. A conditional Koziol–Green model under dependent censoring. Statist. Probab. Lett., accepted for publication] derived in this model a non-parametric Koziol–Green estimator for the conditional distribution function of the time until an event, for which they showed the uniform consistency and the asymptotic normality. In this paper we extend their results and prove the weak convergence of the process associated to this estimator. Furthermore we show that the conditional Koziol–Green estimator is asymptotically more efficient in this model than the general copula-graphic estimator of Braekers and Veraverbeke [2005. A copula-graphic estimator for the conditional survival function under dependent censoring. Canad. J. Statist. 33, 429–447]. As last result, we construct an asymptotic confidence band for the conditional Koziol–Green estimator. Through a simulation study, we investigate the small sample properties of this asymptotic confidence band. Afterwards we apply this estimator and its confidence band on a practical data set.     

Asymptotic normality for a non parametric estimator of conditional quantile with left-truncated data

In this paper, we construct a non parametric estimator of conditional distribution function by the double-kernel local linear approach for left-truncated data, from which we derive the weighted double-kernel local linear estimator of conditional quantile. The asymptotic normality of the proposed estimators is also established. Finite-sample performance of the estimator is investigated via simulation.     

Asymptotic properties of a conditional maximum-likelihood estimator

Inference for a scalar interest parameter in the presence of nuisance parameters is considered in terms of the conditional maximum-likelihood estimator developed by Cox and Reid (1987). Parameter orthogonality is assumed throughout. The estimator is analyzed by means of stochastic asymptotic expansions in three cases: a scalar nuisance parameter, m nuisance parameters from m independent samples, and a vector nuisance parameter. In each case, the expansion for the conditional maximum-likelihood estimator is compared with that for the usual maximum-likelihood estimator. The means and variances are also compared. In each of the cases, the bias of the conditional maximum-likelihood estimator is unaffected by the nuisance parameter to first order. This is not so for the maximum-likelihood estimator. The assumption of parameter orthogonality is crucial in attaining this result. Regardless of parametrization, the difference in the two estimators is first-order and is deterministic to this order.     

The performance of alternative estimators for the probit model with first-order serial correlation 1

The purpose of the paper is to evaluate the relative performance of two generalized conditional moment (GCM) estimators in terms of their mean squared errors, for the Probit model with first-order serial correlation. The first estimator is a linearized one-step estimator described by Poirier and Ruud (1988). The second one is defined in the present paper. Monte Car10 experiments suggest that the GCM estimators outperform the ordinary Probit estimator. The two GCM estimators do almost equally well, except that the second one may be easier to calculate, especially in large samples.