Robust estimation of AR coefficients under simultaneously influencing outliers and missing values

A family of robust estimators for coefficients of Gaussian AR(p) time series under simultaneously influencing distortions of two types: outliers and missing values, is proposed. The estimators are based on special properties of the Cauchy probability distribution; consistency and the asymptotic normality of these estimators are proven. An approximate solution of the problem of minimization of the asymptotic variance within the proposed family of estimators is found. Performance of the proposed estimators is illustrated for simulated time series and for real data sets.     

基于时间序列分析方法的连续性抽样调查研究

针对连续性抽样调查中如何利用过去各期的调查信息来提高现期抽样估计精度的问题，引入时间序列分析方法，分别考虑连续性抽样调查中重复样本和重叠样本等不同情况，建立了不同情况下的时间序列模型，利用成熟的时间序列分析方法给出了总体特征的线性组合估计量。由于时间序列分析方法能够充分利用以往各期的调查信息，从而能够给出精度更高的估计量。     

Using difference-based methods for inference in nonparametric regression with time series errors

Summary. We show that difference-based methods can be used to construct simple and explicit estimators of error covariance and autoregressive parameters in nonparametric regression with time series errors. When the error process is Gaussian our estimators are efficient, but they are available well beyond the Gaussian case. As an illustration of their usefulness we show that difference-based estimators can be used to produce a simplified version of time series cross-validation. This new approach produces a bandwidth selector that is equivalent, to both first and second orders, to that given by the full time series cross-validation algorithm. Other applications of difference-based methods are to variance estimation and construction of confidence bands in nonparametric regression.     

Exact simulation of Gaussian Time Series from Nonparametric Spectral Estimates with Application to Bootstrapping

The circulant embedding method for generating statistically exact simulations of time series from certain Gaussian distributed stationary processes is attractive because of its advantage in computational speed over a competitive method based upon the modified Cholesky decomposition. We demonstrate that the circulant embedding method can be used to generate simulations from stationary processes whose spectral density functions are dictated by a number of popular nonparametric estimators, including all direct spectral estimators (a special case being the periodogram), certain lag window spectral estimators, all forms of Welch's overlapped segment averaging spectral estimator and all basic multitaper spectral estimators. One application for this technique is to generate time series for bootstrapping various statistics. When used with bootstrapping, our proposed technique avoids some – but not all – of the pitfalls of previously proposed frequency domain methods for simulating time series.     

On identification of transfer function models by biased regression methods

This paper investigates a biased regression approach to the preliminary estimation of the Box-Jenkins transfer function weights. Using statistical simulation to generate time series, 14 estimators (various OLS, ridge and principal components estimators) are compared in terms of MSE and standard error of the weight estimators. The estimators are investigated for different levels of multicollinearity, signal-to-noise ratio, number of independent variables, length of time series and number of lags included in the estimation. The results show that the ridge estimators nearly always give lower MSE than the OLS estimator, and in the computationally difficult cases give much lower MSE than the OLS estimator. The principal components estimators can give lower MSE than the OLS, but also higher values. All biased estimators nearly always give much lower estimated standard error than OLS when estimating the weights.     

Shrinkage Estimation of the Memory Parameter in Stationary Gaussian Processes

The correct and efficient estimation of memory parameters in a stationary Gaussian processes is an important issue, since otherwise, forecasts based on the resulting time series would be misleading. On the other hand, if the memory parameters are suspected to fall in a smaller subspace through some hypothesis restrictions, it becomes a hard decision whether to use estimators based on the restricted spaces or to use unrestricted estimators over the full parameter space. In this article, we propose James-Stein-type estimators of the memory parameters of a stationary Gaussian times series process, which can efficiently incorporate the hypothetical restrictions. We show theoretically that the proposed estimators are more efficient than the usual unrestricted maximum likelihood estimators over the entire parameter space.     

Two new approaches to robust estimation in time series

Two new approaches to robust time series modelling are proposed. These approaches are natural generalisations of the Yule—Walker and the least squares methods. The approaches generate further a few viable estimators. Simulation experiments are conducted to investigate the relative efficiency and the breakdown bounds of these estimators.     

Bias correction for outlier estimation in time series

The problem of outlier estimation in time series is addressed. The least squares estimators of additive and innovation outliers in the framework of linear stationary and non-stationary models are considered and their bias is evaluated. As a result, simple alternative nearly unbiased estimators are proposed both for the additive and the innovation outlier types. A simulation study confirms the theoretical results and suggests that the proposed estimators are effective in reducing the bias also for short series.     

Statistical inference for α-series process with gamma distribution

The explicit estimators of the parameters α, μ?and?σ² are obtained by using the methodology known as modified maximum likelihood (MML) when the distribution of the first occurrence time of an event is assumed to be Weibull in series process. The efficiencies of the MML estimators are compared with the corresponding nonparametric (NP) estimators and it is shown that the proposed estimators have higher efficiencies than the NP estimators. In this study, we extend these results to the case, where the distribution of the first occurrence time is Gamma. It is another widely used and well-known distribution in reliability analysis. A real data set taken from the literature is analyzed at the end of the study for better understanding the methodology presented in this paper.     

TAR模型加权秩估计及其性质讨论

秩估计是上个世纪60年代逐渐兴起的一种非参数方法,由于它具有稳健性等特征,从而得到较为广泛的应用。本文主要讨论了TAR模型随机加权秩估计及其性质问题,证明了基于一般计分函数的线性秩统计量关于回归参数的渐近一致线性性。本文讨论的建立在计分规则基础上的秩估计方法,虽然以TAR模型为对象,但其基本原理同样可以应用到其他非线性模型的参数估计中。     

Efficient inference for parameters of unobservable periodic autoregressive time series

This paper considers estimating the model coefficients when the observed periodic autoregressive time series is contaminated by a trend. The proposed Yule–Walker estimators are obtained by a two-step procedure. In the first step, the trend is estimated by a weighted local polynomial, and the residuals are obtained by subtracting the trend estimates from the observations; in the second step, the model coefficients are estimated by the well-known Yule–Walker method via the residuals. It is shown that under certain conditions such Yule–Walker estimators are oracally efficient, i.e., they are asymptotically equivalent to those obtained from periodic autoregressive time series without a trend. An easy-to-use implementation procedure is provided. The performance of the estimators is illustrated by simulation studies and real data analysis. In particular, the simulation studies show that the proposed estimator outperforms that obtained from the residuals when the trend is estimated by kernel smoothing without taking the heteroscedasticity into consideration.     

Nonparametric maximum likelihood estimators for ar and ma time series

The problem of estimating the parameters of moving average or autoregressive time series is studied when the error distribution is completely unknown. Four nonparametric maximum likelihood estimators (NPMLE) are presented for this purpose. These estimators are compared with the classical moment and least squares estimators in a simulation study. The behavior of these NPMLEs is much better than the classical ones, suggesting that they should be used extensively when no parametric information is known in advance about the error distribution. An application of these estimators to coal mining accidents data is also included.     

Estimating multivariate autoregressive moving average models by fitting long autoregressions

Some simple methods for the estimation of mixed multivariate autoregressive moving average time series models are introduced. The methods require the fitting of a long autoregression to the data and the computation of consistent initial estimates for the parameters of the model. After these preliminaries the estimators of the paper are obtained by applying weighted least squares to a multivariate auxiliary regression model. Two types of weight matrices are considered. Both of them yield estimators which are strongly consistent and asymptotically normally distributed. The first estimators are also asymptotically efficient while the second ones are not fully efficient but computationally simple. A simulation study is performed to illustrate the behaviour of the estimators in finite samples.     

Time series models with asymmetric innovations

We consider AR(q) models in time series with asymmetric innovations represented by two families ofdistributions: (i) gamma with support IR : (0, ∞), and (ii) generalized logistic with support IR:(-∞,∞). Since the ML (maximum likelihood) estimators are intractable, we derive the MML (modified maximum likelihood) estimators of the parameters and show that they are remarkably efficient besides being easy to compute. We investigate the efficiency properties of the classical LS (least squares) estimators. Their efficiencies relative to the proposed MML estimators are very low.     

M-estimators of some GARCH-type models; computation and application

In this paper, we consider robust M-estimation of time series models with both symmetric and asymmetric forms of heteroscedasticity related to the GARCH and GJR models. The class of estimators includes least absolute deviation (LAD), Huber’s, Cauchy and B-estimator as well as the well-known quasi maximum likelihood estimator (QMLE). Extensive simulations are used to check the relative performance of these estimators in both models and the weighted resampling methods are used to approximate the sampling distribution of M-estimators. Our study indicates that there are estimators that can perform better than QMLE and even outperform robust estimator such as LAD when the error distribution is heavy-tailed. These estimators are also applied to real data sets.     

Parameter Estimation Robust to Low-Frequency Contamination

We provide methods to robustly estimate the parameters of stationary ergodic short-memory time series models in the potential presence of additive low-frequency contamination. The types of contamination covered include level shifts (changes in mean) and monotone or smooth time trends, both of which have been shown to bias parameter estimates toward regions of persistence in a variety of contexts. The estimators presented here minimize trimmed frequency domain quasi-maximum likelihood (FDQML) objective functions without requiring specification of the low-frequency contaminating component. When proper sample size-dependent trimmings are used, the FDQML estimators are consistent and asymptotically normal, asymptotically eliminating the presence of any spurious persistence. These asymptotic results also hold in the absence of additive low-frequency contamination, enabling the practitioner to robustly estimate model parameters without prior knowledge of whether contamination is present. Popular time series models that fit into the framework of this article include autoregressive moving average (ARMA), stochastic volatility, generalized autoregressive conditional heteroscedasticity (GARCH), and autoregressive conditional heteroscedasticity (ARCH) models. We explore the finite sample properties of the trimmed FDQML estimators of the parameters of some of these models, providing practical guidance on trimming choice. Empirical estimation results suggest that a large portion of the apparent persistence in certain volatility time series may indeed be spurious. Supplementary materials for this article are available online.     

基于秩方法的TAM估计

一、问题的提出作为统计学一个重要分支学科 ,现代时间序列分析的发展十分惊人 ,尤其是近二十年来 ,人们已不再满足于平稳、线性的时间序列分析 ,如AR、MA、ARMA、ARIMA等 ,越来越多的人将视野投向非平稳时间序列、谱分析、时间序列的线性系统、非线性时间序列及非线性系统、空间序列、不等间隔抽样等问题的研究。TAM模型属于非线性时间序列分析的范围 ,是我国香港地区的学者汤家豪 (参见 [12 ,13])先生于 1978年提出来的 ,由于该模型具有一些重要的性质特征 ,如比 :设置“门坎”(门限 ) ,然后通过门限的控制作用 ,保障模型自身的稳…     

Estimation in conditional first order autoregression with discrete support

We consider estimation in the class of first order conditional linear autoregressive models with discrete support that are routinely used to model time series of counts. Various groups of estimators proposed in the literature are discussed: moment-based estimators; regression-based estimators; and likelihood-based estimators. Some of these have been used previously and others not. In particular, we address the performance of new types of generalized method of moments estimators and propose an exact maximum likelihood procedure valid for a Poisson marginal model using backcasting. The small sample properties of all estimators are comprehensively analyzed using simulation. Three situations are considered using data generated with: a fixed autoregressive parameter and equidispersed Poisson innovations; negative binomial innovations; and, additionally, a random autoregressive coefficient. The first set of experiments indicates that bias correction methods, not hitherto used in this context to our knowledge, are some-times needed and that likelihood-based estimators, as might be expected, perform well. The second two scenarios are representative of overdispersion. Methods designed specifically for the Poisson context now perform uniformly badly, but simple, bias-corrected, Yule-Walker and least squares estimators perform well in all cases.     

A geometric time series model with a new dependent Bernoulli counting series

ABSTRACT

New generalized binomial thinning operator with dependent counting series is introduced. An integer valued time series model with geometric marginals based on this thinning operator is constructed. Main features of the process are analyzed and determined. Estimation of the parameters are presented and some asymptotic properties of the obtained estimators are discussed. Behavior of the estimators is described through the numerical results. Also, model is applied on the real data set and compared to some relevant INAR(1) models.     

Expansion and estimation of Lévy process functionals in nonlinear and nonstationary time series regression

In this article, we develop a series estimation method for unknown time-inhomogeneous functionals of Lévy processes involved in econometric time series models. To obtain an asymptotic distribution for the proposed estimators, we establish a general asymptotic theory for partial sums of bivariate functionals of time and nonstationary variables. These results show that the proposed estimators in different situations converge to quite different random variables. In addition, the rates of convergence depend on various factors rather than just the sample size. Finite sample simulations are provided to evaluate the finite sample performance of the proposed model and estimation method.