Non-linear autoregressive time series with multivariate Gaussian mixtures as marginal distributions

A new form of non-linear autoregressive time series is proposed to model solar radiation data, by specifying joint marginal distributions at low lags to be multivariate Gaussian mixtures. The model is also a type of multiprocess dynamic linear model, but with the advantage that the likelihood has a closed form.     

Harrison–Stevens Forecasting and the Multiprocess Dynamic Linear Model

This is an expository article. The Harrison–Stevens forecasting algorithm using the multiprocess dynamic linear model is a robust method for forecasting in a nonstationary time series. The purpose of this article is to help statisticians become familiar with the method.     

An efficient algorithm for Harrison-Stevens forecasting using the multi-process multivariate dynamic linear model

This paper develops a computationally efficient algorithm for Harrison-Stevens forecasting in a multivariate time series which has correlated errors. The algorithm uses the observation vector one component at a time on the multiprocess multivariate dynamic linear model. This gives a computationally efficient, robust, quick adapting forecasting method for non stationary multivariate time series.     

A Comparison of Two Alternative Approaches to Modeling Level Shifts in the Presence of Outliers

Abstract

We study alternative models for capturing abrupt structural changes (level shifts) in a times series. The problem is confounded by the presence of transient outliers. We compare the performance of non-Gaussian time-varying parameter models and multiprocess mixture models within a Monte Carlo experimental setup. Our findings suggest that once we incorporate shocks with thick-tailed probability distributions, the superiority of the multiprocess mixture models over the time-varying parameter models, reported in an earlier study, disappears. The behavior of the two models, both in adapting to level shifts and in reacting to transient outliers, is very similar.     

Estimation in the multiprocess dynamic generlized linear model

The dynamic generalized linear model and the dynamic discount Bayesian model have been used to describe processes involving time-varying parameters. This paper develops an estimation algorithm for the multiprocess extension of these model. These algorithms have the same characteristics as Harrison-Steven forecasting, namely insensitivity to outliers and quick reaction to real change in the parameters.     

A Comparison of Time-Varying Parameter and Multiprocess Mixture Models in the Case of Money-Supply Announcements

This study compares the performance of a recently proposed multiprocess mixture model and a random-walk time-varying parameter (TVP) model, using the interest rate–weekly money relationship for illustrative purposes. For the case of this relationship, which is subject to regime shifts and outliers, the mixture model performs well and the latter model performs poorly. This finding is of general interest, since investigators often adopt random-walk TVP models to accommodate potential regime shifts in regression relationships. The TVP estimation procedure is unlikely to find abrupt shifts, since the estimate of parameter variance is based on the entire data sample. In the face of rapid discontinuous shifts in the parameters, this variance estimate is unrepresentative of the variability during periods of abrupt shift or transient observations.     

On time-irreversibility and other non-linear features in time series

Time-irreversibility, asymmetry of the distribution, and the occurrence of sudden bursts are considered, amongst others, as non-linear features in time series modeling. The implication is often made that time series showing these features must be analyzed using non-linear models. In contrast, this paper shows that time-irreversible asymmetric time series showing certain types of sudden bursts may be generated by linear models with adequate input sequences. Thus some non-linear time series features may be caused by the pattern in the input sequence rather than by non-linearity in the model. Examples are considered to illustrate the situation.     

Diagnostics for non-linear regression

Sensitivity analysis in regression is concerned with assessing the sensitivity of the results of a regression model (e.g., the objective function, the regression parameters, and the fitted values) to changes in the data. Sensitivity analysis in least squares linear regression has seen a great surge of research activities over the last three decades. By contrast, sensitivity analysis in non-linear regression has received very little attention. This paper deals with the problem of local sensitivity analysis in non-linear regression. Closed-form general formulas are provided for the sensitivities of three standard methods for the estimation of the parameters of a non-linear regression model based on a set of data. These methods are the least squares, the minimax, and the least absolute value methods. The effectiveness of the proposed measures is illustrated by application to several non-linear models including the ultrasonic data and the onion yield data. The proposed sensitivity measures are shown to deal effectively with the detection of influential observations in non-linear regression models.     

基于核密度估计的非线性时间序列聚类

本文研究的是时间序列的聚类问题。由于现实世界中时间序列多数是非线性的,而现有的时间序列聚类问题大都是基于线性时间序列模型进行聚类的,本文提出了可以用于非线性时间序列的聚类方法。以时间序列的二维核密度估计之间的相似性作为非线性时间序列的距离度量,该距离度量方式是一种非参数的距离度量方法,考虑到了时间序列自相关结构的差异,能够粗糙地识别时间序列形状和动态相关结构的相似性。与理论研究结果相一致,我们的模拟实验结果也验证了这种距离度量的有效性。     

Multivariate non-linear time series modelling of exposure and risk in road safety research

Summary.  A multivariate non-linear time series model for road safety data is presented. The model is applied in a case-study into the development of a yearly time series of numbers of fatal accidents (inside and outside urban areas) and numbers of kilometres driven by motor vehicles in the Netherlands between 1961 and 2000. The model accounts for missing entries in the disaggregated numbers of kilometres driven although the aggregated numbers are observed throughout. We consider a multivariate non-linear time series model for the analysis of these data. The model consists of dynamic unobserved factors for exposure and risk that are related in a non-linear way to the number of fatal accidents. The multivariate dimension of the model is due to its inclusion of multiple time series for inside and outside urban areas. Approximate maximum likelihood methods based on the extended Kalman filter are utilized for the estimation of unknown parameters. The latent factors are estimated by extended smoothing methods. It is concluded that the salient features of the observed time series are captured by the model in a satisfactory way.     

Linear and nonlinear causality tests in an LSTAR model: wavelet decomposition in a nonlinear environment

In this paper, we use simulated data to investigate the power of different causality tests in a two-dimensional vector autoregressive (VAR) model. The data are presented in a nonlinear environment that is modelled using a logistic smooth transition autoregressive function. We use both linear and nonlinear causality tests to investigate the unidirection causality relationship and compare the power of these tests. The linear test is the commonly used Granger causality F test. The nonlinear test is a non-parametric test based on Baek and Brock [A general test for non-linear Granger causality: Bivariate model. Tech. Rep., Iowa State University and University of Wisconsin, Madison, WI, 1992] and Hiemstra and Jones [Testing for linear and non-linear Granger causality in the stock price–volume relation, J. Finance 49(5) (1994), pp. 1639–1664]. When implementing the nonlinear test, we use separately the original data, the linear VAR filtered residuals, and the wavelet decomposed series based on wavelet multiresolution analysis. The VAR filtered residuals and the wavelet decomposition series are used to extract the nonlinear structure of the original data. The simulation results show that the non-parametric test based on the wavelet decomposition series (which is a model-free approach) has the highest power to explore the causality relationship in nonlinear models.     

Bayesian monitoring of local residual autocorrelations taking into account the run-length

This paper proposes new two-sided monitoring algorithms for detecting the presence of first order residual autocorrelations in Dynamic Normal Models. The methodology uses a Bayesian decision approach with loss function which takes into account the run-length of the process. The power and mean run-length of the proposed algorithms are analysed by Monte Carlo methods. The results obtained improve those corresponding to the monitoring algorithm for residual autocorrelations proposed in Gargallo and Salvador [2003. Monitoring residual autocorrelations in dynamic linear models. Comm. Statist. Simulation Comput. 32(4), 1079–1104.] with respect to the run-length, and also exhibit more homogeneous behaviour.     

Adaptive varying-coefficient linear models

Summary. Varying-coefficient linear models arise from multivariate nonparametric regression, non-linear time series modelling and forecasting, functional data analysis, longitudinal data analysis and others. It has been a common practice to assume that the varying coefficients are functions of a given variable, which is often called an index . To enlarge the modelling capacity substantially, this paper explores a class of varying-coefficient linear models in which the index is unknown and is estimated as a linear combination of regressors and/or other variables. We search for the index such that the derived varying-coefficient model provides the least squares approximation to the underlying unknown multidimensional regression function. The search is implemented through a newly proposed hybrid backfitting algorithm. The core of the algorithm is the alternating iteration between estimating the index through a one-step scheme and estimating coefficient functions through one-dimensional local linear smoothing. The locally significant variables are selected in terms of a combined use of the t -statistic and the Akaike information criterion. We further extend the algorithm for models with two indices. Simulation shows that the methodology proposed has appreciable flexibility to model complex multivariate non-linear structure and is practically feasible with average modern computers. The methods are further illustrated through the Canadian mink–muskrat data in 1925–1994 and the pound–dollar exchange rates in 1974–1983.     

Conditional inference in linear versus nonlinear models for binary time series

The modelling of discrete such as binary time series, unlike the continuous time series, is not easy. This is due to the fact that there is no unique way to model the correlation structure of the repeated binary data. Some models may also provide a complicated correlation structure with narrow ranges for the correlations. In this paper, we consider a nonlinear dynamic binary time series model that provides a correlation structure which is easy to interpret and the correlations under this model satisfy the full?1 to 1 range. For the estimation of the parameters of this nonlinear model, we use a conditional generalized quasilikelihood (CGQL) approach which provides the same estimates as those of the well-known maximum likelihood approach. Furthermore, we consider a competitive linear dynamic binary time series model and examine the performance of the CGQL approach through a simulation study in estimating the parameters of this linear model. The model mis-specification effects on estimation as well as forecasting are also examined through simulations.     

Volatility clustering in the presence of time-varying model parameters

The volatility pattern of financial time series is often characterized by several peaks and abrupt changes, consistent with the time-varying coefficients of the underlying data-generating process. As a consequence, the model-based classification of the volatility of a set of assets could vary over a period of time. We propose a procedure to classify the unconditional volatility obtained from an extended family of Multiplicative Error Models with time-varying coefficients to verify if it changes in correspondence with different regimes or particular dates. The proposed procedure is experimented on 15 stock indices.     

Comprehensive definitions of breakdown points for independent and dependent observations

Summary. We provide a new definition of breakdown in finite samples, with an extension to asymptotic breakdown. Previous definitions centre on defining a critical region for either the parameter or the objective function. If for a particular outlier configuration the critical region is entered, breakdown is said to occur. In contrast with the traditional approach, we leave the definition of the critical region implicit. Our proposal encompasses previous definitions of breakdown in linear and non-linear regression settings. In some cases, it leads to a different and more intuitive notion of breakdown than other procedures that are available. An important advantage of our new definition is that it also applies to models for dependent observations where current definitions of breakdown typically fail. We illustrate our suggestion by using examples from linear and non-linear regression, and time series.     

Estimating the average slope

The slope is usually the parameter of primary importance in a simple linear regression. If the straight line model gives a poor fit to the data, one can consider the average slope of the non-linear response. In this paper, we show that if the response is quadratic, then the average slope can be obtained by simply using the slope from a straight line fit. In fact, if the slope of the best fitting line to a smooth non-linear function equals the average slope of the function over an arbitrary interval, then the function must be quadratic. This paper illustrates the case where intentionally fitting a wrong model (in this case, a straight line) gives the correct result (the average slope). The example which motivated this study is used to illustrate the results.     

Parameterization and inference for nonparametric regression problems

We consider local likelihood or local estimating equations, in which a multivariate function () is estimated but a derived function () of () is of interest. In many applications, when most naturally formulated the derived function is a non-linear function of (). In trying to understand whether the derived non-linear function is constant or linear, a problem arises with this approach: when the function is actually constant or linear, the expectation of the function estimate need not be constant or linear, at least to second order. In such circumstances, the simplest standard methods in nonparametric regression for testing whether a function is constant or linear cannot be applied. We develop a simple general solution which is applicable to nonparametric regression, varying-coefficient models, nonparametric generalized linear models, etc. We show that, in local linear kernel regression, inference about the derived function () is facilitated without a loss of power by reparameterization so that () is itself a component of (). Our approach is in contrast with the standard practice of choosing () for convenience and allowing ()> to be a non-linear function of (). The methods are applied to an important data set in nutritional epidemiology.     

ELICITING A DIRECTED ACYCLIC GRAPH FOR A MULTIVARIATE TIME SERIES OF VEHICLE COUNTS IN A TRAFFIC NETWORK

The problem of modelling multivariate time series of vehicle counts in traffic networks is considered. It is proposed to use a model called the linear multiregression dynamic model (LMDM). The LMDM is a multivariate Bayesian dynamic model which uses any conditional independence and causal structure across the time series to break down the complex multivariate model into simpler univariate dynamic linear models. The conditional independence and causal structure in the time series can be represented by a directed acyclic graph (DAG). The DAG not only gives a useful pictorial representation of the multivariate structure, but it is also used to build the LMDM. Therefore, eliciting a DAG which gives a realistic representation of the series is a crucial part of the modelling process. A DAG is elicited for the multivariate time series of hourly vehicle counts at the junction of three major roads in the UK. A flow diagram is introduced to give a pictorial representation of the possible vehicle routes through the network. It is shown how this flow diagram, together with a map of the network, can suggest a DAG for the time series suitable for use with an LMDM.     

带异质线性趋势的动态二元选择面板模型估计

本文提出了带异质线性趋势的动态二元面板模型的极大似然偏误纠正估计量和近似条件Logit估计量。我们给出了通常极大似然估计量偏误的解析形式,并提供了相应的估计方法。小样本实验表明近似条件似然函数可以很好的消除异质性参数的影响,而偏误纠正估计量可以显著的修正极大似然估计量的偏误。最后我们将本文提出的方法应用到现金红利支付模型。