Randomized singular spectrum analysis for long time series

ABSTRACT

Singular spectrum analysis (SSA) is a relatively new method for time series analysis and comes as a non-parametric alternative to the classical methods. This methodology has proven to be effective in analysing non-stationary and complex time series since it is a non-parametric method and do not require the classical assumptions over the stationarity or over the normality of the residuals. Although SSA have proved to provide advantages over traditional methods, the challenges that arise when long time series are considered, make the standard SSA very demanding computationally and often not suitable. In this paper we propose the randomized SSA which is an alternative to SSA for long time series without losing the quality of the analysis. The SSA and the randomized SSA are compared in terms of quality of the model fit and forecasting, and computational time. This is done by using Monte Carlo simulations and real data about the daily prices of five of the major world commodities.     

Common singular spectrum analysis of several time series

Singular spectrum analysis (SSA) is a non-parametric time series modelling technique where an observed time series is unfolded into the column vectors of a Hankel structured matrix, known as a trajectory matrix. For noise-free signals the column vectors of the trajectory matrix lie on a single R-flat. Singular value decomposition (SVD) can be used to find the orthonormal base vectors of the linear subspace parallel to this R-flat. SSA can essentially handle functions that are governed by a linear recurrent formula (LRF) and include the broad class of functions that was proposed by Buchstaber [1994. Time series analysis and Grassmannians. Amer. Math. Soc. Transl. 162 (2), 1–17]. SSA is useful to model time series with complex cyclical patterns that increase over time.Various methods have been studied to extend SSA for application to several time series, see Golyandina et al. [2003. Variants of the Caterpillar SSA-method for analysis of multidimensional time series (in Russian) hhttp://www.gistatgroup.com/cat/i]. Prior to that Von Storch and Zwiers (1999) and Allen and Robertson (1996) (see Ghil et al. [2002. Advanced spectral methods for climatic time series. Rev. Geophys. 40 (1), 3.1–3.41]) used multi-channel SSA (M-SSA), to apply SSA to “grand” block matrices. Our approach is different from all of these by using the common principal components approaches introduced by Flury [1988. Common Principal Components and Related Multivariate Models. Wiley, New York]. In this paper SSA is extended to several time series which are similar in some respects, like cointegrated, i.e. sharing a common R-flat. By using the common principal component (CPC) approach of Flury [1988. Common Principal Components and Related Multivariate Models. Wiley, New York] the SSA method is extended to common singular spectrum analysis (CSSA) where common features of several time series can be studied. CSSA decomposes the different original time series into the sum of a common small number of components which are related to common trend and oscillatory components and noise. The determination of the most likely dimension of the supporting linear subspace is studied using a heuristic approach and a hierarchical selection procedure.     

Multivariate posterior singular spectrum analysis

A generalized, multivariate version of the Posterior Singular Spectrum Analysis (PSSA) method is described for the identification of credible features in multivariate time series. We combine Bayesian posterior modeling with multivariate SSA (MSSA) and infer the MSSA signal components with a credibility analysis of the posterior sample. The performance of multivariate PSSA (MPSSA) is compared to the single-variate PSSA with an artificial example and the potential of MPSSA is demonstrated with real data using NAO and SOI climate index series.     

Forecasting before,during, and after recession with singular spectrum analysis

The aim of this research is to apply the singular spectrum analysis (SSA) technique, which is a relatively new and powerful technique in time series analysis and forecasting, to forecast the 2008 UK recession, using eight economic time series. These time series were selected as they represent the most important economic indicators in the UK. The ability to understand the underlying structure of these series and to quickly identify turning points such as the on-set of the recent recession is of key interest to users. In recent years, the SSA technique has been further developed and applied to many practical problems. Hence, these series will provide an ideal practical test of the potential benefits from SSA during one of the most challenging periods for econometric analyses of recent years. The results are compared with those obtained using the ARIMA and Holt–Winters models as these methods are currently used as standard forecasting methods in the Office for National Statistics in the UK.     

Tourist number prediction of historic buildings by singular spectrum analysis

A wooden historic building located in Tibet, China, experienced structural damage when subjected to tourists visit. This kind of ancient building attends to too many visitors every day because heritage sites never fail to attract tourists. There should be a balance between accepting the visitors and the protection of historic buildings considering the importance of the cultural relics. In this paper, the singular spectrum analysis (SSA) is used for forecasting the number of tourist for the building management to exercise maintenance measures to the structure. The analyzed results can be used to control the tourist flow to avoid excessive pedestrian loading on the structure. The relationship between the measured acceleration from the structure and the tourist number is firstly studied. The root-mean-square (RMS) value of the measured acceleration in the passage route of the tourist is selected for forecasting future tourist number. The forecasting results from different methods are compared. The SSA is found slightly outperforms the autoregressive integrated moving average model (ARIMA), the X-11-ARIMA model and the cubic spline extrapolation in terms of the RMS error, mean absolute error and mean absolute percentage error for long-term prediction, whereas the opposite is observed for short-term forecasting.     

A Review of Some Modern Approaches to the Problem of Trend Extraction

This article presents a review of some modern approaches to trend extraction for one-dimensional time series, which is one of the major tasks of time series analysis. The trend of a time series is usually defined as a smooth additive component which contains information about the time series global change, and we discuss this and other definitions of the trend. We do not aim to review all the novel approaches, but rather to observe the problem from different viewpoints and from different areas of expertise. The article contributes to understanding the concept of a trend and the problem of its extraction. We present an overview of advantages and disadvantages of the approaches under consideration, which are: the model-based approach (MBA), nonparametric linear filtering, singular spectrum analysis (SSA), and wavelets. The MBA assumes the specification of a stochastic time series model, which is usually either an autoregressive integrated moving average (ARIMA) model or a state space model. The nonparametric filtering methods do not require specification of model and are popular because of their simplicity in application. We discuss the Henderson, LOESS, and Hodrick–Prescott filters and their versions derived by exploiting the Reproducing Kernel Hilbert Space methodology. In addition to these prominent approaches, we consider SSA and wavelet methods. SSA is widespread in the geosciences; its algorithm is similar to that of principal components analysis, but SSA is applied to time series. Wavelet methods are the de facto standard for denoising in signal procession, and recent works revealed their potential in trend analysis.     

Statistical dimension estimation in singular spectrum analysis

Summary Singular spectrum analysis has been proposed in the field of nonlinear dynamical systems as filtering method. In this paper a criterion to choose the number of components which leads to the best filtering is proposed. The selection is made by minimizing the prediction error.     

Time series analysis of non-Gaussian observations based on state space models from both classical and Bayesian perspectives

The analysis of non-Gaussian time series by using state space models is considered from both classical and Bayesian perspectives. The treatment in both cases is based on simulation using importance sampling and antithetic variables; Markov chain Monte Carlo methods are not employed. Non-Gaussian disturbances for the state equation as well as for the observation equation are considered. Methods for estimating conditional and posterior means of functions of the state vector given the observations, and the mean-square errors of their estimates, are developed. These methods are extended to cover the estimation of conditional and posterior densities and distribution functions. The choice of importance sampling densities and antithetic variables is discussed. The techniques work well in practice and are computationally efficient. Their use is illustrated by applying them to a univariate discrete time series, a series with outliers and a volatility series.     

Vector and recurrent singular spectrum analysis: which is better at forecasting?

Singular spectrum analysis (SSA) is an increasingly popular and widely adopted filtering and forecasting technique which is currently exploited in a variety of fields. Given its increasing application and superior performance in comparison to other methods, it is pertinent to study and distinguish between the two forecasting variations of SSA. These are referred to as Vector SSA (SSA-V) and Recurrent SSA (SSA-R). The general notion is that SSA-V is more robust and provides better forecasts than SSA-R. This is especially true when faced with time series which are non-stationary and asymmetric, or affected by unit root problems, outliers or structural breaks. However, currently there exists no empirical evidence for proving the above notions or suggesting that SSA-V is better than SSA-R. In this paper, we evaluate out-of-sample forecasting capabilities of the optimised SSA-V and SSA-R forecasting algorithms via a simulation study and an application to 100 real data sets with varying structures, to provide a statistically reliable answer to the question of which SSA algorithm is best for forecasting at both short and long run horizons based on several important criteria.     

Multivariate singular spectrum analysis for forecasting revisions to real-time data

Real-time data on national accounts statistics typically undergo an extensive revision process, leading to multiple vintages on the same generic variable. The time between the publication of the initial and final data is a lengthy one and raises the question of how to model and forecast the final vintage of data – an issue that dates from seminal articles by Mankiw et al. [51 Mankiw, N. G., Runkle, M. and Shapiro, M. D. 1984. Are preliminary announcements of the money stock rational forecasts?. J. Monetary Econ., 14: 15–27. [Crossref], [Web of Science ®] [Google Scholar]], Mankiw and Shapiro [52 Mankiw, N. G. and Shapiro, M. D. 1986. News or noise? An analysis of GNP revisions. Surv. Curr. Bus. May, : 20–25.  [Google Scholar]] and Nordhaus [57 Nordhaus, W. D. 1987. Forecasting efficiency: Concepts and applications. Rev. Econ. Stat., 4: 667–674.  [Google Scholar]]. To solve this problem, we develop the non-parametric method of multivariate singular spectrum analysis (MSSA) for multi-vintage data. MSSA is much more flexible than the standard methods of modelling that involve at least one of the restrictive assumptions of linearity, normality and stationarity. The benefits are illustrated with data on the UK index of industrial production: neither the preliminary vintages nor the competing models are as accurate as the forecasts using MSSA.     

A Note on Window Length Selection in Singular Spectrum Analysis

In singular spectrum analysis (SSA) window length is a critical tuning parameter that must be assigned by the practitioner. This paper provides a theoretical analysis of signal–noise separation and time series reconstruction in SSA that can serve as a guide to optimal window choice. We establish numerical bounds on the mean squared reconstruction error and present their almost sure limits under very general regularity conditions on the underlying data generating mechanism. We also provide asymptotic bounds for the mean squared separation error. Evidence obtained using simulation experiments and real data sets indicates that the theoretical properties are reflected in observed behaviour, even in relatively small samples, and the results indicate how, in practice, an optimal assignment for the window length can be made.     

Censored time series analysis with autoregressive moving average models

The authors consider time series observations with data irregularities such as censoring due to a detection limit. Practitioners commonly disregard censored data cases which often result in biased estimates. The authors present an attractive remedy for handling autocorrelated censored data based on a class of autoregressive and moving average (ARMA) models. In particular, they introduce an imputation method well suited for fitting ARMA models in the presence of censored data. They demonstrate the effectiveness of their technique in terms of bias, efficiency, and information loss. They also describe its adaptation to a specific context of meteorological time series data on cloud ceiling height, which are measured subject to the detection limit of the recording device.     

An investigation of lag identification tools for vector nonlinear time series

Exploratory methods for determining appropriate lagged vsrlables in a vector nonlinear time series model are investigated. The first is a multivariate extension of the R statistic considered by Granger and Lin (1994), which is based on an estimate of the mutual information criterion. The second method uses Kendall's ρ and partial ρ statistics for lag determination. The methods provide nonlinear analogues of the autocorrelation and partial autocorrelation matrices for a vector time series. Simulation studies indicate that the R statistic reliabiy identifies appropriate lagged nonlinear moving average terms in a vector time series, while Kendall's ρ and partial ρ statistics have some power in identifying appropirate lagged nonlinear moving average and autoregressive terms, respectively, when the nonlinear relationship between lagged variables is monotonic. For illustration, the methods are applied to set of annual temperature and tree ring measurements at Campito Mountain In California.     

Estimation of a nonparametric regression spectrum for multivariate time series

Estimation of a nonparametric regression spectrum based on the periodogram is considered. Neither trend estimation nor smoothing of the periodogram is required. Alternatively, for cases where spectral estimation of phase shifts fails and the shift does not depend on frequency, a time domain estimator of the lag-shift is defined. Asymptotic properties of the frequency and time domain estimators are derived. Simulations and a data example illustrate the methods.     

Dynamic factor analysis with non-linear temporal aggregation constraints

Summary.  The paper estimates an index of coincident economic indicators for the US economy by using time series with different frequencies of observation (monthly and quarterly, possibly with missing values). The model that is considered is the dynamic factor model that was proposed by Stock and Watson, specified in the logarithms of the original variables and at the monthly frequency, which poses a problem of temporal aggregation with a non-linear observational constraint when quarterly time series are included. Our main methodological contribution is to provide an exact solution to this problem that hinges on conditional mode estimation by iteration of the extended Kalman filtering and smoothing equations. On the empirical side the contribution of the paper is to provide monthly estimates of quarterly indicators, among which is the gross domestic product, that are consistent with the quarterly totals. Two applications are considered: the first dealing with the construction of a coincident index for the US economy, whereas the second does the same with reference to the euro area.     

Segmental dynamic factor analysis for time series of curves

A new approach is introduced in this article for describing and visualizing time series of curves, where each curve has the particularity of being subject to changes in regime. For this purpose, the curves are represented by a regression model including a latent segmentation, and their temporal evolution is modeled through a Gaussian random walk over low-dimensional factors of the regression coefficients. The resulting model is nothing else than a particular state-space model involving discrete and continuous latent variables, whose parameters are estimated across a sequence of curves through a dedicated variational Expectation-Maximization algorithm. The experimental study conducted on simulated data and real time series of curves has shown encouraging results in terms of visualization of their temporal evolution and forecasting.     

A simulation method for finite non-stationary time series

In this paper, we propose a novel simulation method which enables us to obtain a large number of simulated time series cheaply. The developed method can be applied to any non-stationary time series of finite length and it guarantees that not only the marginal distributions but also the autocorrelation structures of observed and simulated time series are the same. Extensive simulation studies have been conducted to check the performance of our method and to assess if the overall dynamics of the observed time series is preserved by the simulated realizations. The developed simulation method has also been applied to the real size data of cocoon filament, which can be reeled from a cocoon produced by a silkworm. Very good results have been achieved in all the cases considered in the paper.     

Missing data and forecasting in multivariate time series: An application of the common components dynamic linear model

Summary The paper deals with missing data and forecasting problems in multivariate time series making use of the Common Components Dynamic Linear Model (DLMCC), presented in Quintana (1985), and West and Harrison (1989). Some results are presented and discussed: exploiting the correlation between series, estimated by the DLMCC, the paper shows as it is possible to update state vector posterior distributions for the unobserved series. This is realized on the base of the updating of the observed series state vectors, for which the usual Kalman filter equations can be applied. An application concerning some Italian private consumption series provides an example of the model capabilities.     

A multilevel model with autoregressive components for the analysis of tribal art prices

In this paper, we introduce a multilevel model specification with time-series components for the analysis of prices of artworks sold at auctions. Since auction data do not constitute a panel or a time series but are composed of repeated cross-sections, they require a specification with items at the first level nested in time-points. Our approach combines the flexibility of mixed effect models together with the predicting performance of time series as it allows to model the time dynamics directly. Model estimation is obtained by means of maximum likelihood through the expectation–maximization algorithm. The model is motivated by the analysis of the first database ethnic artworks sold in the most important auctions worldwide. The results show that the proposed specification improves considerably over classical proposals both in terms of fit and prediction.     

Rational Economic Data Revisions

The efficient handling of provisional economic time series data is considered. Procedures are justified in terms of a testable hypothesis regarding the nature of data revisions. The hypothesis leads to explicit and practical variance expressions for measurement errors. Testing and estimation issues are dealt with. An efficient dual filter is developed for recursive signal estimation. Techniques are applied to the Canadian index of production data.