Randomized singular spectrum analysis for long time series

ABSTRACT

Singular spectrum analysis (SSA) is a relatively new method for time series analysis and comes as a non-parametric alternative to the classical methods. This methodology has proven to be effective in analysing non-stationary and complex time series since it is a non-parametric method and do not require the classical assumptions over the stationarity or over the normality of the residuals. Although SSA have proved to provide advantages over traditional methods, the challenges that arise when long time series are considered, make the standard SSA very demanding computationally and often not suitable. In this paper we propose the randomized SSA which is an alternative to SSA for long time series without losing the quality of the analysis. The SSA and the randomized SSA are compared in terms of quality of the model fit and forecasting, and computational time. This is done by using Monte Carlo simulations and real data about the daily prices of five of the major world commodities.     

Vector and recurrent singular spectrum analysis: which is better at forecasting?

Singular spectrum analysis (SSA) is an increasingly popular and widely adopted filtering and forecasting technique which is currently exploited in a variety of fields. Given its increasing application and superior performance in comparison to other methods, it is pertinent to study and distinguish between the two forecasting variations of SSA. These are referred to as Vector SSA (SSA-V) and Recurrent SSA (SSA-R). The general notion is that SSA-V is more robust and provides better forecasts than SSA-R. This is especially true when faced with time series which are non-stationary and asymmetric, or affected by unit root problems, outliers or structural breaks. However, currently there exists no empirical evidence for proving the above notions or suggesting that SSA-V is better than SSA-R. In this paper, we evaluate out-of-sample forecasting capabilities of the optimised SSA-V and SSA-R forecasting algorithms via a simulation study and an application to 100 real data sets with varying structures, to provide a statistically reliable answer to the question of which SSA algorithm is best for forecasting at both short and long run horizons based on several important criteria.     

Common singular spectrum analysis of several time series

Singular spectrum analysis (SSA) is a non-parametric time series modelling technique where an observed time series is unfolded into the column vectors of a Hankel structured matrix, known as a trajectory matrix. For noise-free signals the column vectors of the trajectory matrix lie on a single R-flat. Singular value decomposition (SVD) can be used to find the orthonormal base vectors of the linear subspace parallel to this R-flat. SSA can essentially handle functions that are governed by a linear recurrent formula (LRF) and include the broad class of functions that was proposed by Buchstaber [1994. Time series analysis and Grassmannians. Amer. Math. Soc. Transl. 162 (2), 1–17]. SSA is useful to model time series with complex cyclical patterns that increase over time.Various methods have been studied to extend SSA for application to several time series, see Golyandina et al. [2003. Variants of the Caterpillar SSA-method for analysis of multidimensional time series (in Russian) hhttp://www.gistatgroup.com/cat/i]. Prior to that Von Storch and Zwiers (1999) and Allen and Robertson (1996) (see Ghil et al. [2002. Advanced spectral methods for climatic time series. Rev. Geophys. 40 (1), 3.1–3.41]) used multi-channel SSA (M-SSA), to apply SSA to “grand” block matrices. Our approach is different from all of these by using the common principal components approaches introduced by Flury [1988. Common Principal Components and Related Multivariate Models. Wiley, New York]. In this paper SSA is extended to several time series which are similar in some respects, like cointegrated, i.e. sharing a common R-flat. By using the common principal component (CPC) approach of Flury [1988. Common Principal Components and Related Multivariate Models. Wiley, New York] the SSA method is extended to common singular spectrum analysis (CSSA) where common features of several time series can be studied. CSSA decomposes the different original time series into the sum of a common small number of components which are related to common trend and oscillatory components and noise. The determination of the most likely dimension of the supporting linear subspace is studied using a heuristic approach and a hierarchical selection procedure.     

A Review of Some Modern Approaches to the Problem of Trend Extraction

This article presents a review of some modern approaches to trend extraction for one-dimensional time series, which is one of the major tasks of time series analysis. The trend of a time series is usually defined as a smooth additive component which contains information about the time series global change, and we discuss this and other definitions of the trend. We do not aim to review all the novel approaches, but rather to observe the problem from different viewpoints and from different areas of expertise. The article contributes to understanding the concept of a trend and the problem of its extraction. We present an overview of advantages and disadvantages of the approaches under consideration, which are: the model-based approach (MBA), nonparametric linear filtering, singular spectrum analysis (SSA), and wavelets. The MBA assumes the specification of a stochastic time series model, which is usually either an autoregressive integrated moving average (ARIMA) model or a state space model. The nonparametric filtering methods do not require specification of model and are popular because of their simplicity in application. We discuss the Henderson, LOESS, and Hodrick–Prescott filters and their versions derived by exploiting the Reproducing Kernel Hilbert Space methodology. In addition to these prominent approaches, we consider SSA and wavelet methods. SSA is widespread in the geosciences; its algorithm is similar to that of principal components analysis, but SSA is applied to time series. Wavelet methods are the de facto standard for denoising in signal procession, and recent works revealed their potential in trend analysis.     

Nonparametric Forecasting in Time Series—A Comparative Study

The problem of predicting a future value of a time series is considered in this article. If the series follows a stationary Markov process, this can be done by nonparametric estimation of the autoregression function. Two forecasting algorithms are introduced. They only differ in the nonparametric kernel-type estimator used: the Nadaraya-Watson estimator and the local linear estimator. There are three major issues in the implementation of these algorithms: selection of the autoregressor variables, smoothing parameter selection, and computing prediction intervals. These have been tackled using recent techniques borrowed from the nonparametric regression estimation literature under dependence. The performance of these nonparametric algorithms has been studied by applying them to a collection of 43 well-known time series. Their results have been compared to those obtained using classical Box-Jenkins methods. Finally, the practical behavior of the methods is also illustrated by a detailed analysis of two data sets.     

A comparison of stepwise common singular spectrum analysis and horizontal multi-channel singular spectrum analysis

The problem of forecasting a time series by using information provided by a second time series is considered. Two multivariate extensions of Singular Spectrum Analysis (SSA) are compared in terms of forecast error: Horizontal Multi-channel SSA and Stepwise Common SSA. Different signal structures, defined in terms of trend, period, amplitude and phase, are investigated. In broad terms we find that neither Horizontal Multichannel SSA nor Stepwise Common SSA is best in all cases. Horizontal MSSA is outperformed particularly in cases where different trends are considered.     

Dynamic Forecasts of Qualitative Variables

This article presents a new Qual VAR model for incorporating information from qualitative and/or discrete variables in vector autoregressions. With a Qual VAR, it is possible to create dynamic forecasts of the qualitative variable using standard VAR projections. Previous forecasting methods for qualitative variables, in contrast, produce only static forecasts. I apply the Qual VAR to forecasting the 2001 business recession out of sample and to analyzing the Romer and Romer narrative measure of monetary policy contractions as an endogenous variable in a VAR. Out of sample, the model predicts the timing of the 2001 recession quite well relative to the recession probabilities put forth at the time by professional forecasters. Qual VARs—which include information about the qualitative variable—can also enhance the quality of density forecasts of the other variables in the system.     

Observable trend-projecting state-space models

Much attention has focused in recent years on the use of state-space models for describing and forecasting industrial time series. However, several state-space models that are proposed for such data series are not observable and do not have a unique representation, particularly in situations where the data history suggests marked seasonal trends. This raises major practical difficulties since it becomes necessary to impose one or more constraints and this implies a complicated error structure on the model. The purpose of this paper is to demonstrate that state-space models are useful for describing time series data for forecasting purposes and that there are trend-projecting state-space components that can be combined to provide observable state-space representations for specified data series. This result is particularly useful for seasonal or pseudo-seasonal time series. A well-known data series is examined in some detail and several observable state-space models are suggested and compared favourably with the constrained observable model.     

Observable trend-projecting state-space models

Much attention has focused in recent years on the use of state-space models for describing and forecasting industrial time series. However, several state-space models that are proposed for such data series are not observable and do not have a unique representation, particularly in situations where the data history suggests marked seasonal trends. This raises major practical difficulties since it becomes necessary to impose one or more constraints and this implies a complicated error structure on the model. The purpose of this paper is to demonstrate that state-space models are useful for describing time series data for forecasting purposes and that there are trend-projecting state-space components that can be combined to provide observable state-space representations for specified data series. This result is particularly useful for seasonal or pseudo-seasonal time series. A well-known data series is examined in some detail and several observable state-space models are suggested and compared favourably with the constrained observable model.     

Nonparametric forecasting: a comparison of three kernel-based methods

In this paper the use of three kernel-based nonparametric forecasting methods - the conditional mean, the conditional median, and the conditional mode -is explored in detail. Several issues related to the estimation of these methods are discussed, including the choice of the bandwidth and the type of kernel function. The out-of-sample forecasting performance of the three nonparametric methods is investigated using 60 real time series. We find that there is no superior forecast method for series having approximately less than 100 observations. However, when a time series is long or when its conditional density is bimodal there is quite a difference between the forecasting performance of the three kernel-based forecasting methods.     

人工智能方法在旅游预测中的应用及评析

对旅游需求预测的研究始于20世纪60年代，绝大多数研究成果出现于80年代以后。而对此类文献进行整理和研究的成果相对较少，且有明显的缺陷：一是研究深度不够，仅仅是对近期论文的简单罗列；二是由于受研究时间的局限性，未能涉及最新的研究方法。为此，系统地论述诸如粗糙集理论、遗传算法、时间序列方法等，并通过比较得出：人工智能方法在旅游预测方面的应用尽管取得了较好的效果，但也有其自身的缺陷，在以后的研究中应发挥各种分析方法的优点，根据实际分析对象的具体情况选择合适的分析方法，这样才能收到事半功倍的效果。     

Forecasting aggregate period-specific birth rates: the time series properties of a microdynamic neoclassical model of fertility

"This article demonstrates the value of microdata for understanding the effect of wages on life cycle fertility dynamics. Conventional estimates of neoclassical economic fertility models obtained from linear aggregate time series regressions are widely criticized for being nonrobust when adjusted for serial correlation. Moreover, the forecasting power of these aggregative neoclassical models has been shown to be inferior when compared with conventional time series models that assign no role to wages. This article demonstrates that, when neoclassical models of fertility are estimated on microdata using methods that incorporate key demographic restrictions and when they are properly aggregated, they have considerable forecasting power." Data are from the 1981 Swedish Fertility Survey.     

INDEX TO VOLUME 8 (1 990)

This article provides a simple shrinkage representation that describes the operational characteristics of various forecasting methods designed for a large number of orthogonal predictors (such as principal components). These methods include pretest methods, Bayesian model averaging, empirical Bayes, and bagging. We compare empirically forecasts from these methods with dynamic factor model (DFM) forecasts using a U.S. macroeconomic dataset with 143 quarterly variables spanning 1960–2008. For most series, including measures of real economic activity, the shrinkage forecasts are inferior to the DFM forecasts. This article has online supplementary material.     

Forecasting Contemporaneously Aggregated Vector ARMA Processes

Given a multiple time series that is generated by a multivariate ARMA process and assuming the objective is to forecast a weighted sum of the individual variables, then under a mean squared error measure of forecasting precision, it is preferable to forecast the disaggregated multiple time series and aggregate the forecasts, rather than forecast the aggregated series directly, if the involved processes are known. This result fails to hold if the processes used for forecasting are estimated from a given set of time series data. The implications of these results for empirical research are investigated using different sets of economic data.     

Comparison of the finite mixture of ARMA-GARCH,back propagation neural networks and support-vector machines in forecasting financial returns

The use of GARCH type models and computational-intelligence-based techniques for forecasting financial time series has been proved extremely successful in recent times. In this article, we apply the finite mixture of ARMA-GARCH model instead of AR or ARMA models to compare with the standard BP and SVM in forecasting financial time series (daily stock market index returns and exchange rate returns). We do not apply the pure GARCH model as the finite mixture of the ARMA-GARCH model outperforms the pure GARCH model. These models are evaluated on five performance metrics or criteria. Our experiment shows that the SVM model outperforms both the finite mixture of ARMA-GARCH and BP models in deviation performance criteria. In direction performance criteria, the finite mixture of ARMA-GARCH model performs better. The memory property of these forecasting techniques is also examined using the behavior of forecasted values vis-à-vis the original values. Only the SVM model shows long memory property in forecasting financial returns.     

Forecasting the spot price of gold:combined forecast approaches versus a composite forecast approach

The fluctuation of the gold price has significant impact on the economic and social aspects of a society. In the literature, most authors have employed fundamental analysis approach in forecast model building. The basic principle underlying this approach is that it is the supply and the demand which simultaneously determines the gold price. However, due to the lack of data of quantity supplied and quantity demanded, simultaneous econometric approach seems unsuccessful. In this paper, combined and composite time series forecasting techniques are proposed. The effects of various economic factors towards spot price of gold are also examined. Among the combined forecasting models, it seems that the odds-matrix method of assigning weights provides the most accurate forecasts of spot price of gold. For the economic factors considered, the futures price of gold and and the exchange rate seem to be most informative in forecasting the spot price of gold.     

Predicting recessions using trends in the yield spread

The yield spread, measured as the difference between long- and short-term interest rates, is widely regarded as one of the strongest predictors of economic recessions. In this paper, we propose an enhanced recession prediction model that incorporates trends in the value of the yield spread. We expect our model to generate stronger recession signals because a steadily declining value of the yield spread typically indicates growing pessimism associated with the reduced future business activity. We capture trends in the yield spread by considering both the level of the yield spread at a lag of 12 months as well as its value at each of the previous two quarters leading up to the forecast origin, and we evaluate its predictive abilities using both logit and artificial neural network models. Our results indicate that models incorporating information from the time series of the yield spread correctly predict future recession periods much better than models only considering the spread value as of the forecast origin. Furthermore, the results are strongest for our artificial neural network model and logistic regression model that includes interaction terms, which we confirm using both a blocked cross-validation technique as well as an expanding estimation window approach.     

On the Optimal Parameters for Reconstruction and Forecasting in Singular Spectrum Analysis

There are two main parameters in Singular Spectrum Analysis (SSA). The aim of this study is to determine whether the optimal values of these parameters are different for reconstruction and forecasting stages, and if those are worth the extra computational effort and time which they require. Here, we evaluate these issues using simulation study.     

Forecasting electricity consumption with extra-model information provided by consumers

SUMMARY Univariate time series models make efficient use of available historical records of electricity consumption for short-term forecasting. However, the information (expectations) provided by electricity consumers in an energy-saving survey, even though qualitative, was considered to be particularly important, because the consumers' perception of the future may take into account the changing economic conditions. Our approach to forecasting electricity consumption combines historical data with expectations of the consumers in an optimal manner, using the technique of restricted forecasts. The same technique can be applied in some other forecasting situations in which additional information-besides the historical record of a variable-is available in the form of expectations.     

Forecasting functional time series using weighted likelihood methodology

Functional time series whose sample elements are recorded sequentially over time are frequently encountered with increasing technology. Recent studies have shown that analyzing and forecasting of functional time series can be performed easily using functional principal component analysis and existing univariate/multivariate time series models. However, the forecasting performance of such functional time series models may be affected by the presence of outlying observations which are very common in many scientific fields. Outliers may distort the functional time series model structure, and thus, the underlying model may produce high forecast errors. We introduce a robust forecasting technique based on weighted likelihood methodology to obtain point and interval forecasts in functional time series in the presence of outliers. The finite sample performance of the proposed method is illustrated by Monte Carlo simulations and four real-data examples. Numerical results reveal that the proposed method exhibits superior performance compared with the existing method(s).