Semiparametric Time Series Models with Log‐concave Innovations: Maximum Likelihood Estimation and its Consistency

We study semiparametric time series models with innovations following a log‐concave distribution. We propose a general maximum likelihood framework that allows us to estimate simultaneously the parameters of the model and the density of the innovations. This framework can be easily adapted to many well‐known models, including autoregressive moving average (ARMA), generalized autoregressive conditionally heteroscedastic (GARCH), and ARMA‐GARCH models. Furthermore, we show that the estimator under our new framework is consistent in both ARMA and ARMA‐GARCH settings. We demonstrate its finite sample performance via a thorough simulation study and apply it to model the daily log‐return of the FTSE 100 index.     

COMPOSITIONAL TIME SERIES ANALYSIS OF MORTALITY PROPORTIONS

Compositional time series are multivariate time series which at each time point are proportions that sum to a constant. Accurate inference for such series which occur in several disciplines such as geology, economics and ecology is important in practice. Usual multivariate statistical procedures ignore the inherent constrained nature of these observations as parts of a whole and may lead to inaccurate estimation and prediction. In this article, a regression model with vector autoregressive moving average (VARMA) errors is fit to the compositional time series after an additive log ratio (ALR) transformation. Inference is carried out in a hierarchical Bayesian framework using Markov chain Monte Carlo techniques. The approach is illustrated on compositional time series of mortality events in Los Angeles in order to investigate dependence of different categories of mortality on air quality.     

On the identification of ARMA echelon-form models

An identification procedure for multivariate autoregressive moving average (ARMA) echelon-form models is proposed. It is based on the study of the linear dependence between rows of the Hankel matrix of serial correlations. To that end, we define a statistical test for checking the linear dependence between vectors of serial correlations. It is shown that the test statistic t?_n considered is distributed asymptotically as a finite linear combination of independent chi-square random variables with one degree of freedom under the null hypothesis, whereas under the alternative hypothesis, t?_N/N converges in probability to a positive constant. These results allow us, in particular, to compute the asymptotic probability of making a specification error with the proposed procedure. Links to other methods based on the application of canonical analysis are discussed. A simulation experiment was done in order to study the performance of the procedure. It is seen that the graphical representation of t?_N, as a function of N, can be very useful in identifying the dynamic structure of ARMA models. Furthermore, for the model considered, the proposed identification procedure performs very well for series of 100 observations or more and reasonably well with short series of 50 observations.     

Modelling long-term dependence in measurement errors of plutonium concentration

In this paper the fractional differenced autoregressive-moving average (ARMA) model is applied in order to model the long-term dependence of plutonium concentration measurements of a physical process, and its performance is compared with that of the common ARMA model using a frequency domain based bootstrap approach.     

On change point test for ARMA–GARCH models: Bootstrap approach

The problem of testing for a parameter change has been a core issue in time series analysis. It is well known that the estimates-based CUSUM test often suffers from severe size distortions in general GARCH type models. The residual-based CUSUM test has been used as an alternative, which, however, has a defect not to detect the ARMA parameter changes in ARMA–GARCH models. As a remedy, one can employ the score vector-based CUSUM test in ARMA–GARCH models as in Oh and Lee (0000). However, it shows some size distortions for relatively small samples. Hence, we consider the bootstrap counterpart for obtaining a more stable test. Focus is made on the verification of the weak consistency of the proposed test. An empirical study is illustrated for its evaluation.     

On the pade tablé and its relationship to the r and sarrays and arm a modeling

The Box-Jenkins method is a popular and important technique for modeling and forecasting of time series. Unfortunately the problem of determining the appropriate ARMA forecasting model (or indeed if an ARMA model holds) is a major drawback to the use of the Box-Jenkins methodology. Gray et al. (1978) and Woodward and Gray (1979) have proposed methods of estimating p and qin ARMA modeling based on the R and Sarrays that circumvent some of these modeling difficulties.

In this paper we generalize the R and S arrays by showing a relationship to Padé approximunts and then show that these arrays have a much wider application than in just determining model order. Particular non-ARMA models can be identified as well. This includes certain processes that consist of deterministic functions plus ARMA noise, indeed we believe that the combined R and S arrays are the best overall tool so fur developed for the identification of general 2nd order (not just stationary) time scries models.     

Premia in Forward Foreign Exchange as Unobserved Components: A Note

We reconsider the signal-extraction approach to measuring premia in the pricing of forward foreign exchange, put forward by Wolff, in which the difference between the forward rate and the associated future spot rate is modeled as an autoregressive moving average (ARMA) model for the risk premium buried in a white-noise forecast error. We point out that an ARMA model for the risk premium is not always identifiable from information on the difference between the forward rate and the future spot rate only. We present solutions to the problem of identification and show how the model for the risk premium can be estimated in a direct way, provided that the identification problem is solved. For reason of comparison, we use the series analyzed by Wolff to estimate the models for risk premia. The results confirm the earlier finding that premia in forward exchange exhibit a certain degree of persistence over time.     

EWNA charts for monitoring the mean and the autocovariances of stationary processes

In this paper various types of EWMA control charts are introduced for the simultaneous monitoring of the mean and the autocovariances. The target process is assumed to be a stationary process up to fourth-order or an ARMA process with heavy tailed innovations. The case of a Gaussian process is included in our results as well. The charts are compared within a simulation study. As a measure of the performance the average run length is taken. The target process is an ARMA (1,1) process with Student-t distributed innovations. The behavior of the charts is analyzed with respect to several out-of-control models. The best design parameters are determined for each chart. Our comparisons show that the multivariate EWMA chart applied to the residuals has the best overall performance.     

Estimating linear representations of nonlinear processes

This paper considers the problem of estimating an autoregressive-moving average (ARMA) model when only ergodic and mixing assumptions can be made. The estimation procedure is based on the minimization of a sum of squared deviations about linear conditional expectations. It is shown that the estimator is strongly consistent and asymptotically normal. The results can be used to estimate weak linear representations of some nonlinear processes. Several examples of such linear representations are provided. Other potential areas of applications are inference for noncausal ARMA, aggregation and marginalization of linear processes. A numerical study is also presented. It appears that standard identification routines based on strong hypothesis on the innovation of ARMA models can be seriously misleading when these assumptions do not hold.     

Identifying the time of step change in the mean of autocorrelated processes

Control charts are used to detect changes in a process. Once a change is detected, knowledge of the change point would simplify the search for and identification of the special cause. Consequently, having an estimate of the process change point following a control chart signal would be useful to process analysts. Change-point methods for the uncorrelated process have been studied extensively in the literature; however, less attention has been given to change-point methods for autocorrelated processes. Autocorrelation is common in practice and is often modeled via the class of autoregressive moving average (ARMA) models. In this article, a maximum likelihood estimator for the time of step change in the mean of covariance-stationary processes that fall within the general ARMA framework is developed. The estimator is intended to be used as an “add-on” following a signal from a phase II control chart. Considering first-order pure and mixed ARMA processes, Monte Carlo simulation is used to evaluate the performance of the proposed change-point estimator across a range of step change magnitudes following a genuine signal from a control chart. Results indicate that the estimator provides process analysts with an accurate and useful estimate of the last sample obtained from the unchanged process. Additionally, results indicate that if a change-point estimator designed for the uncorrelated process is applied to an autocorrelated process, the performance of the estimator can suffer dramatically.     

Forecasting interest rates: a comparative assessment of some second-generation nonlinear models

Modeling and forecasting of interest rates has traditionally proceeded in the framework of linear stationary methods such as ARMA and VAR, but only with moderate success. We examine here three methods, which account for several specific features of the real world asset prices such as nonstationarity and nonlinearity. Our three candidate methods are based, respectively, on a combined wavelet artificial neural network (WANN) analysis, a mixed spectrum (MS) analysis and nonlinear ARMA models with Fourier coefficients (FNLARMA). These models are applied to weekly data on interest rates in India and their forecasting performance is evaluated vis-à-vis three GARCH models [GARCH (1,1), GARCH-M (1,1) and EGARCH (1,1)] as well as the random walk model. Both the WANN and MS methods show marked improvement over other benchmark models, and may thus hold out several potentials for real world modeling and forecasting of financial data.     

On the relationship between levinson recursion and the r and s arrays for arma model identification

Motivated by the papers of Woodward and Gray (1979) and Gray, Kelly and McIntire (1978) on the R and S array approach to ARMA modeling, the authors show that the R and S array algorithm is completely equivalent to Levinson recursion. Since entries in the R and S array can be computed by either algorithm, the equivalence provides greater insight into the R and S methodology as well as its links to Akaike's AIC or FPE. Numerical simulations serve to highlight the differences between the various approaches as well as illustrate the problems associated with exact methods. The K and S array approach is shown to be an effective procedure for determining ARMA model orders.     

The consistency of model selection for dynamic Semi-varying coefficient models with autocorrelated errors

The consistency of model selection criterion BIC has been well and widely studied for many nonlinear regression models. However, few of them had considered models with lag variables as regressors and auto-correlated errors in time series settings, which is common in both linear and nonlinear time series modeling. This paper studies a dynamic semi-varying coefficient model with ARMA errors, using an approach based on spectrum analysis of time series. The consistency property of the proposed model selection criteria is established and an implementation procedure of model selection is proposed for practitioners. Simulation studies have also been conducted to numerically show the consistency property.     

Random Level-Shift Time Series Models,ARIMA Approximations,and Level-Shift Detection

The main purpose of this article is to assess the performance of autoregressive integrated moving average (ARIMA) models when occasional level shifts occur in the time series under study. A random level-shift time series model that allows the level of the process to change occasionally is introduced. Between two consecutive changes, the process behaves like the usual autoregressive moving average (ARMA) process. In practice, a series generated from a random level-shift ARMA (RLARMA) model may be misspecified as an ARIMA process. The efficiency of this ARIMA approximation with respect to estimation of current level and forecasting is investigated. The results of examining a special case of an RLARMA model indicate that the ARIMA approximations are inadequate for estimating the current level, but they are robust for forecasting future observations except when there is a very low frequency of level shifts or when the series are highly negatively correlated. A level-shift detection procedure is presented to handle the low-frequency level-shift phenomena, and its usefulness in building models for forecasting is demonstrated.     

Asymptotic Inefficiency of Mean-Correction on Parameter Estimation for a Periodic First-Order Autoregressive Model

A common practice in time series analysis is to fit a centered model to the mean-corrected data set. For stationary autoregressive moving-average (ARMA) processes, as far as the parameter estimation is concerned, fitting an ARMA model without intercepts to the mean-corrected series is asymptotically equivalent to fitting an ARMA model with intercepts to the observed series. We show that, related to the parameter least squares estimation of periodic ARMA models, the second approach can be arbitrarily more efficient than the mean-corrected counterpart. This property is illustrated by means of a periodic first-order autoregressive model. The asymptotic variance of the estimators for both approaches is derived. Moreover, empirical experiments based on simulations investigate the finite sample properties of the estimators.     

ANOVA decomposition of conditional Gaussian processes for sensitivity analysis with dependent inputs

Complex computer codes are widely used in science to model physical systems. Sensitivity analysis aims to measure the contributions of the inputs on the code output variability. An efficient tool to perform such analysis is the variance-based methods which have been recently investigated in the framework of dependent inputs. One of their issue is that they require a large number of runs for the complex simulators. To handle it, a Gaussian process (GP) regression model may be used to approximate the complex code. In this work, we propose to decompose a GP into a high-dimensional representation. This leads to the definition of a variance-based sensitivity measure well tailored for non-independent inputs. We give a methodology to estimate these indices and to quantify their uncertainty. Finally, the approach is illustrated on toy functions and on a river flood model.     

Identification of Periodic Moving-Average Models

Abstract

ARMA models with seasonally-varying parameters and orders, known as periodic ARMA (PARMA) models, have found wide applications in modeling of seasonal processes. This article considers the identification of orders of periodic MA (PMA) models. The identification is based on the cut-off property of the periodic autocorrelation function (PeACF). We derive an explicit expression for the asymptotic variance of the sample PeACF to be used in establishing its bands. A simulated example is also provided which agrees well with the theoretical results.     

Time series models with asymmetric Laplace innovations

We propose autoregressive moving average (ARMA) and generalized autoregressive conditional heteroscedastic (GARCH) models driven by asymmetric Laplace (AL) noise. The AL distribution plays, in the geometric-stable class, the analogous role played by the normal in the alpha-stable class, and has shown promise in the modelling of certain types of financial and engineering data. In the case of an ARMA model we derive the marginal distribution of the process, as well as its bivariate distribution when separated by a finite number of lags. The calculation of exact confidence bands for minimum mean-squared error linear predictors is shown to be straightforward. Conditional maximum likelihood-based inference is advocated, and corresponding asymptotic results are discussed. The models are particularly suited for processes that are skewed, peaked, and leptokurtic, but which appear to have some higher order moments. A case study of a fund of real estate returns reveals that AL noise models tend to deliver a superior fit with substantially less parameters than normal noise counterparts, and provide both a competitive fit and a greater degree of numerical stability with respect to other skewed distributions.     

Testing for Equal Predictability of Stationary ARMA Processes

In this work we use a measure of predictability of a time series following a stationary ARMA process to develop a test of equal predictability of two or more time series. The test is derived by a set of propositions which links the structure of the AR and MA coefficients to the predictability measure. A particular case of this general approach is constituted by time series having a Wold decomposition with weights having the same sign; in this framework the equal predictability is equivalent to parallelism among ARMA models and the null hypothesis of equal predictability is simply a set of linear restrictions. The ARMA representation of the GARCH models presents non-negative weights, so that this test can be extended to verify the equal predictability of squared time series following GARCH structures.     

Asymptotic Results for Spatial ARMA Models

Causal quadrantal-type spatial ARMA(p, q) models with independent and identically distributed innovations are considered. In order to select the orders (p, q) of these models and estimate their autoregressive parameters, estimators of the autoregressive coefficients, derived from the extended Yule–Walker equations are defined. Consistency and asymptotic normality are obtained for these estimators. Then, spatial ARMA model identification is considered and simulation study is given.