Asymptotic Results for Spatial ARMA Models

Causal quadrantal-type spatial ARMA(p, q) models with independent and identically distributed innovations are considered. In order to select the orders (p, q) of these models and estimate their autoregressive parameters, estimators of the autoregressive coefficients, derived from the extended Yule–Walker equations are defined. Consistency and asymptotic normality are obtained for these estimators. Then, spatial ARMA model identification is considered and simulation study is given.     

On the Optimal Use of Suboptimal Forecasts of Explanatory Variables

Ashley (1983) gave a simple condition for determining when a forecast of an explanatory variable (X_t ) is sufficiently inaccurate that direct replacement of X_t by the forecast yields worse forecasts of the dependent variable than does respecification of the equation to omit X_t . Many available macroeconomic forecasts were shown to be of limited usefulness in direct replacement. Direct replacement, however, is not optimal if the forecast's distribution is known. Here optimal linear forms in commercial forecasts of several macroeconomic variables are obtained by using estimates of their distributions. Although they are an improvement on the raw forecasts (direct replacement), these optimal forms are still too inaccurate to be useful in replacing the actual explanatory variables in forecasting models. The results strongly indicate that optimal forms involving several commercial forecasts will not be very useful either. Thus Ashley's (1983) sufficient condition retains its value in gauging the usefulness of a forecast of an explanatory variable in a forecasting model, even though it focuses on direct replacement.     

Theory of Bilinear Time Series Models

ABSTRACT

In this paper, we prove some theoretic properties of bilinear time series models which are extension of ARMA models. The sufficient conditions for asymptotic stationarity and ivertibility of some types of bilinear models are derived. The structural theory of discussed bilinear models is similar to that of ARMA models. For illustration, a bilinear model has been fitted to the Wolfer sunspot numbers and a substantial reduction in sum of squared residuals is obtained as comparing with Box-Jenkins ARMA model.     

Obtaining prediction intervals for FARIMA processes using the sieve bootstrap

The sieve bootstrap (SB) prediction intervals for invertible autoregressive moving average (ARMA) processes are constructed using resamples of residuals obtained by fitting a finite degree autoregressive approximation to the time series. The advantage of this approach is that it does not require the knowledge of the orders, p and q, associated with the ARMA(p, q) model. Up until recently, the application of this method has been limited to ARMA processes whose autoregressive polynomials do not have fractional unit roots. The authors, in a 2012 publication, introduced a version of the SB suitable for fractionally integrated autoregressive moving average (FARIMA (p,d,q)) processes with 0<d<0.5 and established its asymptotic validity. Herein, we study the finite sample properties this new method and compare its performance against an older method introduced by Bisaglia and Grigoletto in 2001. The sieve bootstrap (SB) method is a numerically simpler alternative to the older method which requires the estimation of p, d, and q at every bootstrap step. Monte-Carlo simulation studies, carried out under the assumption of normal, mixture of normals, and exponential distributions for the innovations, show near nominal coverages for short-term and long-term SB prediction intervals under most situations. In addition, the sieve bootstrap method yields better coverage and narrower intervals compared to the Bisaglia–Grigoletto method in some situations, especially when the error distribution is a mixture of normals.     

Least squates estimation of missing values in time series

The minimum mean square error linear interpolator for missing values in time series is extended to handle any pattern of nonconsecutive observations. The paper then develops evidence with simple ARMA models that the usefulness of either the"nonparametric"or the parametric form of the least squares interpolator depends on the time series model, the arrangement of the missing data and the objective for completing the series.     

On the pade tablé and its relationship to the r and sarrays and arm a modeling

The Box-Jenkins method is a popular and important technique for modeling and forecasting of time series. Unfortunately the problem of determining the appropriate ARMA forecasting model (or indeed if an ARMA model holds) is a major drawback to the use of the Box-Jenkins methodology. Gray et al. (1978) and Woodward and Gray (1979) have proposed methods of estimating p and qin ARMA modeling based on the R and Sarrays that circumvent some of these modeling difficulties.

In this paper we generalize the R and S arrays by showing a relationship to Padé approximunts and then show that these arrays have a much wider application than in just determining model order. Particular non-ARMA models can be identified as well. This includes certain processes that consist of deterministic functions plus ARMA noise, indeed we believe that the combined R and S arrays are the best overall tool so fur developed for the identification of general 2nd order (not just stationary) time scries models.     

Identification of composite (∑+II) arma models by relatively simpler models

In the real world situations, many time series are aggregates of two or more time series. An aggregation may take place due to an addition or the product or both of two or more time series. We are often interested in the study of the properties of aggregates which are, in turn, dependent on the properties of the constituent series. Motivated by this problem, the authors study in this paper the properties of models generated by the operator (Σ+II) on autoregressive-moving-average (ARMA) processes of orders (p_i,q_i), i = l→n . A few practical examples where such models have been used are given in the introduction and an illustrative numerical example is discussed at the end of the paper.     

Predictor distribution and forecast accuracy of threshold models

In the present paper the predictor distribution of a SETAR (Self Exciting Threshold Autoregressive) model (Tong and Lim, 1980) has been investigated when the lead time is greater than the threshold delay.After a brief presentation of the model under study, some relevant aspects of the density forecasts are shown highlighting how they can be used to generate more accurate predictions and to estimate an approximation of the probability density function of the SETAR predictors. The performances of competing predictors have been evaluated through a simulation study and an application to financial market data of the daily Nikkey 300 stock market returns.     

Reverse Regression and Employment Discrimination

The importance of interval forecasts is reviewed. Several general approaches to calculating such forecasts are described and compared. They include the use of theoretical formulas based on a fitted probability model (with or without a correction for parameter uncertainty), various “approximate” formulas (which should be avoided), and empirically based, simulation, and resampling procedures. The latter are useful when theoretical formulas are not available or there are doubts about some model assumptions. The distinction between a forecasting method and a forecasting model is expounded. For large groups of series, a forecasting method may be chosen in a fairly ad hoc way. With appropriate checks, it may be possible to base interval forecasts on the model for which the method is optimal. It is certainly unsound to use a model for which the method is not optimal, but, strangely, this is sometimes done. Some general comments are made as to why prediction intervals tend to be too narrow in practice to encompass the required proportion of future observations. An example demonstrates the overriding importance of careful model specification. In particular, when data are “nearly nonstationary,” the difference between fitting a stationary and a nonstationary model is critical.     

Fourier smoother and additive models

Suppose the observations (t_i,y_i), i = 1,… n, follow the model where g_j are unknown functions. The estimation of the additive components can be done by approximating g_j, with a function made up of the sum of a linear fit and a truncated Fourier series of cosines and minimizing a penalized least-squares loss function over the coefficients. This finite-dimensional basis approximation, when fitting an additive model with r predictors, has the advantage of reducing the computations drastically, since it does not require the use of the backfitting algorithm. The cross-validation (CV) [or generalized cross-validation (GCV)] for the additive fit is calculated in a further 0(n) operations. A search path in the r-dimensional space of degrees of freedom is proposed along which the CV (GCV) continuously decreases. The path ends when an increase in the degrees of freedom of any of the predictors yields an increase in CV (GCV). This procedure is illustrated on a meteorological data set.     

Inference and prediction with arma processes

An essential ingredient of any time series analysis is the estimation of the model parameters and the forecasting of future observations. This investigation takes a Bayesian approach to the analysis of time series by making inferences of the model parameters from the posterior distribution and forecasting from the predictive distribution.

The foundation of the approach is to approximate the condi-tional likelihood by a normal-gamma distribution on the parameter space. The techniques illustrated with many examples of ARMA processes.     

Probabilistic Properties of Parametric Dual and Inverse Time Series Models Generated by ARMA Models

For the class of autoregressive-moving average (ARMA) processes, we examine the relationship between the dual and the inverse processes. It is demonstrated that the inverse process generated by a causal and invertible ARMA (p, q) process is a causal and invertible ARMA (q, p) model. Moreover, it is established that this representation is strong if and only if the generating process is Gaussian. More precisely, it is derived that the linear innovation process of the inverse process is an all-pass model. Some examples and applications to time reversibility are given to illustrate the obtained results.     

Interpolation,outliers mid inverse autocorrelations

The paper addresses the problem of estimating missing observations in an infinite realization of a linear, possibly nonstationary, stochastic processes when the model is known. The general case of any possible distribution of missing observations in the time series is considered, and analytical expressions for the optimal estimators and their associated mean squared errors are obtained. These expressions involve solely the elements of the inverse or dual autocorrelation function of the series.

This optimal estimator -the conditional expectation of the missing observations given the available ones- is equal to the estimator that results from filling the missing values in the series with arbitrary numbers, treating these numbers as additive outliers, and removing with intervention analysis the outlier effects from the invented numbers.     

Bridge Estimation for Linear Regression Models with Mixing Properties

Penalized regression methods have for quite some time been a popular choice for addressing challenges in high dimensional data analysis. Despite their popularity, their application to time series data has been limited. This paper concerns bridge penalized methods in a linear regression time series model. We first prove consistency, sparsity and asymptotic normality of bridge estimators under a general mixing model. Next, as a special case of mixing errors, we consider bridge regression with autoregressive and moving average (ARMA) error models and develop a computational algorithm that can simultaneously select important predictors and the orders of ARMA models. Simulated and real data examples demonstrate the effective performance of the proposed algorithm and the improvement over ordinary bridge regression.     

ESTIMATION OF SPATIAL ARMA MODELS

Spatial ARMA models are considered using the nonsymmetric half plane ordering on a lattice of data. A method is given for the estimation of the orders and the coefficients of such models under an identifiability condition and the condition that the beat linear predictor is the best predictor in the mean square sense. Under these conditions, the strong consistency of the estimators ia established. The usual methods for ARMA modelling in Time Series Analysis require estimation of the innovations. The method of this paper introduces an inveree model complementary to the original model so that the estimation of the innovations is avoided. This leads to a substantial reduction in the computational complexity in the two-dimensional case.     

A NOTE ON ARMA PARAMETERISATION*

This paper considers the relationship between ARMA parameterisations of models for y(t) and Ay(t), where A is invertible and y(t) is a vector time series (t = 0,±1,…). An ARMA model for the transformed series Ay(t) may have fewer parameters than a model for y(t). This paper shows that such a saving is illusory because the apparently saved parameters are exactly balanced by the number of new parameters appearing in A.     

Multi-step forecasts from threshold ARMA models using asymmetric loss functions

The forecasts generation from nonlinear time series models is investigated under general loss functions. After presenting the main results and some relevant features of these functions, the Linex loss has been used to generate multi-step forecasts from threshold autoregressive moving average models showing their main properties and some results connected to a proper transformation of the forecast errors. A simulation exercise highlights interesting properties of the proposed predictors, both in terms of their bias and their distribution, further clarifying how the Linex predictor can be helpful in empirical applications.     

The Relative Effectiveness of Procedures Commonly Used in Multiple Regression Analysis for Dealing with Missing Values

Expressions are derived for the bias and variance associated with procedures frequently used to estimate partial regression coefficients in a linear model having the two explanatory variables x ₁ and x ₂, with missing values on x ₂ only. The expressions are used to help gain insight into the relative effectiveness of these procedures for handling more complex patterns of missing data.     

M‐estimation for general ARMA Processes with Infinite Variance

Abstract. General autoregressive moving average (ARMA) models extend the traditional ARMA models by removing the assumptions of causality and invertibility. The assumptions are not required under a non‐Gaussian setting for the identifiability of the model parameters in contrast to the Gaussian setting. We study M‐estimation for general ARMA processes with infinite variance, where the distribution of innovations is in the domain of attraction of a non‐Gaussian stable law. Following the approach taken by Davis et al. (1992) and Davis (1996) , we derive a functional limit theorem for random processes based on the objective function, and establish asymptotic properties of the M‐estimator. We also consider bootstrapping the M‐estimator and extend the results of Davis & Wu (1997) to the present setting so that statistical inferences are readily implemented. Simulation studies are conducted to evaluate the finite sample performance of the M‐estimation and bootstrap procedures. An empirical example of financial time series is also provided.     

Forecasting Contemporaneously Aggregated Vector ARMA Processes

Given a multiple time series that is generated by a multivariate ARMA process and assuming the objective is to forecast a weighted sum of the individual variables, then under a mean squared error measure of forecasting precision, it is preferable to forecast the disaggregated multiple time series and aggregate the forecasts, rather than forecast the aggregated series directly, if the involved processes are known. This result fails to hold if the processes used for forecasting are estimated from a given set of time series data. The implications of these results for empirical research are investigated using different sets of economic data.