Time-Varying Smooth Transition Autoregressive Models

Nonlinear regime-switching behavior and structural change are often perceived as competing alternatives to linearity. In this article we study the so-called time-varying smooth transition autoregressive (TV-STAR) model, which can be used both for describing simultaneous nonlinearity and structural change and for distinguishing between these features. Two modeling strategies for empirical specification of TV-STAR models are developed. Monte Carlo simulations show that neither of the two strategies dominates the other. A specific-to-general-to-specific procedure is best suited for obtaining a first impression of the importance of nonlinearity and/or structural change for a particular time series. A specific-to-general procedure is most useful in careful specification of a model with nonlinear and/or time-varying properties. An empirical application to a large dataset of U.S. macroeconomic time series illustrates the relative merits of both modeling strategies.     

Bootstrap Procedures for Online Monitoring of Changes in Autoregressive Models

We compare the behavior of several bootstrap procedures for monitoring changes in the error distribution of autoregressive time series. The proposed procedures are designed to control the overall significance level and include classical tests based on the empirical distribution function as well as Fourier-type methods that utilize the empirical characteristic function, both functions being computed on the basis of properly estimated residuals. The Monte Carlo study incorporates different estimators and a variety of sampling situations with and without outliers.     

Inference for Local Autocorrelations in Locally Stationary Models

For nonstationary processes, the time-varying correlation structure provides useful insights into the underlying model dynamics. We study estimation and inferences for local autocorrelation process in locally stationary time series. Our constructed simultaneous confidence band can be used to address important hypothesis testing problems, such as whether the local autocorrelation process is indeed time-varying and whether the local autocorrelation is zero. In particular, our result provides an important generalization of the R function acf() to locally stationary Gaussian processes. Simulation studies and two empirical applications are developed. For the global temperature series, we find that the local autocorrelations are time-varying and have a “V” shape during 1910–1960. For the S&P 500 index, we conclude that the returns satisfy the efficient-market hypothesis whereas the magnitudes of returns show significant local autocorrelations.     

A Class of Non-Gaussian State Space Models With Exact Likelihood Inference

The likelihood function of a general nonlinear, non-Gaussian state space model is a high-dimensional integral with no closed-form solution. In this article, I show how to calculate the likelihood function exactly for a large class of non-Gaussian state space models that include stochastic intensity, stochastic volatility, and stochastic duration models among others. The state variables in this class follow a nonnegative stochastic process that is popular in econometrics for modeling volatility and intensities. In addition to calculating the likelihood, I also show how to perform filtering and smoothing to estimate the latent variables in the model. The procedures in this article can be used for either Bayesian or frequentist estimation of the model’s unknown parameters as well as the latent state variables. Supplementary materials for this article are available online.     

The Performance of Periodic Autoregressive Models in Forecasting Seasonal U.K. Consumption

The parameters of a periodic model are allowed to vary according to the time at which observations are made. Periodic autoregressive models are fitted to the quarterly values of seasonally unadjusted real nondurable consumers' expenditure for the United Kingdom and its components. The periodic model offers no improvement over conventional specifications if the aggregate is modeled directly. On the other hand, periodic models generally perform well for the components, which contain additional seasonal information. The choice between a periodic or nonperiodic specification is also shown to have an important influence on the resulting dynamic properties.     

Inference for Time Series Regression Models With Weakly Dependent and Heteroscedastic Errors

Motivated by the need to assess the significance of the trend in some macroeconomic series, this article considers inference of a parameter in parametric trend functions when the errors exhibit certain degrees of nonstationarity with changing unconditional variances. We adopt the recently developed self-normalized approach to avoid the difficulty involved in the estimation of the asymptotic variance of the ordinary least-square estimator. The limiting distribution of the self-normalized quantity is nonpivotal but can be consistently approximated by using the wild bootstrap, which is not consistent in general without studentization. Numerical simulation demonstrates favorable coverage properties of the proposed method in comparison with alternative ones. The U.S. nominal wages series is analyzed to illustrate the finite sample performance. Some technical details are included in the online supplemental material.     

Statistical Inference on the Parametric Component in Partially Linear Spatial Autoregressive Models

A statistical test procedure is proposed to check whether the parameters in the parametric component of the partially linear spatial autoregressive models satisfy certain linear constraint conditions, in which a residual-based bootstrap procedure is suggested to derive the p-value of the test. Some simulations are conducted to assess the performance of the test and the results show that the bootstrap approximation to the null distribution of the test statistic is valid and the test is of satisfactory power. Furthermore, a real-world example is given to demonstrate the application of the proposed test.     

Using the Residual White Noise Autoregressive Order Determination Criterion to Identify Unit Roots in Arima Models

We present a simplified form of a univariate identification approach for time series models based on the residual white noise autoregressive order determination criterion and linear estimation methods. We also show how the procedure can be used to identify the degree of differencing necessary to induce stationarity in data. The performance of this approach is also contrasted with Portmanteau tests for detection of white noise residuals and with Dickey-Fuller and Bayesian procedures for detection of unit roots. Simulated and economic data are used to demonstrate the capabilities of the modified approach.     

Hidden Markov Mixture Autoregressive Models: Stability and Moments

This article introduces a parsimonious structure for mixture of autoregressive models, where the weighting coefficients are determined through latent random variables, as functions of all past observations. These latent variables follow a Markov model. We propose a dynamic programming algorithm for forecasting, which reduces the volume of calculations. We also derive limiting behavior of unconditional first moment of the process and an appropriate upper bound for the limiting value of the variance. Further more, we show convergence and stability of the second moment. Finally, we illustrate the efficacy of the proposed model by simulation.     

Likelihood-Based Inference in Autoregressive Models with Scaled t-Distributed Innovations by Means of EM-Based Algorithms

This article applies the EM-based (ECM and ECME) algorithms to find the maximum likelihood estimates of model parameters in general AR models with independent scaled t-distributed innovations whenever the degrees of freedom are unknown. The ECME, sharing advantages with both EM and Newton–Raphson algorithms, is an extension of ECM, which itself is an extension of the EM algorithm. The ECM and ECME algorithms, which are analytically quite simple to use, are then compared based on the computational running time and the accuracy of estimation via a simulation study. The results demonstrate that the ECME is efficient and usable in practice. We also show how our method can be applied to the Wolfer's sunspot data.     

Adaptive Shrinkage in Bayesian Vector Autoregressive Models

Vector autoregressive (VAR) models are frequently used for forecasting and impulse response analysis. For both applications, shrinkage priors can help improving inference. In this article, we apply the Normal-Gamma shrinkage prior to the VAR with stochastic volatility case and derive its relevant conditional posterior distributions. This framework imposes a set of normally distributed priors on the autoregressive coefficients and the covariance parameters of the VAR along with Gamma priors on a set of local and global prior scaling parameters. In a second step, we modify this prior setup by introducing another layer of shrinkage with scaling parameters that push certain regions of the parameter space to zero. Two simulation exercises show that the proposed framework yields more precise estimates of model parameters and impulse response functions. In addition, a forecasting exercise applied to U.S. data shows that this prior performs well relative to other commonly used specifications in terms of point and density predictions. Finally, performing structural inference suggests that responses to monetary policy shocks appear to be reasonable.     

Sampling-based Inference of Time Deformation Models with Heavy Tail Distributions

This article focuses on simulation-based inference for the time-deformation models directed by a duration process. In order to better capture the heavy tail property of the time series of financial asset returns, the innovation of the observation equation is subsequently assumed to have a Student-t distribution. Suitable Markov chain Monte Carlo (MCMC) algorithms, which are hybrids of Gibbs and slice samplers, are proposed for estimation of the parameters of these models. In the algorithms, the parameters of the models can be sampled either directly from known distributions or through an efficient slice sampler. The states are simulated one at a time by using a Metropolis-Hastings method, where the proposal distributions are sampled through a slice sampler. Simulation studies conducted in this article suggest that our extended models and accompanying MCMC algorithms work well in terms of parameter estimation and volatility forecast.     

Penalized Pseudolikelihood Inference in Spatial Interaction Models with Covariates

Given spatially located observed random variables ( x , z = {( x _i , z _i )} _i , we propose a new method for non-parametric estimation of the potential functions of a Markov random field p ( x | z ), based on a roughness penalty approach. The new estimator maximizes the penalized log-pseudolikelihood function and is a natural cubic spline. The calculations involved do not rely on Monte Carlo simulation. We suggest the use of B-splines to stabilize the numerical procedure. An application in Bayesian image reconstruction is described.     

Markov regime switching in mean and in fractional integration parameter

We propose a specific general Markov-regime switching estimation both in the long memory parameter d and the mean of a time series. We employ Viterbi algorithm that combines the Viterbi procedures in two state Markov-switching parameter estimation. It is well-known that existence of mean break and long memory in time series can be easily confused with each other in most cases. Thus, we aim at observing the deviation and interaction of mean and d estimates for different cases. A Monte Carlo experiment reveals that the finite sample performance of the proposed algorithm for a simple mixture model of Markov-switching mean and d changes with respect to the fractional integrating parameters and the mean values for the two regimes.     

Inference for circular distributions and processes

One approach to defining models for circular data and processes has been to take a standard Euclidean model and to wrap it around the circle. This generates rich families of circular models but creates difficulties for inference. Using data augmentation ideas which have previously been applied to this problem in the framework of an EM algorithm, we demonstrate the power and flexibility of Markov chain Monte Carlo methods to fit such classes of models to circular data. The precision of the technique is confirmed through simulated examples, and then applications are given to multivariate and time series data of wind directions.     

Probabilistic Properties of Parametric Dual and Inverse Time Series Models Generated by ARMA Models

For the class of autoregressive-moving average (ARMA) processes, we examine the relationship between the dual and the inverse processes. It is demonstrated that the inverse process generated by a causal and invertible ARMA (p, q) process is a causal and invertible ARMA (q, p) model. Moreover, it is established that this representation is strong if and only if the generating process is Gaussian. More precisely, it is derived that the linear innovation process of the inverse process is an all-pass model. Some examples and applications to time reversibility are given to illustrate the obtained results.     

Feedback and Mediation in Causal Inference Illustrated by Stochastic Process Models

The concept of causality is naturally related to processes developing over time. Central ideas of causal inference like time‐dependent confounding (feedback) and mediation should be viewed as dynamic concepts. We shall study these concepts in the context of simple dynamic systems. Time‐dependent confounding and its implications are illustrated in a Markov model. We emphasize the distinction between average treatment effect, ATE, and treatment effect of the treated, ATT. These effects could be quite different, and we discuss the relationship between them. Mediation is studied in a stochastic differential equation model. A type of natural direct and indirect effects is considered for this model. Mediation analysis of discrete measurements from such processes may give misleading results, and one needs to consider the underlying continuous process. The dynamic and time‐continuous view of causality and mediation is an essential feature, and more attention should be payed to the time aspect in causal inference.     

Robust Inference in Generalized Linear Models

Robust inference on the parameters in generalized linear models is performed using the weighted likelihood method. Two cases are considered: a case with replicated observations and a case with a single observation of the dependent variable for each combination of the explanatory variables. The first case is common in the design of experiments, while the second case arises in observational studies. Theoretical and computational results on real datasets are presented and compared with other existing techniques.     

Parametric Inference in Stationary Time Series Models with Dependent Errors

This article is concerned with inference for the parameter vector in stationary time series models based on the frequency domain maximum likelihood estimator. The traditional method consistently estimates the asymptotic covariance matrix of the parameter estimator and usually assumes the independence of the innovation process. For dependent innovations, the asymptotic covariance matrix of the estimator depends on the fourth‐order cumulants of the unobserved innovation process, a consistent estimation of which is a difficult task. In this article, we propose a novel self‐normalization‐based approach to constructing a confidence region for the parameter vector in such models. The proposed procedure involves no smoothing parameter, and is widely applicable to a large class of long/short memory time series models with weakly dependent innovations. In simulation studies, we demonstrate favourable finite sample performance of our method in comparison with the traditional method and a residual block bootstrap approach.