Bias of ml and reml estimators in regression models with arma errors

Data are simulated for a regression model in which the errors have an autoregressive, moving average structure. The parameters of this structure together with the error variance are estimated using both MLand REML techniques. Average biases of estimators from each technique are reported for a range of true parameter values.     

ORDER SELECTION IN ARMA MODELS USING THE FOCUSED INFORMATION CRITERION

This paper develops a new approach for order selection in autoregressive moving average models using the focused information criterion. This criterion minimizes the asymptotic mean squared error of the estimator of a parameter of interest. Simulation studies indicate that the suggested criterion is quite effective and comparable to the Akaike information criterion, the corrected Akaike information criterion and the Bayesian information criterion in autoregressive moving average order selection. The use of the focused information criterion for the simultaneous selection of regression variables and order of the error process in a linear regression model with autoregressive moving average errors is also considered.     

A recursive approach to parameter estimation in regression and time series models

In this paper we discuss the recursive (or on line) estimation in (i) regression and (ii) autoregressive integrated moving average (ARIMA) time series models. The adopted approach uses Kalman filtering techniques to calculate estimates recursively. This approach is used for the estimation of constant as well as time varying parameters. In the first section of the paper we consider the linear regression model. We discuss recursive estimation both for constant and time varying parameters. For constant parameters, Kalman filtering specializes to recursive least squares. In general, we allow the parameters to vary according to an autoregressive integrated moving average process and update the parameter estimates recursively. Since the stochastic model for the parameter changes will "be rarely known, simplifying assumptions have to be made. In particular we assume a random walk model for the time varying parameters and show how to determine whether the parameters are changing over time. This is illustrated with an example.     

Shrinkage estimation for linear regression with ARMA errors

In this paper, we extend the modified lasso of Wang et al. (2007) to the linear regression model with autoregressive moving average (ARMA) errors. Such an extension is far from trivial because new devices need to be called for to establish the asymptotics due to the existence of the moving average component. A shrinkage procedure is proposed to simultaneously estimate the parameters and select the informative variables in the regression, autoregressive, and moving average components. We show that the resulting estimator is consistent in both parameter estimation and variable selection, and enjoys the oracle properties. To overcome the complexity in numerical computation caused by the existence of the moving average component, we propose a procedure based on a least squares approximation to implement estimation. The ordinary least squares formulation with the use of the modified lasso makes the computation very efficient. Simulation studies are conducted to evaluate the finite sample performance of the procedure. An empirical example of ground-level ozone is also provided.     

Testing for structural change in cointegrated regression models: some comparisons and generalizations

This paper compares and generalizes some testing procedures for structural change in the context of cointegrated regression models. The Lagrange Multiplier (LM) tests proposod by Hansen (1992) are generalized to testing for partial structural change. An exponential average LM test is also suggested following the idea of Andrews and Ploberger (1992). In particular, an optimal test for cointegration is developed. We also propose a new cointegration test which is robust to a possible one-time discrete jump in the intercept. We tabulate the asymptotic critical values for the above tests and conduct a small Monte Carlo simulation to investigate their finite sample performance.     

Testing for structural change in cointegrated regression models: some comparisons and generalizations

This paper compares and generalizes some testing procedures for structural change in the context of cointegrated regression models. The Lagrange Multiplier (LM) tests proposod by Hansen (1992) are generalized to testing for partial structural change. An exponential average LM test is also suggested following the idea of Andrews and Ploberger (1992). In particular, an optimal test for cointegration is developed. We also propose a new cointegration test which is robust to a possible one-time discrete jump in the intercept. We tabulate the asymptotic critical values for the above tests and conduct a small Monte Carlo simulation to investigate their finite sample performance.     

Stationarity and invertibility regions for low order starma models

The building of STARMA, space-time autoregressive moving average, models requires a working knowledge of the conditions under which a particular model represents a stationary process. Constraints on the parameter space that ensure stationarity are developed for all STARMA models of autoregressive temporal order le*ss than or equal to two and spatial order less than or equalto one when the model form utilizes scaled weights. Invertibility conditions for these same models are also given.     

Tests for comparing time series of unequal lengths

This paper deals with hypothesis testing for independent time series with unequal length. It proposes a spectral test based on the distance between the periodogram ordinates and a parametric test based on the distance between the parameter estimates of fitted autoregressive moving average models. Both tests are compared with a likelihood ratio test based on the pooled spectra. In all cases, the null hypothesis is that the two series under consideration are generated by the same stochastic process. The performance of the three tests is investigated by a Monte Carlo simulation study.     

Independence and sphericity tests for the residuals of space-time arma models

The mechanics of the procedure for building space-time autoregressive moving average (STARMA) models is dependent upon the form of G, the variance-covariance matrix of the underlying errors.This paper presents large sample tests of the hypotheses that G is diagonal and that G equals o² I. Tables of the critical values for these tests are constructed     

Testing for the Equality of Two Nonparametric Regression Curves with Long Memory Errors

This article discusses the problem of testing the equality of two nonparametric regression functions against two-sided alternatives for uniform design on [0,1] with long memory moving average errors. The standard deviations and the long memory parameters are possibly different for the two errors. The article adapts the partial sum process idea used in the independent observations settings to construct the tests and derives their asymptotic null distributions. The article also shows that these tests are consistent for general alternatives and obtains their limiting distributions under a sequence of local alternatives. Since the limiting null distributions of these tests are unknown, we first conducted a Monte Carlo simulation study to obtain a few selected critical values of the proposed tests. Then based on these critical values, another Monte Carlo simulation is conducted to study the finite sample level and power behavior of these tests at some alternatives. The article also contains a simulation study that assesses the effect of estimating the nonparametric regression function on an estimate of the long memory parameter of the errors. It is observed that the estimate based on direct observations is generally preferable over the one based on the estimated nonparametric residuals.     

On the duality between long-run relations and common trends in the i(1) versus(2)model.an application to aggregate money holdings

Long-run relations and common trends are discussed in terms of the multivariate cointegration model given in the autoregressive and the moving average form. The basic results needed for the analysis of I(1) and 1(2)processes are reviewed and the results applied to Danish monetary data. The test procedures reveal that nominal money stock is essentially I(2). Long-run price homogeneity is supported by the data and imposed on the system. It is found that the bond rate is weakly exogenous for the long-run parameters and therefore act as a driving trend. Using the nonstationarity property of the data, “excess money” is estimated and its effect on the other determinants of the system is investigated. In particular, it is found that “excess money” has no effect on price inflation.     

非线性协整的秩检验方法及其响应面函数研究

 本文对非线性协整关系的秩检验方法进行了系统的梳理,运用Monte Carlo模拟给出了不同样本容量的各个秩检验统计量的临界值,并进一步探讨了其响应面函数,给出了各个秩检验统计量临界值的近似计算公式。对中国上证综指与主要发达国家股指关系的秩协整检验表明,与传统线性协整Johansen检验相比,秩协整检验能够检测到更多的线性和非线性协整关系。     

A significance test for classifying arma models

Given that the Euclidean distance between the parameter estimates of autoregressive expansions of autoregressive moving average models can be used to classify stationary time series into groups, a test of hypothesis is proposed to determine whether two stationary series in a particular group have significantly different generating processes. Based on this test a new clustering algorithm is also proposed. The results of Monte Carlo simulations are given.     

Uniformly adaptive estimation for models with arma errors

A semiparametric estimator based on an unknown density isuniformly adaptive if the expected loss of the estimator converges to the asymptotic expected loss of the maximum liklihood estimator based on teh true density (MLE), and if convergence does not depend on either the parameter values or the form of the unknown density. Without uniform adaptivity, the asymptotic expected loss of the MLE need not approximate the expected loss of a semiparametric estimator for any finite sample I show that a two step semiparametric estimator is uniformly adaptive for the parameters of nonlinear regression models with autoregressive moving average errors.     

On the Distribution of Likelihood Ratio Test Statistics for Cointegration Rank

This paper analyses the likelihood ratio test for the hypothesis of reduced cointegration rank in a Gaussian vector autoregressive model. The usual asymptotic distribution typically gives rather large size distortions. This is explained by the fact that the asymptotic distribution of the likelihood ratio test statistic varies across the parameter space. A much improved distribution approximation can be obtained using local asymptotic theory. The idea is discussed for some low dimensional examples.     

On the distribution of independence test for the residuals of space-time arma models

The procedure for building space-time autoregressive moving average (STARMA) models depends on the form of the variance-covariance matrix G of the underlying errors (see Pfeifer Deutsch (1980a,c)). In this paper the distribu¬tion of the statistic for testing the hypothesis that G is diagonal is obtained in a very convenient computational form. A table of critical values for the test is given Comparison is made with the approximate values obtained by Pfeifer Deutsch (1980c)     

Uniformly adaptive estimation for models with arma errors

A semiparametric estimator based on an unknown density isuniformly adaptive if the expected loss of the estimator converges to the asymptotic expected loss of the maximum liklihood estimator based on teh true density (MLE), and if convergence does not depend on either the parameter values or the form of the unknown density. Without uniform adaptivity, the asymptotic expected loss of the MLE need not approximate the expected loss of a semiparametric estimator for any finite sample I show that a two step semiparametric estimator is uniformly adaptive for the parameters of nonlinear regression models with autoregressive moving average errors.     

Bayesian averaging of classical estimates in asymmetric vector autoregressive models

The estimated vector autoregressive (VAR) model is sensitive to model misspecifications, resulting to biased and inconsistent parameter estimates. This article extends the Bayesian averaging of classical estimates, a robustness procedure in cross-section data, to a vector time-series that is estimated using a large number of asymmetric VAR models. The proposed procedure was applied to simulated data from various forms of model misspecifications. The results of the simulation suggest that, under misspecification problems, particularly if an important variable and moving average (MA) terms were omitted, the proposed procedure gives robust results and better forecasts than the automatically selected equal lag-length VAR model.     

Beta seasonal autoregressive moving average models

In this paper, we introduce the class of beta seasonal autoregressive moving average (βSARMA) models for modelling and forecasting time series data that assume values in the standard unit interval. It generalizes the class of beta autoregressive moving average models [Rocha AV and Cribari-Neto F. Beta autoregressive moving average models. Test. 2009;18(3):529–545] by incorporating seasonal dynamics to the model dynamic structure. Besides introducing the new class of models, we develop parameter estimation, hypothesis testing inference, and diagnostic analysis tools. We also discuss out-of-sample forecasting. In particular, we provide closed-form expressions for the conditional score vector and for the conditional Fisher information matrix. We also evaluate the finite sample performances of conditional maximum likelihood estimators and white noise tests using Monte Carlo simulations. An empirical application is presented and discussed.     

THE AUTOREGRESSIVE MOVING AVERAGE MODEL FOR SPATIAL ANALYSIS

A two dimensional autoregressive moving average spatial model is used to analyse spatial interaction. Maximum likelihood estimates of the unknown parameters are derived as the solution of a system of nonlinear equations, and are shown to be best asymptotic normal. One important computational procedure is discussed. The argument is extended to the general regression model with autoregressive moving average residuals. Explicit computational formulae are given.