An efficient algorithm for Harrison-Stevens forecasting using the multi-process multivariate dynamic linear model

This paper develops a computationally efficient algorithm for Harrison-Stevens forecasting in a multivariate time series which has correlated errors. The algorithm uses the observation vector one component at a time on the multiprocess multivariate dynamic linear model. This gives a computationally efficient, robust, quick adapting forecasting method for non stationary multivariate time series.     

Short run spc based upon the second order dynamic linear model for trend detection

Recently, several new applications of control chart procedures for short production runs have been introduced. Bothe (1989) and Burr (1989) proposed the use of control chart statistics which are obtained by scaling the quality characteristic by target values or process estimates of a location and scale parameter. The performance of these control charts can be significantly affected by the use of incorrect scaling parameters, resulting in either an excessive "false alarm rate," or insensitivity to the detection of moderate shifts in the process. To correct for these deficiencies, Quesenberry (1990, 1991) has developed the Q-Chart which is formed from running process estimates of the sample mean and variance. For the case where both the process mean and variance are unknown, the Q-chaxt statistic is formed from the standard inverse Z-transformation of a t-statistic. Q-charts do not perform correctly, however, in the presence of special cause disturbances at process startup. This has recently been supported by results published by Del Castillo and Montgomery (1992), who recommend the use of an alternative control chart procedure which is based upon a first-order adaptive Kalman filter model Consistent with the recommendations by Castillo and Montgomery, we propose an alternative short run control chart procedure which is based upon the second order dynamic linear model (DLM). The control chart is shown to be useful for the early detection of unwanted process trends. Model and control chart parameters are updated sequentially in a Bayesian estimation framework, providing the greatest degree of flexibility in the level of prior information which is incorporated into the model. The result is a weighted moving average control chart statistic which can be used to provide running estimates of process capability. The average run length performance of the control chart is compared to the optimal performance of the exponentially weighted moving average (EWMA) chart, as reported by Gan (1991). Using a simulation approach, the second order DLM control chart is shown to provide better overall performance than the EWMA for short production run applications     

The potential of integrated modelling in conservation biology: A case study of the black‐footed albatross (Phoebastria nigripes)

Conservation biology aims at assessing the status of a population, based on information which is often incomplete. Integrated population modelling based on state‐space models appears to be a powerful and relevant way of combining into a single likelihood several types of information such as capture‐recapture data and population surveys. In this paper, the authors describe the principles of integrated population modelling and they evaluate its performance for conservation biology based on a case study, that of the black‐footed albatross, a northern Pacific albatross species suspected to be impacted by longline fishing     

Bound and convergence of the non-constant dynamic linear model

This paper extends the limiting results of West and Harrison (1997, section 5.5) about the convergence of the variances of time series dynamic linear models (TSDLMs) when both, the variances of the observation and evolution errors of the model, are time-varying with steady limits. Analytical results are derived and an illustrative example is provided.     

Estimation and tests of hypotheses for the initial mean and covariance in the kalman filter model

Kalman filtering techniques are widely used by engineers to recursively estimate random signal parameters which are essentially coefficients in a large-scale time series regression model. These Bayesian estimators depend on the values assumed for the mean and covariance parameters associated with the initial state of the random signal. This paper considers a likelihood approach to estimation and tests of hypotheses involving the critical initial means and covariances. A computationally simple convergent iterative algorithm is used to generate estimators which depend only on standard Kalman filter outputs at each successive stage. Conditions are given under which the maximum likelihood estimators are consistent and asymptotically normal. The procedure is illustrated using a typical large-scale data set involving 10-dimensional signal vectors.     

Multivariate stochastic volatility with Bayesian dynamic linear models

This paper develops a Bayesian procedure for estimation and forecasting of the volatility of multivariate time series. The foundation of this work is the matrix-variate dynamic linear model, for the volatility of which we adopt a multiplicative stochastic evolution, using Wishart and singular multivariate beta distributions. A diagonal matrix of discount factors is employed in order to discount the variances element by element and therefore allowing a flexible and pragmatic variance modelling approach. Diagnostic tests and sequential model monitoring are discussed in some detail. The proposed estimation theory is applied to a four-dimensional time series, comprising spot prices of aluminium, copper, lead and zinc of the London metal exchange. The empirical findings suggest that the proposed Bayesian procedure can be effectively applied to financial data, overcoming many of the disadvantages of existing volatility models.     

Reml and best linear unbiased prediction in state space models

This article takes a hierarchical model approach to the estimation of state space models with diffuse initial conditions. An initial state is said to be diffuse when it cannot be assigned a proper prior distribution. In state space models this occurs either when fixed effects are present or when modelling nonstationarity in the state transition equation. Whereas much of the literature views diffuse states as an initialization problem, we follow the approach of Sallas and Harville (1981,1988) and incorporate diffuse initial conditions via noninformative prior distributions into hierarchical linear models. We apply existing results to derive the restricted loglike-lihood and appropriate modifications to the standard Kalman filter and smoother. Our approach results in a better understanding of De Jong's (1991) contributions. This article also shows how to adjust the standard Kalman filter, the fixed inter- val smoother and the state space model forecasting recursions, together with their mean square errors, for he presence of diffuse components. Using a hierarchical model approach it is shown that the estimates obtained are Best Linear Unbiased Predictors (BLUP).     

A multivariate time series model for the analysis and prediction of carbon monoxide atmospheric concentrations

We use a Bayesian multivariate time series model for the analysis of the dynamics of carbon monoxide atmospheric concentrations. The data are observed at four sites. It is assumed that the logarithm of the observed process can be represented as the sum of unobservable components: a trend, a daily periodicity, a stationary autoregressive signal and an erratic term. Bayesian analysis is performed via Gibbs sampling. In particular, we consider the problem of joint temporal prediction when data are observed at a few sites and it is not possible to fit a complex space–time model. A retrospective analysis of the trend component is also given, which is important in that it explains the evolution of the variability in the observed process.     

On the asymptotic properties of parameter estimates in a regression model with non-normally distributed errors

As pointed out in a recent paper by Amirkhalkhali and Rao (1986) (henceforth referred to as A&R), the usual assumption of normality for the error terms of a regression model isoften untenable. However, when this assumption is dropped, it may be difficult to characterize parameter estimates for the model. For example, A&R (p. 189) state that “if the regression errors are non-normal, we are not even sure of their [e.g., the generalized least squares parameter estimates1] asymptotic properties.” A partial answer, however, is given by Spall and Wall (1984), which presents an asymptotic distribution theory for Kalman filter estimates for cases where the random terms of the state space model are not necessarily Gaussian. Certain of these asymptotic distribution results are also discussed in Spall (1985) in the context of model validation (diagnostic checking)     

Prediction and forecasting in linear models with measurement error

We consider measurement error models within the time series unobserved component framework. A variable of interest is observed with some measurement error and modelled as an unobserved component. The forecast and the prediction of this variable given the observed values is given by the Kalman filter and smoother along with their conditional variances. By expressing the forecasts and predictions as weighted averages of the observed values, we investigate the effect of estimation error in the measurement and observation noise variances. We also develop corrected standard errors for prediction and forecasting accounting for the fact that the measurement and observation error variances are estimated by the same sample that is used for forecasting and prediction purposes. We apply the theory to the Yellowstone grizzly bears and US index of production datasets.     

Missing data and forecasting in multivariate time series: An application of the common components dynamic linear model

Summary The paper deals with missing data and forecasting problems in multivariate time series making use of the Common Components Dynamic Linear Model (DLMCC), presented in Quintana (1985), and West and Harrison (1989). Some results are presented and discussed: exploiting the correlation between series, estimated by the DLMCC, the paper shows as it is possible to update state vector posterior distributions for the unobserved series. This is realized on the base of the updating of the observed series state vectors, for which the usual Kalman filter equations can be applied. An application concerning some Italian private consumption series provides an example of the model capabilities.     

HEAVY-TAILED-DISTRIBUTED THRESHOLD STOCHASTIC VOLATILITY MODELS IN FINANCIAL TIME SERIES

To capture mean and variance asymmetries and time‐varying volatility in financial time series, we generalize the threshold stochastic volatility (THSV) model and incorporate a heavy‐tailed error distribution. Unlike existing stochastic volatility models, this model simultaneously accounts for uncertainty in the unobserved threshold value and in the time‐delay parameter. Self‐exciting and exogenous threshold variables are considered to investigate the impact of a number of market news variables on volatility changes. Adopting a Bayesian approach, we use Markov chain Monte Carlo methods to estimate all unknown parameters and latent variables. A simulation experiment demonstrates good estimation performance for reasonable sample sizes. In a study of two international financial market indices, we consider two variants of the generalized THSV model, with US market news as the threshold variable. Finally, we compare models using Bayesian forecasting in a value‐at‐risk (VaR) study. The results show that our proposed model can generate more accurate VaR forecasts than can standard models.     

Conditional inference in linear versus nonlinear models for binary time series

The modelling of discrete such as binary time series, unlike the continuous time series, is not easy. This is due to the fact that there is no unique way to model the correlation structure of the repeated binary data. Some models may also provide a complicated correlation structure with narrow ranges for the correlations. In this paper, we consider a nonlinear dynamic binary time series model that provides a correlation structure which is easy to interpret and the correlations under this model satisfy the full?1 to 1 range. For the estimation of the parameters of this nonlinear model, we use a conditional generalized quasilikelihood (CGQL) approach which provides the same estimates as those of the well-known maximum likelihood approach. Furthermore, we consider a competitive linear dynamic binary time series model and examine the performance of the CGQL approach through a simulation study in estimating the parameters of this linear model. The model mis-specification effects on estimation as well as forecasting are also examined through simulations.     

Likelihood inference for dynamic linear models with Markov switching parameters: on the efficiency of the Kim filter

The Kim filter (KF) approximation is widely used for the likelihood calculation of dynamic linear models with Markov regime-switching parameters. However, despite its popularity, its approximation error has not yet been examined rigorously. Therefore, this study investigates the reliability of the KF approximation for maximum likelihood (ML) and Bayesian estimations. To measure the approximation error, we compare the outcomes of the KF method with those of the auxiliary particle filter (APF). The APF is a numerical method that requires a longer computing time, but its numerical error can be sufficiently minimized by increasing simulation size. According to our extensive simulation and empirical studies, the likelihood values obtained from the KF approximation are practically identical to those of the APF. Furthermore, we show that the KF method is reliable, particularly when regimes are persistent and sample size is small. From the Bayesian perspective, we show that the KF method improves the efficiency of posterior simulation. This study contributes to the literature by providing evidence to justify the use of the KF method in both ML and Bayesian estimations.     

Monte Carlo Kalman filter and smoothing for multivariate discrete state space models

The author studies state space models for multivariate binomial time series, focussing on the development of the Kalman filter and smoothing for state variables. He proposes a Monte Carlo approach employing the latent variable representation which transplants the classical Kalman filter and smoothing developed for Gaussian state space models to discrete models and leads to a conceptually simple and computationally convenient approach. The method is illustrated through simulations and concrete examples.     

国家财政对农业投入的分析与预测——基于状态空间模型的实证分析

国家财政对农业的投入是影响农业发展的重要因素。收集了建国以来国家财政对农业投入的数据,分析构造出状态空间模型,应用卡尔曼滤波估计出状态向量,挖掘出隐藏在数据内部的变化特征,分析国家财政对农业投入的实际情况,并对未来几年的农业投入进行预测。     

Estimation of the linear EV model with censored data

In this paper, a censored linear errors-in-variables model is investigated. The asymptotic normality of the unknown parameter's estimator is obtained. Two empirical log-likelihood ratio statistics for the unknown parameter in the model are suggested. It is proved that the proposed statistics are asymptotically chi-squared under some mild conditions, and hence can be used to construct the confidence regions of the parameter of interest. Finite sample performance of the proposed method is illustrated in a simulation study.     

Estimation in the piece-wise constant hazard rate model

The piece-wise constant hazard rate is presented along with the resulting piece-wise constant exponential model for the life times. Maximum likelihood estimation is considered for the complete life test and a life test censored at a preset time. The estimators are found along with their expected values and variances. An example from industry illustrates the estimation procedure in the special case where only two pieces are used.     

Forecasting Multivariate Road Traffic Flows Using Bayesian Dynamic Graphical Models,Splines and Other Traffic Variables

Traffic flow data are routinely collected for many networks worldwide. These invariably large data sets can be used as part of a traffic management system, for which good traffic flow forecasting models are crucial. The linear multiregression dynamic model (LMDM) has been shown to be promising for forecasting flows, accommodating multivariate flow time series, while being a computationally simple model to use. While statistical flow forecasting models usually base their forecasts on flow data alone, data for other traffic variables are also routinely collected. This paper shows how cubic splines can be used to incorporate extra variables into the LMDM in order to enhance flow forecasts. Cubic splines are also introduced into the LMDM to parsimoniously accommodate the daily cycle exhibited by traffic flows. The proposed methodology allows the LMDM to provide more accurate forecasts when forecasting flows in a real high‐dimensional traffic data set. The resulting extended LMDM can deal with some important traffic modelling issues not usually considered in flow forecasting models. Additionally, the model can be implemented in a real‐time environment, a crucial requirement for traffic management systems designed to support decisions and actions to alleviate congestion and keep traffic flowing.     

Estimation in the generalized linear empirical bayes model using the extended quasi-likelihood

A generalized linear empirical Bayes model is developed for empirical Bayes analysis of several means in natural exponential families. A unified approach is presented for all natural exponential families with quadratic variance functions (the Normal, Poisson, Binomial, Gamma, and two others.) The hyperparameters are estimated using the extended quasi-likelihood of Nelder and Pregibon (1987), which is easily implemented via the GLIM package. The accuracy of these estimates is developed by asymptotic approximation of the variance. Two data examples are illustrated.