Performing armchair roundoff analyses of statistical algorithms

Numerical stability is but one of many desirable properties which should be considered when designing statistical software. However, rigorous roundoff analysis is rarely done because it seems not worth the price; the influence of rounding error is usually of secondary importance, and the analysis is thought to be beyond the reach of all but a few specialists. This note discusses the role of roundoff analysis in the design of a statistical program and shows that new techniques sometimes make assessment of the effect of rounding errors no more difficult than the verification of other program properties.     

The Quantitative Significance of the Lucas Critique

Doan, Litterman, and Sims (DLS) have suggested using conditional forecasts to do policy analysis with Bayesian vector autoregression (BVAR) models. Their method seems to violate the Lucas critique, which implies that coefficients of a BVAR model will change when there is a change in policy rules. In this article, we attempt to determine whether the Lucas critique is important quantitatively in a BVAR macro model that we construct. We find evidence following two candidate policy rule changes of significant coefficient instability and of a deterioration in the performance of the DLS method.     

Locking the Wiener Process to its Level-Crossing Time

We consider the specific transformation of a Wiener process {X(t), t ≥ 0} in the presence of an absorbing barrier a that results when this process is “time-locked” with respect to its first passage time T _a through a criterion level a, and the evolution of X(t) is considered backwards (retrospectively) from T _a . Formally, we study the random variables defined by Y(t) ≡ X(T _a  ? t) and derive explicit results for their density and mean, and also for their asymptotic forms. We discuss how our results can aid interpretations of time series “response-locked” to their times of crossing a criterion level.     

Some Observations,a Suggestion,and Some Comments on the Conway-Roberts Article

This article provides new tools for the evaluation of dynamic stochastic general equilibrium (DSGE) models and applies them to a large-scale new Keynesian model. We approximate the DSGE model by a vector autoregression, and then systematically relax the implied cross-equation restrictions and document how the model fit changes. We also compare the DSGE model's impulse responses to structural shocks with those obtained after relaxing its restrictions. We find that the degree of misspecification in this large-scale DSGE model is no longer so large as to prevent its use in day-to-day policy analysis, yet is not small enough to be ignored.     

Evaluation of an analysis approach used to account for extra-variation in clustered categorical responses

This article presents the results of a simulation study investigating the performance of an approach developed by Miller and Landis (1991) for the analysis of clustered categorical responses. Evaluation of this “two-step” approach, which utilizes the method of moments to estimate the extra-variation pardmeters and subsequently incorporates these parameters into estimating equations for modelling the marginal expectations, is carried out in an experimental setting involving a comparison between two groups of observations. We assume that data for both groups are collected from each cluster and responses are measured on a three-point ordinal scale. The performance of the estimators used in both “steps” of the analysisis investigated and comparisons are made to an alternative analysismethod that ignores the clustering. The results indicate that in the chosen setting the test for a difference between groups generally operatbs at the nominal α=0.05 for 10 or more clusters and hasincreasing power with both an increasing number of clusters and an inrreasing treatment effect. These results provide a striking contrasc to those obtained from an improper analysis that ignores clustering.