Combining Economic Forecasts

A method for combining forecasts may or may not account for dependence and differing precision among forecasts. In this article we test a variety of such methods in the context of combining forecasts of GNP from four major econometric models. The methods include one in which forecasting errors are jointly normally distributed and several variants of this model as well as some simpler procedures and a Bayesian approach with a prior distribution based on exchangeability of forecasters. The results indicate that a simple average, the normal model with an independence assumption, and the Bayesian model perform better than the other approaches that are studied here.     

On the Optimal Use of Suboptimal Forecasts of Explanatory Variables

Ashley (1983) gave a simple condition for determining when a forecast of an explanatory variable (X_t ) is sufficiently inaccurate that direct replacement of X_t by the forecast yields worse forecasts of the dependent variable than does respecification of the equation to omit X_t . Many available macroeconomic forecasts were shown to be of limited usefulness in direct replacement. Direct replacement, however, is not optimal if the forecast's distribution is known. Here optimal linear forms in commercial forecasts of several macroeconomic variables are obtained by using estimates of their distributions. Although they are an improvement on the raw forecasts (direct replacement), these optimal forms are still too inaccurate to be useful in replacing the actual explanatory variables in forecasting models. The results strongly indicate that optimal forms involving several commercial forecasts will not be very useful either. Thus Ashley's (1983) sufficient condition retains its value in gauging the usefulness of a forecast of an explanatory variable in a forecasting model, even though it focuses on direct replacement.     

Coherent mortality forecasting by the weighted multilevel functional principal component approach

In human mortality modelling, if a population consists of several subpopulations it can be desirable to model their mortality rates simultaneously while taking into account the heterogeneity among them. The mortality forecasting methods tend to result in divergent forecasts for subpopulations when independence is assumed. However, under closely related social, economic and biological backgrounds, mortality patterns of these subpopulations are expected to be non-divergent in the future. In this article, we propose a new method for coherent modelling and forecasting of mortality rates for multiple subpopulations, in the sense of nondivergent life expectancy among subpopulations. The mortality rates of subpopulations are treated as multilevel functional data and a weighted multilevel functional principal component (wMFPCA) approach is proposed to model and forecast them. The proposed model is applied to sex-specific data for nine developed countries, and the results show that, in terms of overall forecasting accuracy, the model outperforms the independent model and the Product-Ratio model as well as the unweighted multilevel functional principal component approach.     

The relationship between the length of the base period and population forecast errors

"The base period of a population forecast is the time period from which historical data are collected for the purpose of forecasting future population values. The length of the base period is one of the fundamental decisions made in preparing population forecasts, yet very few studies have investigated the effects of this decision on population forecast errors. In this article the relationship between the length of the base period and population forecast errors is analyzed, using three simple forecasting techniques and data from 1900 to 1980 for states in the United States. It is found that increasing the length of the base period up to 10 years improves forecast accuracy, but that further increases generally have little additional effect. The only exception to this finding is long-range forecasts of rapidly growing states, in which a longer base period substantially improves forecast accuracy for two of the forecasting techniques."     

Central Bank Macroeconomic Forecasting During the Global Financial Crisis: The European Central Bank and Federal Reserve Bank of New York Experiences

This article documents macroeconomic forecasting during the global financial crisis by two key central banks: the European Central Bank and the Federal Reserve Bank of New York. The article is the result of a collaborative effort between staff at the two institutions, allowing us to study the time-stamped forecasts as they were made throughout the crisis. The analysis does not exclusively focus on point forecast performance. It also examines methodological contributions, including how financial market data could have been incorporated into the forecasting process.     

Comparison of the effectiveness of forecasts obtained by means of selected probability functions with respect to forecast error distributions

The forecasting of sales in a company is one of the crucial challenges that must be faced. Nowadays, there is a large spectrum of methods that enable making reliable forecasts. However, sometimes the nature of time series excludes many well-known and widely used forecasting methods (e.g., econometric models). Therefore, the authors decided to forecast on the basis of a seasonally adjusted median of selected probability distributions. The obtained forecasts were verified by means of distributions of the Theil U² coefficient and unbiasedness coefficient.     

Stochastic population forecasts based on conditional expert opinions

The paper develops and applies an expert-based stochastic population forecasting method, which can also be used to obtain a probabilistic version of scenario-based official forecasts. The full probability distribution of population forecasts is specified by starting from expert opinions on the future development of demographic components. Expert opinions are elicited as conditional on the realization of scenarios, in a two-step (or multiple-step) fashion. The method is applied to develop a stochastic forecast for the Italian population, starting from official scenarios from the Italian National Statistical Office.     

PITMAN-CLOSENESS AS A MEASURE TO EVALUATE THE QUALITY OF FORECASTS

ABSTRACT

We consider Pitman-closeness to evaluate the performance of univariate and multivariate forecasting methods. Optimal weights for the combination of forecasts are calculated with respect to this criterion. These weights depend on the assumption of the distribution of the individual forecasts errors. In the normal case they are identical with the optimal weights with respect to the MSE-criterion (univariate case) and with the optimal weights with respect to the MMSE-criterion (multivariate case). Further, we present a simple example to show how the different combination techniques perform. There we can see how much the optimal multivariate combination can outperform different other combinations. In practice, we can find multivariate forecasts e.g., in econometrics. There is often the situation that forecast institutes estimate several economic variables.     

INDEX TO VOLUME 7 (1989)

Surveys of forecasters, containing respondents’ predictions of future values of key macroeconomic variables, receive a lot of attention in the financial press, from investors and from policy makers. They are apparently widely perceived to provide useful information about agents’ expectations. Nonetheless, these survey forecasts suffer from the crucial disadvantage that they are often quite stale, as they are released only infrequently. In this article, we propose MIDAS regression and Kalman filter methods for using asset price data to construct daily forecasts of upcoming survey releases. Our methods also allow us to predict actual outcomes, providing competing forecasts, and allow us to estimate what professional forecasters would predict if they were asked to make a forecast each day, making it possible to measure the effects of events and news announcements on expectations.     

Kalman filter-based modelling and forecasting of stochastic volatility with threshold

We propose a parametric nonlinear time-series model, namely the Autoregressive-Stochastic volatility with threshold (AR-SVT) model with mean equation for forecasting level and volatility. Methodology for estimation of parameters of this model is developed by first obtaining recursive Kalman filter time-update equation and then employing the unrestricted quasi-maximum likelihood method. Furthermore, optimal one-step and two-step-ahead out-of-sample forecasts formulae along with forecast error variances are derived analytically by recursive use of conditional expectation and variance. As an illustration, volatile all-India monthly spices export during the period January 2006 to January 2012 is considered. Entire data analysis is carried out using EViews and matrix laboratory (MATLAB) software packages. The AR-SVT model is fitted and interval forecasts for 10 hold-out data points are obtained. Superiority of this model for describing and forecasting over other competing models for volatility, namely AR-Generalized autoregressive conditional heteroscedastic, AR-Exponential GARCH, AR-Threshold GARCH, and AR-Stochastic volatility models is shown for the data under consideration. Finally, for the AR-SVT model, optimal out-of-sample forecasts along with forecasts of one-step-ahead variances are obtained.     

Forecast Uncertainty—Ex Ante and Ex Post: U.S. Inflation and Output Growth

Survey respondents who make point predictions and histogram forecasts of macro-variables reveal both how uncertain they believe the future to be, ex ante, as well as their ex post performance. Macroeconomic forecasters tend to be overconfident at horizons of a year or more, but overestimate (i.e., are underconfident regarding) the uncertainty surrounding their predictions at short horizons. Ex ante uncertainty remains at a high level compared to the ex post measure as the forecast horizon shortens. There is little evidence of a link between individuals’ ex post forecast accuracy and their ex ante subjective assessments.     

Scenarios, Uncertainty and Conditional Forecasts of the World Population

Current official population forecasts differ little from those that Whelpton made 50 years ago either in the cohort–component methodology used or in the arguments used to motivate the assumptions. However, Whelpton produced some of the most erroneous forecasts of this century. This suggests that current forecasters should ensure that they give users an assessment of the uncertainty of their forecasts. We show how simple statistical methods can be combined with expert judgment to arrive at an overall predictive distribution for the future population. We apply the methods to a world population forecast that was made in 1994. Accepting that point forecast, we find that the probability is only about 2% that the world population in the year 2030 will be less than the low scenario of 8317 million. The probability that the world population will exceed the high scenario of 10 736 million is about 13%. Similarly, the probability is only about 51% that the high–low interval of a recent United Nations (UN) forecast will contain the true population in the year 2025. Even if we consider the UN high–low intervals as conditional on the possible future policies of its member states, they appear to have a relatively small probability of encompassing the future population.     

The Integration of Artificial Neural Networks and Text Mining to Forecast Gold Futures Prices

Although a previous study found that neural network forecasts were more accurate than time series models for predicting Latin American stock indexes, the forecasting accuracy of neural network for predicting gold futures prices has never been discussed. Therefore, the first objective of this study is to compare the forecasting accuracy of a neural network model with that of ARIMA models. Furthermore, the fluctuations in gold futures are not only influenced by the quantitative variables, but also by many nonquantifiable factors, such as wars, international relations, and terrorist attacks. The second objective of this study is therefore to propose the integration of text mining and an artificial neural network to forecast gold futures prices. The historical gold futures prices from 1999 to 2008 were used as training data and testing data, and the prices of 2009 were used to examine the effectiveness of the proposed model. The results of empirical analysis showed that an artificial neural network forecasted gold futures prices better than ARIMA models did. In addition, text mining provided a reasonable explanation of the trend in gold futures prices.     

University student enrollment forecasts by analysis structural ratios using ARIMA-methods

Summary Forecasts for the number of students in Germany are conducted by the Kultusministerkonferenz. They use a transition model which does not allow for prediction intervals and therefore lack a measure of uncertainty of the forecast. Since the uncertainty is high for such forecasts, this lack is of importance. In this paper, structural ratios, relating the number of university students to the population of the same age, are analyzed and forescasted using ARIMA-models with outliers. Multiplying these ratios with official population forecasts for Germany provides the future number of students, additionally giving prediction intervals. This number will increase from 1.94 million in 2002 to 2.35 million in 2015. The uncertainty of the forecast is high; the forecast interval in 2015 will range between 1.72 and 2.98 million at a 95% confidence level. Supported by the German Research Foundation (DFG). We are grateful to an anonymous referee for some helpful comments.     

Multiperiod Forecasts of Interest Rates

The accuracy of forecasts of interest rates over different forecast horizons and time periods is examined. The results indicate a deterioration in “absolute” forecast accuracy measured by the mean absolute error and the root mean squared error but no decrease in “relative” accuracy measured by the Theil coefficient with an increase in the forecast span. The results also indicate a decline in accuracy in periods of volatile interest rates. Support is found for the hypothesis that the ratio of the variability of predicted changes to that of actual changes falls with an increase in the forecast horizon.     

The Promise of Prediction Contests

This article examines the prediction contest as a vehicle for aggregating the opinions of a crowd of experts. After proposing a general definition distinguishing prediction contests from other mechanisms for harnessing the wisdom of crowds, we focus on point-forecasting contests—contests in which forecasters submit point forecasts with a prize going to the entry closest to the quantity of interest. We first illustrate the incentive for forecasters to submit reports that exaggerate in the direction of their private information. Whereas this exaggeration raises a forecaster's mean squared error, it increases his or her chances of winning the contest. And in contrast to conventional wisdom, this nontruthful reporting usually improves the accuracy of the resulting crowd forecast. The source of this improvement is that exaggeration shifts weight away from public information (information known to all forecasters) and by so doing helps alleviate public knowledge bias. In the context of a simple theoretical model of overlapping information and forecaster behaviors, we present closed-form expressions for the mean squared error of the crowd forecasts which will help identify the situations in which point forecasting contests will be most useful.     

Forecasting multivariate longitudinal binary data with marginal and marginally specified models

Forecasting with longitudinal data has been rarely studied. Most of the available studies are for continuous response and all of them are for univariate response. In this study, we consider forecasting multivariate longitudinal binary data. Five different models including simple ones, univariate and multivariate marginal models, and complex ones, marginally specified models, are studied to forecast such data. Model forecasting abilities are illustrated via a real-life data set and a simulation study. The simulation study includes a model independent data generation to provide a fair environment for model competitions. Independent variables are forecast as well as the dependent ones to mimic the real-life cases best. Several accuracy measures are considered to compare model forecasting abilities. Results show that complex models yield better forecasts.     

Combination forecasting for directional accuracy: An application to survey interest rate forecasts

Using published interest rates forecasts issued by professional economists, two combination forecasts designed to improve the directional accuracy of interest rate forecasting are constructed. The first combination forecast takes a weighted average of the individual forecasters' predictions. The more successful the forecaster was in past forecasts at predicting the direction of change in interest rates, the greater is the weight given to his/her current forecast. The second combination forecast is simply the forecast issued by the forecaster who had the greatest success rate at predicting the direction of change in interest rates in previous forecasts. In cases where two or more forecasters tie for best historic directional accuracy track record, the arithmetic mean of these forecasters is used. The study finds that neither combination forecasting method performs better than coin-flipping at predicting the direction of change in interest rates. Nor does either method beat the simple arithmetic mean of the predictions of all the forecasters surveyed at predicting the direction of change in interest rates.     

Forecast Evaluation in the Presence of Unobserved Volatility

A number of volatility forecasting studies have led to the perception that the ARCH- and Stochastic Volatility-type models provide poor out-of-sample forecasts of volatility. This is primarily based on the use of traditional forecast evaluation criteria concerning the accuracy and the unbiasedness of forecasts. In this paper we provide an analytical assessment of volatility forecasting performance. We use the volatility and log volatility framework to prove how the inherent noise in the approximation of the true- and unobservable-volatility by the squared return, results in a misleading forecast evaluation, inflating the observed mean squared forecast error and invalidating the Diebold-Mariano statistic. We analytically characterize this noise and explicitly quantify its effects assuming normal errors. We extend our results using more general error structures such as the Compound Normal and the Gram-Charlier classes of distributions. We argue that evaluation problems are likely to be exacerbated by non-normality of the shocks and that non-linear and utility-based criteria can be more suitable for the evaluation of volatility forecasts.     

Cointegration and Long-Horizon Forecasting

We consider the forecasting of cointegrated variables, and we show that at long horizons nothing is lost by ignoring cointegration when forecasts are evaluated using standard multivariate forecast accuracy measures. In fact, simple univariate Box–Jenkins forecasts are just as accurate. Our results highlight a potentially important deficiency of standard forecast accuracy measures—they fail to value the maintenance of cointegrating relationships among variables—and we suggest alternatives that explicitly do so.