AN APPROACH TO OPTIMIZATION IN RESPONSE SURFACE METHODOLOGY

We consider the optimization of a response surface given by a polynomial model. In this article the problem is stated as a stochastic optimization problem. For the first-order model, the E-Model technique is used to find the maximum and stationary points; the exact distributions are derived under the linearity assumption.

     

Assessing influence in time series

This paper studies influential observations on the spectrum of a stationary stochastic process. We introduce a leave-one-out procedure in spectral density estimation to identify influential points. A simulated envelope is proposed to assess the magnitude of influence when the data follow an autoregressive integrated moving average model. Practical illustrations are discussed in two examples.     

Testing for coefficient stability of AR(1) model when the null is an integrated or a stationary process

In this paper, we propose a new test for coefficient stability of an AR(1) model against the random coefficient autoregressive model of order 1 neither assuming a stationary nor a non-stationary process under the null hypothesis of a constant coefficient. The proposed test is obtained as a modification of the locally best invariant (LBI) test by Lee [(1998). Coefficient constancy test in a random coefficient autoregressive model. J. Statist. Plann. Inference 74, 93–101]. We examine finite sample properties of the proposed test by Monte Carlo experiments comparing with other existing tests, in particular, the LBI test by McCabe and Tremayne [(1995). Testing a time series for difference stationary. Ann. Statist. 23 (3), 1015–1028], which is for the null of a unit root process against the alternative of a stochastic unit root process.     

Stochastic Model Specification Search for Time-Varying Parameter VARs

This article develops a new econometric methodology for performing stochastic model specification search (SMSS) in the vast model space of time-varying parameter vector autoregressions (VARs) with stochastic volatility and correlated state transitions. This is motivated by the concern of overfitting and the typically imprecise inference in these highly parameterized models. For each VAR coefficient, this new method automatically decides whether it is constant or time-varying. Moreover, it can be used to shrink an otherwise unrestricted time-varying parameter VAR to a stationary VAR, thus providing an easy way to (probabilistically) impose stationarity in time-varying parameter models. We demonstrate the effectiveness of the approach with a topical application, where we investigate the dynamic effects of structural shocks in government spending on U.S. taxes and gross domestic product (GDP) during a period of very low interest rates.     

Long memory stochastic volatility : A bayesian approach

We propose a simulation-based Bayesian approach to the analysis of long memory stochastic volatility models, stationary and nonstationary. The main tool used to reduce the likelihood function to a tractable form is an approximate state-space representation of the model, A data set of stock market returns is analyzed with the proposed method. The approach taken here allows a quantitative assessment of the empirical evidence in favor of the stationarity, or nonstationarity, of the instantaneous volatility of the data.     

Some statistical results on autoregressive conditionally heteroscedastic models

The aim of this paper is to present some statistical aspects of an order 1 autoregressive model with errors following a stationary and ergodic generalized threshold ARCH process. So, to analyse the precision of forecasts obtained with these models a probabilistic study will be done. Moreover, a consistent test for a general AR(1) model with errors following an ergodic white noise of null conditional median will be developed and adapted to our stochastic process.     

Penalized Projection Estimator for Volatility Density

Abstract.  In this paper, we consider a stochastic volatility model ( Y _t , V _t ), where the volatility (V _t ) is a positive stationary Markov process. We assume that ( ln V _t ) admits a stationary density f that we want to estimate. Only the price process Y _t is observed at n discrete times with regular sampling interval Δ . We propose a non-parametric estimator for f obtained by a penalized projection method. Under mixing assumptions on ( V _t ), we derive bounds for the quadratic risk of the estimator. Assuming that Δ=Δ _n tends to 0 while the number of observations and the length of the observation time tend to infinity, we discuss the rate of convergence of the risk. Examples of models included in this framework are given.     

A hierarchical modelling approach to combining environmental data at different scales

Summary. Long-transported air pollution in Europe is monitored by a combination of a highly complex mathematical model and a limited number of measurement stations. The model predicts deposition on a 150 km × 150 km square grid covering the whole of the continent. These predictions can be regarded as spatial averages, with some spatially correlated model error. The measurement stations give a limited number of point estimates, regarded as error free. We combine these two sources of data by assuming that both are observations of an underlying true process. This true deposition is made up of a smooth deterministic trend, due to gradual changes in emissions over space and time, and two stochastic components. One is non- stationary and correlated over long distances; the other describes variation within a grid square. Our approach is through hierarchical modelling with predictions and measurements being independent conditioned on the underlying non-stationary true deposition. We assume Gaussian processes and calculate maximum likelihood estimates through numerical optimization. We find that the variation within a grid square is by far the largest component of the variation in the true deposition. We assume that the mathematical model produces estimates of the mean over an area that is approximately equal to a grid square, and we find that it has an error that is similar to the long-range stochastic component of the true deposition, in addition to a large bias.     

Gaussian models for degradation processes-part I: Methods for the analysis of biomarker data

We present two stochastic models that describe the relationship between biomarker process values at random time points, event times, and a vector of covariates. In both models the biomarker processes are degradation processes that represent the decay of systems over time. In the first model the biomarker process is a Wiener process whose drift is a function of the covariate vector. In the second model the biomarker process is taken to be the difference between a stationary Gaussian process and a time drift whose drift parameter is a function of the covariates. For both models we present statistical methods for estimation of the regression coefficients. The first model is useful for predicting the residual time from study entry to the time a critical boundary is reached while the second model is useful for predicting the latency time from the infection until the time the presence of the infection is detected. We present our methods principally in the context of conducting inference in a population of HIV infected individuals.     

Analysis of Stochastic Online Bin Packing Processes

Abstract

A stochastic online version of the classical bin packing problem, where a bin corresponds to the capacity of a resource allocated among streams of requests at discrete time units, is a fundamental problem that arises in a wide variety of application areas including bandwidth allocation in networks, memory management in computers, and message transmission in slotted network channels. We derive a mathematical analysis of the corresponding multi-dimensional stochastic process, potentially infinite in each dimension, under a general class of scheduling policies based on a combination of a Lyapunov function technique and matrix-analytic methods. Our analysis yields stability conditions and stationary distributions for this stochastic bin packing process under general probability distributions. We further provide some algorithmic techniques for the numerical computation of these measures.     

A STOCHASTIC LOGISTIC MODEL WITH TIME DELAY

The stochastic version of the logistic model for population growth is generalized to take account of continuously distributed time delay with an exponentially decaying kernel. The theory of diffusion processes is used to analyse the probability density function of the population size. The explicit expression for the stationary distribution is worked out and the effect of time delay on various statistics is discussed.     

Nonparametric maximum-likelihood estimation of probability measures: existence and consistency

This paper formulates the nonparametric maximum-likelihood estimation of probability measures and generalizes the consistency result on the maximum-likelihood estimator (MLE). We drop the independent assumption on the underlying stochastic process and replace it with the assumption that the stochastic process is stationary and ergodic. The present proof employs Birkhoff's ergodic theorem and the martingale convergence theorem. The main result is applied to the parametric and nonparametric maximum-likelihood estimation of density functions.     

On two conjectures about perturbations of the stochastic growth rate

The stochastic growth rate describes long-run growth of a population that lives in a fluctuating environment. Perturbation analysis of the stochastic growth rate provides crucial information for population managers, ecologists and evolutionary biologists. This analysis quantifies the response of the stochastic growth rate to changes in demographic parameters. A form of this analysis deals with changes that only occur in some environmental states. Caswell put forth two conjectures about environment-specific perturbations of the stochastic growth rate. The conjectures link the stationary distribution of the stochastic environmental process with the magnitude of some environment-specific perturbations. This note disproves one conjecture and proves the other.     

A frequentist understanding of sets of measures

We present a mathematical theory of objective, frequentist chance phenomena that uses as a model a set of probability measures. In this work, sets of measures are not viewed as a statistical compound hypothesis or as a tool for modeling imprecise subjective behavior. Instead we use sets of measures to model stable (although not stationary in the traditional stochastic sense) physical sources of finite time series data that have highly irregular behavior. Such models give a coarse-grained picture of the phenomena, keeping track of the range of the possible probabilities of the events. We present methods to simulate finite data sequences coming from a source modeled by a set of probability measures, and to estimate the model from finite time series data. The estimation of the set of probability measures is based on the analysis of a set of relative frequencies of events taken along subsequences selected by a collection of rules. In particular, we provide a universal methodology for finding a family of subsequence selection rules that can estimate any set of probability measures with high probability.     

A bayesian analysis of trend determination in economic time series

In this paper we provide a comprehensive Bayesian posterior analysis of trend determination in general autoregressive models. Multiple lag autoregressive models with fitted drifts and time trends as well as models that allow for certain types of structural change in the deterministic components are considered. We utilize a modified information matrix-based prior that accommodates stochastic nonstationarity, takes into account the interactions between long-run and short-run dynamics and controls the degree of stochastic nonstationarity permitted. We derive analytic posterior densities for all of the trend determining parameters via the Laplace approximation to multivariate integrals. We also address the sampling properties of our posteriors under alternative data generating processes by simulation methods. We apply our Bayesian techniques to the Nelson-Plosser macroeconomic data and various stock price and dividend data. Contrary to DeJong and Whiteman (1989a,b,c), we do not find that the data overwhelmingly favor the existence of deterministic trends over stochastic trends. In addition, we find evidence supporting Perron's (1989) view that some of the Nelson and Plosser data are best construed as trend stationary with a change in the trend function occurring at 1929.     

A bayesian analysis of trend determination in economic time series

In this paper we provide a comprehensive Bayesian posterior analysis of trend determination in general autoregressive models. Multiple lag autoregressive models with fitted drifts and time trends as well as models that allow for certain types of structural change in the deterministic components are considered. We utilize a modified information matrix-based prior that accommodates stochastic nonstationarity, takes into account the interactions between long-run and short-run dynamics and controls the degree of stochastic nonstationarity permitted. We derive analytic posterior densities for all of the trend determining parameters via the Laplace approximation to multivariate integrals. We also address the sampling properties of our posteriors under alternative data generating processes by simulation methods. We apply our Bayesian techniques to the Nelson-Plosser macroeconomic data and various stock price and dividend data. Contrary to DeJong and Whiteman (1989a,b,c), we do not find that the data overwhelmingly favor the existence of deterministic trends over stochastic trends. In addition, we find evidence supporting Perron's (1989) view that some of the Nelson and Plosser data are best construed as trend stationary with a change in the trend function occurring at 1929.     

Likelihood Analysis of the I(2) Model

The I (2) model is defined as a submodel of the general vector autoregressive model, by two reduced rank conditions. The model describes stochastic processes with stationary second difference. A parametrization is suggested which makes likelihood inference feasible. Consistency of the maximum likelihood estimator is proved, and the asymptotic distribution of the maximum likelihood estimator is given. It is shown that the asymptotic distribution is either Gaussian, mixed Gaussian or, in some cases, even more complicated.     

Spurious Instrumental Variables

Spurious regression phenomenon has been recognized for a wide range of Data Generating Processes: driftless unit roots, unit roots with drift, long memory, trend and broken-trend stationarity, etc. The usual framework is Ordinary Least Squares. We show that the spurious phenomenon also occurs in Instrumental Variables estimation when using non stationary variables, whether the non stationarity component is stochastic or deterministic. Finite sample evidence supports the asymptotic results.     

Random number generation and estimation with the bimodal asymmetric power-normal distribution

Recently, Bolfarine et al. [Bimodal symmetric-asymmetric power-normal families. Commun Statist Theory Methods. Forthcoming. doi:10.1080/03610926.2013.765475] introduced a bimodal asymmetric model having the normal and skew normal as special cases. Here, we prove a stochastic representation for their bimodal asymmetric model and use it to generate random numbers from that model. It is shown how the resulting algorithm can be seen as an improvement over the rejection method. We also discuss practical and numerical aspects regarding the estimation of the model parameters by maximum likelihood under simple random sampling. We show that a unique stationary point of the likelihood equations exists except when all observations have the same sign. However, the location-scale extension of the model usually presents two or more roots and this fact is illustrated here. The standard maximization routines available in the R system (Broyden–Fletcher–Goldfarb–Shanno (BFGS), Trust, Nelder–Mead) were considered in our implementations but exhibited similar performance. We show the usefulness of inspecting profile loglikelihoods as a method to obtain starting values for maximization and illustrate data analysis with the location-scale model in the presence of multiple roots. A simple Bayesian model is discussed in the context of a data set which presents a flat likelihood in the direction of the skewness parameter.     

Cointegration Detection Using Dynamic Factor Models

A method of information-criterion-based cointegration detection using dynamic factor models is proposed. The results of the data-based and non data-based Monte Carlo simulations suggest that this method is as effective as conventional hypothesis-testing methods. In the proposed method, an observed multivariate time series is described in terms of common stochastic trends plus stationary autoregressive cycles. Then the best model is selected from among alternative models obtained by changing the number of common stochastic trends, on the basis of information criteria. Consequently, the cointegration rank is determined on the basis of the selected model. Two advantages of the proposed method are also discussed.