The Ornstein-Uhlenbeck Dirichlet process and other time-varying processes for Bayesian nonparametric inference

This paper introduces a new class of time-varying, measure-valued stochastic processes for Bayesian nonparametric inference. The class of priors is constructed by normalising a stochastic process derived from non-Gaussian Ornstein-Uhlenbeck processes and generalises the class of normalised random measures with independent increments from static problems. Some properties of the normalised measure are investigated. A particle filter and MCMC schemes are described for inference. The methods are applied to an example in the modelling of financial data.     

Integer-valued autoregressive processes with periodic structure

In this paper the periodic integer-valued autoregressive model of order one with period T, driven by a periodic sequence of independent Poisson-distributed random variables, is studied in some detail. Basic probabilistic and statistical properties of this model are discussed. Moreover, parameter estimation is also addressed. Specifically, the methods of estimation under analysis are the method of moments, least squares-type and likelihood-based ones. Their performance is compared through a simulation study.     

On asymptotic posterior normality for controlled branching processes

For a controlled branching process (CBP) with offspring distribution belonging to the power series family, the asymptotic normality of the posterior distribution of the basic parameter and the offspring mean is proved. As practical applications, we calculate asymptotic high probability density credibility sets for the offspring mean and we provide a rule to make inference about the value of this parameter. Moreover, the asymptotic posterior normality of the respective parameters of two classical branching models, namely the standard Galton–Watson process and the Galton–Watson process with immigration, is derived as particular cases of the CBP.     

Bayesian inference and forecasting in the stationary bilinear model

A stationary bilinear (SB) model can be used to describe processes with a time-varying degree of persistence that depends on past shocks. This study develops methods for Bayesian inference, model comparison, and forecasting in the SB model. Using monthly U.K. inflation data, we find that the SB model outperforms the random walk, first-order autoregressive AR(1), and autoregressive moving average ARMA(1,1) models in terms of root mean squared forecast errors. In addition, the SB model is superior to these three models in terms of predictive likelihood for the majority of forecast observations.     

On periodic autoregressive stochastic volatility models: structure and estimation

To capture both the volatility evolution and the periodicity feature in the autocorrelation structure exhibited by many nonlinear time series, a Periodic AutoRegressive Stochastic Volatility (PAR-SV ) model is proposed. Some probabilistic properties, namely the strict and second-order periodic stationarity, are provided. Furthermore, conditions for the existence of higher-order moments are established. The autocovariance structure of the squares and higher order powers of the PAR-SV process is studied. Its dynamic properties are shown to be consistent with financial time series empirical findings. Ways in which the model may be estimated are discussed. Finally, a simulation study of the performance of the proposed estimation methods is provided and the PAR-SV is applied to model the spot rates of the euro and US dollar both against the Algerian dinar. The empirical analysis shows that the proposed PAR-SV model can be considered as a viable alternative to the periodic generalized autoregressive conditionally heteroscedastic (PGARCH) model.     

On asymptotic properties of bootstrap for AR(1) processes

We consider a first-order autoregressive process when the autoregressive parameter β may vary over the entire real line. The standard bootstrap approximation to the sampling distribution of the least squares estimator of β is shown to converge weakly to a random (i.e., nondegenerate) limit for the usual choice of the bootstrap sample size when β equals 1 or −1. The bootstrap approximation, however, is asymptotically valid in probability, or even almost surely, for suitably selected resample sizes, whatever β may be.     

On the asymptotic behavior of the periodograms of periodically correlated spatial processes: Periodicity detection

In this work, the asymptotic unbiasedness and the asymptotic uncorrelatedness of periodograms for the periodically correlated spatial processes are given. This will be done using the time dependent spectral representation of periodically correlated spatial processes and Cholesky factorization of the spectral density. A graphical method is also proposed to detect the period of periodically correlated spatial processes. In order to support the theory, a simulation study and a real data example are performed.     

Quasi-maximum likelihood estimation and inference in dynamic models with time-varying covariances

We study the properties of the quasi-maximum likelihood estimator (QMLE) and related test statistics in dynamic models that jointly parameterize conditional means and conditional covariances, when a normal log-likelihood os maximized but the assumption of normality is violated. Because the score of the normal log-likelihood has the martingale difference property when the forst two conditional moments are correctly specified, the QMLE is generally Consistent and has a limiting normal destribution. We provide easily computable formulas for asymptotic standard errors that are valid under nonnormality. Further, we show how robust LM tests for the adequacy of the jointly parameterized mean and variance can be computed from simple auxiliary regressions. An appealing feature of these robyst inference procedures is that only first derivatives of the conditional mean and variance functions are needed. A monte Carlo study indicates that the asymptotic results carry over to finite samples. Estimation of several AR and AR-GARCH time series models reveals that in most sotuations the robust test statistics compare favorably to the two standard (nonrobust) formulations of the Wald and IM tests. Also, for the GARCH models and the sample sizes analyzed here, the bias in the QMLE appears to be relatively small. An empirical application to stock return volatility illustrates the potential imprtance of computing robust statistics in practice.     

Small sample asymptotic inference for the coefficient of variation: normal and nonnormal models

In applied statistics, the coefficient of variation is widely calculated and interpreted even when the sample size of the data set is very small. However, confidence intervals for the coefficient of variation are rarely reported. One of the reasons is the exact confidence interval for the coefficient of variation, which is given in Lehmann (Testing Statistical Hypotheses, 2nd Edition, Wiley, New York, 1996), is very difficult to calculate. Various asymptotic methods have been proposed in literature. These methods, in general, require the sample size to be large. In this article, we will apply a recently developed small sample asymptotic method to obtain approximate confidence intervals for the coefficient of variation for both normal and nonnormal models. These small sample asymptotic methods are very accurate even for very small sample size. Numerical examples are given to illustrate the accuracy of the proposed method.     

Quasi-maximum likelihood estimation and inference in dynamic models with time-varying covariances

We study the properties of the quasi-maximum likelihood estimator (QMLE) and related test statistics in dynamic models that jointly parameterize conditional means and conditional covariances, when a normal log-likelihood os maximized but the assumption of normality is violated. Because the score of the normal log-likelihood has the martingale difference property when the forst two conditional moments are correctly specified, the QMLE is generally Consistent and has a limiting normal destribution. We provide easily computable formulas for asymptotic standard errors that are valid under nonnormality. Further, we show how robust LM tests for the adequacy of the jointly parameterized mean and variance can be computed from simple auxiliary regressions. An appealing feature of these robyst inference procedures is that only first derivatives of the conditional mean and variance functions are needed. A monte Carlo study indicates that the asymptotic results carry over to finite samples. Estimation of several AR and AR-GARCH time series models reveals that in most sotuations the robust test statistics compare favorably to the two standard (nonrobust) formulations of the Wald and IM tests. Also, for the GARCH models and the sample sizes analyzed here, the bias in the QMLE appears to be relatively small. An empirical application to stock return volatility illustrates the potential imprtance of computing robust statistics in practice.     

Periodograms asymptotic distributions in periodically correlated processes and multivariate stationary processes: An alternative approach

Discrete time periodically correlated (PC) processes are viewed as the processes with time-dependent spectra. This, together with an auxiliary operator which is defined here is employed to apply classical results on the asymptotic distribution of the periodogram of the univariate white noise (innovations) to derive the asymptotic distributions of the periodograms for the PC processes and also for the multivariate stationary processes. We assume only the continuity and positive definiteness of the spectral densities together with the independence of the innovations.     

Alternating event processes during lifetimes: population dynamics and statistical inference

In the literature studying recurrent event data, a large amount of work has been focused on univariate recurrent event processes where the occurrence of each event is treated as a single point in time. There are many applications, however, in which univariate recurrent events are insufficient to characterize the feature of the process because patients experience nontrivial durations associated with each event. This results in an alternating event process where the disease status of a patient alternates between exacerbations and remissions. In this paper, we consider the dynamics of a chronic disease and its associated exacerbation-remission process over two time scales: calendar time and time-since-onset. In particular, over calendar time, we explore population dynamics and the relationship between incidence, prevalence and duration for such alternating event processes. We provide nonparametric estimation techniques for characteristic quantities of the process. In some settings, exacerbation processes are observed from an onset time until death; to account for the relationship between the survival and alternating event processes, nonparametric approaches are developed for estimating exacerbation process over lifetime. By understanding the population dynamics and within-process structure, the paper provide a new and general way to study alternating event processes.     

Model fitting and inference under latent equilibrium processes

This paper presents a methodology for model fitting and inference in the context of Bayesian models of the type f(Y | X,θ)f(X|θ)f(θ), where Y is the (set of) observed data, θ is a set of model parameters and X is an unobserved (latent) stationary stochastic process induced by the first order transition model f(X ^(t+1)|X ^(t),θ), where X ^(t) denotes the state of the process at time (or generation) t. The crucial feature of the above type of model is that, given θ, the transition model f(X ^(t+1)|X ^(t),θ) is known but the distribution of the stochastic process in equilibrium, that is f(X|θ), is, except in very special cases, intractable, hence unknown. A further point to note is that the data Y has been assumed to be observed when the underlying process is in equilibrium. In other words, the data is not collected dynamically over time. We refer to such specification as a latent equilibrium process (LEP) model. It is motivated by problems in population genetics (though other applications are discussed), where it is of interest to learn about parameters such as mutation and migration rates and population sizes, given a sample of allele frequencies at one or more loci. In such problems it is natural to assume that the distribution of the observed allele frequencies depends on the true (unobserved) population allele frequencies, whereas the distribution of the true allele frequencies is only indirectly specified through a transition model. As a hierarchical specification, it is natural to fit the LEP within a Bayesian framework. Fitting such models is usually done via Markov chain Monte Carlo (MCMC). However, we demonstrate that, in the case of LEP models, implementation of MCMC is far from straightforward. The main contribution of this paper is to provide a methodology to implement MCMC for LEP models. We demonstrate our approach in population genetics problems with both simulated and real data sets. The resultant model fitting is computationally intensive and thus, we also discuss parallel implementation of the procedure in special cases.     

Asymptotic inference in poverty indices: an empirical processes approach

We derive an empirical poverty index containing most of those proposed in the literature. Then, we study its asymptotic behavior by using empirical processes theory. From the results obtained, we derive a Wald-type test for comparing a vector of theoretical poverty indices to a vector of reference indices. We study the test statistic under the null hypothesis of equality, fixed alternatives, and a sequence of local alternatives. A simulation experiment conducted shows that our test performs well for exponential and Pareto data.     

On the foundations: Statistical models and inference

This paper presents an overview of some recent results concerning statistical models and inference. specifically: grounds for statistical models. types of models that simplify by standard probability analysis, the use of categorical information in the reduction of the model with data, and the role of additives in the inference process. The relevant technical material has been developed elsewhere.