A Conditional Autoregressive Gaussian Process for Irregularly Spaced Multivariate Data with Application to Modelling Large Sets of Binary Data

A Gaussian conditional autoregressive (CAR) formulation is presented that permits the modelling of the spatial dependence and the dependence between multivariate random variables at irregularly spaced sites so capturing some of the modelling advantages of the geostatistical approach. The model benefits not only from the explicit availability of the full conditionals but also from the computational simplicity of the precision matrix determinant calculation using a closed form expression involving the eigenvalues of a precision matrix submatrix. The introduction of covariates into the model adds little computational complexity to the analysis and thus the method can be straightforwardly extended to regression models. The model, because of its computational simplicity, is well suited to application involving the fully Bayesian analysis of large data sets involving multivariate measurements with a spatial ordering. An extension to spatio-temporal data is also considered. Here, we demonstrate use of the model in the analysis of bivariate binary data where the observed data is modelled as the sign of the hidden CAR process. A case study involving over 450 irregularly spaced sites and the presence or absence of each of two species of rain forest trees at each site is presented; Markov chain Monte Carlo (MCMC) methods are implemented to obtain posterior distributions of all unknowns. The MCMC method works well with simulated data and the tree biodiversity data set.     

Missing covariates in generalized linear models when the missing data mechanism is non-ignorable

We propose a method for estimating parameters in generalized linear models with missing covariates and a non-ignorable missing data mechanism. We use a multinomial model for the missing data indicators and propose a joint distribution for them which can be written as a sequence of one-dimensional conditional distributions, with each one-dimensional conditional distribution consisting of a logistic regression. We allow the covariates to be either categorical or continuous. The joint covariate distribution is also modelled via a sequence of one-dimensional conditional distributions, and the response variable is assumed to be completely observed. We derive the E- and M-steps of the EM algorithm with non-ignorable missing covariate data. For categorical covariates, we derive a closed form expression for the E- and M-steps of the EM algorithm for obtaining the maximum likelihood estimates (MLEs). For continuous covariates, we use a Monte Carlo version of the EM algorithm to obtain the MLEs via the Gibbs sampler. Computational techniques for Gibbs sampling are proposed and implemented. The parametric form of the assumed missing data mechanism itself is not `testable' from the data, and thus the non-ignorable modelling considered here can be viewed as a sensitivity analysis concerning a more complicated model. Therefore, although a model may have `passed' the tests for a certain missing data mechanism, this does not mean that we have captured, even approximately, the correct missing data mechanism. Hence, model checking for the missing data mechanism and sensitivity analyses play an important role in this problem and are discussed in detail. Several simulations are given to demonstrate the methodology. In addition, a real data set from a melanoma cancer clinical trial is presented to illustrate the methods proposed.     

The Gaussian Mixture Dynamic Conditional Correlation Model: Parameter Estimation,Value at Risk Calculation,and Portfolio Selection

A multivariate generalized autoregressive conditional heteroscedasticity model with dynamic conditional correlations is proposed, in which the individual conditional volatilities follow exponential generalized autoregressive conditional heteroscedasticity models and the standardized innovations follow a mixture of Gaussian distributions. Inference on the model parameters and prediction of future volatilities are addressed by both maximum likelihood and Bayesian estimation methods. Estimation of the Value at Risk of a given portfolio and selection of optimal portfolios under the proposed specification are addressed. The good performance of the proposed methodology is illustrated via Monte Carlo experiments and the analysis of the daily closing prices of the Dow Jones and NASDAQ indexes.     

A close look at the spatial structure implied by the CAR and SAR models

Modeling spatial interactions that arise in spatially referenced data is commonly done by incorporating the spatial dependence into the covariance structure either explicitly or implicitly via an autoregressive model. In the case of lattice (regional summary) data, two common autoregressive models used are the conditional autoregressive model (CAR) and the simultaneously autoregressive model (SAR). Both of these models produce spatial dependence in the covariance structure as a function of a neighbor matrix W and often a fixed unknown spatial correlation parameter. This paper examines in detail the correlation structures implied by these models as applied to an irregular lattice in an attempt to demonstrate their many counterintuitive or impractical results. A data example is used for illustration where US statewide average SAT verbal scores are modeled and examined for spatial structure using different spatial models.     

Non-ergodic martingale estimating functions and related asymptotics

Well-known estimation methods such as conditional least squares, quasilikelihood and maximum likelihood (ML) can be unified via a single framework of martingale estimating functions (MEFs). Asymptotic distributions of estimates for ergodic processes use constant norm (e.g. square root of the sample size) for asymptotic normality. For certain non-ergodic-type applications, however, such as explosive autoregression and super-critical branching processes, one needs a random norm in order to get normal limit distributions. In this paper, we are concerned with non-ergodic processes and investigate limit distributions for a broad class of MEFs. Asymptotic optimality (within a certain class of non-ergodic MEFs) of the ML estimate is deduced via establishing a convolution theorem using a random norm. Applications to non-ergodic autoregressive processes, generalized autoregressive conditional heteroscedastic-type processes, and super-critical branching processes are discussed. Asymptotic optimality in terms of the maximum random limiting power regarding large sample tests is briefly discussed.     

Non-linear autoregressive time series with multivariate Gaussian mixtures as marginal distributions

A new form of non-linear autoregressive time series is proposed to model solar radiation data, by specifying joint marginal distributions at low lags to be multivariate Gaussian mixtures. The model is also a type of multiprocess dynamic linear model, but with the advantage that the likelihood has a closed form.     

A Lagrange multiplier test for testing the adequacy of constant conditional correlation GARCH model

ABSTRACT

A Lagrange multiplier test for testing the parametric structure of a constant conditional correlation-generalized autoregressive conditional heteroskedasticity (CCC-GARCH) model is proposed. The test is based on decomposing the CCC-GARCH model multiplicatively into two components, one of which represents the null model, whereas the other one describes the misspecification. A simulation study shows that the test has good finite sample properties. We compare the test with other tests for misspecification of multivariate GARCH models. The test has high power against alternatives where the misspecification is in the GARCH parameters and is superior to other tests. The test is not greatly affected by misspecification in the conditional correlations and is therefore well suited for considering misspecification of GARCH equations.     

Indirect estimation of randomized generalized autoregressive conditional heteroskedastic models

The class of generalized autoregressive conditional heteroskedastic (GARCH) models can be used to describe the volatility with less parameters than autoregressive conditional heteroskedastic (ARCH)-type models, their distributions are heavy-tailed, with time-dependent conditional variance, and are able to model clustering of volatility. Despite all these facts, the way that GARCH models are built imposes limits on the heaviness of the tails of their unconditional distribution. The class of randomized generalized autoregressive conditional heteroskedastic (R-GARCH) models includes the ARCH and GARCH models allowing the use of stable innovations. Estimation methods and empirical analysis of R-GARCH models are the focus of this work. We present the indirect inference method to estimate the R-GARCH models, some simulations and an empirical application.     

Bayesian Methods for Missing Covariates in Cure Rate Models

We propose methods for Bayesian inference for missing covariate data with a novel class of semi-parametric survival models with a cure fraction. We allow the missing covariates to be either categorical or continuous and specify a parametric distribution for the covariates that is written as a sequence of one dimensional conditional distributions. We assume that the missing covariates are missing at random (MAR) throughout. We propose an informative class of joint prior distributions for the regression coefficients and the parameters arising from the covariate distributions. The proposed class of priors are shown to be useful in recovering information on the missing covariates especially in situations where the missing data fraction is large. Properties of the proposed prior and resulting posterior distributions are examined. Also, model checking techniques are proposed for sensitivity analyses and for checking the goodness of fit of a particular model. Specifically, we extend the Conditional Predictive Ordinate (CPO) statistic to assess goodness of fit in the presence of missing covariate data. Computational techniques using the Gibbs sampler are implemented. A real data set involving a melanoma cancer clinical trial is examined to demonstrate the methodology.     

Exact Bayesian modeling for bivariate Poisson data and extensions

Bivariate count data arise in several different disciplines (epidemiology, marketing, sports statistics just to name a few) and the bivariate Poisson distribution being a generalization of the Poisson distribution plays an important role in modelling such data. In the present paper we present a Bayesian estimation approach for the parameters of the bivariate Poisson model and provide the posterior distributions in closed forms. It is shown that the joint posterior distributions are finite mixtures of conditionally independent gamma distributions for which their full form can be easily deduced by a recursively updating scheme. Thus, the need of applying computationally demanding MCMC schemes for Bayesian inference in such models will be removed, since direct sampling from the posterior will become available, even in cases where the posterior distribution of functions of the parameters is not available in closed form. In addition, we define a class of prior distributions that possess an interesting conjugacy property which extends the typical notion of conjugacy, in the sense that both prior and posteriors belong to the same family of finite mixture models but with different number of components. Extension to certain other models including multivariate models or models with other marginal distributions are discussed.     

Bayesian LASSO-Regularized quantile regression for linear regression models with autoregressive errors

Quantile regression (QR) is a natural alternative for depicting the impact of covariates on the conditional distributions of a outcome variable instead of the mean. In this paper, we investigate Bayesian regularized QR for the linear models with autoregressive errors. LASSO-penalized type priors are forced on regression coefficients and autoregressive parameters of the model. Gibbs sampler algorithm is employed to draw the full posterior distributions of unknown parameters. Finally, the proposed procedures are illustrated by some simulation studies and applied to a real data analysis of the electricity consumption.     

Some asymptotic properties in INAR(1) processes with Poisson marginals

The first-order integer-valued autoregressive (INAR(1)) process with Poisson marginal distributions is considered. It is shown that the sample autocovariance function of the model is asymptotically normally distributed. We derive asymptotic distribution of Yule-Walker type estimators of parameters. It turns out that our Yule-Walker type estimators are better than the conditional least squares estimators proposed by Klimko and Nelson (1978) and Al-Osh and Alzaid (1987). also, we study the relationship between the model andM/M/∞ queueing system.     

Bent‐cable regression with autoregressive noise

Motivated by time series of atmospheric concentrations of certain pollutants the authors develop bent‐cable regression for autocorrelated errors. Bent‐cable regression extends the popular piecewise linear (broken‐stick) model, allowing for a smooth change region of any non‐negative width. Here the authors consider autoregressive noise added to a bent‐cable mean structure, with unknown regression and time series parameters. They develop asymptotic theory for conditional least‐squares estimation in a triangular array framework, wherein each segment of the bent cable contains an increasing number of observations while the autoregressive order remains constant as the sample size grows. They explore the theory in a simulation study, develop implementation details, apply the methodology to the motivating pollutant dataset, and provide a scientific interpretation of the bent‐cable change point not discussed previously. The Canadian Journal of Statistics 38: 386–407; 2010 © 2010 Statistical Society of Canada     

Production Frontiers and Panel Data

Value at risk (VaR) is the standard measure of market risk used by financial institutions. Interpreting the VaR as the quantile of future portfolio values conditional on current information, the conditional autoregressive value at risk (CAViaR) model specifies the evolution of the quantile over time using an autoregressive process and estimates the parameters with regression quantiles. Utilizing the criterion that each period the probability of exceeding the VaR must be independent of all the past information, we introduce a new test of model adequacy, the dynamic quantile test. Applications to real data provide empirical support to this methodology.     

Asymptotics for a class of generalized multicast autoregressive processes

We propose a new class of generalized multicast autoregressive (GMCAR, for short, hereafter) models indexed by a multi-casting tree where each individual produces exactly the same number of offspring. This class includes standard bifurcating autoregressive processes (BAR, cf. Cowan and Staudte (1986)) and multicast autoregressive (MCAR, cf. Hwang and Choi (2009)) models as special cases. Accommodating non-Gaussian, non-negative and count data, the class includes various models such as nonlinear autoregression, conditionally heteroscedastic process and conditional exponential family. The pathwise stationarity of the GMCAR model is discussed. A law of large numbers and a central limit theorem are established which are in turn used to derive asymptotic distributions associated with martingale estimating functions.     

A fractionally integrated Wishart stochastic volatility model

There has recently been growing interest in modeling and estimating alternative continuous time multivariate stochastic volatility models. We propose a continuous time fractionally integrated Wishart stochastic volatility (FIWSV) process, and derive the conditional Laplace transform of the FIWSV model in order to obtain a closed form expression of moments. A two-step procedure is used, namely estimating the parameter of fractional integration via the local Whittle estimator in the first step, and estimating the remaining parameters via the generalized method of moments in the second step. Monte Carlo results for the procedure show a reasonable performance in finite samples. The empirical results for the S&P 500 and FTSE 100 indexes show that the data favor the new FIWSV process rather than the one-factor and two-factor models of the Wishart autoregressive process for the covariance structure.     

Information loss on the mean for spatial processes when some values are missing

The loss of information on the mean due to the presence of missing values is discussed for a Gaussian univariate process on a rectangular lattice. The exact as well as the approximate formulae for this loss are given for general conditional autoregressive (CAR) and simultaneous autoregressive (SAR) processes. The formulae are evaluated for some low order CAR and SAR processes. The approximate formula is shown to give a good insight into how the loss varies over the different configurations of missing sites.     

Transformed symmetric generalized autoregressive moving average models

Cordeiro and Andrade [Transformed generalized linear models. J Stat Plan Inference. 2009;139:2970–2987] incorporated the idea of transforming the response variable to the generalized autoregressive moving average (GARMA) model, introduced by Benjamin et al. [Generalized autoregressive moving average models. J Am Stat Assoc. 2003;98:214–223], thus developing the transformed generalized autoregressive moving average (TGARMA) model. The goal of this article is to develop the TGARMA model for symmetric continuous conditional distributions with a possible nonlinear structure for the mean that enables the fitting of a wide range of models to several time series data types. We derive an iterative process for estimating the parameters of the new model by maximum likelihood and obtain a simple formula to estimate the parameter that defines the transformation of the response variable. Furthermore, we determine the moments of the original dependent variable which generalize previous published results. We illustrate the theory by means of real data sets and evaluate the results developed through simulation studies.     

Large sample tests for testing symmetry and independence in some bivariate exponential models

Bivariate Exponential Distribution (BVED) were introduced by Freund (1961), Marshall and Olkin (1967) and Block and Basu (1974) as models for the distributions of (X,Y) the failure times of dependent components (C₁,C₂). We study the structure of these models and observe that Freund model leads to a regular exponential family with a four dimensional orthogonal parameter. Marshall-Olkin model involving three parameters leads to a conditional or piece wise exponential family and Block-Basu model which also depends on three parameters is a sub-model of the Freund model and is a curved exponential family. We obtain a large sample tests for symmetry as well as independence of (X,Y) in each of these models by using the Generalized Likelihood Ratio Tests (GLRT) or tests basesd on MLE of the parameters and root n consistent estimators of their variance-covariance matrices.     

A dynamic double asymmetric copula generalized autoregressive conditional heteroskedasticity model: application to China's and US stock market

Modeling the relationship between multiple financial markets has had a great deal of attention in both literature and real-life applications. One state-of-the-art technique is that the individual financial market is modeled by generalized autoregressive conditional heteroskedasticity (GARCH) process, while market dependence is modeled by copula, e.g. dynamic asymmetric copula-GARCH. As an extension, we propose a dynamic double asymmetric copula (DDAC)-GARCH model to allow for the joint asymmetry caused by the negative shocks as well as by the copula model. Furthermore, our model adopts a more intuitive way of constructing the sample correlation matrix. Our new model yet satisfies the positive-definite condition as found in dynamic conditional correlation-GARCH and constant conditional correlation-GARCH models. The simulation study shows the performance of the maximum likelihood estimate for DDAC-GARCH model. As a case study, we apply this model to examine the dependence between China and US stock markets since 1990s. We conduct a series of likelihood ratio test tests that demonstrate our extension (dynamic double joint asymmetry) is adequate in dynamic dependence modeling. Also, we propose a simulation method involving the DDAC-GARCH model to estimate value at risk (VaR) of a portfolio. Our study shows that the proposed method depicts VaR much better than well-established variance–covariance method.