Asymmetric matrix-valued covariances for multivariate random fields on spheres

ABSTRACT

Matrix-valued covariance functions are crucial to geostatistical modelling of multivariate spatial data. The classical assumption of symmetry of a multivariate covariance function is overly restrictive and has been considered as unrealistic for most of the real data applications. Despite of that, the literature on asymmetric covariance functions has been very sparse. In particular, there is some work related to asymmetric covariances on Euclidean spaces, depending on the Euclidean distance. However, for data collected over large portions of planet Earth, the most natural spatial domain is a sphere, with the corresponding geodesic distance being the natural metric. In this work, we propose a strategy based on spatial rotations to generate asymmetric covariances for multivariate random fields on the d-dimensional unit sphere. We illustrate through simulations as well as real data analysis that our proposal allows to achieve improvements in the predictive performance in comparison to the symmetric counterpart.     

Blur-generated non-separable space–time models

Statistical space–time modelling has traditionally been concerned with separable covariance functions, meaning that the covariance function is a product of a purely temporal function and a purely spatial function. We draw attention to a physical dispersion model which could model phenomena such as the spread of an air pollutant. We show that this model has a non-separable covariance function. The model is well suited to a wide range of realistic problems which will be poorly fitted by separable models. The model operates successively in time: the spatial field at time t +1 is obtained by 'blurring' the field at time t and adding a spatial random field. The model is first introduced at discrete time steps, and the limit is taken as the length of the time steps goes to 0. This gives a consistent continuous model with parameters that are interpretable in continuous space and independent of sampling intervals. Under certain conditions the blurring must be a Gaussian smoothing kernel. We also show that the model is generated by a stochastic differential equation which has been studied by several researchers previously.     

Space–time correlation analysis: a comparative study

Space–time correlation modelling is one of the crucial steps of traditional structural analysis, since space–time models are used for prediction purposes. A comparative study among some classes of space–time covariance functions is proposed. The relevance of choosing a suitable model by taking into account the characteristic behaviour of the models is proved by using a space–time data set of ozone daily averages and the flexibility of the product-sum model is also highlighted through simulated data sets.     

Monitoring point patterns for the development of space–time clusters

Existing statistical methods for the detection of space–time clusters of point events are retrospective, in that they are used to ascertain whether space–time clustering exists among a fixed number of past events. In contrast, prospective methods treat a series of observations sequentially, with the aim of detecting quickly any changes that occur in the series. In this paper, cumulative sum methods of monitoring are adapted for use with Knox's space–time statistic. The result is a procedure for the rapid detection of any emergent space–time interactions for a set of sequentially monitored point events. The approach relies on a 'local' Knox statistic that is useful in retrospective analyses to detect when and where space–time interaction occurs. The distribution of the local Knox statistic under the null hypothesis of no space–time interaction is derived. The retrospective local statistic and the prospective cumulative sum monitoring method are illustrated by using previously published data on Burkitt's lymphoma in Uganda.     

Recent advances to model anisotropic space–time data

Building new and flexible classes of nonseparable spatio-temporal covariances and variograms has resulted a key point of research in the last years. The goal of this paper is to present an up-to-date overview of recent spatio-temporal covariance models taking into account the problem of spatial anisotropy. The resulting structures are proved to have certain interesting mathematical properties, together with a considerable applicability. In particular, we focus on the problem of modelling anisotropy through isotropy within components. We present the Bernstein class, and a generalisation of Gneiting’s approach (2002a) to obtain new classes of space–time covariance functions which are spatially anisotropic. We also discuss some methods for building covariance functions that attain negative values. We finally present several differentiation and integration operators acting on particular space–time covariance classes.      

Spatiotemporal prediction for log-Gaussian Cox processes

Space–time point pattern data have become more widely available as a result of technological developments in areas such as geographic information systems. We describe a flexible class of space–time point processes. Our models are Cox processes whose stochastic intensity is a space–time Ornstein–Uhlenbeck process. We develop moment-based methods of parameter estimation, show how to predict the underlying intensity by using a Markov chain Monte Carlo approach and illustrate the performance of our methods on a synthetic data set.     

Modelling mercury deposition through latent space–time processes

Summary.  The paper provides a space–time process model for total wet mercury deposition. Key methodological features that are introduced include direct modelling of deposition rather than of expected deposition, the utilization of precipitation information (there is no deposition without precipitation) without having to construct a precipitation model and the handling of point masses at 0 in the distributions of both precipitation and deposition. The result is a specification that enables spatial interpolation and temporal prediction of deposition as well as aggregation in space or time to see patterns and trends in deposition. We use weekly deposition monitoring data from the National Atmospheric Deposition Program–Mercury Deposition Network for 2003 restricted to the eastern USA and Canada. Our spatiotemporal hierarchical model allows us to interpolate to arbitrary locations and, hence, to an arbitrary grid, enabling weekly deposition surfaces (with associated uncertainties) for this region. It also allows us to aggregate weekly depositions at coarser, quarterly and annual, temporal levels.     

Structural learning with time-varying components: tracking the cross-section of financial time series

Summary.  When modelling multivariate financial data, the problem of structural learning is compounded by the fact that the covariance structure changes with time. Previous work has focused on modelling those changes by using multivariate stochastic volatility models. We present an alternative to these models that focuses instead on the latent graphical structure that is related to the precision matrix. We develop a graphical model for sequences of Gaussian random vectors when changes in the underlying graph occur at random times, and a new block of data is created with the addition or deletion of an edge. We show how a Bayesian hierarchical model incorporates both the uncertainty about that graph and the time variation thereof.     

Fusing point and areal level space–time data with application to wet deposition

Summary.  Motivated by the problem of predicting chemical deposition in eastern USA at weekly, seasonal and annual scales, the paper develops a framework for joint modelling of point- and grid-referenced spatiotemporal data in this context. The hierarchical model proposed can provide accurate spatial interpolation and temporal aggregation by combining information from observed point-referenced monitoring data and gridded output from a numerical simulation model known as the 'community multi-scale air quality model'. The technique avoids the change-of-support problem which arises in other hierarchical models for data fusion settings to combine point- and grid-referenced data. The hierarchical space–time model is fitted to weekly wet sulphate and nitrate deposition data over eastern USA. The model is validated with set-aside data from a number of monitoring sites. Predictive Bayesian methods are developed and illustrated for inference on aggregated summaries such as quarterly and annual sulphate and nitrate deposition maps. The highest wet sulphate deposition occurs near major emissions sources such as fossil-fuelled power plants whereas lower values occur near background monitoring sites.     

Non-stationary spatiotemporal analysis of karst water levels

Summary.  We consider non-stationary spatiotemporal modelling in an investigation into karst water levels in western Hungary. A strong feature of the data set is the extraction of large amounts of water from mines, which caused the water levels to reduce until about 1990 when the mining ceased, and then the levels increased quickly. We discuss some traditional hydrogeological models which might be considered to be appropriate for this situation, and various alternative stochastic models. In particular, a separable space–time covariance model is proposed which is then deformed in time to account for the non-stationary nature of the lagged correlations between sites. Suitable covariance functions are investigated and then the models are fitted by using weighted least squares and cross-validation. Forecasting and prediction are carried out by using spatiotemporal kriging. We assess the performance of the method with one-step-ahead forecasting and make comparisons with naïve estimators. We also consider spatiotemporal prediction at a set of new sites. The new model performs favourably compared with the deterministic model and the naïve estimators, and the deformation by time shifting is worthwhile.     

Estimated estimating equations: semiparametric inference for clustered and longitudinal data

Summary.  We introduce a flexible marginal modelling approach for statistical inference for clustered and longitudinal data under minimal assumptions. This estimated estimating equations approach is semiparametric and the proposed models are fitted by quasi-likelihood regression, where the unknown marginal means are a function of the fixed effects linear predictor with unknown smooth link, and variance–covariance is an unknown smooth function of the marginal means. We propose to estimate the nonparametric link and variance–covariance functions via smoothing methods, whereas the regression parameters are obtained via the estimated estimating equations. These are score equations that contain nonparametric function estimates. The proposed estimated estimating equations approach is motivated by its flexibility and easy implementation. Moreover, if data follow a generalized linear mixed model, with either a specified or an unspecified distribution of random effects and link function, the model proposed emerges as the corresponding marginal (population-average) version and can be used to obtain inference for the fixed effects in the underlying generalized linear mixed model, without the need to specify any other components of this generalized linear mixed model. Among marginal models, the estimated estimating equations approach provides a flexible alternative to modelling with generalized estimating equations. Applications of estimated estimating equations include diagnostics and link selection. The asymptotic distribution of the proposed estimators for the model parameters is derived, enabling statistical inference. Practical illustrations include Poisson modelling of repeated epileptic seizure counts and simulations for clustered binomial responses.     

Rank Regression Analysis of Multivariate Failure Time Data Based on Marginal Linear Models

Abstract.  Multivariate failure time data arises when each study subject can potentially ex-perience several types of failures or recurrences of a certain phenomenon, or when failure times are sampled in clusters. We formulate the marginal distributions of such multivariate data with semiparametric accelerated failure time models (i.e. linear regression models for log-transformed failure times with arbitrary error distributions) while leaving the dependence structures for related failure times completely unspecified. We develop rank-based monotone estimating functions for the regression parameters of these marginal models based on right-censored observations. The estimating equations can be easily solved via linear programming. The resultant estimators are consistent and asymptotically normal. The limiting covariance matrices can be readily estimated by a novel resampling approach, which does not involve non-parametric density estimation or evaluation of numerical derivatives. The proposed estimators represent consistent roots to the potentially non-monotone estimating equations based on weighted log-rank statistics. Simulation studies show that the new inference procedures perform well in small samples. Illustrations with real medical data are provided.     

On the Estimation of Integrated Covariance Functions of Stationary Random Fields

Abstract.  For stationary vector-valued random fields on     the asymptotic covariance matrix for estimators of the mean vector can be given by integrated covariance functions. To construct asymptotic confidence intervals and significance tests for the mean vector, non-parametric estimators of these integrated covariance functions are required. Integrability conditions are derived under which the estimators of the covariance matrix are mean-square consistent. For random fields induced by stationary Boolean models with convex grains, these conditions are expressed by sufficient assumptions on the grain distribution. Performance issues are discussed by means of numerical examples for Gaussian random fields and the intrinsic volume densities of planar Boolean models with uniformly bounded grains.     

Disaggregated spatial modelling for areal unit categorical data

Summary.  We consider joint spatial modelling of areal multivariate categorical data assuming a multiway contingency table for the variables, modelled by using a log-linear model, and connected across units by using spatial random effects. With no distinction regarding whether variables are response or explanatory, we do not limit inference to conditional probabilities, as in customary spatial logistic regression. With joint probabilities we can calculate arbitrary marginal and conditional probabilities without having to refit models to investigate different hypotheses. Flexible aggregation allows us to investigate subgroups of interest; flexible conditioning enables not only the study of outcomes given risk factors but also retrospective study of risk factors given outcomes. A benefit of joint spatial modelling is the opportunity to reveal disparities in health in a richer fashion, e.g. across space for any particular group of cells, across groups of cells at a particular location, and, hence, potential space–group interaction. We illustrate with an analysis of birth records for the state of North Carolina and compare with spatial logistic regression.     

Characteristics of some classes of space–time covariance functions

Although a wide list of classes of space–time covariance functions is now available, selecting an appropriate class of models for a variable under study is still difficult and it represents a priority problem with respect to the choice of a particular model of a specified class. Then, knowing the characteristics of various classes of covariances, and their auxiliary functions, and matching those with the characteristics of the empirical space–time covariance surface might be helpful in the selection of a suitable class. In this paper some characteristics, such as behavior at the origin, asymptotic behavior, nonseparability and anisotropy aspects, are studied for some well known classes of covariance models of stationary space–time random fields. Moreover, some important issues related to modeling choices are described and a case study is presented.     

Positive and negative non-separability for space–time covariance models

Separable spatio-temporal covariance models, defined as the product of purely spatial and purely temporal covariance functions, are often used in practice, but frequently they only represent a convenient assumption. On the other hand, non-separable models are receiving a lot of attention, since they are more flexible to handle empirical covariances showed up in applications. Different forms of non-separability for space–time covariance functions have been recently defined in the literature. In this paper, the notion of positive and negative non-separability is further formalized in order to distinguish between pointwise and uniform non-separability. Various well-known non-separable space–time stationary covariance models are analyzed and classified by using the new definition of non-separability. In particular, wide classes of non-separable spatio-temporal covariance functions, able to capture positive and negative non-separability, are proposed and some examples of these classes are given. General results concerning the non-separability of spatial–temporal covariance functions obtained by a linear combination of spatial–temporal covariance functions and some stability properties are also presented. These results can be helpful to generate as well as to select appropriate covariance models for describing space–time data.     

Non‐stationary Cross‐Covariance Models for Multivariate Processes on a Globe

Abstract. In geophysical and environmental problems, it is common to have multiple variables of interest measured at the same location and time. These multiple variables typically have dependence over space (and/or time). As a consequence, there is a growing interest in developing models for multivariate spatial processes, in particular, the cross‐covariance models. On the other hand, many data sets these days cover a large portion of the Earth such as satellite data, which require valid covariance models on a globe. We present a class of parametric covariance models for multivariate processes on a globe. The covariance models are flexible in capturing non‐stationarity in the data yet computationally feasible and require moderate numbers of parameters. We apply our covariance model to surface temperature and precipitation data from an NCAR climate model output. We compare our model to the multivariate version of the Matérn cross‐covariance function and models based on coregionalization and demonstrate the superior performance of our model in terms of AIC (and/or maximum loglikelihood values) and predictive skill. We also present some challenges in modelling the cross‐covariance structure of the temperature and precipitation data. Based on the fitted results using full data, we give the estimated cross‐correlation structure between the two variables.     

Linear Discriminant Analysis of Multivariate Spatial–Temporal Regressions

Abstract.  We consider classification of the realization of a multivariate spatial–temporal Gaussian random field into one of two populations with different regression mean models and factorized covariance matrices. Unknown means and common feature vector covariance matrix are estimated from training samples with observations correlated in space and time, assuming spatial–temporal correlations to be known. We present the first-order asymptotic expansion of the expected error rate associated with a linear plug-in discriminant function. Our results are applied to ecological data collected from the Lithuanian Economic Zone in the Baltic Sea.     

Small confidence sets for the mean of a spherically symmetric distribution

Summary.  Suppose that X has a k -variate spherically symmetric distribution with mean vector θ and identity covariance matrix. We present two spherical confidence sets for θ , both centred at a positive part Stein estimator     . In the first, we obtain the radius by approximating the upper α -point of the sampling distribution of     by the first two non-zero terms of its Taylor series about the origin. We can analyse some of the properties of this confidence set and see that it performs well in terms of coverage probability, volume and conditional behaviour. In the second method, we find the radius by using a parametric bootstrap procedure. Here, even greater improvement in terms of volume over the usual confidence set is possible, at the expense of having a less explicit radius function. A real data example is provided, and extensions to the unknown covariance matrix and elliptically symmetric cases are discussed.     

Maximum likelihood estimation of linear continuous time long memory processes with discrete time data

Summary.  We develop a new class of time continuous autoregressive fractionally integrated moving average (CARFIMA) models which are useful for modelling regularly spaced and irregu-larly spaced discrete time long memory data. We derive the autocovariance function of a stationary CARFIMA model and study maximum likelihood estimation of a regression model with CARFIMA errors, based on discrete time data and via the innovations algorithm. It is shown that the maximum likelihood estimator is asymptotically normal, and its finite sample properties are studied through simulation. The efficacy of the approach proposed is demonstrated with a data set from an environmental study.