Fisher information and maximum-likelihood estimation of covariance parameters in Gaussian stochastic processes

The inverse of the Fisher information matrix is commonly used as an approximation for the covariance matrix of maximum-likelihood estimators. We show via three examples that for the covariance parameters of Gaussian stochastic processes under infill asymptotics, the covariance matrix of the limiting distribution of their maximum-likelihood estimators equals the limit of the inverse information matrix. This is either proven analytically or justified by simulation. Furthermore, the limiting behaviour of the trace of the inverse information matrix indicates equivalence or orthogonality of the underlying Gaussian measures. Even in the case of singularity, the estimator of the process variance is seen to be unbiased, and also its variability is approximated accurately from the information matrix.     

Conditional simulation for moving average processes with discrete or continuous values

A conditional simulation technique has previously been presented for variance reduction when estimating tail probabilities, particularly extreme ones, for a wide class of moving-average processes. Here, we generalize the technique from continuous to discrete random variables. Two distinct approaches to this generalization are presented and compared. We describe some of the empirical properties of the preferred method in simple examples, and present some more general examples including autoregressive moving-average processes in one and two dimensions. We show that the technique performs well for processes with a wide range of structures, provided the tail probability to be estimated is not too large. We discuss briefly the application of this technique in investigating volatility in financial models of, for example, asset prices.     

On some moving-average processes with exponentially distributed innovations

Summary In this paper we discusse the stationary sequence of random variables which are formed from an independent identically distributed sequence, according to the moving-average model of ordern. Some properties of the process are considered. The joint bivariate exponential distribution is given, as well as the distribution of the sum.     

Spatial sampling design for parameter estimation of the covariance function

We study the spatial optimal sampling design for covariance parameter estimation. The spatial process is modeled as a Gaussian random field and maximum likelihood (ML) is used to estimate the covariance parameters. We use the log determinant of the inverse Fisher information matrix as the design criterion and run simulations to investigate the relationship between the inverse Fisher information matrix and the covariance matrix of the ML estimates. A simulated annealing algorithm is developed to search for an optimal design among all possible designs on a fine grid. Since the design criterion depends on the unknown parameters, we define relative efficiency of a design and consider minimax and Bayesian criteria to find designs that are robust for a range of parameter values. Simulation results are presented for the Matérn class of covariance functions.     

La méthode de vraisemblance pour les processus linéaires spatiaux définis sur un treillis triangulaire

Spatial linear processes {X_s, s ? T} where T is a triangular lattice in R² are considered. Special attention is given to the class of spatial moving-average processes. Precisely, for each site s T, the variable X_s is defined as a linear combination of real-valued random shocks located at the vertices of regular concentric hexagons centered at s. For Gaussian random shocks, the process is also Gaussian, and estimates of its parameters are obtained by maximizing the exact likelihood. For non-Gaussian random shocks, the exact likelihood is difficult to obtain; however, the Gaussian likelihood is still used giving the pseudo-Gaussian likelihood estimates. The behaviour of these estimates is analyzed through the study of asymptotic properties and some simulation experiments based on an isotropic model defined with one coefficient.     

Analysis of Bivariate Survival Data using Shared Inverse Gaussian Frailty Model

In this article, we consider shared frailty model with inverse Gaussian distribution as frailty distribution and log-logistic distribution (LLD) as baseline distribution for bivariate survival times. We fit this model to three real-life bivariate survival data sets. The problem of analyzing and estimating parameters of shared inverse Gaussian frailty is the interest of this article and then compare the results with shared gamma frailty model under the same baseline for considered three data sets. Data are analyzed using Bayesian approach to the analysis of clustered survival data in which there is a dependence of failure time observations within the same group. The variance component estimation provides the estimated dispersion of the random effects. We carried out a test for frailty (or heterogeneity) using Bayes factor. Model comparison is made using information criteria and Bayes factor. We observed that the shared inverse Gaussian frailty model with LLD as baseline is the better fit for all three bivariate data sets.     

A new non parametric estimator for Pdf based on inverse gamma distribution

ABSTRACT

The non parametric approach is considered to estimate probability density function (Pdf) which is supported on(0, ∞). This approach is the inverse gamma kernel. We show that it has same properties as gamma, reciprocal inverse Gaussian, and inverse Gaussian kernels such that it is free of the boundary bias, non negative, and it achieves the optimal rate of convergence for the mean integrated squared error. Also some properties of the estimator were established such as bias and variance. Comparison of the bandwidth selection methods for inverse gamma kernel estimation of Pdf is done.     

Calibration for inverse gaussian regression

Inverse Gaussian regression models are useful for regression data where both variables are nonnegative and the variance of the dependent variable depends on the independent variable, Zero intercept inverse Gaussian regression models are presented with non-constant variance, constant ratio of variance to the mean and constant coefficient of variation, For purposes of calibration, the prediction band is used to give point and interval estimators for the independent variable, The results are illustrated with a real data set.     

Erratum

For a random variable obeying the inverse Gaussian distribu-tion and its reciprocal, the uniformly minimum variance unbiased (UMVU) estimators of each mode are obtained. The UMVU estimators

of the left and right limits of a certain interval which contains an inverse Gaussian variate with an arbitrary given probability are also proposed.     

Simulating random variables using moment-generating functions and the saddlepoint approximation

When we are given only a transform such as the moment-generating function of a distribution, it is rare that we can efficiently simulate random variables. Possible approaches such as the inverse transform using numerical inversion of the transform are computationally very expensive. However, the saddlepoint approximation is known to be exact for the Normal, Gamma, and inverse Gaussian distribution and remarkably accurate for a large number of others. We explore the efficient use of the saddlepoint approximation for simulating distributions and provide three examples of the accuracy of these simulations.     

Regression Properties for Asymmetric Generalized Scale Mixtures of Multivariate Gaussian Variables

Analytical properties of regression and the variance–covariance matrix of asymmetric generalized scale mixture of multivariate Gaussian variables are presented. The analysis includes an in-depth analytical investigation of the first two conditional moments of the mixing variable. Exact computable expressions for the prediction and the conditional variance are presented for the generalized hyperbolic distribution using the inversion theorem for Fourier transforms. An application to financial log returns is demonstrated via the classical Euler approximation. The methodology is illustrated by analyzing the regression of intraday log returns for CISCO against the corresponding data from S&P 500.     

Testing for departures from nominal dispersion in generalized nonlinear models with varying dispersion and/or additive random effects

This paper discusses the tests for departures from nominal dispersion in the framework of generalized nonlinear models with varying dispersion and/or additive random effects. We consider two classes of exponential family distributions. The first is discrete exponential family distributions, such as Poisson, binomial, and negative binomial distributions. The second is continuous exponential family distributions, such as normal, gamma, and inverse Gaussian distributions. Correspondingly, we develop a unifying approach and propose several tests for testing for departures from nominal dispersion in two classes of generalized nonlinear models. The score test statistics are constructed and expressed in simple, easy to use, matrix formulas, so that the tests can easily be implemented using existing statistical software. The properties of test statistics are investigated through Monte Carlo simulations.     

On convergence of the distributions of random sequences with independent random indexes to variance–mean mixtures

We prove a transfer theorem for random sequences with independent random indexes in the double array limit setting under relaxed conditions. We also prove its partial inverse providing the necessary and sufficient conditions for the convergence of randomly indexed random sequences. Special attention is paid to the case where the elements of the basic double array are formed as cumulative sums of independent not necessarily identically distributed random variables. Using simple moment-type conditions we prove the theorem on convergence of the distributions of such sums to normal variance–mean mixtures.     

A permutation-based Bayesian approach for inverse covariance estimation

Abstract

Covariance estimation and selection for multivariate datasets in a high-dimensional regime is a fundamental problem in modern statistics. Gaussian graphical models are a popular class of models used for this purpose. Current Bayesian methods for inverse covariance matrix estimation under Gaussian graphical models require the underlying graph and hence the ordering of variables to be known. However, in practice, such information on the true underlying model is often unavailable. We therefore propose a novel permutation-based Bayesian approach to tackle the unknown variable ordering issue. In particular, we utilize multiple maximum a posteriori estimates under the DAG-Wishart prior for each permutation, and subsequently construct the final estimate of the inverse covariance matrix. The proposed estimator has smaller variability and yields order-invariant property. We establish posterior convergence rates under mild assumptions and illustrate that our method outperforms existing approaches in estimating the inverse covariance matrices via simulation studies.     

Asymptotic distributions for the intervals estimators of the extremal index and the cluster-size probabilities

Under appropriate long range dependence conditions, the point process of exceedances of a stationary sequence weakly converges to a homogeneous compound Poisson point process. This limiting point process can be characterized by the extremal index and the cluster-size probabilities. In this paper we address the problem of estimating these quantities and we consider the intervals estimators introduced in Ferro and Segers [2003. Inference for clusters of extreme values. J. Roy. Statist. Soc. Ser. B 545–556] and in Ferro [2004. Statistical methods for clusters of extreme values. Ph.D. Thesis, Lancaster University]. We establish asymptotic weak convergence to Gaussian random variables and we give their asymptotic variance.     

Bootstrapping data with multiple levels of variation

The authors consider general estimators for the mean and variance parameters in the random effect model and in the transformation model for data with multiple levels of variation. They show that these estimators have different distributions under the two models unless all the variables have Gaussian distributions. They investigate the asymptotic properties of bootstrap procedures designed for the two models. They also report simulation results and illustrate the bootstraps using data on red spruce trees.     

Local Estimation of the Conditional Stable Tail Dependence Function

We consider the local estimation of the stable tail dependence function when a random covariate is observed together with the variables of main interest. Our estimator is a weighted version of the empirical estimator adapted to the covariate framework. We provide the main asymptotic properties of our estimator, when properly normalized, in particular the convergence of the empirical process towards a tight centred Gaussian process. The finite sample performance of our estimator is illustrated on a small simulation study and on a dataset of air pollution measurements.     

Lévy‐based Modelling in Brain Imaging

Abstract. A substantive problem in neuroscience is the lack of valid statistical methods for non‐Gaussian random fields. In the present study, we develop a flexible, yet tractable model for a random field based on kernel smoothing of a so‐called Lévy basis. The resulting field may be Gaussian, but there are many other possibilities, including random fields based on Gamma, inverse Gaussian and normal inverse Gaussian (NIG) Lévy bases. It is easy to estimate the parameters of the model and accordingly to assess by simulation the quantiles of test statistics commonly used in neuroscience. We give a concrete example of magnetic resonance imaging scans that are non‐Gaussian. For these data, simulations under the fitted models show that traditional methods based on Gaussian random field theory may leave small, but significant changes in signal level undetected, while these changes are detectable under a non‐Gaussian Lévy model.     

Empirical likelihood confidence bands for distribution functions with missing responses

Distribution function estimation plays a significant role of foundation in statistics since the population distribution is always involved in statistical inference and is usually unknown. In this paper, we consider the estimation of the distribution function of a response variable Y with missing responses in the regression problems. It is proved that the augmented inverse probability weighted estimator converges weakly to a zero mean Gaussian process. A augmented inverse probability weighted empirical log-likelihood function is also defined. It is shown that the empirical log-likelihood converges weakly to the square of a Gaussian process with mean zero and variance one. We apply these results to the construction of Gaussian process approximation based confidence bands and empirical likelihood based confidence bands of the distribution function of Y. A simulation is conducted to evaluate the confidence bands.     

A Multivariate Extension of Inverse Gaussian Distribution Derived from Inverse Relationship

Abstract

We propose a new multivariate extension of the inverse Gaussian distribution derived from a certain multivariate inverse relationship. First we define a multivariate extension of the inverse relationship between two sets of multivariate distributions, then define a reduced inverse relationship between two multivariate distributions. We derive the multivariate continuous distribution that has the reduced multivariate inverse relationship with a multivariate normal distribution and call it a multivariate inverse Gaussian distribution. This distribution is also characterized as the distribution of the location of a multivariate Brownian motion at some stopping time. The marginal distribution in one direction is the inverse Gaussian distribution, and the conditional distribution in the space perpendicular to this direction is a multivariate normal distribution. Mean, variance, and higher order cumulants are derived from the multivariate inverse relationship with a multivariate normal distribution. Other properties such as reproductivity and infinite divisibility are also given.