Bayesian inverse problems with heterogeneous variance

We consider inverse problems in Hilbert spaces under correlated Gaussian noise, and use a Bayesian approach to find their regularized solution. We focus on mildly ill-posed inverse problems with fractional noise, using a novel wavelet-based vaguelette–vaguelette approach. It allows us to apply sequence space methods without assuming that all operators are simultaneously diagonalizable. The results are proved for more general bases and covariance operators. Our primary aim is to study posterior contraction rate in such inverse problems over Sobolev classes and compare it to the derived minimax rate. Secondly, we study effect of plugging in a consistent estimator of variances in sequence space on the posterior contraction rate. This result is applied to the problem with error in forward operator. Thirdly, we show that empirical Bayes posterior distribution with a plugged-in maximum marginal likelihood estimator of the prior scale contracts at the optimal rate, adaptively, in the minimax sense.     

Smoothed detrended fluctuation analysis

ABSTRACT

The method of detrended fluctuation analysis (DFA) is useful in revealing the extent of long-range dependence, it has successfully been applied to different fields of interest. In this paper we proposed a smoothed detrended fluctuation analysis method based on the principle of wavelet shrinkage. The procedure is illustrated and compared with the DFA method by Monte Carlo simulations on fractional Gaussian noise models.     

Blind deconvolution model in periodic setting with fractional Gaussian noise

We consider the problem of estimating the response function in a deconvolution model under fractional Gaussian noise and noisy kernel. A preliminary threshold is used to stabilize the inversion. Our estimator is adaptive and attains minimax optimal or near-optimal rates in a wide range of Besov balls.     

D-optimal minimax design criterion for two-level fractional factorial designs

A D-optimal minimax design criterion is proposed to construct two-level fractional factorial designs, which can be used to estimate a linear model with main effects and some specified interactions. D-optimal minimax designs are robust against model misspecification and have small biases if the linear model contains more interaction terms. When the D-optimal minimax criterion is compared with the D-optimal design criterion, we find that the D-optimal design criterion is quite robust against model misspecification. Lower and upper bounds derived for the loss functions of optimal designs can be used to estimate the efficiencies of any design and evaluate the effectiveness of a search algorithm. Four algorithms to search for optimal designs for any run size are discussed and compared through several examples. An annealing algorithm and a sequential algorithm are particularly effective to search for optimal designs.     

The effect of long-range dependence on change-point estimators

We study the asymptotic behaviour of a class of estimators of the time of change in the mean of Gaussian observations having long-range dependence. We prove that after a suitable normalization the estimators converge in distribution to functionals of fractional Brownian motion.     

Stochastic volatility modelling in continuous time with general marginal distributions: Inference,prediction and model selection

We compare results for stochastic volatility models where the underlying volatility process having generalized inverse Gaussian (GIG) and tempered stable marginal laws. We use a continuous time stochastic volatility model where the volatility follows an Ornstein–Uhlenbeck stochastic differential equation driven by a Lévy process. A model for long-range dependence is also considered, its merit and practical relevance discussed. We find that the full GIG and a special case, the inverse gamma, marginal distributions accurately fit real data. Inference is carried out in a Bayesian framework, with computation using Markov chain Monte Carlo (MCMC). We develop an MCMC algorithm that can be used for a general marginal model.     

Directional dependence via Gaussian copula beta regression model with asymmetric GARCH marginals

This article proposes a new directional dependence by using the Gaussian copula beta regression model. In particular, we consider an asymmetric Generalized AutoRegressive Conditional Heteroscedasticity (GARCH) model for the marginal distribution of standardized residuals to make data exhibiting conditionally heteroscedasticity to white noise process. With the simulated data generated by an asymmetric bivariate copula, we verify our proposed directional dependence method. For the multivariate direction dependence by using the Gaussian copula beta regression model, we employ a three-dimensional archemedian copula to generate trivariate data and then show the directional dependence for one random variable given two other random variables. With West Texas Intermediate Daily Price (WTI) and the Standard & Poor’s 500 (S&P 500), our proposed directional dependence by the Gaussian copula beta regression model reveals that the directional dependence from WTI to S&P 500 is greater than that from S&P 500 to WTI. To validate our empirical result, the Granger causality test is conducted, confirming the same result produced by our method.     

Asymptotic minimax rates for abstract linear estimators

Abstract linear estimation concerns the estimation of an abstract parameter that depends on the underlying density via a linear transformation. An important subclass is the class of inverse problems where this transformation is naturally described as the inverse of some bounded operator. Suitable preconditioning allows us to restrict ourselves to the inverse of some Hermitian operator, which does not remain restricted to the class of compact operators. A lower bound to the minimax risk is obtained for the class of all estimators satisfying a natural moment condition and certain submodels. To establish the bound we use the Bayesian van Trees inequality and systems of (pseudo) eigenvectors of the operator involved. We also briefly sketch a general construction method for estimators, based on a regularized inverse of the operator involved, and show that these estimators attain the asymptotic minimax rate in interesting examples.     

Analysis of Bivariate Survival Data using Shared Inverse Gaussian Frailty Model

In this article, we consider shared frailty model with inverse Gaussian distribution as frailty distribution and log-logistic distribution (LLD) as baseline distribution for bivariate survival times. We fit this model to three real-life bivariate survival data sets. The problem of analyzing and estimating parameters of shared inverse Gaussian frailty is the interest of this article and then compare the results with shared gamma frailty model under the same baseline for considered three data sets. Data are analyzed using Bayesian approach to the analysis of clustered survival data in which there is a dependence of failure time observations within the same group. The variance component estimation provides the estimated dispersion of the random effects. We carried out a test for frailty (or heterogeneity) using Bayes factor. Model comparison is made using information criteria and Bayes factor. We observed that the shared inverse Gaussian frailty model with LLD as baseline is the better fit for all three bivariate data sets.     

D‐optimal minimax fractional factorial designs

The D‐optimal minimax criterion is proposed to construct fractional factorial designs. The resulting designs are very efficient, and robust against misspecification of the effects in the linear model. The criterion was first proposed by Wilmut & Zhou (2011); their work is limited to two‐level factorial designs, however. In this paper we extend this criterion to designs with factors having any levels (including mixed levels) and explore several important properties of this criterion. Theoretical results are obtained for construction of fractional factorial designs in general. This minimax criterion is not only scale invariant, but also invariant under level permutations. Moreover, it can be applied to any run size. This is an advantage over some other existing criteria. The Canadian Journal of Statistics 41: 325–340; 2013 © 2013 Statistical Society of Canada     

Asymptotically efficient estimators for nonparametric heteroscedastic regression models

This paper concerns the estimation of a function at a point in nonparametric heteroscedastic regression models with Gaussian noise or noise having unknown distribution. In those cases an asymptotically efficient kernel estimator is constructed for the minimax absolute error risk.     

Improved robust Bayes estimators of the error variance in linear models

We consider the problem of estimating the error variance in a general linear model when the error distribution is assumed to be spherically symmetric, but not necessary Gaussian. In particular we study the case of a scale mixture of Gaussians including the particularly important case of the multivariate-t distribution. Under Stein's loss, we construct a class of estimators that improve on the usual best unbiased (and best equivariant) estimator. Our class has the interesting double robustness property of being simultaneously generalized Bayes (for the same generalized prior) and minimax over the entire class of scale mixture of Gaussian distributions.     

Weak convergence of functionals of stationary long memory processes to Rosenblatt-type distributions

We provide an asymptotic result for the distribution of functionals of continuous Gaussian processes with long memory. Much of the existing literature on the subject resorts to asymptotic representations based on stochastic integrals. However, the method of proof used here, based on characteristic functions, enables one to extend the class of functionals for which we are able to provide an asymptotic representation. Next, we study the properties of the asymptotic process and finally, as an application, we consider the case of continuous regression where the process of errors follows a Gamma process with long-range dependence.     

Asymptotic Minimax Risk for the White Noise Model on the Sphere

Estimation of an unknown function on the unit sphere of the Euclidean space is considered. The function is observed in Gaussian continuous time white noise. Uniform norm is chosen as a loss function and exact asymptotic minimax risk is derived extending the result of Korostelev (1993). The exact asymptotic minimax risk is also given for the L ₂-loss, applying the result of Pinsker (1980).     

Markov random field-based image subsampling method

The use of Bayesian models for the reconstruction of images degraded by both some blurring function H and the presence of noise has become popular in recent years. Making an analogy between classical degradation processes and resampling, we propose a Bayesian model for generating finer resolution images. The approach involves defining resampling, or aggregation, as a linear operator applied to an original picture to produce derived lower resolution data which represent our available experimental infor-mation. Within this framework, the operation of making inference on the orginal data can be viewed as an inverse linear transformation problem. This problem, formalized through Bayes' theorem, can be solved by the classical maximum a posteriori estimation procedure. Image local characteristics are assumed to follow a Gaussian Markov random field. Under some mild assumptions, simple, iterative and local operations are involved, making parallel 'relaxation' processing feasible. experimental results are shown on some images, for which good subsampling estimates are obtained.     

Statistical properties of detrended fluctuation analysis

The main goal of this work is to consider the detrended fluctuation analysis (DFA), proposed by Peng et al. [Mosaic organization of DNA nucleotides, Phys. Rev. E. 49(5) (1994), 1685–1689]. This is a well-known method for analysing the long-range dependence in non-stationary time series. Here we describe the DFA method and we prove its consistency and its exact distribution, based on the usual i.i.d. assumption, as an estimator for the fractional parameter d. In the literature it is well established that the nucleotide sequences present long-range dependence property. In this work, we analyse the long dependence property in view of the autoregressive moving average fractionally integrated ARFIMA(p, d, q) processes through the analysis of four nucleotide sequences. For estimating the fractional parameter d we consider the semiparametric regression method based on the periodogram function, in both classical and robust versions; the semiparametric R/S(n) method, proposed by Hurst [Long term storage in reservoirs, Trans. Am. Soc. Civil Eng. 116 (1986), 770–779] and the maximum likelihood method (see [R. Fox and M.S. Taqqu, Large-sample properties of parameter estimates for strongly dependent stationary Gaussian time series, Ann. Statist. 14 (1986), 517–532]), by considering the approximation suggested by Whittle [Hypothesis Testing in Time Series Analysis (1953), Hafner, New York].     

Infant mortality rates: time trends and fractional integration

This paper examines the existence of time trends in the infant mortality rates in a number of countries in the twentieth century. We test for the presence of deterministic trends by adopting a linear model for the log-transformed data. Instead of assuming that the error term is a stationary I(0), or alternatively, a non-stationary I(1) process, we allow for the possibility of fractional integration and hence for a much greater degree of flexibility in the dynamic specification of the series. Indeed, once the linear trend is removed, all series appear to be I(d) with 0<d<1, implying long-range dependence. As expected, the time trend coefficients are significantly negative, although of a different magnitude from those obtained assuming integer orders of differentiation.     

Non‐Gaussian geostatistical modeling using (skew) t processes

We propose a new model for regression and dependence analysis when addressing spatial data with possibly heavy tails and an asymmetric marginal distribution. We first propose a stationary process with t marginals obtained through scale mixing of a Gaussian process with an inverse square root process with Gamma marginals. We then generalize this construction by considering a skew‐Gaussian process, thus obtaining a process with skew‐t marginal distributions. For the proposed (skew) t process, we study the second‐order and geometrical properties and in the t case, we provide analytic expressions for the bivariate distribution. In an extensive simulation study, we investigate the use of the weighted pairwise likelihood as a method of estimation for the t process. Moreover we compare the performance of the optimal linear predictor of the t process versus the optimal Gaussian predictor. Finally, the effectiveness of our methodology is illustrated by analyzing a georeferenced dataset on maximum temperatures in Australia.     

Regularized Posteriors in Linear Ill‐Posed Inverse Problems

Abstract. We study the Bayesian solution of a linear inverse problem in a separable Hilbert space setting with Gaussian prior and noise distribution. Our contribution is to propose a new Bayes estimator which is a linear and continuous estimator on the whole space and is stronger than the mean of the exact Gaussian posterior distribution which is only defined as a measurable linear transformation. Our estimator is the mean of a slightly modified posterior distribution called regularized posterior distribution. Frequentist consistency of our estimator and of the regularized posterior distribution is proved. A Monte Carlo study and an application to real data confirm good small‐sample properties of our procedure.