Central Limit Theorems of Local Polynomial Threshold Estimator for Diffusion Processes with Jumps

Central limit theorems play an important role in the study of statistical inference for stochastic processes. However, when the non‐parametric local polynomial threshold estimator, especially local linear case, is employed to estimate the diffusion coefficients of diffusion processes, the adaptive and predictable structure of the estimator conditionally on the σ ‐field generated by diffusion processes is destroyed, so the classical central limit theorem for martingale difference sequences cannot work. In high‐frequency data, we proved the central limit theorems of local polynomial threshold estimators for the volatility function in diffusion processes with jumps by Jacod's stable convergence theorem. We believe that our proof procedure for local polynomial threshold estimators provides a new method in this field, especially in the local linear case.     

On Integrated Volatility of Itô Semimartingales when Sampling Times are Endogenous

In this paper, we estimate the integrated volatility of Itô semimartingale when sampling times are endogenous. The estimator is proved to be consistent, and is robust to jumps, regardless of whether they are finite and infinite activity jumps. We also establish a central limit theorem for the estimator in a general endogenous time setting when the jumps have finite variation. Simulation is also included to illustrate the performance of the proposed procedure.     

A Test to Detect Within-family Infectivity when the Whole Epidemic Process is Observed

An epidemic model for the spread of an infectious disease in a population of families is considered. The score test of the hypothesis that there is no higher infectivity between family members is constructed under the assumption that the epidemic process is observed continuously up to some time t . The score process is a martingale as a function of t and by letting the number of families tend to infinity, a central limit theorem for the process can be proved. The central limit theorem not only justifies a normal approximation of the test statistic—it also suggests a smaller variance estimator than expected.     

Estimation of multivariate conditional-tail-expectation using Kendall's process

This paper deals with the problem of estimating the multivariate version of the Conditional-Tail-Expectation, proposed by Di Bernardino et al. [(2013), ‘Plug-in Estimation of Level Sets in a Non-Compact Setting with Applications in Multivariable Risk Theory’, ESAIM: Probability and Statistics, (17), 236–256]. We propose a new nonparametric estimator for this multivariate risk-measure, which is essentially based on Kendall's process [Genest and Rivest, (1993), ‘Statistical Inference Procedures for Bivariate Archimedean Copulas’, Journal of American Statistical Association, 88(423), 1034–1043]. Using the central limit theorem for Kendall's process, proved by Barbe et al. [(1996), ‘On Kendall's Process’, Journal of Multivariate Analysis, 58(2), 197–229], we provide a functional central limit theorem for our estimator. We illustrate the practical properties of our nonparametric estimator on simulations and on two real test cases. We also propose a comparison study with the level sets-based estimator introduced in Di Bernardino et al. [(2013), ‘Plug-In Estimation of Level Sets in A Non-Compact Setting with Applications in Multivariable Risk Theory’, ESAIM: Probability and Statistics, (17), 236–256] and with (semi-)parametric approaches.     

A Non‐Parametric Estimator of the Spectral Density of a Continuous‐Time Gaussian Process Observed at Random Times

Abstract. In numerous applications data are observed at random times and an estimated graph of the spectral density may be relevant for characterizing and explaining phenomena. By using a wavelet analysis, one derives a non‐parametric estimator of the spectral density of a Gaussian process with stationary increments (or a stationary Gaussian process) from the observation of one path at random discrete times. For every positive frequency, this estimator is proved to satisfy a central limit theorem with a convergence rate depending on the roughness of the process and the moment of random durations between successive observations. In the case of stationary Gaussian processes, one can compare this estimator with estimators based on the empirical periodogram. Both estimators reach the same optimal rate of convergence, but the estimator based on wavelet analysis converges for a different class of random times. Simulation examples and an application to biological data are also provided.     

On integral functionals of a density

ABSTRACT

Estimation of a non linear integral functional of probability distribution density and its derivatives is studied. The truncated plug-in-estimator is taken for the estimation. The integrand function can be unlimited, but it cannot exceed polynomial growth. Consistency of the estimator is proved and the convergence order is established. Aversion of the central limit theorem is proved. As an example an extended Fisher information integral and generalized Shannon's entropy functional are considered.     

On Esseen type inequalities for combinatorial random sums

We derive new bounds of the remainder in a combinatorial central limit theorem with a random number of summands. Esseen type inequalities are obtained for random combinatorial sums. Various moment conditions are considered. Moments of order 2 + δ, δ ∈ (0, 1], are partial cases. A variant of a combinatorial central limit theorem is proved for random sums with indices having Poisson distributions.     

Statistical Estimation for a Class of Self‐Regulating Processes

Self‐regulating processes are stochastic processes whose local regularity, as measured by the pointwise Hölder exponent, is a function of amplitude. They seem to provide relevant models for various signals arising for example in geophysics or biomedicine. We propose in this work an estimator of the self‐regulating function (that is, the function relating amplitude and Hölder regularity) of the self‐regulating midpoint displacement process and study some of its properties. We prove that it is almost surely convergent and obtain a central limit theorem. Numerical simulations show that the estimator behaves well in practice.     

A general central limit theorem and a subsampling variance estimator for α‐mixing point processes

We establish a central limit theorem for multivariate summary statistics of nonstationary α‐mixing spatial point processes and a subsampling estimator of the covariance matrix of such statistics. The central limit theorem is crucial for establishing asymptotic properties of estimators in statistics for spatial point processes. The covariance matrix subsampling estimator is flexible and model free. It is needed, for example, to construct confidence intervals and ellipsoids based on asymptotic normality of estimators. We also provide a simulation study investigating an application of our results to estimating functions.     

Deviation of order p for estimators of the variance in first-order stochastic differential equation (SDE)

In this work, we consider a non-parametric estimator of the variance in one-dimensional diffusion models or, more generally, in Itô processes with a deterministic diffusion term and a general non-anticipative drift. The estimation is based on the quadratic variation of discrete time observations over a finite interval. In particular, a central limit theorem (CLT) is proved for the deviation in L ^p norm (p≥; 1) between the variance and this estimator. The method of the proof consists in writing the L ^p norm of the deviation, when the drift term is equal to zero, as a sum of 4-dependent random variables. The moments are then computed by means of a Gaussian approximation and a CLT for m-dependent random variables is applied. The convergence is stable in law, this allows the result for processes with general drifts to be obtained, by using Girsanov's formula.     

Proportional hazards estimate of the conditional survival function

We introduce a new estimator of the conditional survival function given some subset of the covariate values under a proportional hazards regression. The new estimate does not require estimating the base-line cumulative hazard function. An estimate of the variance is given and is easy to compute, involving only those quantities that are routinely calculated in a Cox model analysis. The asymptotic normality of the new estimate is shown by using a central limit theorem for Kaplan–Meier integrals. We indicate the straightforward extension of the estimation procedure under models with multiplicative relative risks, including non-proportional hazards, and to stratified and frailty models. The estimator is applied to a gastric cancer study where it is of interest to predict patients' survival based only on measurements obtained before surgery, the time at which the most important prognostic variable, stage, becomes known.     

On the Estimation of Integrated Volatility With Jumps and Microstructure Noise

In this article, we propose a nonparametric procedure to estimate the integrated volatility of an Itô semimartingale in the presence of jumps and microstructure noise. The estimator is based on a combination of the preaveraging method and threshold technique, which serves to remove microstructure noise and jumps, respectively. The estimator is shown to work for both finite and infinite activity jumps. Furthermore, asymptotic properties of the proposed estimator, such as consistency and a central limit theorem, are established. Simulations results are given to evaluate the performance of the proposed method in comparison with other alternative methods.     

A Pointwise Estimator for the k-Fold Convolution of a Distribution Function

ABSTRACT

This article is concerned with some parametric and nonparametric estimators for the k-fold convolution of a distribution function. An alternative estimator is proposed and its unbiasedness, asymptotic unbiasedness, and consistency properties are investigated. The asymptotic normality of this estimator is established. Some applications of the estimator are given in renewal processes. Finally, the computational procedures are described and the relative performance of these estimators for small sample sizes is investigated by a simulation study.     

On nonparametric variogram estimation

A critical step for geostatistical prediction is estimation of variogram from the data. One of the popular methods estimating variogram is a smoothed version of classical nonparametric variogram estimator. In this paper we investigate its theoretical and empirical properties to provide useful information for using it. The main results are based on asymptotic theories (i.e., risk and central limit theorem) under nearly infill domain sampling. Simulation is also employed to make our points.     

When is n large enough? Looking for the right sample size to estimate proportions

The central limit theorem indicates that when the sample size goes to infinite, the sampling distribution of means tends to follow a normal distribution; it is the basis for the most usual confidence interval and sample size formulas. This study analyzes what sample size is large enough to assume that the distribution of the estimator of a proportion follows a Normal distribution. Also, we propose the use of a correction factor in sample size formulas to ensure a confidence level even when the central limit theorem does not apply for these distributions.     

Central limit theorem for the variable bandwidth kernel density estimators

In this paper we study the ideal variable bandwidth kernel density estimator introduced by McKay (1993a, b) and Jones et al. (1994) and the plug-in practical version of the variable bandwidth kernel estimator with two sequences of bandwidths as in Giné and Sang (2013). Based on the bias and variance analysis of the ideal and plug-in variable bandwidth kernel density estimators, we study the central limit theorems for each of them. The simulation study confirms the central limit theorem and demonstrates the advantage of the plug-in variable bandwidth kernel method over the classical kernel method.     

Variance estimation in the central limit theorem for Markov chains

This article concerns the variance estimation in the central limit theorem for finite recurrent Markov chains. The associated variance is calculated in terms of the transition matrix of the Markov chain. We prove the equivalence of different matrix forms representing this variance. The maximum likelihood estimator for this variance is constructed and it is proved that it is strongly consistent and asymptotically normal. The main part of our analysis consists in presenting closed matrix forms for this new variance. Additionally, we prove the asymptotic equivalence between the empirical and the maximum likelihood estimation (MLE) for the stationary distribution.     

A comparison of Bayesian model selection based on MCMC with an application to GARCH-type models

This paper presents a comprehensive review and comparison of five computational methods for Bayesian model selection, based on MCMC simulations from posterior model parameter distributions. We apply these methods to a well-known and important class of models in financial time series analysis, namely GARCH and GARCH-t models for conditional return distributions (assuming normal and t-distributions). We compare their performance with the more common maximum likelihood-based model selection for simulated and real market data. All five MCMC methods proved reliable in the simulation study, although differing in their computational demands. Results on simulated data also show that for large degrees of freedom (where the t-distribution becomes more similar to a normal one), Bayesian model selection results in better decisions in favor of the true model than maximum likelihood. Results on market data show the instability of the harmonic mean estimator and reliability of the advanced model selection methods.     

A class of Stein‐rules in multivariate regression model with structural changes

In this paper, we consider an estimation problem of the matrix of the regression coefficients in multivariate regression models with unknown change‐points. More precisely, we consider the case where the target parameter satisfies an uncertain linear restriction. Under general conditions, we propose a class of estimators that includes as special cases shrinkage estimators (SEs) and both the unrestricted and restricted estimator. We also derive a more general condition for the SEs to dominate the unrestricted estimator. To this end, we extend some results underlying the multidimensional version of the mixingale central limit theorem as well as some important identities for deriving the risk function of SEs. Finally, we present some simulation studies that corroborate the theoretical findings.     

Importance sampling type estimators based on approximate marginal Markov chain Monte Carlo

We consider importance sampling (IS) type weighted estimators based on Markov chain Monte Carlo (MCMC) targeting an approximate marginal of the target distribution. In the context of Bayesian latent variable models, the MCMC typically operates on the hyperparameters, and the subsequent weighting may be based on IS or sequential Monte Carlo (SMC), but allows for multilevel techniques as well. The IS approach provides a natural alternative to delayed acceptance (DA) pseudo-marginal/particle MCMC, and has many advantages over DA, including a straightforward parallelization and additional flexibility in MCMC implementation. We detail minimal conditions which ensure strong consistency of the suggested estimators, and provide central limit theorems with expressions for asymptotic variances. We demonstrate how our method can make use of SMC in the state space models context, using Laplace approximations and time-discretized diffusions. Our experimental results are promising and show that the IS-type approach can provide substantial gains relative to an analogous DA scheme, and is often competitive even without parallelization.