Parameter estimation by contrast minimization for noisy observations of a diffusion process

We consider the estimation of unknown parameters in the drift and diffusion coefficients of a one-dimensional ergodic diffusion X when the observation Y is a discrete sampling of X with an additive noise, at times i δ, i=1,?…?, N. Assuming that the sampling interval tends to 0 while the total length-time interval tends to infinity, we prove limit theorems for functionals associated with the observations, based on local means of the sample. We apply these results to obtain a contrast function. The associated minimum contrast estimators are shown to be consistent. Some examples are discussed with numerical simulations.     

Estimation for Discretely Observed Small Diffusions Based on Approximate Martingale Estimating Functions

Abstract.  We consider an asymptotically efficient estimator of the drift parameter for a multi-dimensional diffusion process with small dispersion parameter ɛ . In the situation where the sample path is observed at equidistant times k / n , k  = 0, 1, …,  n , we study asymptotic properties of an M -estimator derived from an approximate martingale estimating function as ɛ tends to 0 and n tends to ∞ simultaneously.     

Estimation of an Ergodic Diffusion from Discrete Observations

We consider a one-dimensional diffusion process X , with ergodic property, with drift b ( x , θ) and diffusion coefficient a ( x , σ) depending on unknown parameters θ and σ. We are interested in the joint estimation of (θ, σ). For that purpose, we dispose of a discretized trajectory, observed at n equidistant times tⁿ_i = ih_n , 1 ≤ i ≤ n . We assume that h_n ← 0 and nh_n ←∞. Under the condition nh_n^p ← 0 for an arbitrary integer p , we exhibit a contrast dependent on p which provides us with an asymptotically normal and efficient estimator of (θ, σ).     

Minimum Contrast Estimation for Fractional Diffusions

Abstract.  When the Hurst coefficient of a fractional Brownian motion     is greater than 1/2 it is possible to define a stochastic integral with respect to     , as the pathwise limit of Riemann sums, and thus to consider pathwise solutions to fractional diffusion equations. In this paper, we consider the vanishing drift case and assume that the solution X _t is parameterized by θ in a compact parameter space Θ . Our main interest is the estimation of θ based on discrete time, but with very frequent observations. It is shown that the estimation problem in this context is locally asymptotically mixed normal. The asymptotic behaviour of a certain class of minimum contrast estimators is then studied and asymptotic efficiency is discussed.     

Simple and Explicit Estimating Functions for a Discretely Observed Diffusion Process

We consider a one-dimensional diffusion process X , with ergodic property, with drift b ( x , θ) and diffusion coefficient a ( x , θ) depending on an unknown parameter θ that may be multidimensional. We are interested in the estimation of θ and dispose, for that purpose, of a discretized trajectory, observed at n equidistant times t_i = iΔ , i = 0, ..., n . We study a particular class of estimating functions of the form ∑ f (θ, X _{t i −1}) which, under the assumption that the integral of f with respect to the invariant measure is null, provide us with a consistent and asymptotically normal estimator. We determine the choice of f that yields the estimator with minimum asymptotic variance within the class and indicate how to construct explicit estimating functions based on the generator of the diffusion. Finally the theoretical study is completed with simulations.     

Estimation of R=P[Y<X] for three-parameter generalized Rayleigh distribution

Surles and Padgett [Inference for reliability and stress–strength for a scaled Burr type X distribution. Lifetime Data Anal. 2001;7:187–200] introduced a two-parameter Burr-type X distribution, which can be described as a generalized Rayleigh distribution. In this paper, we consider the estimation of the stress–strength parameter R=P[Y<X], when X and Y are both three-parameter generalized Rayleigh distributions with the same scale and locations parameters but different shape parameters. It is assumed that they are independently distributed. It is observed that the maximum-likelihood estimators (MLEs) do not exist, and we propose a modified MLE of R. We obtain the asymptotic distribution of the modified MLE of R, and it can be used to construct the asymptotic confidence interval of R. We also propose the Bayes estimate of R and the construction of the associated credible interval based on importance sampling technique. Analysis of two real data sets, (i) simulated and (ii) real, have been performed for illustrative purposes.     

Maximum likelihood drift estimation for a threshold diffusion

We study the maximum likelihood estimator of the drift parameters of a stochastic differential equation, with both drift and diffusion coefficients constant on the positive and negative axis, yet discontinuous at zero. This threshold diffusion is called drifted oscillating Brownian motion. For this continuously observed diffusion, the maximum likelihood estimator coincides with a quasi-likelihood estimator with constant diffusion term. We show that this estimator is the limit, as observations become dense in time, of the (quasi)-maximum likelihood estimator based on discrete observations. In long time, the asymptotic behaviors of the positive and negative occupation times rule the ones of the estimators. Differently from most known results of the literature, we do not restrict ourselves to the ergodic framework: indeed, depending on the signs of the drift, the process may be ergodic, transient, or null recurrent. For each regime, we establish whether or not the estimators are consistent; if they are, we prove the convergence in long time of the properly rescaled difference of the estimators towards a normal or mixed normal distribution. These theoretical results are backed by numerical simulations.     

On cusp location estimation for perturbed dynamical systems

We consider the problem of parameter estimation in the case of observation of the trajectory of the diffusion process. We suppose that the drift coefficient has a singularity of cusp type and that the unknown parameter corresponds to the position of the point of the cusp. The asymptotic properties of the maximum likelihood estimator and Bayesian estimators are described in the asymptotic of small noise, that is, as the diffusion coefficient tends to zero. The consistency, limit distributions, and the convergence of moments of these estimators are established.     

Non-parametric Regression with Dependent Censored Data

Abstract.  Let ( X _i , Y _i ) ( i = 1 ,…, n ) be n replications of a random vector ( X , Y  ), where Y is supposed to be subject to random right censoring. The data ( X _i , Y _i ) are assumed to come from a stationary α -mixing process. We consider the problem of estimating the function m ( x ) = E ( φ ( Y ) |  X = x ), for some known transformation φ . This problem is approached in the following way: first, we introduce a transformed variable     , that is not subject to censoring and satisfies the relation     , and then we estimate m ( x ) by applying local linear regression techniques. As a by-product, we obtain a general result on the uniform rate of convergence of kernel type estimators of functionals of an unknown distribution function, under strong mixing assumptions.     

Estimation for change point of discretely observed ergodic diffusion processes

We treat the change point problem in ergodic diffusion processes from discrete observations. Tonaki et al. (2021a) proposed adaptive tests for detecting changes in the diffusion and drift parameters in ergodic diffusion process models. When any change in the diffusion or drift parameter is detected by this or any other method, the next question to consider is where the change point is located. Therefore, we propose the method to estimate the change point of the parameter for two cases: the case where there is a change in the diffusion parameter, and the case where there is no change in the diffusion parameter but a change in the drift parameter. Furthermore, we present rates of convergence and distributional results of the change point estimators. Some examples and simulation results are also given.     

Maximum Likelihood Estimation for Cox's Regression Model Under Case–Cohort Sampling

Abstract.  Case–cohort sampling aims at reducing the data sampling and costs of large cohort studies. It is therefore important to estimate the parameters of interest as efficiently as possible. We present a maximum likelihood estimator (MLE) for a case–cohort study based on the proportional hazards assumption. The estimator shows finite sample properties that improve on those by the Self & Prentice [Ann. Statist. 16 (1988)] estimator. The size of the gain by the MLE varies with the level of the disease incidence and the variability of the relative risk over the considered population. The gain tends to be small when the disease incidence is low. The MLE is found by a simple EM algorithm that is easy to implement. Standard errors are estimated by a profile likelihood approach based on EM-aided differentiation.     

Economic-statistical design of X ¥ charts for non-normal data by considering quality loss

When the X ¥ control chart is used to monitor a process, three parameters should be determined: the sample size, the sampling interval between successive samples, and the control limits of the chart. Duncan presented a cost model to determine the three parameters for an X ¥ chart. Alexander et al. combined Duncan's cost model with the Taguchi loss function to present a loss model for determining the three parameters. In this paper, the Burr distribution is employed to conduct the economic-statistical design of X ¥ charts for non-normal data. Alexander's loss model is used as the objective function, and the cumulative function of the Burr distribution is applied to derive the statistical constraints of the design. An example is presented to illustrate the solution procedure. From the results of the sensitivity analyses, we find that small values of the skewness coefficient have no significant effect on the optimal design; however, a larger value of skewness coefficient leads to a slightly larger sample size and sampling interval, as well as wider control limits. Meanwhile, an increase on the kurtosis coefficient results in an increase on the sample size and wider control limits.     

Comparison of Akaike information criterion and consistent Akaike information criterion for model selection and statistical inference from capture-recapture studies

SUMMARY We compare properties of parameter estimators under Akaike information criterion (AIC) and 'consistent' AIC (CAIC) model selection in a nested sequence of open population capture-recapture models. These models consist of product multinomials, where the cell probabilities are parameterized in terms of survival ( ) and capture ( p ) i i probabilities for each time interval i . The sequence of models is derived from 'treatment' effects that might be (1) absent, model H ; (2) only acute, model H ; or (3) acute and 0 2 p chronic, lasting several time intervals, model H . Using a 35 factorial design, 1000 3 repetitions were simulated for each of 243 cases. The true number of parameters ranged from 7 to 42, and the sample size ranged from approximately 470 to 55 000 per case. We focus on the quality of the inference about the model parameters and model structure that results from the two selection criteria. We use achieved confidence interval coverage as an integrating metric to judge what constitutes a 'properly parsimonious' model, and contrast the performance of these two model selection criteria for a wide range of models, sample sizes, parameter values and study interval lengths. AIC selection resulted in models in which the parameters were estimated with relatively little bias. However, these models exhibited asymptotic sampling variances that were somewhat too small, and achieved confidence interval coverage that was somewhat below the nominal level. In contrast, CAIC-selected models were too simple, the parameter estimators were often substantially biased, the asymptotic sampling variances were substantially too small and the achieved coverage was often substantially below the nominal level. An example case illustrates a pattern: with 20 capture occasions, 300 previously unmarked animals are released at each occasion, and the survival and capture probabilities in the control group on each occasion were 0.9 and 0.8 respectively using model H . There was a strong acute treatment effect 3 on the first survival ( ) and first capture probability ( p ), and smaller, chronic effects 1 2 on the second and third survival probabilities ( and ) as well as on the second capture 2 3 probability ( p ); the sample size for each repetition was approximately 55 000. CAIC 3 selection led to a model with exactly these effects in only nine of the 1000 repetitions, compared with 467 times under AIC selection. Under CAIC selection, even the two acute effects were detected only 555 times, compared with 998 for AIC selection. AIC selection exhibited a balance between underfitted and overfitted models (270 versus 263), while CAIC tended strongly to select underfitted models. CAIC-selected models were overly parsimonious and poor as a basis for statistical inferences about important model parameters or structure. We recommend the use of the AIC and not the CAIC for analysis and inference from capture-recapture data sets.     

Implied distributions in multiple change point problems

A method for efficiently calculating exact marginal, conditional and joint distributions for change points defined by general finite state Hidden Markov Models is proposed. The distributions are not subject to any approximation or sampling error once parameters of the model have been estimated. It is shown that, in contrast to sampling methods, very little computation is needed. The method provides probabilities associated with change points within an interval, as well as at specific points.     

Penalized Projection Estimator for Volatility Density

Abstract.  In this paper, we consider a stochastic volatility model ( Y _t , V _t ), where the volatility (V _t ) is a positive stationary Markov process. We assume that ( ln V _t ) admits a stationary density f that we want to estimate. Only the price process Y _t is observed at n discrete times with regular sampling interval Δ . We propose a non-parametric estimator for f obtained by a penalized projection method. Under mixing assumptions on ( V _t ), we derive bounds for the quadratic risk of the estimator. Assuming that Δ=Δ _n tends to 0 while the number of observations and the length of the observation time tend to infinity, we discuss the rate of convergence of the risk. Examples of models included in this framework are given.     

Asymptotic Inference for Jump Diffusions with State‐Dependent Intensity

We establish the local asymptotic normality property for a class of ergodic parametric jump‐diffusion processes with state‐dependent intensity and known volatility function sampled at high frequency. We prove that the inference problem about the drift and jump parameters is adaptive with respect to parameters in the volatility function that can be consistently estimated.     

Bayesian Estimation of Survival Functions under Stochastic Precedence

When estimating the distributions of two random variables, X and Y, investigators often have prior information that Y tends to be bigger than X. To formalize this prior belief, one could potentially assume stochastic ordering between X and Y, which implies Pr(X < or = z) > or = Pr(Y < or = z) for all z in the domain of X and Y. Stochastic ordering is quite restrictive, though, and this article focuses instead on Bayesian estimation of the distribution functions of X and Y under the weaker stochastic precedence constraint, Pr(X < or = Y) > or = 0.5. We consider the case where both X and Y are categorical variables with common support and develop a Gibbs sampling algorithm for posterior computation. The method is then generalized to the case where X and Y are survival times. The proposed approach is illustrated using data on survival after tumor removal for patients with malignant melanoma.     

Maximum Likelihood Estimation for Stochastic Differential Equations with Random Effects

Abstract. We consider N independent stochastic processes (X _i (t), t ∈ [0,T _i ]), i=1,…, N, defined by a stochastic differential equation with drift term depending on a random variable φ _i . The distribution of the random effect φ _i depends on unknown parameters which are to be estimated from the continuous observation of the processes X_i. We give the expression of the exact likelihood. When the drift term depends linearly on the random effect φ _i and φ _i has Gaussian distribution, an explicit formula for the likelihood is obtained. We prove that the maximum likelihood estimator is consistent and asymptotically Gaussian, when T _i =T for all i and N tends to infinity. We discuss the case of discrete observations. Estimators are computed on simulated data for several models and show good performances even when the length time interval of observations is not very large.     

Small confidence sets for the mean of a spherically symmetric distribution

Summary.  Suppose that X has a k -variate spherically symmetric distribution with mean vector θ and identity covariance matrix. We present two spherical confidence sets for θ , both centred at a positive part Stein estimator     . In the first, we obtain the radius by approximating the upper α -point of the sampling distribution of     by the first two non-zero terms of its Taylor series about the origin. We can analyse some of the properties of this confidence set and see that it performs well in terms of coverage probability, volume and conditional behaviour. In the second method, we find the radius by using a parametric bootstrap procedure. Here, even greater improvement in terms of volume over the usual confidence set is possible, at the expense of having a less explicit radius function. A real data example is provided, and extensions to the unknown covariance matrix and elliptically symmetric cases are discussed.     

On Erlang(2) Risk Process Perturbed by Diffusion

ABSTRACT

In this article, we consider an Erlang(2) risk process perturbed by diffusion. From the extreme value distribution of Brownian motion with drift and the renewal theory, we show that the survival probability satisfies an integral equation. We then give the bounds for the ultimate ruin probability and the ruin probability caused by claim. By introducing a random walk associated with the proposed risk process, we define an adjustment-coefficient. The relation between the adjustment-coefficient and the bound is given and the Lundberg-type inequality for the bound is obtained. Also, a formula of Pollaczek–Khinchin type for the bound is derived. Using these results, the bound can be calculated when claim sizes are exponentially distributed.