Simplified Estimating Functions for Diffusion Models with a High-dimensional Parameter

We consider estimating functions for discretely observed diffusion processes of the following type: for one part of the parameter of interest we propose to use a simple and explicit estimating function of the type studied by Kessler (2000); for the remaining part of the parameter we use a martingale estimating function. Such an approach is particularly useful in practical applications when the parameter is high-dimensional. It is also often necessary to supplement a simple estimating function by another type of estimating function because only the part of the parameter on which the invariant measure depends can be estimated by a simple estimating function. Under regularity conditions the resulting estimators are consistent and asymptotically normal. Several examples are considered in order to demonstrate the idea of the estimating procedure. The method is applied to two data sets comprising wind velocities and stock prices. In one example we also propose a general method for constructing diffusion models with a prescribed marginal distribution which have a flexible dependence structure.     

Combining estimating functions for volatility

Accurate estimates of volatility are needed in risk management. Generalized autoregressive conditional heteroscedastic (GARCH) models and random coefficient autoregressive (RCA) models have been used for volatility modelling. Following Heyde [1997. Quasi-likelihood and its Applications. Springer, New York], volatility estimates are obtained by combining two different estimating functions. It turns out that the combined estimating function for the parameter in autoregressive processes with GARCH errors and RCA models contains maximum information. The combination of the least squares (LS) estimating function and the least absolute deviation (LAD) estimating function with application to GARCH model error identification is discussed as an application.     

Simple and Explicit Estimating Functions for a Discretely Observed Diffusion Process

We consider a one-dimensional diffusion process X , with ergodic property, with drift b ( x , θ) and diffusion coefficient a ( x , θ) depending on an unknown parameter θ that may be multidimensional. We are interested in the estimation of θ and dispose, for that purpose, of a discretized trajectory, observed at n equidistant times t_i = iΔ , i = 0, ..., n . We study a particular class of estimating functions of the form ∑ f (θ, X _{t i −1}) which, under the assumption that the integral of f with respect to the invariant measure is null, provide us with a consistent and asymptotically normal estimator. We determine the choice of f that yields the estimator with minimum asymptotic variance within the class and indicate how to construct explicit estimating functions based on the generator of the diffusion. Finally the theoretical study is completed with simulations.     

Parameter Orthogonality and Bias Adjustment for Estimating Functions

Abstract.  We consider an extended notion of parameter orthogonality for estimating functions, called nuisance parameter insensitivity, which allows a unified treatment of nuisance parameters for a wide range of methods, including Liang and Zeger's generalized estimating equations. Nuisance parameter insensitivity has several important properties in common with conventional parameter orthogonality, such as the nuisance parameter causing no loss of efficiency for estimating the interest parameter, and a simplified estimation algorithm. We also consider bias adjustment for profile estimating functions, and apply the results to restricted maximum likelihood estimation of dispersion parameters in generalized estimating equations.     

Estimation for Discretely Observed Small Diffusions Based on Approximate Martingale Estimating Functions

Abstract.  We consider an asymptotically efficient estimator of the drift parameter for a multi-dimensional diffusion process with small dispersion parameter ɛ . In the situation where the sample path is observed at equidistant times k / n , k  = 0, 1, …,  n , we study asymptotic properties of an M -estimator derived from an approximate martingale estimating function as ɛ tends to 0 and n tends to ∞ simultaneously.     

Normalizing unbiased estimating functions

We consider a method for setting second-order accurate confidence intervals for a scalar parameter by applying normalizing transformations to unbiased estimating functions. Normalizing a nonlinear estimating function is usually easier than normalizing the estimator defined as the solution to the corresponding estimating equation. This estimator usually has to be obtained by some iterative algorithm. Numerical examples include a canonical Poisson regression and the estimation of the correlation coefficient. Numerical comparisons are made with the asymptotically equivalent method called estimating function bootstrap proposed recently by Hu and Kalbfleisch (Canad. J. Statist. 28 (2000) 449).     

On estimation of the mean parameter of a truncated normal disiribution with known coefficient of variation

This paper eals with the proplem on estimating the mean paramerer of a truncated normal distribution with known coefficient of variation. In the previous treatment of this problem most authors have used the sample standared deviation for estimating this parameter. In the present paper we use Gini’s coefficient of mean difference g and obtain the minimum variance unbiased estimate of the mean based on a linear function of the sample mean and g, It is shown that this new estimate has desirable properties for small samples as well as for large samples. We also give a numerical example.     

Bayes sequential estimation for a time-transformed exponential model

A problem of Bayesian sequential estimating an unknown parameter of a time-transformed exponential model is considered. It is supposed that the loss associated with the error of estimation is weighted squared or precautionary and the cost of observing the process is a function of time and the number of observations. Bayes sequential procedures for estimating the unknown parameter are presented.     

Second-order properties of intraclass correlation estimators for a symmetric normal distribution

Consider the problem of estimating the intraclass correlation coefficient of a symmetric normal distribution under the squared error loss function. The general admissibility of the standard estimators of the intraclass correlation coefficient is hard to check due to their complicated sampling distributions. We follow the asymptotic decision-theoretic approach of Ghosh and Sinha (1981) and prove that the three standard intraclass correlation estimators (the maximum-likelihood estimator, the method-of-moments estimator and the first-order unbiased estimator) are second-order admissible for all p ≥ 2, p being the dimension of the distribution.     

A regression approach for estimating the parameters of the covariance function of a stationary spatial random process

We consider the problem of estimating the parameters of the covariance function of a stationary spatial random process. In spatial statistics, there are widely used parametric forms for the covariance functions, and various methods for estimating the parameters have been proposed in the literature. We develop a method for estimating the parameters of the covariance function that is based on a regression approach. Our method utilizes pairs of observations whose distances are closest to a value h>0$h>0$ which is chosen in a way that the estimated correlation at distance h is a predetermined value. We demonstrate the effectiveness of our procedure by simulation studies and an application to a water pH data set. Simulation studies show that our method outperforms all well-known least squares-based approaches to the variogram estimation and is comparable to the maximum likelihood estimation of the parameters of the covariance function. We also show that under a mixing condition on the random field, the proposed estimator is consistent for standard one parameter models for stationary correlation functions.     

Inference for linear and nonlinear stable error processes via estimating functions

This paper describes an estimating function approach for parameter estimation in linear and nonlinear times series models with infinite variance stable errors. Joint estimates of location and scale parameters are derived for classes of autoregressive (AR) models and random coefficient autoregressive (RCA) models with stable errors, as well as for AR models with stable autoregressive conditionally heteroscedastic (ARCH) errors. Fast, on-line, recursive parametric estimation for the location parameter based on estimating functions is discussed using simulation studies. A real financial time series is also discussed in some detail.     

Contrast function estimation for the drift parameter of ergodic jump diffusion process

In this paper, we consider an ergodic diffusion process with jumps whose drift coefficient depends on an unknown parameter. We suppose that the process is discretely observed. We introduce an estimator based on a contrast function, which is efficient without requiring any conditions on the rate at which the step discretization goes to zero, and where we allow the observed process to have nonsummable jumps. This extends earlier results where the condition on the step discretization was needed and where the process was supposed to have summable jumps. In general situations, our contrast function is not explicit and one has to resort to some approximation. In the case of a finite jump activity, we propose explicit approximations of the contrast function such that the efficient estimation of the drift parameter is feasible. This extends the results obtained by Kessler in the case of continuous processes.     

A note on Pitman's measure of closeness with balanced loss function

In this note, we consider the problem of estimating an unknown parameter θ in the sense of the Pitman's measure of closeness (PMC) using the balanced loss function (BLF). We show that the PMC comparison of estimators under the BLF can be reduced to the PMC comparison under the usual absolute error loss. The Pitman-closest estimators of the location and scale parameters under BLF are also characterized. Illustrative examples are given to show the broad range applications of the obtained results.     

Estimating the parameters of a bathtub-shaped distribution under progressive type-II censoring

We consider the problem of estimating unknown parameters, reliability function and hazard function of a two parameter bathtub-shaped distribution on the basis of progressive type-II censored sample. The maximum likelihood estimators and Bayes estimators are derived for two unknown parameters, reliability function and hazard function. The Bayes estimators are obtained against squared error, LINEX and entropy loss functions. Also, using the Lindley approximation method we have obtained approximate Bayes estimators against these loss functions. Some numerical comparisons are made among various proposed estimators in terms of their mean square error values and some specific recommendations are given. Finally, two data sets are analyzed to illustrate the proposed methods.     

On cusp location estimation for perturbed dynamical systems

We consider the problem of parameter estimation in the case of observation of the trajectory of the diffusion process. We suppose that the drift coefficient has a singularity of cusp type and that the unknown parameter corresponds to the position of the point of the cusp. The asymptotic properties of the maximum likelihood estimator and Bayesian estimators are described in the asymptotic of small noise, that is, as the diffusion coefficient tends to zero. The consistency, limit distributions, and the convergence of moments of these estimators are established.     

Sequential estimation of a location parameter from delayed observations

The problem of sequentially estimating a location parameter is considered in the special case when the data arrive at random times. Certain classes of sequential estimation procedures are derived under a location invariant loss function and with the observation cost determined by a function of the moment of stopping and the number of observations up to this moment.     

Parameter Estimation for a Discretely Observed Integrated Diffusion Process

Abstract.  We consider the estimation of unknown parameters in the drift and diffusion coefficients of a one-dimensional ergodic diffusion X when the observation is a discrete sampling of the integral of X at times i Δ , i  =  1 ,…, n . Assuming that the sampling interval tends to 0 while the total length time interval tends to infinity, we first prove limit theorems for functionals associated with our observations. We apply these results to obtain a contrast function. The associated minimum contrast estimators are shown to be consistent and asymptotically Gaussian with different rates for drift and diffusion coefficient parameters.     

Fast Censored Linear Regression

Weighted log‐rank estimating function has become a standard estimation method for the censored linear regression model, or the accelerated failure time model. Well established statistically, the estimator defined as a consistent root has, however, rather poor computational properties because the estimating function is neither continuous nor, in general, monotone. We propose a computationally efficient estimator through an asymptotics‐guided Newton algorithm, in which censored quantile regression methods are tailored to yield an initial consistent estimate and a consistent derivative estimate of the limiting estimating function. We also develop fast interval estimation with a new proposal for sandwich variance estimation. The proposed estimator is asymptotically equivalent to the consistent root estimator and barely distinguishable in samples of practical size. However, computation time is typically reduced by two to three orders of magnitude for point estimation alone. Illustrations with clinical applications are provided.     

Quickly variable selection for varying coefficient models with missing response at random

This paper focuses on the variable selections for a varying coefficient models with missing response at random. A procedure is presented by basis function approximations with smooth-threshold estimating equations. Furthermore, the proposed method selects significant variables and estimates coefficients simultaneously avoiding the problem of solving a convex optimization, which reduced the burden of computation. Compared to existing equation based approaches, our procedure is more efficient and quick. With proper choices the regularization parameter, the resulting estimates perform an oracle property. A cross-validation for tuning parameter selection is also proposed, a numerical study confirms the performance of the proposed method.     

Estimation and inference for varying coefficient partially nonlinear models

In this paper, we extend the varying coefficient partially linear model to the varying coefficient partially nonlinear model in which the linear part of the varying coefficient partially linear model is replaced by a nonlinear function of the covariates. A profile nonlinear least squares estimation procedure for the parameter vector and the coefficient function vector of the varying coefficient partially nonlinear model is proposed and the asymptotic properties of the resulting estimators are established. We further propose a generalized likelihood ratio (GLR) test to check whether or not the varying coefficients in the model are constant. The asymptotic null distribution of the GLR statistic is derived and a residual-based bootstrap procedure is also suggested to derive the p-value of the GLR test. Some simulations are conducted to assess the performance of the proposed estimating and testing procedures and the results show that both the procedures perform well in finite samples. Furthermore, a real data example is given to demonstrate the application of the proposed model and its estimating and testing procedures.