Nearest neighbor hazard estimation with left-truncated duration data

Duration data often suffer from both left-truncation and right-censoring. We show how both deficiencies can be overcome at the same time when estimating the hazard rate nonparametrically by kernel smoothing with the nearest-neighbor bandwidth. Smoothing Turnbull’s estimator of the cumulative hazard rate, we derive strong uniform consistency of the estimate from Hoeffding’s inequality, applied to a generalized empirical distribution function. We also apply our estimator to rating transitions of corporate loans in Germany.     

Oracle Inequalities for Convex Loss Functions with Nonlinear Targets

This article considers penalized empirical loss minimization of convex loss functions with unknown target functions. Using the elastic net penalty, of which the Least Absolute Shrinkage and Selection Operator (Lasso) is a special case, we establish a finite sample oracle inequality which bounds the loss of our estimator from above with high probability. If the unknown target is linear, this inequality also provides an upper bound of the estimation error of the estimated parameter vector. Next, we use the non-asymptotic results to show that the excess loss of our estimator is asymptotically of the same order as that of the oracle. If the target is linear, we give sufficient conditions for consistency of the estimated parameter vector. We briefly discuss how a thresholded version of our estimator can be used to perform consistent variable selection. We give two examples of loss functions covered by our framework.     

Asymptotic properties of the kernel mode estimator under twice censorship model

In this article, we study the asymptotic properties of the kernel estimator of the mode and density function when the data are twice censored. More specifically, we first establish a strong uniform consistency over a compact set with a rate of the kernel density estimator and then we give the consistency with rate and asymptotic normality for the kernel mode estimator. An application to confidence bands is given.     

Convergence rate of the kernel regression estimator for associated and truncated data

This paper studies the behaviour of the kernel estimator of the regression function for associated data in the random left truncated model. The uniform strong consistency rate over a real compact set of the estimate is established. The finite sample performance of the estimator is investigated through extensive simulation studies.     

Asymptotics for L2-norm of ARCH innovation density estimator

In this paper we consider the asymptotic properties of the ARCH innovation density estimator. We obtain the asymptotic normality of the Bickel-Rosenblatt test statistic (based on our density estimator) under the null hypothesis, which is the same as in the case of the one sample set up (given in Bickel and Rosenblatt, 1973). We also show the strong consistency of the estimator for the true density in L2-norm.     

Wavelet Estimator in Nonparametric Regression Model with Dependent Error’s Structure

In this article, we consider a nonparametric regression model with replicated observations based on the dependent error’s structure, for exhibiting dependence among the units. The wavelet procedures are developed to estimate the regression function. The moment consistency, the strong consistency, strong convergence rate and asymptotic normality of wavelet estimator are established under suitable conditions. A simulation study is undertaken to assess the finite sample performance of the proposed method.     

Double-smoothed drift estimation of jump-diffusion model

In this paper, we consider the non parametric drift estimation for the jump-diffusion model. We employ the double-smoothed non parametric method, and establish the strong consistency and asymptotic normality for estimator.     

Asymptotic properties of nonparametric regression for long memory random fields

The kernel estimator of spatial regression function is investigated for stationary long memory (long range dependent) random fields observed over a finite set of spatial points. A general result on the strong consistency of the kernel density estimator is first obtained for the long memory random fields, and then, under some mild regularity assumptions, the asymptotic behaviors of the regression estimator are established. For the linear long memory random fields, a weak convergence theorem is also obtained for kernel density estimator. Finally, some related issues on the inference of long memory random fields are discussed through a simulation example.     

Asymptotic properties of a quast-maximum likelihood estimator in truncated regression model with serial correlation

Robinson (1982a) presented a general approach to serial correlation in limited dependent variable models and proved the strong consistency and asymptotic normality of the quasi-maximum likelihood estimator (QMLE) for the Tobit model with serial correlation, obtained under the assumption of independent errors. This paper proves the strong consistency and asymptotic normality of the QMLE based on independent errors for the truncated regression model with serial correlation and gives consistent estimators for the limiting covariance matrix of the QMLE.     

Asymptotic properties of a quast-maximum likelihood estimator in truncated regression model with serial correlation

Robinson (1982a) presented a general approach to serial correlation in limited dependent variable models and proved the strong consistency and asymptotic normality of the quasi-maximum likelihood estimator (QMLE) for the Tobit model with serial correlation, obtained under the assumption of independent errors. This paper proves the strong consistency and asymptotic normality of the QMLE based on independent errors for the truncated regression model with serial correlation and gives consistent estimators for the limiting covariance matrix of the QMLE.     

Semiparametric regression estimation for longitudinal data in models with martingale difference error's structure

An inherent characteristic of longitudinal data is the dependence among the observations within the same subject. For exhibiting dependencies among the observations within the same subject, this paper considers a semiparametric partially linear regression model for longitudinal data based on martingale difference error's structure. We establish a strong consistency for the least squares estimator of a parametric component and the estimator of a non-parametric function under some mild conditions. A simulation study shows the performance of the proposed estimator in finite samples.     

Parameter estimation for the skew Ornstein-Uhlenbeck processes based on discrete observations

Abstract

In this paper, the drift parameter estimation for the one-dimensional skew Ornstein-Uhlenbeck process is considered. We derived the moment estimator in terms of the sample moments and invariant density. Then, we proved the strong consistency and asymptotic normality. Finally, some numerical experiments are presented to show the effect of the moment estimator.     

Extended Glivenko–Cantelli Theorem in Nonparametric Regression

In this paper, we consider the uniform strong consistency of the cumulative distribution function estimator in nonparametric regression. We obtain the extended Glivenko–Cantelli theorem for the residual-based empirical distribution function.     

On the Sampling Performance of an Improved Stein Inequality Restricted Estimator

Using the Stein (1964) variance estimator, this paper defines a modified Stein inequality constrained estimator and derives its exact risk under quadratic loss. Numerical evaluations show that over a wide range of the parameter space, the modified Stein inequality constrained estimator has lower risk than the traditional Stein inequality constrained estimator introduced by Judge et al . (1984).     

On the estimation of the marginal density of a moving average process

The authors present a new convolution‐type kernel estimator of the marginal density of an MA(1) process with general error distribution. They prove the √n; ‐consistency of the nonparametric estimator and give asymptotic expressions for the mean square and the integrated mean square error of some unobservable version of the estimator. An extension to MA(q) processes is presented in the case of the mean integrated square error. Finally, a simulation study shows the good practical behaviour of the estimator and the strong connection between the estimator and its unobservable version in terms of the choice of the bandwidth.     

Information dependency: Strong consistency of Darbellay–Vajda partition estimators

The Darbellay–Vajda partition scheme is a well known method to estimate the information dependency. This estimator belongs to a class of data-dependent partition estimators. We would like to prove that with some simple conditions, the Darbellay–Vajda partition estimator is a strong consistency for the information dependency estimation of a bivariate random vector. This result is an extension of 20 and 21 work which gives some simple conditions to confirm that the Gessaman's partition estimator and the tree-quantization partition estimator, other estimators in the class of data-dependent partition estimators, are strongly consistent.     

Nonparametric bayes estimation of the survival function from a record of failures and follow-ups

In some observational studies, we have random censoring model. However, the data available may be partially observable censored data consisting of the observed failure times and only those nonfailure times which are subject to follow-up. Suzuki (1985) discussed the problem of nonparametric estimation of the survival function from such partially observable censored data. In this article, we derive a nonparametric Bayes estimator of the survival function for such data of failures and follow-ups under a Dirichlet process prior and squared error loss. The limiting properties such as the mean square consistency, weak convergence and strong consistency of the Bayes estimator are studied. Finally, the procedures developed are illustrated by means of an example.     

Second-order least squares estimation of censored regression models

This paper proposes the second-order least squares estimation, which is an extension of the ordinary least squares method, for censored regression models where the error term has a general parametric distribution (not necessarily normal). The strong consistency and asymptotic normality of the estimator are derived under fairly general regularity conditions. We also propose a computationally simpler estimator which is consistent and asymptotically normal under the same regularity conditions. Finite sample behavior of the proposed estimators under both correctly and misspecified models are investigated through Monte Carlo simulations. The simulation results show that the proposed estimator using optimal weighting matrix performs very similar to the maximum likelihood estimator, and the estimator with the identity weight is more robust against the misspecification.     

On Nonparametric Maximum Likelihood Estimations of Multivariate Distribution Function Based on Interval-Censored Data

This article considers the nonparametric maximum likelihood estimator (NPMLE) of a joint distribution function when the multivariate failure times of interest are interval-censored. With different types of interval censoring mechanism, the NPMLE's of the multivariate distribution function are studied and the strong consistency for the NPMLEs is obtained in terms of a self-consistency equation. Furthermore, the convergence rate of the estimator is given, which depends on the types of interval censoring mechanism.     

Strong uniform consistency results of the weighted average of conditional artificial data points

In this paper, we study strong uniform consistency of a weighted average of artificial data points. This is especially useful when information is incomplete (censored data, missing data …). In this case, reconstruction of the information is often achieved nonparametrically by using a local preservation of mean criterion for which the corresponding mean is estimated by a weighted average of new data points. The present approach enlarges the possible scope for applications beyond just the incomplete data context and can also be useful to treat the estimation of the conditional mean of specific functions of complete data points. As a consequence, we establish the strong uniform consistency of the Nadaraya–Watson [Nadaraya, E.A., 1964. On estimating regression. Theory Probab. Appl. 9, 141–142; Watson, G.S., 1964. Smooth regression analysis. Sankhyā Ser. A 26, 359–372] estimator for general transformations of the data points. This result generalizes the one of Härdle et al. [Strong uniform consistency rates for estimators of conditional functionals. Ann. Statist. 16, 1428–1449]. In addition, the strong uniform consistency of a modulus of continuity will be obtained for this estimator. Applications of those two results are detailed for some popular estimators.