On boundary correction in kernel density estimation

It is well known now that kernel density estimators are not consistent when estimating a density near the finite end points of the support of the density to be estimated. This is due to boundary effects that occur in nonparametric curve estimation problems. A number of proposals have been made in the kernel density estimation context with some success. As of yet there appears to be no single dominating solution that corrects the boundary problem for all shapes of densities. In this paper, we propose a new general method of boundary correction for univariate kernel density estimation. The proposed method generates a class of boundary corrected estimators. They all possess desirable properties such as local adaptivity and non-negativity. In simulation, it is observed that the proposed method perform quite well when compared with other existing methods available in the literature for most shapes of densities, showing a very important robustness property of the method. The theory behind the new approach and the bias and variance of the proposed estimators are given. Results of a data analysis are also given.     

Boundary and Bias Correction in Kernel Hazard Estimation

A new class of local linear hazard estimators based on weighted least square kernel estimation is considered. The class includes the kernel hazard estimator of Ramlau-Hansen (1983), which has the same boundary correction property as the local linear regression estimator (see Fan & Gijbels, 1996). It is shown that all the local linear estimators in the class have the same pointwise asymptotic properties. We derive the multiplicative bias correction of the local linear estimator. In addition we propose a new bias correction technique based on bootstrap estimation of additive bias. This latter method has excellent theoretical properties. Based on an extensive simulation study where we compare the performance of competing estimators, we also recommend the use of the additive bias correction in applied work.     

An estimator of a conditional quantile in the presence of auxiliary information

In this paper, a new estimator for a conditional quantile is proposed by using the empirical likelihood method and local linear fitting when some auxiliary information is available. The asymptotic normality of the estimator at both boundary and interior points is established. It is shown that the asymptotic variance of the proposed estimator is smaller than those of the usual kernel estimators at interior points, and that the proposed estimator has the desired sampling properties at both boundary and interior points. Therefore, no boundary modifications are required in our estimation.     

A locally adaptive transformation method of boundary correction in kernel density estimation

Kernel smoothing methods are widely used in many research areas in statistics. However, kernel estimators suffer from boundary effects when the support of the function to be estimated has finite endpoints. Boundary effects seriously affect the overall performance of the estimator. In this article, we propose a new method of boundary correction for univariate kernel density estimation. Our technique is based on a data transformation that depends on the point of estimation. The proposed method possesses desirable properties such as local adaptivity and non-negativity. Furthermore, unlike many other transformation methods available, the proposed estimator is easy to implement. In a Monte Carlo study, the accuracy of the proposed estimator is numerically analyzed and compared with the existing methods of boundary correction. We find that it performs well for most shapes of densities. The theory behind the new methodology, along with the bias and variance of the proposed estimator, are presented. Results of a data analysis are also given.     

Statistical inference in the partial linear models with the inverse gaussian kernel

Symmetric kernel smoothing is commonly used in estimating the nonparametric component in the partial linear regression models. In this article, we propose a new estimation method for the partial linear regression models using the inverse Gaussian kernel when the explanatory variable of the nonparametric component is non-negatively supported. As an asymmetric kernel function, the inverse Gaussian kernel is also supported on the non-negative half line. The asymptotic properties, including the asymptotic normality, uniform almost sure convergence, and the iterated logarithm laws, of the proposed estimators are thoroughly discussed for both homoscedastic and heteroscedastic cases. The simulation study is conducted to evaluate the finite sample performance of the proposed estimators.     

Semiparametric estimation for count data through weighted distributions

This paper is concerned with semiparametric discrete kernel estimators when the unknown count distribution can be considered to have a general weighted Poisson form. The estimator is constructed by multiplying the Poisson estimate with a nonparametric discrete kernel-type estimate of the Poisson weight function. Comparisons are then carried out with the ordinary discrete kernel probability mass function estimators. The Poisson weight function is thus a local multiplicative correction factor, and is considered as the uniform measure to detect departures from the equidispersed Poisson distribution. In this way, the effects of dispersion and zero-proportion with respect to the standard Poisson distribution are also minimized. This method of estimation is also applied to the weighted binomial form for the count distribution having a finite support. The proposed estimators, in addition to being simple, easy-to-implement and effective, also outperform the competing nonparametric and parametric estimators in finite-sample situations. Two examples illustrate this new semiparametric estimation.     

Estimating the parameters of a doubly truncated normal distribution

This paper deals with the maximum likelihood estimation of parameters for a doubly truncated normal distribution when the truncation points are known. We prove, in this case, that the MLEs are nonexistent (become infinite) with positive probability. For estimators that exist with probability one, the class of Bayes modal estimators or modified maximum likelihood estimators is explored. Another useful estimating procedure, called mixed estimation, is proposed. Simulations compare the behavior of the MLEs, the modified MLEs, and the mixed estimators which reveal that the MLE, in addition to being nonexistent with positive probability, behaves poorly near the upper boundary of the interval of its existence. The modified MLEs and the mixed estimators are seen to be remarkably better than the MLE     

Non Parametric Estimation of Second-Order Diffusion Equation by Using Asymmetric Kernels

In this paper, we study the non parametric estimation of drift coefficient and diffusion coefficient in the second-order diffusion equation by using the asymmetric kernel functions, based on the difference of discrete time observations. The basic idea relies upon replacing the symmetric kernel by asymmetric kernel and provides a new way of obtaining the non parametric estimation for second-order diffusion equation. Under the appropriate assumptions, we prove that the proposed estimators of second-order diffusion equation are consistent and asymptotically follow normal distribution.     

On the Local Polynomial Estimators of the Counting Process Intensity Function and its Derivatives

Abstract. We consider the properties of the local polynomial estimators of a counting process intensity function and its derivatives. By expressing the local polynomial estimators in a kernel smoothing form via effective kernels, we show that the bias and variance of the estimators at boundary points are of the same magnitude as at interior points and therefore the local polynomial estimators in the context of intensity estimation also enjoy the automatic boundary correction property as they do in other contexts such as regression. The asymptotically optimal bandwidths and optimal kernel functions are obtained through the asymptotic expressions of the mean square error of the estimators. For practical purpose, we suggest an effective and easy‐to‐calculate data‐driven bandwidth selector. Simulation studies are carried out to assess the performance of the local polynomial estimators and the proposed bandwidth selector. The estimators and the bandwidth selector are applied to estimate the rate of aftershocks of the Sichuan earthquake and the rate of the Personal Emergency Link calls in Hong Kong.     

Density estimation using asymmetric kernels and Bayes bandwidths with censored data

We propose a modification to the regular kernel density estimation method that use asymmetric kernels to circumvent the spill over problem for densities with positive support. First a pivoting method is introduced for placement of the data relative to the kernel function. This yields a strongly consistent density estimator that integrates to one for each fixed bandwidth in contrast to most density estimators based on asymmetric kernels proposed in the literature. Then a data-driven Bayesian local bandwidth selection method is presented and lognormal, gamma, Weibull and inverse Gaussian kernels are discussed as useful special cases. Simulation results and a real-data example illustrate the advantages of the new methodology.     

Subsampling quantile estimators and uniformity criteria

Several asymptotically equivalent quantile estimators recently have been proposed as alternative to the conventional sample quantile. A variety of weight functions have been obtained either by subsampling considerations or by a kernel approach, analogous to density estimation techniques. Focusing on the former approach, a unified treatment of quantile estimators derived by subsampling is developed. Closely related to the generalized Harrell-Davis (HD) and Kaigh-Lachenbruch (KL) estimators, a new statistic performed well in Monte Carlo effiency comparisons presented here. Moreover, the new estimator shares certain desirable computational and finite-sample theeoretical properties with the KL estimator to yield convenient components representations for tests of uniformity and goodness-of-fit criteria. Similar analytic treatment for the HD statistics and kernel quantile estimators, however, is precluded by intractable eigenvalue problems.     

A minimum variance kernel estimator and a discrete frequency polygon estimator for ordinal contingency tables

This paper introduces two estimators, a boundary corrected minimum variance kernel estimator based on a uniform kernel and a discrete frequency polygon estimator, for the cell probabilities of ordinal contingency tables. Simulation results show that the minimum variance boundary kernel estimator has a smaller average sum of squared error than the existing boundary kernel estimators. The discrete frequency polygon estimator is simple and easy to interpret, and it is competitive with the minimum variance boundary kernel estimator. It is proved that both estimators have an optimal rate of convergence in terms of mean sum of squared error, The estimators are also defined for high-dimensional tables.     

An Adaptive Two-stage Estimation Method for Additive Models

Abstract.  In this paper, a two-stage estimation method for non-parametric additive models is investigated. Differing from Horowitz and Mammen's two-stage estimation, our first-stage estimators are designed not only for dimension reduction but also as initial approximations to all of the additive components. The second-stage estimators are obtained by using one-dimensional non-parametric techniques to refine the first-stage ones. From this procedure, we can reveal a relationship between the regression function spaces and convergence rate, and then provide estimators that are optimal in the sense that, better than the usual one-dimensional mean-squared error (MSE) of the order n ^−4/5 , the MSE of the order n ^{− 1} can be achieved when the underlying models are actually parametric. This shows that our estimation procedure is adaptive in a certain sense. Also it is proved that the bandwidth that is selected by cross-validation depends only on one-dimensional kernel estimation and maintains the asymptotic optimality. Simulation studies show that the new estimators of the regression function and all components outperform the existing estimators, and their behaviours are often similar to that of the oracle estimator.     

Nonlinear semiparametric AR(1) model with skew-symmetric innovations

In this paper, we expand a first-order nonlinear autoregressive (AR) model with skew normal innovations. A semiparametric method is proposed to estimate a nonlinear part of model by using the conditional least squares method for parametric estimation and the nonparametric kernel approach for the AR adjustment estimation. Then computational techniques for parameter estimation are carried out by the maximum likelihood (ML) approach using Expectation-Maximization (EM) type optimization and the explicit iterative form for the ML estimators are obtained. Furthermore, in a simulation study and a real application, the accuracy of the proposed methods is verified.     

On multivariate associated kernels to estimate general density functions

Multivariate associated kernel estimators, which depend on both target point and bandwidth matrix, are appropriate for distributions with partially or totally bounded supports and generalize the classical ones such as the Gaussian. Previous studies on multivariate associated kernels have been restricted to products of univariate associated kernels, also considered having diagonal bandwidth matrices. However, it has been shown in classical cases that, for certain forms of target density such as multimodal ones, the use of full bandwidth matrices offers the potential for significantly improved density estimation. In this paper, general associated kernel estimators with correlation structure are introduced. Asymptotic properties of these estimators are presented; in particular, the boundary bias is investigated. Generalized bivariate beta kernels are handled in more details. The associated kernel with a correlation structure is built with a variant of the mode-dispersion method and two families of bandwidth matrices are discussed using the least squared cross validation method. Simulation studies are done. In the particular situation of bivariate beta kernels, a very good performance of associated kernel estimators with correlation structure is observed compared to the diagonal case. Finally, an illustration on a real dataset of paired rates in a framework of political elections is presented.     

Nonparametric Quantile Estimation with Correlated Failure Time Data

In biomedical studies, correlated failure time data arise often. Although point and confidence interval estimation for quantiles with independent censored failure time data have been extensively studied, estimation for quantiles with correlated failure time data has not been developed. In this article, we propose a nonparametric estimation method for quantiles with correlated failure time data. We derive the asymptotic properties of the quantile estimator and propose confidence interval estimators based on the bootstrap and kernel smoothing methods. Simulation studies are carried out to investigate the finite sample properties of the proposed estimators. Finally, we illustrate the proposed method with a data set from a study of patients with otitis media.     

A new class of boundary kernels for distribution function estimation

In this note we introduce a new class of boundary kernels for distribution function estimation which shows itself to be especially performing when the classical kernel distribution function estimator suffers from severe boundary problems.     

Multiple-output quantile regression through optimal quantization

A new nonparametric quantile regression method based on the concept of optimal quantization was developed recently and was showed to provide estimators that often dominate their classical, kernel-type, competitors. In the present work, we extend this method to multiple-output regression problems. We show how quantization allows approximating population multiple-output regression quantiles based on halfspace depth. We prove that this approximation becomes arbitrarily accurate as the size of the quantization grid goes to infinity. We also derive a weak consistency result for a sample version of the proposed regression quantiles. Through simulations, we compare the performances of our estimators with (local constant and local bilinear) kernel competitors. The results reveal that the proposed quantization-based estimators, which are local constant in nature, outperform their kernel counterparts and even often dominate their local bilinear kernel competitors. The various approaches are also compared on artificial and real data.     

The stochastic approximation method for the estimation of a multivariate probability density

We apply the stochastic approximation method to construct a large class of recursive kernel estimators of a probability density, including the one introduced by Hall and Patil [1994. On the efficiency of on-line density estimators. IEEE Trans. Inform. Theory 40, 1504–1512]. We study the properties of these estimators and compare them with Rosenblatt's nonrecursive estimator. It turns out that, for pointwise estimation, it is preferable to use the nonrecursive Rosenblatt's kernel estimator rather than any recursive estimator. A contrario, for estimation by confidence intervals, it is better to use a recursive estimator rather than Rosenblatt's estimator.     

A Note on Support Vector Density Estimation for the Deconvolution Problem

The problem of support vector density estimation is studied when the sample observations are contaminated with random noise. A procedure based on support vector method and the Fourier transform is presented and is compared with kernel density estimators by the simulation study.