A consistent nonparametric density estimator for the deconvolution problem

The problem of nonparametric estimation of a probability density function when the sample observations are contaminated with random noise is studied. A particular estimator f?_n(x) is proposed which uses kernel-density and deconvolution techniques. The estimator f?_n(x) is shown to be uniformly consistent, and its appearance and properties are affected by constants M_n and h_n which the user may choose. The optimal choices of M_n and h_n depend on the sample size n, the noise distribution, and the true distribution which is being estimated. Particular selections for M_n and h_n which minimize upper-bound functions of the mean squared error for f?_n(x) are recommended.     

Consistency and Normality of M-Estimators in Partly Linear Models with Stochastic Adapted Errors

The robust M-estimators for the partly linear model under stochastic adapted errors are considered. It is shown that the M-estimator of parameter is asymptotically normal and the M-estimator of the nonparametric function achieves the optimal rate of convergence for nonparametric regression. Some known results are improved and generalized. Some simulations and a real data example are conducted to illustrate the proposed method.     

A New Test for New Better Than Used in Expectation Lifetimes

The mean residual life of a non negative random variable X with a finite mean is defined by M(t) = E[X ? t|X > t] for t ? 0. A popular nonparametric model of aging is new better than used in expectation (NBUE), when M(t) ? M(0) for all t ? 0. The exponential distribution lies at the boundary. There is a large literature on testing exponentiality against NBUE alternatives. However, comparisons of tests have been made only for alternatives much stronger than NBUE. We show that a new Kolmogorov-Smirnov type test is much more powerful than its competitors in most cases.     

Minimum hellinger distance estimation for normal models

A robust estimator introduced by Beran (1977a, 1977b), which is based on the minimum Hellinger distance between a projection model density and a nonparametric sample density, is studied empirically. An extensive simulation provides an estimate of the small sample distribution and supplies empirical evidence of the estimator performance for a normal location-scale model. While the performance of the minimum Hellinger distance estimator is seen to be competitive with the maximum likelihood estimator at the true model, its robustness to deviations from normality is shown to be competitive in this setting with that obtained from the M-estimator and the Cramér-von Mises minimum distance estimator. Beran also introduced a goodness-of-fit statisticH ₂, based on the minimized Hellinger distance between a member of a parametric family of densities and a nonparametric density estimate. We investigate the statistic H (the square root of H ₂) as a test for normality when both location and scale are unspecified. Empirically derived critical values are given which do not require extensive tables. The power of the statistic H compares favorably with four other widely used tests for normality.     

Robust kernel estimators for additive models with dependent observations

Robust nonparametric estimators for additive regression or autoregression models under an α-mixing condition are proposed. They are based on local M-estimators or local medians with kernel weights, and their asymptotic behaviour is studied. Moreover, diese local M-estimators achieve the same univariate rate of convergence as their linear relatives.     

A model-averaging approach for smoothing spline regression

ABSTRACT

This article considers nonparametric regression problems and develops a model-averaging procedure for smoothing spline regression problems. Unlike most smoothing parameter selection studies determining an optimum smoothing parameter, our focus here is on the prediction accuracy for the true conditional mean of Y given a predictor X. Our method consists of two steps. The first step is to construct a class of smoothing spline regression models based on nonparametric bootstrap samples, each with an appropriate smoothing parameter. The second step is to average bootstrap smoothing spline estimates of different smoothness to form a final improved estimate. To minimize the prediction error, we estimate the model weights using a delete-one-out cross-validation procedure. A simulation study has been performed by using a program written in R. The simulation study provides a comparison of the most well known cross-validation (CV), generalized cross-validation (GCV), and the proposed method. This new method is straightforward to implement, and gives reliable performances in simulations.     

Asymptotic Normality of M-Estimators for Varying Coefficient Models with Longitudinal Data

This article considers a nonparametric varying coefficient regression model with longitudinal observations. The relationship between the dependent variable and the covariates is assumed to be linear at a specific time point, but the coefficients are allowed to change over time. A general formulation is used to treat mean regression, median regression, quantile regression, and robust mean regression in one setting. The local M-estimators of the unknown coefficient functions are obtained by local linear method. The asymptotic distributions of M-estimators of unknown coefficient functions at both interior and boundary points are established. Various applications of the main results, including estimating conditional quantile coefficient functions and robustifying the mean regression coefficient functions are derived. Finite sample properties of our procedures are studied through Monte Carlo simulations.     

A lower bound to the measure of optimality for main effect plans in the general asymmetric factorial experiments

A design d is called D-optimal if it maximizes det(M _d ) and is called MS-optimal if it maximizes tr(M _d ) and minimizes tr[(M _d )²] among those which maximize tr(M _d ), where M _d stands for the information matrix produced from d under a given model. In this paper, we establish a lower bound for tr[(M _d )²] with respect to a main effects model, where d is an s ₁×s ₂×···×s _m levels asymmetric orthogonal array of strength at least 1. Nonisomorphic asymmetrical MS-optimal orthogonal arrays of strength 1 with N=6, 8 and 12 runs are also presented.     

A Lower Bound to the Measure of Optimality for Main Effect Plans in the Symmetric Factorial Experiments

A design d is called D-optimal if it maximizes det(M _d ), and is called MS-optimal if it maximizes tr(M _d ) and minimizes tr[(M _d )²] among those which maximize tr(M _d ), where M _d stands for the information matrix produced from d under a given model. In this article, we establish a lower bound for tr[(M _d )²] with respect to a main effects model, where d is an s-level symmetric orthogonal array of strength at least one. Non isomorphic two level MS-optimal orthogonal arrays of strength one with N = 10, 14, and 18 runs, non isomorphic three level MS-optimal orthogonal arrays of strength one with N = 6, 12, and 15 runs and non isomorphic four level MS-optimal orthogonal arrays of strength one with N = 12 runs are also presented.     

Nonparametric density estimation for censored survival data: Regression-spline approach

A method for nonparametric estimation of density based on a randomly censored sample is presented. The density is expressed as a linear combination of cubic M -splines, and the coefficients are determined by pseudo-maximum-likelihood estimation (likelihood is maximized conditionally on data-dependent knots). By using regression splines (small number of knots) it is possible to reduce the estimation problem to a space of low dimension while preserving flexibility, thus striking a compromise between parametric approaches and ordinary nonparametric approaches based on spline smoothing. The number of knots is determined by the minimum AIC. Examples of simulated and real data are presented. Asymptotic theory and the bootstrap indicate that the precision and the accuracy of the estimates are satisfactory.     

Small-Sample Quantile Estimators in a Large Nonparametric Model

The large nonparametric model in this note is a statistical model with the family ? of all continuous and strictly increasing distribution functions. In the abundant literature of the subject, there are many proposals for nonparametric estimators that are applicable in the model. Typically the kth order statistic X _k:n is taken as a simplest estimator, with k = [nq], or k = [(n + 1)q], or k = [nq] + 1, etc. Often a linear combination of two consecutive order statistics is considered. In more sophisticated constructions, different L-statistics (e.g., Harrel–Davis, Kaigh–Lachenbruch, Bernstein, kernel estimators) are proposed. Asymptotically the estimators do not differ substantially, but if the sample size n is fixed, which is the case of our concern, differences may be serious. A unified treatment of quantile estimators in the large, nonparametric statistical model is developed.     

A Note on Asymptotic Behavior of the Nonparametric Density Estimators in Multivariate Mixtures

The asymptotic behavior of the nonparametric density estimator has been given for a multivariate mixture model. It has been observed that the estimator is asymptotically normally distributed with bias of size h ² and variance of size (nh)^?1.     

A plug-in technique in nonparametric regression with dependence

The problem addressed is that of smoothing parameter selection in kernel nonparametric regression in the fixed design regression model with dependent noise. An asymptotic expression of the optimum bandwidth parameter has been obtained in recent studies, where this takes the form h = C ₀ n ^?1/5. This paper proposes to use a plug-in methodology, in order to obtain an optimum estimation of the bandwidth parameter, through preliminary estimation of the unknown value of C ₀.     

Robust estimation and wavelet thresholding in partially linear models

This paper is concerned with a semiparametric partially linear regression model with unknown regression coefficients, an unknown nonparametric function for the non-linear component, and unobservable Gaussian distributed random errors. We present a wavelet thresholding based estimation procedure to estimate the components of the partial linear model by establishing a connection between an l ₁-penalty based wavelet estimator of the nonparametric component and Huber’s M-estimation of a standard linear model with outliers. Some general results on the large sample properties of the estimates of both the parametric and the nonparametric part of the model are established. Simulations are used to illustrate the general results and to compare the proposed methodology with other methods available in the recent literature.     

Constrained nonparametric maximum-likelihood estimation for mixture models

A nonparametric mixture model specifies that observations arise from a mixture distribution, ∫ f(x, θ) dG(θ), where the mixing distribution G is completely unspecified. A number of algorithms have been developed to obtain unconstrained maximum-likelihood estimates of G, but none of these algorithms lead to estimates when functional constraints are present. In many cases, there is a natural interest in functional ?(G), such as the mean and variance, of the mixing distribution, and profile likelihoods and confidence intervals for ?(G) are desired. In this paper we develop a penalized generalization of the ISDM algorithm of Kalbfleisch and Lesperance (1992) that can be used to solve the problem of constrained estimation. We also discuss its use in various different applications. Convergence results and numerical examples are given for the generalized ISDM algorithm, and asymptotic results are developed for the likelihood-ratio test statistics in the multinomial case.     

A new test for decreasing mean residual lifetimes

The mean residual life of a non negative random variable X with a finite mean is defined by M(t) = E[X ? t|X > t] for t ? 0. One model of aging is the decreasing mean residual life (DMRL): M is decreasing (non increasing) in time. It vastly generalizes the more stringent model of increasing failure rate (IFR). The exponential distribution lies at the boundary of both of these classes. There is a large literature on testing exponentiality against DMRL alternatives which are all of the integral type. Because most parametric families of DMRL distributions are IFR, their relative merits have been compared only at some IFR alternatives. We introduce a new Kolmogorov–Smirnov type sup-test and derive its asymptotic properties. We compare the powers of this test with some integral tests by simulations using a class of DMRL, but not IFR alternatives, as well as some popular IFR alternatives. The results show that the sup-test is much more powerful than the integral tests in all cases.     

Automatic bandwidth selection for modified m-smoother ∗

Traditional parametric and nonparametric regression techniques encounter serious over smoothing problems when jump point discontinuities exist in the underlying mean function. Recently, Chu, Glad, Godtliebsen and Marron (1998) developed a method using a modified M-smoothing technique to preserve jumps and spikes while producing a smooth estimate of the mean function. The performance of Chu etal.'s (1998) method is quite sensitive to the choice of the required bandwidths g and h. Furthermore, it is not obvious how to extend certain commonly used automatic bandwidth selection procedures when jumps and spikes are present. In this paper we propose a rule of thumb method of choosing the smoothing parameters based on asymptotic optimal bandwidth formulas and robust estimates of unknown quantities. We also evaluate the proposed bandwidth selection method via a small simulation study.     

A simple test for comparing regression curves versus one-sided alternatives

In this article we present a simple procedure to test for the null hypothesis of equality of two regression curves versus one-sided alternatives in a general nonparametric and heteroscedastic setup. The test is based on the comparison of the sample averages of the estimated residuals in each regression model under the null hypothesis. The test statistic has asymptotic normal distribution and can detect any local alternative of rate n^-1/2. Some simulations and an application to a data set are included.     

Finite mixtures of natural exponential families

Let μ be a positive measure concentrated on R⁺ generating a natural exponential family (NEF) F with quadratic variance function V_F(m), m being the mean parameter of F. It is shown that v(dx) = (γ+x)μ(γ ≥ 0) (γ ≥ 0) generates a NEF G whose variance function is of the form l(m)Δ+cΔ(m), where l(m) is an affine function of m, Δ(m) is a polynomial in m (the mean of G) of degree 2, and c is a constant. The family G turns out to be a finite mixture of F and its length-biased family. We also examine the cases when F has cubic variance function and show that for suitable choices of γ the family G has variance function of the form P(m) + Q(m)m where P, Q are polynomials in m of degree m2 while Δ is an affine function of m. Finally we extend the idea to two dimensions by considering a bivariate Poisson and bivariate gamma mixture distribution.     

A Bayesian nonparametric estimator based on left censored data

Summary This paper introduces a Bayesian nonparametric estimator for an unknown distribution function based on left censored observations. Hjort (1990)/Lo (1993) introduced Bayesian nonparametric estimators derived from beta/beta-neutral processes which allow for right censoring. These processes are taken as priors from the class ofneutral to the right processes (Doksum, 1974). The Kaplan-Meier nonparametric product limit estimator can be obtained from these Bayesian nonparametric estimators in the limiting case of a vague prior. The present paper introduces what can be seen as the correspondingleft beta/beta-neutral process prior which allow for left censoring. The Bayesian nonparametyric estimator is obtained as in the corresponding product limit estimator based on left censored data.