Adaptive wavelet estimation of a density from mixtures under multiplicative censoring

In this paper, a mixture model under multiplicative censoring is considered. We investigate the estimation of a component of the mixture (a density) from the observations. A new adaptive estimator based on wavelets and a hard thresholding rule is constructed for this problem. Under mild assumptions on the model, we study its asymptotic properties by determining an upper bound of the mean integrated squared error over a wide range of Besov balls. We prove that the obtained upper bound is sharp.     

Periodograms asymptotic distributions in periodically correlated processes and multivariate stationary processes: An alternative approach

Discrete time periodically correlated (PC) processes are viewed as the processes with time-dependent spectra. This, together with an auxiliary operator which is defined here is employed to apply classical results on the asymptotic distribution of the periodogram of the univariate white noise (innovations) to derive the asymptotic distributions of the periodograms for the PC processes and also for the multivariate stationary processes. We assume only the continuity and positive definiteness of the spectral densities together with the independence of the innovations.     

New aspects of Bregman divergence in regression and classification with parametric and nonparametric estimation

In statistical learning, regression and classification concern different types of the output variables, and the predictive accuracy is quantified by different loss functions. This article explores new aspects of Bregman divergence (BD), a notion which unifies nearly all of the commonly used loss functions in regression and classification. The authors investigate the duality between BD and its generating function. They further establish, under the framework of BD, asymptotic consistency and normality of parametric and nonparametric regression estimators, derive the lower bound of their asymptotic covariance matrices, and demonstrate the role that parametric and nonparametric regression estimation play in the performance of classification procedures and related machine learning techniques. These theoretical results and new numerical evidence show that the choice of loss function affects estimation procedures, whereas has an asymptotically relatively negligible impact on classification performance. Applications of BD to statistical model building and selection with non‐Gaussian responses are also illustrated. The Canadian Journal of Statistics 37: 119‐139; 2009 © 2009 Statistical Society of Canada     

A nonparametric repeated significance test with adaptive target sample size

In this article a general result is derived that, along with a functional central limit theorem for a sequence of statistics, can be employed in developing a nonparametric repeated significance test with adaptive target sample size. This method is used in deriving a repeated significance test with adaptive target sample size for the shift model. The repeated significance test is based on a functional central limit theorem for a sequence of partial sums of truncated observations. Based on numerical results presented in this article one can conclude that this nonparametric sequential test performs quite well.     

Lifetesting and estimation with arbitrary distribution function

We consider the problem of estimating the life–distribution F from censored lifetimes. The observation scheme is renewal testing over a long time horizon although the results can apply to survival testing with repetitions. We exhibit a product–limit estimator of F which is shown to be consistent and to converge weakly to a GAUSsian process. To do this we first extend these properties of the NELSON-AALEN martingale estimator to the family of PoissoN–type counting processes. Our proof of weak convergence is based on the general functional central limit theorems for semimartingales as developed by .JACOB, SHIRYAYEV and others     

Invalidity of average squared error criterion in density estimation

The average squared error has been suggested earlier as an appropriate estimate of the integrated squared error, but an example is given which shows their ratio can tend to infinity. The results of a Monte Carlo study are also presented which suggest the average squared error can seriously underestimate the errors inherent in even the simplest density estimations.     

Improved orthogonal polynomial density estimates

Density estimates that are expressible as the product of a base density function and a linear combination of orthogonal polynomials are considered in this paper. More specifically, two criteria are proposed for determining the number of terms to be included in the polynomial adjustment component and guidelines are suggested for the selection of a suitable base density function. A simulation study reveals that these stopping rules produce density estimates that are generally more accurate than kernel density estimates or those resulting from the application of the Kronmal–Tarter criterion. Additionally, it is explained that the same approach can be utilized to obtain multivariate density estimates. The proposed orthogonal polynomial density estimation methodology is applied to several univariate and bivariate data sets, some of which have served as benchmarks in the statistical literature on density estimation.     

Probability density estimation with data missing at random when covariables are present

This paper addresses the problem of the probability density estimation in the presence of covariates when data are missing at random (MAR). The inverse probability weighted method is used to define a nonparametric and a semiparametric weighted probability density estimators. A regression calibration technique is also used to define an imputed estimator. It is shown that all the estimators are asymptotically normal with the same asymptotic variance as that of the inverse probability weighted estimator with known selection probability function and weights. Also, we establish the mean squared error (MSE) bounds and obtain the MSE convergence rates. A simulation is carried out to assess the proposed estimators in terms of the bias and standard error.     

Multivariate spatial U-quantiles: A Bahadur–Kiefer representation,a Theil–Sen estimator for multiple regression,and a robust dispersion estimator

A leading multivariate extension of the univariate quantiles is the so-called “spatial” or “geometric” notion, for which sample versions are highly robust and conveniently satisfy a Bahadur–Kiefer representation. Another extension of univariate quantiles has been to univariate U-quantiles, on the basis of which, for example, the well-known Hodges–Lehmann location estimator has a natural formulation. Generalizing both extensions, we introduce multivariate spatial U-quantiles and develop a corresponding Bahadur–Kiefer representation. New statistics based on spatial U-quantiles are presented for nonparametric estimation of multiple regression coefficients, extending the classical Theil–Sen nonparametric simple linear regression slope estimator, and for robust estimation of multivariate dispersion. Some other applications are mentioned as well.     

Confidence bands for ROC curves

We develop two methods to construct confidence bands for the receiver operating characteristic (ROC) curve without estimating the densities of the underlying distributions. The first method is based on the smoothed bootstrap while the second method uses the Bonferroni inequality. As an illustration, we provide confidence bands for the ROC curve using data on Duchanne Muscular Dystrophy.     

Bernstein conditional density estimation with application to conditional distribution and regression functions

In this paper we propose a smooth nonparametric estimation for the conditional probability density function based on a Bernstein polynomial representation. Our estimator can be written as a finite mixture of beta densities with data-driven weights. Using the Bernstein estimator of the conditional density function, we derive new estimators for the distribution function and conditional mean. We establish the asymptotic properties of the proposed estimators, by proving their asymptotic normality and by providing their asymptotic bias and variance. Simulation results suggest that the proposed estimators can outperform the Nadaraya–Watson estimator and, in some specific setups, the local linear kernel estimators. Finally, we use our estimators for modeling the income in Italy, conditional on year from 1951 to 1998, and have another look at the well known Old Faithful Geyser data.     

Analysis of supersaturated designs via the Dantzig selector

A supersaturated design is a design whose run size is not enough for estimating all the main effects. It is commonly used in screening experiments, where the goals are to identify sparse and dominant active factors with low cost. In this paper, we study a variable selection method via the Dantzig selector, proposed by Candes and Tao [2007. The Dantzig selector: statistical estimation when p$p$ is much larger than n$n$. Annals of Statistics 35, 2313–2351], to screen important effects. A graphical procedure and an automated procedure are suggested to accompany with the method. Simulation shows that this method performs well compared to existing methods in the literature and is more efficient at estimating the model size.     

Limit behaviors of the estimator of nonparametric regression model based on martingale difference errors

In the paper, we shall establish some limit theorems for the nonparametric estimator of the regression model, which include $L^p$-convergence, complete convergence, and strong convergence of the estimator. These results supplement and improve some known works.     

Projection estimation capacity of Hadamard designs

In a screening design, often only a few factors among a large number of potential factors are significantly important. Usually, it is not known which factors will be important ones. Thus, it is of practical interest to know if each projection of a design onto a small subset of factors is able to entertain and estimate all two-factor-interactions along with its main effects, assuming higher order interactions are negligible. In this paper, we investigate the estimation capacity of projections of Hadamard designs with run size up to 60. Possible applications of our results to robust parameter designs are also discussed.