Estimators Based on Data‐Driven Generalized Weighted Cramér‐von Mises Distances under Censoring – with Applications to Mixture Models

Abstract. Estimators based on data‐driven generalized weighted Cramér‐von Mises distances are defined for data that are subject to a possible right censorship. The function used to measure the distance between the data, summarized by the Kaplan–Meier estimator, and the target model is allowed to depend on the sample size and, for example, on the number of censored items. It is shown that the estimators are consistent and asymptotically multivariate normal for every p dimensional parametric family fulfiling some mild regularity conditions. The results are applied to finite mixtures. Simulation results for finite mixtures indicate that the estimators are useful for moderate sample sizes. Furthermore, the simulation results reveal the usefulness of sample size dependent and censoring sensitive distance functions for moderate sample sizes. Moreover, the estimators for the mixing proportion seem to be fairly robust against a ‘symmetric’ contamination model even when censoring is present.     

An Empirical Process View of Inverse Regression

A common approach taken in high‐dimensional regression analysis is sliced inverse regression, which separates the range of the response variable into non‐overlapping regions, called ‘slices’. Asymptotic results are usually shown assuming that the slices are fixed, while in practice, estimators are computed with random slices containing the same number of observations. Based on empirical process theory, we present a unified theoretical framework to study these techniques, and revisit popular inverse regression estimators. Furthermore, we introduce a bootstrap methodology that reproduces the laws of Cramér–von Mises test statistics of interest to model dimension, effects of specified covariates and whether or not a sliced inverse regression estimator is appropriate. Finally, we investigate the accuracy of different bootstrap procedures by means of simulations.     

A comparison of estimators of the degree of insect control

The current estimator of the degree of insect control by an insecticide in a field experiment laid out in randomized blocks is equal to one minus the cross-product ratio of a two way table of total insect counts over blocks. Since much work has been done on estimation of the common odds ratio of a number of strata in medical studies, a series of Monte Carlo studies was performed to investigate the possible use of these estimators and their standard errors in estimating the common degree of inject control of a number of blocks. Maximum likelihood, Mantel-Haenszel, and empirical logit estimators were evaluated and compared with back-transformed means over blocks, of cross-product ratios on the arithmetic, logarithmic, and arcsine scales. Maximum likelihood and Mantel-Haenszel estimators had the smallest mean squared errors, but their standard error estimates were only appropriate when sampling distributions were approximately Poisson and there was little heterogeneity among plots within blocks in the natural rates of population change.     

Inference for Multi‐dimensional High‐frequency Data with an Application to Conditional Independence Testing

We find the asymptotic distribution of the multi‐dimensional multi‐scale and kernel estimators for high‐frequency financial data with microstructure. Sampling times are allowed to be asynchronous and endogenous. In the process, we show that the classes of multi‐scale and kernel estimators for smoothing noise perturbation are asymptotically equivalent in the sense of having the same asymptotic distribution for corresponding kernel and weight functions. The theory leads to multi‐dimensional stable central limit theorems and feasible versions. Hence, they allow to draw statistical inference for a broad class of multivariate models, which paves the way to tests and confidence intervals in risk measurement for arbitrary portfolios composed of high‐frequently observed assets. As an application, we enhance the approach to construct a test for investigating hypotheses that correlated assets are independent conditional on a common factor.     

Robust small area estimation

Small area estimation has received considerable attention in recent years because of growing demand for small area statistics. Basic area‐level and unit‐level models have been studied in the literature to obtain empirical best linear unbiased prediction (EBLUP) estimators of small area means. Although this classical method is useful for estimating the small area means efficiently under normality assumptions, it can be highly influenced by the presence of outliers in the data. In this article, the authors investigate the robustness properties of the classical estimators and propose a resistant method for small area estimation, which is useful for downweighting any influential observations in the data when estimating the model parameters. To estimate the mean squared errors of the robust estimators of small area means, a parametric bootstrap method is adopted here, which is applicable to models with block diagonal covariance structures. Simulations are carried out to study the behaviour of the proposed robust estimators in the presence of outliers, and these estimators are also compared to the EBLUP estimators. Performance of the bootstrap mean squared error estimator is also investigated in the simulation study. The proposed robust method is also applied to some real data to estimate crop areas for counties in Iowa, using farm‐interview data on crop areas and LANDSAT satellite data as auxiliary information. The Canadian Journal of Statistics 37: 381–399; 2009 © 2009 Statistical Society of Canada     

Sequential shrinkage estimation of independent normal means with unkown variances

The Paper considers estimation of the p(> 3)-variate normal mean when the variance-covariance matrix is diagonal with unknown diagonal elements. A class of James-Stein estimators is developed, and is compared with the sample mean under an empirical minimax stopping rule. Asymptotic risk expansions are provided for both the sequential sample mean and the sequential James-Stein estimators. It is shown that the James-Stein estimators dominate the sample mean in a certain asymptotic sense.     

Estimating Archimedean Copulas in High Dimensions

Abstract. This article presents a novel estimation procedure for high‐dimensional Archimedean copulas. In contrast to maximum likelihood estimation, the method presented here does not require derivatives of the Archimedean generator. This is computationally advantageous for high‐dimensional Archimedean copulas in which higher‐order derivatives are needed but are often difficult to obtain. Our procedure is based on a parameter‐dependent transformation of the underlying random variables to a one‐dimensional distribution where a minimum‐distance method is applied. We show strong consistency of the resulting minimum‐distance estimators to the case of known margins as well as to the case of unknown margins when pseudo‐observations are used. Moreover, we conduct a simulation comparing the performance of the proposed estimation procedure with the well‐known maximum likelihood approach according to bias and standard deviation.     

Polynomial Histograms for Multivariate Density and Mode Estimation

Abstract. We consider the problem of efficiently estimating multivariate densities and their modes for moderate dimensions and an abundance of data. We propose polynomial histograms to solve this estimation problem. We present first‐ and second‐order polynomial histogram estimators for a general d‐dimensional setting. Our theoretical results include pointwise bias and variance of these estimators, their asymptotic mean integrated square error (AMISE), and optimal binwidth. The asymptotic performance of the first‐order estimator matches that of the kernel density estimator, while the second order has the faster rate of O(n^?6/(d+6)). For a bivariate normal setting, we present explicit expressions for the AMISE constants which show the much larger binwidths of the second order estimator and hence also more efficient computations of multivariate densities. We apply polynomial histogram estimators to real data from biotechnology and find the number and location of modes in such data.     

An Extended Single‐index Model with Missing Response at Random

An extended single‐index model is considered when responses are missing at random. A three‐step estimation procedure is developed to define an estimator for the single‐index parameter vector by a joint estimating equation. The proposed estimator is shown to be asymptotically normal. An algorithm for computing this estimator is proposed. This algorithm only involves one‐dimensional nonparametric smoothers, thereby avoiding the data sparsity problem caused by high model dimensionality. Some simulation studies are conducted to investigate the finite sample performances of the proposed estimators.     

Estimating Particle Shape and Orientation Using Volume Tensors

We develop statistical procedures for estimating shape and orientation of arbitrary three‐dimensional particles. We focus on the case where particles cannot be observed directly, but only via sections. Volume tensors are used for describing particle shape and orientation, and we derive stereological estimators of the tensors. These estimators are combined to provide consistent estimators of the moments of the so‐called particle cover density. The covariance structure associated with the particle cover density depends on the orientation and shape of the particles. For instance, if the distribution of the typical particle is invariant under rotations, then the covariance matrix is proportional to the identity matrix. We develop a non‐parametric test for such isotropy. A flexible Lévy‐based particle model is proposed, which may be analysed using a generalized method of moments in which the volume tensors enter. The developed methods are used to study the cell organization in the human brain cortex.     

Locally Efficient Semiparametric Estimators for Proportional Hazards Models with Measurement Error

We propose a new class of semiparametric estimators for proportional hazards models in the presence of measurement error in the covariates, where the baseline hazard function, the hazard function for the censoring time, and the distribution of the true covariates are considered as unknown infinite dimensional parameters. We estimate the model components by solving estimating equations based on the semiparametric efficient scores under a sequence of restricted models where the logarithm of the hazard functions are approximated by reduced rank regression splines. The proposed estimators are locally efficient in the sense that the estimators are semiparametrically efficient if the distribution of the error‐prone covariates is specified correctly and are still consistent and asymptotically normal if the distribution is misspecified. Our simulation studies show that the proposed estimators have smaller biases and variances than competing methods. We further illustrate the new method with a real application in an HIV clinical trial.     

Nonparametric weighted symmetry tests

Weighted symmetry is an extension of the classical notion of symmetry in which the tails of a distribution are similar, up to a scaling factor. The authors develop test statistics of weighted symmetry based on empirical processes. The finite‐dimensional distributions of the proposed statistics are either non‐parametric or conditionally nonparametric, according as the parameters of weighted symmetry are known or estimated. Asymptotically, the distributions of the processes behave like Brownian bridges or motions, leading to familiar distributions for the proposed test statistics. The authors also establish the asymptotic normality of Hodges‐Lehmann type estimators based on a generalization of the Wilcoxon signed rank test. Furthermore, they propose density estimators in mat setting.     

A Statistical Analysis of Probabilistic Counting Algorithms

Abstract. This article considers the problem of cardinality estimation in data stream applications. We present a statistical analysis of probabilistic counting algorithms, focusing on two techniques that use pseudo‐random variates to form low‐dimensional data sketches. We apply conventional statistical methods to compare probabilistic algorithms based on storing either selected order statistics, or random projections. We derive estimators of the cardinality in both cases, and show that the maximal‐term estimator is recursively computable and has exponentially decreasing error bounds. Furthermore, we show that the estimators have comparable asymptotic efficiency, and explain this result by demonstrating an unexpected connection between the two approaches.     

Large sample theory for a multivariate structural relationship with replication

For a multivariate structural relationship, where the replicated observations are available and the covariance matrix of the observational error is not restricted to diagonal, we consider the generalized least-squares estimators of the unknown structural parameters. The estimators are proved to be asymptotically normally distributed using the Liapunov central limit theorem under mild conditions on the incidental parameters. Their asymptotic covariance matrix is also derived.     

On multivariate associated kernels to estimate general density functions

Multivariate associated kernel estimators, which depend on both target point and bandwidth matrix, are appropriate for distributions with partially or totally bounded supports and generalize the classical ones such as the Gaussian. Previous studies on multivariate associated kernels have been restricted to products of univariate associated kernels, also considered having diagonal bandwidth matrices. However, it has been shown in classical cases that, for certain forms of target density such as multimodal ones, the use of full bandwidth matrices offers the potential for significantly improved density estimation. In this paper, general associated kernel estimators with correlation structure are introduced. Asymptotic properties of these estimators are presented; in particular, the boundary bias is investigated. Generalized bivariate beta kernels are handled in more details. The associated kernel with a correlation structure is built with a variant of the mode-dispersion method and two families of bandwidth matrices are discussed using the least squared cross validation method. Simulation studies are done. In the particular situation of bivariate beta kernels, a very good performance of associated kernel estimators with correlation structure is observed compared to the diagonal case. Finally, an illustration on a real dataset of paired rates in a framework of political elections is presented.     

Projection estimators of Pickands dependence functions

The authors consider the construction of intrinsic estimators for the Pickands dependence function of an extreme‐value copula. They show how an arbitrary initial estimator can be modified to satisfy the required shape constraints. Their solution consists in projecting this estimator in the space of Pickands functions, which forms a closed and convex subset of a Hilbert space. As the solution is not explicit, they replace this functional parameter space by a sieve of finite‐dimensional subsets. They establish the asymptotic distribution of the projection estimator and its finite‐dimensional approximations, from which they conclude that the projected estimator is at least as efficient as the initial one.     

On minimum Hellinger distance estimation

Efficiency and robustness are two fundamental concepts in parametric estimation problems. It was long thought that there was an inherent contradiction between the aims of achieving robustness and efficiency; that is, a robust estimator could not be efficient and vice versa. It is now known that the minimum Hellinger distance approached introduced by Beran [R. Beran, Annals of Statistics 1977;5:445–463] is one way of reconciling the conflicting concepts of efficiency and robustness. For parametric models, it has been shown that minimum Hellinger estimators achieve efficiency at the model density and simultaneously have excellent robustness properties. In this article, we examine the application of this approach in two semiparametric models. In particular, we consider a two‐component mixture model and a two‐sample semiparametric model. In each case, we investigate minimum Hellinger distance estimators of finite‐dimensional Euclidean parameters of particular interest and study their basic asymptotic properties. Small sample properties of the proposed estimators are examined using a Monte Carlo study. The results can be extended to semiparametric models of general form as well. The Canadian Journal of Statistics 37: 514–533; 2009 © 2009 Statistical Society of Canada     

Estimating the Period of a Cyclic Non‐Homogeneous Poisson Process

Abstract. Motivated by applications of Poisson processes for modelling periodic time‐varying phenomena, we study a semi‐parametric estimator of the period of cyclic intensity function of a non‐homogeneous Poisson process. There are no parametric assumptions on the intensity function which is treated as an infinite dimensional nuisance parameter. We propose a new family of estimators for the period of the intensity function, address the identifiability and consistency issues and present simulations which demonstrate good performance of the proposed estimation procedure in practice. We compare our method to competing methods on synthetic data and apply it to a real data set from a call center.     

Local Digital Algorithms Applied to Boolean Models

We investigate the estimation of specific intrinsic volumes of stationary Boolean models by local digital algorithms; that is, by weighted sums of local configuration counts. We show that asymptotically unbiased estimators for the specific surface area or integrated mean curvature do not exist if the dimension is at least two or three, respectively. For three‐dimensional stationary isotropic Boolean models, we derive asymptotically unbiased estimators for the specific surface area and integrated mean curvature. For a Boolean model with balls as grains, we even obtain an asymptotically unbiased estimator for the specific Euler characteristic.     

Statistical properties of distance estimators

Estimating the distance between two points is of fundamental concern. This paper investigates some statistical properties of three estimators of the distance between two points on a plane. The results of several theoretical comparisons of the performance of the estimators assuming a large sample size are given. Also given is the comparison of the performance of the estimators using simulation when the sample size is small. These comparisons suggest that the estimator of choice is not the most “natural” estimator in this situation. Although the discussion is given in the framework of the plane, the results are readily extended to high dimensional spaces.