Nonparametric estimation of a two dimensional continuous–discrete density function by wavelets

We consider the estimation of a two dimensional continuous–discrete density function. A new methodology based on wavelets is proposed. We construct a linear wavelet estimator and a non-linear wavelet estimator based on a term-by-term thresholding. Their rates of convergence are established under the mean integrated squared error over Besov balls. In particular, we prove that our adaptive wavelet estimator attains a fast rate of convergence. A simulation study illustrates the usefulness of the proposed estimators.     

On general consistency in deconvolution mode estimation

This paper addresses the problem of estimating the mode of a density function based on contaminated data. Unlike conventional methods, which are based on localizing the maximum of a density estimator, we introduce a procedure which requires computation of the maximum among finitely many quantities only. We show that our estimator is strongly consistent under very weak conditions, where not even continuity of the density at the mode is required; moreover, we show that the estimator achieves optimal convergence rates under common smoothness and sharpness constraints. Some numerical simulations are provided.     

Using response probability and ratio imputation in the estimation under callbacks

Although the response model has been frequently applied to nonresponse weighting adjustment or imputation, the estimation under callbacks has been relatively underdeveloped in the response model. We propose an estimator under callbacks using both the response probability and the ratio imputation and a replication variance estimator of the estimator. We also study the estimation of the response probability. A simulation study illustrates our technique.     

Improved precision in the analysis of randomized trials with survival outcomes,without assuming proportional hazards

We present a new estimator of the restricted mean survival time in randomized trials where there is right censoring that may depend on treatment and baseline variables. The proposed estimator leverages prognostic baseline variables to obtain equal or better asymptotic precision compared to traditional estimators. Under regularity conditions and random censoring within strata of treatment and baseline variables, the proposed estimator has the following features: (i) it is interpretable under violations of the proportional hazards assumption; (ii) it is consistent and at least as precise as the Kaplan–Meier and inverse probability weighted estimators, under identifiability conditions; (iii) it remains consistent under violations of independent censoring (unlike the Kaplan–Meier estimator) when either the censoring or survival distributions, conditional on covariates, are estimated consistently; and (iv) it achieves the nonparametric efficiency bound when both of these distributions are consistently estimated. We illustrate the performance of our method using simulations based on resampling data from a completed, phase 3 randomized clinical trial of a new surgical treatment for stroke; the proposed estimator achieves a 12% gain in relative efficiency compared to the Kaplan–Meier estimator. The proposed estimator has potential advantages over existing approaches for randomized trials with time-to-event outcomes, since existing methods either rely on model assumptions that are untenable in many applications, or lack some of the efficiency and consistency properties (i)–(iv). We focus on estimation of the restricted mean survival time, but our methods may be adapted to estimate any treatment effect measure defined as a smooth contrast between the survival curves for each study arm. We provide R code to implement the estimator.

     

Estimation of the angular density in bivariate generalized Pareto models

We investigate a method to estimate the angular density non-parametrically in bivariate generalized Pareto models. The angular density can be used as a visual tool to gain a first insight into the tail-dependence structure of given data. We derive a representation of the angular density by means of the Pickands density and use it to construct our estimator. The estimator is asymptotically normal under certain regularity conditions. We also test it with simulated data and give an application to a real hydrological data set. Finally, we show that our estimator cannot be transferred directly to higher dimensions.     

Alternative estimators of the common regression matrix in two GMANOVA models under weighted quadratic losses

We consider the problem of estimating the common regression matrix of two GMANOVA models with different unknown covariance matrices under certain type of loss functions which include a weighted quadratic loss function as a special case. We consider a class of estimators, which contains the Graybill–Deal-type estimator proposed by Sugiura and Kubokawa (Ann. Inst. Statist. Math. 40 (1988) 119), and we give its risk representation via Kubokawa and Srivastava's (Ann. Statist. 27 (1999) 600; J. Multivariate Anal. 76 (2001) 138) identities when the error matrices follow the elliptically contoured distributions. Using the method similar to an approximate minimization of the unbiased risk estimate due to Stein (Studies in the Statistical Theory of Estimation, vol. 74, Nauka, Leningrad, 1977, p. 4), we obtain an alternative estimator to the Graybill–Deal-type estimator which was given under the normality assumption. However, it seems difficult to evaluate the risk of our proposed estimator analytically because of complex nature of its risk function. Instead, we conduct a Monte-Carlo simulation to evaluate the performance of our proposed estimator. The results indicate that our proposed estimator compares favorably with the Graybill–Deal-type estimator.     

Quantile Regression Estimator for GARCH Models

Abstract. In this article, we study the quantile regression estimator for GARCH models. We formulate the quantile regression problem by a reparametrization method and verify that the obtained quantile regression estimator is strongly consistent and asymptotically normal under certain regularity conditions. We also present our simulation results and a real data analysis for illustration.     

Variance estimation of the Buckley–James estimator under discrete assumptions

The Buckley–James estimator (BJE) is a widely recognized approach in dealing with right-censored linear regression models. There have been a lot of discussions in the literature on the estimation of the BJE as well as its asymptotic distribution. So far, no simulation has been done to directly estimate the asymptotic variance of the BJE. Kong and Yu [Asymptotic distributions of the Buckley–James estimator under nonstandard conditions, Statist. Sinica 17 (2007), pp. 341–360] studied the asymptotic distribution under discontinuous assumptions. Based on their methodology, we recalculate and correct some missing terms in the expression of the asymptotic variance in Theorem 2 of their work. We propose an estimator of the standard deviation of the BJE by using plug-in estimators. The estimator is shown to be consistent. The performance of the estimator is accessed through simulation studies under discrete underline distributions. We further extend our studies to several continuous underline distributions through simulation. The estimator is also applied to a real medical data set. The simulation results suggest that our estimation is a good approximation to the true standard deviation with reference to the empirical standard deviation.     

Goodness-of-Fit Tests Based on Correcting Moments of Entropy Estimators

In this article, we consider the entropy estimator introduced by Alizadeh Noughabi and Arghami (2010) and derive the nonparametric distribution function corresponding to our estimator as a piece-wise uniform distribution. We use the results to introduce goodness-of-fit tests for the normal and the exponential distributions. The critical values and powers for some alternatives are obtained by simulation. The powers of the proposed tests under various alternatives are compared with the competitors.     

Testing for shifts in mean with monotonic power against multiple structural changes

It is known that several widely used structural change tests have non-monotonic power because the long-run variance is poorly estimated under the alternative hypothesis. In this paper, we propose a modified long-run variance estimator to alleviate this problem. We theoretically show that the tests with our long-run variance estimator are consistent against large multiple structural changes. Simulation results show that the proposed test performs well in finite samples.     

Robust Sparse Regression with High-Breakdown Value

Penalized least squares estimators are sensitive to the influence of outliers like the ordinary least squares estimator. We propose a sparse regression estimator for robust variable selection and estimation based on a robust initial estimator. It is proven that our estimator has at least the same breakdown value as the initial estimator. Numerical examples are presented to illustrate our method.     

The Bayes rule of the parameter in (0,1) under Zhang’s loss function with an application to the beta-binomial model

Abstract

For the restricted parameter space (0,1), we propose Zhang’s loss function which satisfies all the 7 properties for a good loss function on (0,1). We then calculate the Bayes rule (estimator), the posterior expectation, the integrated risk, and the Bayes risk of the parameter in (0,1) under Zhang’s loss function. We also calculate the usual Bayes estimator under the squared error loss function, and the Bayes estimator has been proved to underestimate the Bayes estimator under Zhang’s loss function. Finally, the numerical simulations and a real data example of some monthly magazine exposure data exemplify our theoretical studies of two size relationships about the Bayes estimators and the Posterior Expected Zhang’s Losses (PEZLs).     

Efficient Covariance Estimation for Asynchronous Noisy High‐Frequency Data

Abstract. We focus on estimating the integrated covariance of log‐price processes in the presence of market microstructure noise. We construct a consistent asymptotically unbiased estimator for the quadratic covariation of two Itô processes in the case where high‐frequency asynchronous discrete returns under market microstructure noise are observed. This estimator is based on synchronization and multi‐scale methods and attains the optimal rate of convergence. A lower bound for the rate of convergence is derived from the local asymptotic normality property of the simpler parametric model with equidistant and synchronous observations. A Monte Carlo study analyses the finite sample size characteristics of our estimator.     

Asymptotics for L2-norm of ARCH innovation density estimator

In this paper we consider the asymptotic properties of the ARCH innovation density estimator. We obtain the asymptotic normality of the Bickel-Rosenblatt test statistic (based on our density estimator) under the null hypothesis, which is the same as in the case of the one sample set up (given in Bickel and Rosenblatt, 1973). We also show the strong consistency of the estimator for the true density in L2-norm.     

Non‐Parametric Estimation of the Conditional Distribution of the Interjumping Times for Piecewise‐Deterministic Markov Processes

This paper presents a non‐parametric method for estimating the conditional density associated to the jump rate of a piecewise‐deterministic Markov process. In our framework, the estimation needs only one observation of the process within a long time interval. Our method relies on a generalization of Aalen's multiplicative intensity model. We prove the uniform consistency of our estimator, under some reasonable assumptions related to the primitive characteristics of the process. A simulation study illustrates the behaviour of our estimator.     

On the Optimality of Estimating the Tail Index and a Naive Estimator

Using a straightforward estimator for estimating the tail index of a distribution we illustrate the inherent difficulties of this problem. We prove strong and weak consistencies and central limit theorems for our naive estimator, and discuss its various rates of convergence under different conditions. We argue that, while optimal rates of convergence do exist under various conditions for a number of estimators of the tail index, the notion of an optimal sequence for this problem is bound to run into unsurmountable difficulties.     

Integrated-Quantile-Based Estimation for First-Price Auction Models

This article considers nonparametric estimation of first-price auction models under the monotonicity restriction on the bidding strategy. Based on an integrated-quantile representation of the first-order condition, we propose a tuning-parameter-free estimator for the valuation quantile function. We establish its cube-root-n consistency and asymptotic distribution under weaker smoothness assumptions than those typically assumed in the empirical literature. If the latter are true, we also provide a trimming-free smoothed estimator and show that it is asymptotically normal and achieves the optimal rate of Guerre, Perrigne, and Vuong (2000). We illustrate our method using Monte Carlo simulations and an empirical study of the California highway procurement auctions. Supplementary materials for this article are available online.     

Non parametric hazard estimation with dependent censoring using penalized likelihood and an assumed copula

This article introduces a novel non parametric penalized likelihood hazard estimation when the censoring time is dependent on the failure time for each subject under observation. More specifically, we model this dependence using a copula, and the method of maximum penalized likelihood (MPL) is adopted to estimate the hazard function. We do not consider covariates in this article. The non negatively constrained MPL hazard estimation is obtained using a multiplicative iterative algorithm. The consistency results and the asymptotic properties of the proposed hazard estimator are derived. The simulation studies show that our MPL estimator under dependent censoring with an assumed copula model provides a better accuracy than the MPL estimator under independent censoring if the sign of dependence is correctly specified in the copula function. The proposed method is applied to a real dataset, with a sensitivity analysis performed over various values of correlation between failure and censoring times.     

A Bayesian approach with generalized ridge estimation for high-dimensional regression and testing

This paper adopts a Bayesian strategy for generalized ridge estimation for high-dimensional regression. We also consider significance testing based on the proposed estimator, which is useful for selecting regressors. Both theoretical and simulation studies show that the proposed estimator can simultaneously outperform the ordinary ridge estimator and the LSE in terms of the mean square error (MSE) criterion. The simulation study also demonstrates the competitive MSE performance of our proposal with the Lasso under sparse models. We demonstrate the method using the lung cancer data involving high-dimensional microarrays.     

Unbiased and almost unbiased ratio estimators of the population mean in ranked set sampling

In this paper we study the problem of reducing the bias of the ratio estimator of the population mean in a ranked set sampling (RSS) design. We first propose a jackknifed RSS-ratio estimator and then introduce a class of almost unbiased RSS-ratio estimators of the population mean. We also present an unbiased RSS-ratio estimator of the mean using the idea of Hartley and Ross (Nature 174:270?C271, 1954) which performs better than its counterpart with simple random sample data. We show that under certain conditions the proposed unbiased and almost unbiased RSS-ratio estimators perform better than the commonly used (biased) RSS-ratio estimator in estimating the population mean in terms of the mean square error. The theoretical results are augmented by a simulation study using a wheat yield data set from the Iranian Ministry of Agriculture to demonstrate the practical benefits of our proposed ratio-type estimators relative to the RSS-ratio estimator in reducing the bias in estimating the average wheat production.