On multivariate smoothed bootstrap consistency

This paper deals with the convergence in Mallows metric for classical multivariate kernel distribution function estimators. We prove the convergence in Mallows metric of a locally orientated kernel smooth estimator belonging to the class of sample smoothing estimators. The consistency follows for the smoothed bootstrap for regular functions of the marginal means. Two simple simulation studies show how the smoothed versions of the bootstrap give better results than the classical technique.     

The robustness of the quasilikelihood estimator

The quasilikelihood estimator is widely used in data analysis where a likelihood is not available. We illustrate that with a given variance function it is not only conservative, in minimizing a maximum risk, but also robust against a possible misspecification of either the likelihood or cumulants of the model. In examples it is compared with estimators based on maximum likelihood and quadratic estimating functions.     

The Gaussian rank correlation estimator: robustness properties

The Gaussian rank correlation equals the usual correlation coefficient computed from the normal scores of the data. Although its influence function is unbounded, it still has attractive robustness properties. In particular, its breakdown point is above 12%. Moreover, the estimator is consistent and asymptotically efficient at the normal distribution. The correlation matrix obtained from pairwise Gaussian rank correlations is always positive semidefinite, and very easy to compute, also in high dimensions. We compare the properties of the Gaussian rank correlation with the popular Kendall and Spearman correlation measures. A simulation study confirms the good efficiency and robustness properties of the Gaussian rank correlation. In the empirical application, we show how it can be used for multivariate outlier detection based on robust principal component analysis.     

The exact bootstrap mean and variance of an L-estimator

Exact analytic expressions for the bootstrap mean and variance of any L -estimator are obtained, thus eliminating the error due to bootstrap resampling. The expressions follow from the direct calculation of the bootstrap mean vector and covariance matrix of the whole set of order statistics. By using these expressions, recommendations can be made about the appropriateness of bootstrap estimation under given conditions.     

Adaptive likelihood estimator of conditional variance function

Modelling volatility in the form of conditional variance function has been a popular method mainly due to its application in financial risk management. Among others, we distinguish the parametric GARCH models and the nonparametric local polynomial approximation using weighted least squares or gaussian likelihood function. We introduce an alternative likelihood estimate of conditional variance and we show that substitution of the error density with its estimate yields similar asymptotic properties, that is, the proposed estimate is adaptive to the error distribution. Theoretical comparison with existing estimates reveals substantial gains in efficiency, especially if error distribution has fatter tails than Gaussian distribution. Simulated data confirm the theoretical findings while an empirical example demonstrates the gains of the proposed estimate.     

Consistency of least-squares estimator and its jackknife variance estimator in nonlinear models

The purpose of this paper is twofold: (1) We establish the consistency of the least-squares estimator in a nonlinear modely_i = f(x_i,θ) +σ_ie_i where the range of the parameter θ is noncompact, the regression function is unbounded, and the σ_i,'s are not necessarily equal. This extends the results in Jennrich (1969) and Wu (1981). (2) Under the same model, the jackknife estimator of the asymptotic covariance matrix of the least-squares estimator is shown to be consistent, which provides a theoretical justification of the empirical results in Duncan (1978) and the use of the jackknife method in large-sample inferences.     

Minimum variance unbiased estimation based on bootstrap iterations

Practical computation of the minimum variance unbiased estimator (MVUE) is often a difficult, if not impossible, task, even though general theory assures its existence under regularity conditions. We propose a new approach based on iterative bootstrap bias correction of the maximum likelihood estimator to accurately approximate the MVUE. Viewing bootstrap iteration as a Markov process, we develop a computational algorithm for bias correction based on arbitrarily many bootstrap iterations. The algorithm, when applied parametrically to finite sample spaces, does not involve Monte Carlo simulation. For infinite sample spaces, a nonparametric version of the algorithm is combined with a preliminary round of Monte Carlo simulation to yield an approximate MVUE. Both algorithms are computationally more efficient and stable than conventional simulation-based bootstrap iterations. Examples are given of both finite and infinite sample spaces to illustrate the effectiveness of our new approach. Supported by a grant from the Research Grants Council of the Hong Kong Special Administrative Region, China (Project No. HKU 7026/97P).     

Some remarks about the gasser-sroka-jennen-steinmetz variance estimator

This article proposes some simplifications of the residual variance estimator of Gasset, Sroka, and Jeneen-Steinmetz (GSJ, 1986) which is often used in conjunction with non parametric regression. The GSJ estimator is a quadratic form of the data, which depends on the relative spacings of the design points. When the errors are independent, identically distributed Gaussian variables, and the true regression curve is flat, the estimate is distributed as a weighted sum of x² variables. By matching the first two moments, the distribution can be approximated by a x² with degrees of freedom determined by the coefficients of the. quadratic form. Computation of the estimated degrees of freedom requires computing the trace of the square of an n x n matrix, where n is the number of design points. In this article, (n-2)/3 is shown to be a conservative estimate of the approximate degrees of freedom, and (n-2)/2 is shown to be conservative for many designs. In addition, a simplified version of the estimator is shown to be asymptotically equivalent, under many conditions.     

Finite-sample properties of the bootstrap estimator in a Markov-switching model

The size distortion problem is clearly indicative of the small-sample approximation in the Markov-switching regression model. This paper shows that the bootstrap procedure can relieve the effects that this problem has. Our Monte Carlo simulation results reveal that the bootstrap maximum likelihood asymptotic approximations to the distribution can often be good when the sample size is small.     

Consistency and robustness properties of the S-nonnegative garrote estimator

This paper concerns a robust variable selection method in multiple linear regression: the robust S-nonnegative garrote variable selection method. In this paper the consistency of the method, both in terms of estimation and in terms of variable selection, is established. Moreover, the robustness properties of the method are further investigated by providing a lower bound for the breakdown point, and by deriving the influence function. The provided expressions nicely reveal the impact that the choice of an initial estimator has on the robustness properties of the variable selection method. Illustrative examples of influence functions for the S-nonnegative garrote as well as for the original (non-robust) nonnegative garrote variable selection method are provided.     

Risk behavior of a pre-test estimator for normal variance with the Stein-type estimator

In this paper, we examine the risk behavior of a pre-test estimator for normal variance with the Stein-type estimator. The one-sided pre-test is conducted for the null hypothesis that the population variance is equal to a specific value, and the Stein-type estimator is used if the null hypothesis is rejected. A sufficient condition for the pre-test estimator to dominate the Stein-type estimator is shown.     

A new ranked set sample estimator of variance

Summary. We develop an unbiased estimator of the variance of a population based on a ranked set sample. We show that this new estimator is better than estimating the variance based on a simple random sample and more efficient than the estimator based on a ranked set sample proposed by Stokes. Also, a test to determine the effectiveness of the judgment ordering process is proposed.     

Inadmissibility of the uniformly minimum variance unbiased estimator of the inverse gaussian variance

The uniformly minimum variance unbiased estimator (UMVUE) of the variance of the inverse Gaussian distribution is shown to be inadmissible in terms of the mean squared error, and a dominating estimator is given. A dominating estimator to the maximum likelihood estimator (MLE) of the variance and estimators dominating the MLE's and the UMVUE's of other parameters are also given.     

Finite sample moments of a bootstrap estimator of the james-stein rule

The finite sample moments of the bootstrap estimator of the James-Stein rule are derived and shown to be biased. Analytical results shed some light upon the source of bias and suggest that the bootstrap will be biased in other settings where the moments of the statistic of interest depends on nonlinear functions of the parameters of its distribution.     

Finite sample moments of a bootstrap estimator of the james-stein rule

The finite sample moments of the bootstrap estimator of the James-Stein rule are derived and shown to be biased. Analytical results shed some light upon the source of bias and suggest that the bootstrap will be biased in other settings where the moments of the statistic of interest depends on nonlinear functions of the parameters of its distribution.     

A modified bootstrap estimator for the mean of an asymmetric distribution

A modified bootstrap estimator of the population mean is proposed which is a convex combination of the sample mean and sample median, where the weights are random quantities. The estimator is shown to be strongly consistent and asymptotically normally distributed. The small- and moderate-sample-size behavior of the estimator is investigated and compared with that of the sample mean by means of Monte Carlo studies. It is found that the newly proposed estimator has much smaller mean squared errors and also yields significantly shorter confidence intervals for the population mean.     

A jackknife variance estimator for unequal probability sampling

Summary.  The jackknife method is often used for variance estimation in sample surveys but has only been developed for a limited class of sampling designs. We propose a jackknife variance estimator which is defined for any without-replacement unequal probability sampling design. We demonstrate design consistency of this estimator for a broad class of point estimators. A Monte Carlo study shows how the proposed estimator may improve on existing estimators.     

Weighted similarity tests for location-scale families of stable distributions

ABSTRACT

The class of stable distributions plays a central role in the study of asymptotic behavior of normalized partial sums, the same role performed by normal distribution among those with finite second moment. In this note, by exploiting the connection between stable laws and regularly varying functions, we present weighted similarity tests for stable location-scale families. The proposed weight functions are based on the 2nd-order Mallows distance between the empirical distribution and the root stable distribution. And the resulting statistics converge weakly to functionals of Brownian bridge.     

The exact distribution and density functions of the stein-type estimator for normal variance

In this paper, we derive the exact distribution and density functions of the Stein-type estimator for the normal variance. It is shown by numerical evaluation that the density function of the Stein-type estimator is unimodal and concentrates around the mode more than that of the usual estimator.     

Difference-based variance estimator for nonparametric regression in complex surveys

A difference-based variance estimator is proposed for nonparametric regression in complex surveys. By using a combined inference framework, the estimator is shown to be asymptotically normal and to converge to the true variance at a parametric rate. Simulation studies show that the proposed variance estimator works well for complex survey data and also reveals some finite sample properties of the estimator.