LIML in the static linear panel data model

We consider the static linear panel data model with a single regressor. For this model, we derive the LIML estimator. We study the asymptotic behavior of this estimator under many-instruments asymptotics, by showing its consistency, deriving its asymptotic variance, and by presenting an estimator of the asymptotic variance that is consistent under many-instruments asymptotics. We briefly indicate the extension to the static panel data model with multiple regressors.     

Asymptotics for an Adaptive Trimmed Likelihood Location Estimator

An asymptotic normality result is given for an adaptive trimmed likelihood estimator of location, which parallels the asymptotic normality result for the adaptive trimmed mean. The new result comes out of studying the adaptive trimmed likelihood estimator modelled parametrically by a normal family but then examining the behavior when the underlying distribution is in fact some F different from normal. The asymptotic variance of the adaptive estimator is equal to the asymptotic variance of the trimmed likelihood estimator at the optimal trimming proportion for the distribution F, subject to that trimming proportion being positive and F being suitably smooth.     

On using the jackknife to estimate quantile variance

We show that the jackknife technique fails badly when applied to the problem of estimating the variance of a sample quantile. When viewed as a point estimator, the jackknife estimator is known to be inconsistent. We show that the ratio of the jackknife variance estimate to the true variance has an asymptotic Weibull distribution with parameters 1 and 1/2. We also show that if the jackknife variance estimate is used to Studentize the sample quantile, the asymptotic distribution of the resulting Studentized statistic is markedly nonnormal, having infinite mean. This result is in stark contrast with that obtained in simpler problems, such as that of constructing confidence intervals for a mean, where the jackknife-Studentized statistic has an asymptotic standard normal distribution.     

Variance estimation for sparse ultra-high dimensional varying coefficient models

This paper considers the problem of variance estimation for sparse ultra-high dimensional varying coefficient models. We first use B-spline to approximate the coefficient functions, and discuss the asymptotic behavior of a naive two-stage estimator of error variance. We also reveal that this naive estimator may significantly underestimate the error variance due to the spurious correlations, which are even higher for nonparametric models than linear models. This prompts us to propose an accurate estimator of the error variance by effectively integrating the sure independence screening and the refitted cross-validation techniques. The consistency and the asymptotic normality of the resulting estimator are established under some regularity conditions. The simulation studies are carried out to assess the finite sample performance of the proposed methods.     

Efficient Rank Regression with Wavelet Estimated Scores

We provide an estimate of the score function for rank regression using compactly supported wavelets. This estimate is then used to find a rank-based asymptotically efficient estimator for the slope parameter of a linear model. We also provide a consistent estimator of the asymptotic variance of the rank estimator. For related mixed models, the asymptotic relative efficiency is also discussed     

Bootstrap adaptive estimation: The trimmed-mean example

We consider the problem of choosing among a class of possible estimators by selecting the estimator with the smallest bootstrap estimate of finite sample variance. This is an alternative to using cross-validation to choose an estimator adaptively. The problem of a confidence interval based on such an adaptive estimator is considered. We illustrate the ideas by applying the method to the problem of choosing the trimming proportion of an adaptive trimmed mean. It is shown that a bootstrap adaptive trimmed mean is asymptotically normal with an asymptotic variance equal to the smallest among trimmed means. The asymptotic coverage probability of a bootstrap confidence interval based on such adaptive estimators is shown to have the nominal level. The intervals based on the asymptotic normality of the estimator share the same asymptotic result, but have poor small-sample properties compared to the bootstrap intervals. A small-sample simulation demonstrates that bootstrap adaptive trimmed means adapt themselves rather well even for samples of size 10.     

A nonparametric measure of interclass correlation

A nonparametric measure of interclass correlation is considered and its unbiased estimator and a test based on the estimator are studied. Hie measure is an analogue of the Kendall's measure of dependence. It is shown that the variance of the estimator is small and the information loss of the test based on the estimator is not serious relative to a standard parametric test in the sense of the Pitman asymptotic relative efficiency. Furthermore, the approximate variance of the estimator is given in the normal model.     

AN ADAPTIVE TRIMMED LIKELIHOOD ALGORITHM FOR IDENTIFICATION OF MULTIVARIATE OUTLIERS

This article describes an algorithm for the identification of outliers in multivariate data based on the asymptotic theory for location estimation as described typically for the trimmed likelihood estimator and in particular for the minimum covariance determinant estimator. The strategy is to choose a subset of the data which minimizes an appropriate measure of the asymptotic variance of the multivariate location estimator. Observations not belonging to this subset are considered potential outliers which should be trimmed. For α less than about 0.5, the correct trimming proportion is taken to be that α > 0 for which the minimum of any minima of this measure of the asymptotic variance occurs. If no minima occur for an α > 0 then the data set will be considered outlier free.     

Inference based on adaptive grid selection of probability transforms

Probability transform-based inference, for example, characteristic function-based inference, is a good alternative to likelihood methods when the probability density function is unavailable or intractable. However, a set of grids needs to be determined to provide an effective estimator based on probability transforms. This paper is concerned with parametric inference based on adaptive selection of grids. By employing a closeness measure to evaluate the asymptotic variance of the transform-based estimator, we propose a statistical inference procedure, accompanied with adaptive grid selection. The selection algorithm aims for a small set of grids, and yet the resulting estimator can be highly efficient. Generally, the asymptotic variance is very close to that of the maximum likelihood estimator.     

Variance estimation of the Buckley–James estimator under discrete assumptions

The Buckley–James estimator (BJE) is a widely recognized approach in dealing with right-censored linear regression models. There have been a lot of discussions in the literature on the estimation of the BJE as well as its asymptotic distribution. So far, no simulation has been done to directly estimate the asymptotic variance of the BJE. Kong and Yu [Asymptotic distributions of the Buckley–James estimator under nonstandard conditions, Statist. Sinica 17 (2007), pp. 341–360] studied the asymptotic distribution under discontinuous assumptions. Based on their methodology, we recalculate and correct some missing terms in the expression of the asymptotic variance in Theorem 2 of their work. We propose an estimator of the standard deviation of the BJE by using plug-in estimators. The estimator is shown to be consistent. The performance of the estimator is accessed through simulation studies under discrete underline distributions. We further extend our studies to several continuous underline distributions through simulation. The estimator is also applied to a real medical data set. The simulation results suggest that our estimation is a good approximation to the true standard deviation with reference to the empirical standard deviation.     

Higher Order Asymptotic Cumulants of Studentized Estimators in Covariance Structures

In covariance structure analysis, the Studentized pivotal statistic of a parameter estimator is often used since the statistic is asymptotically normally distributed with mean zero and unit variance. For more accurate asymptotic distribution, the first and third asymptotic cumulants can be used to have the single-term Edgeworth, Cornish-Fisher, and Hall type asymptotic expansions. In this paper, the higher order asymptotic variance and the fourth asymptotic cumulant of the statistic are obtained under nonnormality when the partial derivatives of a parameter estimator with respect to sample variances and covariances up to the third order and the moments of the associated observed variables up to the eighth order are available. The result can be used to have the two-term Edgeworth expansion. Simulations are performed to see the accuracy of the asymptotic results in finite samples.     

A note on calibration weightings for stratified double sampling with equal probability

This study proposes a more efficient calibration estimator for estimating population mean in stratified double sampling using new calibration weights. The variance of the proposed calibration estimator has been derived under large sample approximation. Calibration asymptotic optimum estimator and its approximate variance estimator are derived for the proposed calibration estimator and existing calibration estimators in stratified double sampling. Analytical results showed that the proposed calibration estimator is more efficient than existing members of its class in stratified double sampling. Analysis and evaluation are presented.     

Bootstrapping quantiles in a fixed design regression model with censored data

We consider the problem of estimating the quantiles of a distribution function in a fixed design regression model in which the observations are subject to random right censoring. The quantile estimator is defined via a conditional Kaplan-Meier type estimator for the distribution at a given design point. We establish an a.s. asymptotic representation for this quantile estimator, from which we obtain its asymptotic normality. Because a complicated estimation procedure is necessary for estimating the asymptotic bias and variance, we use a resampling procedure, which provides us, via an asymptotic representation for the bootstrapped estimator, with an alternative for the normal approximation.     

An estimator of a conditional quantile in the presence of auxiliary information

In this paper, a new estimator for a conditional quantile is proposed by using the empirical likelihood method and local linear fitting when some auxiliary information is available. The asymptotic normality of the estimator at both boundary and interior points is established. It is shown that the asymptotic variance of the proposed estimator is smaller than those of the usual kernel estimators at interior points, and that the proposed estimator has the desired sampling properties at both boundary and interior points. Therefore, no boundary modifications are required in our estimation.     

A Remedy for Kernel Estimation Under Random Design

Two common kernel-based methods for non-parametric regression estimation suffer from well-known drawbacks when the design is random. The Gasser-Müller estimator is inadmissible due to its high variance while the Nadaraya-Watson estimator has zero asymptotic efficiency because of poor bias behavior. Under asymptotic consideration, the local linear estimator avoids these two drawbacks of kernel estimators and achieves minimax optimality. However, when based on compact support kernels its finite sample behavior is disappointing because sudden kinks may show up in the estimate.

This paper proposes a modification of the kernel estimator, called the binned convolution estimator leading to a fast O(n) method. Provided the design density is continously differentiable and the conditional fourth moments exist the binned convolution estimator has asymptotic properties identical with those of the local linear estimator.     

Estimation of regression parameters in generalized linear models for cluster correlated data with measurement error

Liang and Zeger (1986) introduced a class of estimating equations that gives consistent estimates of regression parameters and of their asymptotic variances in the class of generalized linear models for cluster correlated data. When the independent variables or covariates in such models are subject to measurement errors, the parameter estimates obtained from these estimating equations are no longer consistent. To correct for the effect of measurement errors, an estimator with smaller asymptotic bias is constructed along the lines of Stefanski (1985), assuming that the measurement error variance is either known or estimable. The asymptotic distribution of the bias-corrected estimator and a consistent estimator of its asymptotic variance are also given. The special case of a binary logistic regression model is studied in detail. For this case, methods based on conditional scores and quasilikelihood are also extended to cluster correlated data. Results of a small simulation study on the performance of the proposed estimators and associated tests of hypotheses are reported.     

Nonparametric estimation of the conditional distribution function in a semiparametric censorship model

In this paper we propose a new nonparametric estimator of the conditional distribution function under a semiparametric censorship model. We establish an asymptotic representation of the estimator as a sum of iid random variables, balanced by some kernel weights. This representation is used for obtaining large sample results such as the rate of uniform convergence of the estimator, or its limit distributional law. We prove that the new estimator outperforms the conditional Kaplan–Meier estimator for censored data, in the sense that it exhibits lower asymptotic variance. Illustration through real data analysis is provided.     

Conditional quantile estimation with auxiliary information for left-truncated and dependent data

In this paper, the empirical likelihood method is used to define a new estimator of conditional quantile in the presence of auxiliary information for the left-truncation model. The asymptotic normality of the estimator is established when the data exhibit some kind of dependence. It is assumed that the lifetime observations with multivariate covariates form a stationary α‐mixing sequence. The result shows that the asymptotic variance of the proposed estimator is not larger than that of standard kernel estimator. Finite sample behavior of the estimator is investigated via simulations too.     

Error variance function estimation in nonparametric regression models

In this article, a new class of variance function estimators is proposed in the setting of heteroscedastic nonparametric regression models. To obtain a variance function estimator, the main proposal is to smooth the product of the response variable and residuals as opposed to the squared residuals. The asymptotic properties of the proposed methodology are investigated in order to compare its asymptotic behavior with that of the existing methods. The finite sample performance of the proposed estimator is studied through simulation studies. The effect of the curvature of the mean function on its finite sample behavior is also discussed.     

ASYMPTOTIC DEFICIENCY OF THE JACKKNIFE ESTIMATOR

In this paper it is shown that the bias-adjusted maximum likelihood estimator (MLE) is asymptotically equivalent to the jackknife estimator in the variance up to the order n^-1 and the asymptotic deficiency of the jackknife estimator relative to the bias-adjusted MLE is equal to zero.