Smooth nonparametric quantile estimation under censoring: simulations and bootstrap methods

Based on right-censored data from a lifetime distribution F , a smooth nonparametric estimator of the quantile function Q (p) is given by Qn(p)=h 1jjQn(t)K((t-p)/h)dt, where QR(p) denotes the product-limit quantile function. Extensive Monte Carlo simulations indicate that at fixed p this kernel-type quantile estimator has smaller mean squared error than (L(p) for a range of values of the bandwidth h. A method of selecting an "optimal" bandwidth (in the sense of small estimated mean squared error) based on the bootstrap is investigated yielding results consistent with the simulation study. The bootstrap is also used to obtain interval estimates for Q (p) after determining the optimal value of h.     

An improved and efficient biased estimation technique in logistic regression model

Abstract

In this article, we propose a new improved and efficient biased estimation method which is a modified restricted Liu-type estimator satisfying some sub-space linear restrictions in the binary logistic regression model. We study the properties of the new estimator under the mean squared error matrix criterion and our results show that under certain conditions the new estimator is superior to some other estimators. Moreover, a Monte Carlo simulation study is conducted to show the performance of the new estimator in the simulated mean squared error and predictive median squared errors sense. Finally, a real application is considered.     

Comparison of estimators for heteroskedastic models

Ordinary least squares (OLS) yield inefficient parameter estimates and inconsistent estimates of the covariance matrix in case of heteroskedastic errors. Robinson's adaptive estimator and the Cragg estimator avoid any explicit parameterization of heteroskedasticity, and reduce the danger of misspecification. A small Monte Carlo experiment is performed to compare the behavior of the adaptive estimator with the performance of the Cragg estimator. The Monte Carlo experiment includes simulations of the Generalized Least Squares (GLS) estimator. Indeed, an interesting question is how more sophisticated techniques, like the adaptive estimator, compare with GLS when the latter relies on an incorrect specification of the heteroskedastic process. It turns out that the regression parameters, when estimated adaptively, display small mean squared errors and great efficiency in case of medium or high heteroskedasticity. The covariance matrix, instead, is better estimated by the Cragg estimator or by GLS based on a misspecified error term, since the adaptive estimator overpredicts the standard errors of the regression parameters.     

Composite Estimation for Single‐Index Models with Responses Subject to Detection Limits

We propose a semiparametric estimator for single‐index models with censored responses due to detection limits. In the presence of left censoring, the mean function cannot be identified without any parametric distributional assumptions, but the quantile function is still identifiable at upper quantile levels. To avoid parametric distributional assumption, we propose to fit censored quantile regression and combine information across quantile levels to estimate the unknown smooth link function and the index parameter. Under some regularity conditions, we show that the estimated link function achieves the non‐parametric optimal convergence rate, and the estimated index parameter is asymptotically normal. The simulation study shows that the proposed estimator is competitive with the omniscient least squares estimator based on the latent uncensored responses for data with normal errors but much more efficient for heavy‐tailed data under light and moderate censoring. The practical value of the proposed method is demonstrated through the analysis of a human immunodeficiency virus antibody data set.     

One-sided trimming in small samples with asymmetric contamination

An estimator for location, given a sample of only four or five observations, is proposed. The underlying distribution on of the sample may (with probability p) be contaminated by an outlier from a rightly-skewed distribution. The estimator minimizes the maximum mean squared error over all values of p. In fact, there exists an estimator which is unbiased in both the outlier - free and extreme-outlier cases, but its mean square error is substantially higher than the mean squared error for the minimax estimator. Mean squared errors for various underlying distributional situations are calculated and compared with those of other location estimators such as the mean and the median.     

ROBUST ESTIMATION OF SMALL‐AREA MEANS AND QUANTILES

Small‐area estimation techniques have typically relied on plug‐in estimation based on models containing random area effects. More recently, regression M‐quantiles have been suggested for this purpose, thus avoiding conventional Gaussian assumptions, as well as problems associated with the specification of random effects. However, the plug‐in M‐quantile estimator for the small‐area mean can be shown to be the expected value of this mean with respect to a generally biased estimator of the small‐area cumulative distribution function of the characteristic of interest. To correct this problem, we propose a general framework for robust small‐area estimation, based on representing a small‐area estimator as a functional of a predictor of this small‐area cumulative distribution function. Key advantages of this framework are that it naturally leads to integrated estimation of small‐area means and quantiles and is not restricted to M‐quantile models. We also discuss mean squared error estimation for the resulting estimators, and demonstrate the advantages of our approach through model‐based and design‐based simulations, with the latter using economic data collected in an Australian farm survey.     

On parameter estimation in Bernoulli trials with dependence

A simple estimator is proposed for the dependence parameter for the Klotz model of Bernoulli trials with Markov dependence and it is compared with the ratio estimator given by Price and the approximate maximum likelihood estimator given by Klotz. The proposed estimator is shown to have considerably smaller bias than the other two estimators with comparable mean squared errors, and has all the large sample optimal properties that the other two estimators have.     

On huntseerger type shrinkage estimator

This paper is concerned with Hintsberger type weighted shrinkage estimator of a parameter when a target value of the same is available. Expressions for the bias and the mean squared error of the estimator are derived. Some results concerning the bias, existence of uniformly minimum mean squared error estimator etc. are proved. For certain c to ices of the weight function, numerical results are presented for the pretest type weighted shrinkage estimator of the mean of normal as well as exponential distributions.     

A modified bootstrap estimator for the mean of an asymmetric distribution

A modified bootstrap estimator of the population mean is proposed which is a convex combination of the sample mean and sample median, where the weights are random quantities. The estimator is shown to be strongly consistent and asymptotically normally distributed. The small- and moderate-sample-size behavior of the estimator is investigated and compared with that of the sample mean by means of Monte Carlo studies. It is found that the newly proposed estimator has much smaller mean squared errors and also yields significantly shorter confidence intervals for the population mean.     

Improved autoregressive forecasts in the presence of non-normal errors

This paper is concerned with obtaining more accurate point forecasts in the presence of non-normal errors. Specifically, we apply the residual augmented least-squares (RALS) estimator to autoregressive models to utilize the additional moment restrictions embodied in non-normal errors. Monte Carlo experiments are performed to compare our RALS forecasts to forecasts based on the ordinary least-squares estimator and the least absolute deviations (LAD) estimator. We find that the RALS approach provides superior forecasts when the data are skewed. Compared to the LAD forecast, the RALS forecast has smaller mean squared prediction errors in the baseline case with normal errors.     

Combining poisson means

The problem of estimating the Poisson mean is considered based on the two samples in the presence of uncertain prior information (not in the form of distribution) that two independent random samples taken from two possibly identical Poisson populations. The parameter of interest is λ₁ from population I. Three estimators, i.e. the unrestricted estimator, restricted estimator and preliminary test estimator are proposed. Their asymptotic mean squared errors are derived and compared; parameter regions have been found for which restricted and preliminary test estimators are always asymptotically more efficient than the classical estimator. The relative dominance picture of the estimators is presented. Maximum and minimum asymptotic efficiencies of the estimators relative to the classical estimator are tabulated. A max-min rule for the size of the preliminary test is also discussed. A Monte Carlo study is presented to compare the performance of the estimator with that of Kale and Bancroft (1967).     

Prediction Error Property of the Lasso Estimator and its Generalization

The lasso procedure is an estimator‐shrinkage and variable selection method. This paper shows that there always exists an interval of tuning parameter values such that the corresponding mean squared prediction error for the lasso estimator is smaller than for the ordinary least squares estimator. For an estimator satisfying some condition such as unbiasedness, the paper defines the corresponding generalized lasso estimator. Its mean squared prediction error is shown to be smaller than that of the estimator for values of the tuning parameter in some interval. This implies that all unbiased estimators are not admissible. Simulation results for five models support the theoretical results.     

Pooling means under uncertain prior information with application to discrete distributions

The problem of pooling means is considered based on two samples in presence of the uncertain prior information that these samples are taken from possibly identical populations. Two discrete models, Poisson and binomial are considered in particular. Three estimators, i.e. the unrestricted estimator, shrinkage restricted estimator and estimators based on preliminary test are proposed. Their asymptotic mean squared errors are derived and compared. It is demonstrated via asymptotic results that the range of the parameter space in which shrinkage preliminary test estimator dominates the unrestricted estimator is wider than that of the usual preliminary test estimator. A Monte Carlo study for Poisson model is presented to compare the performance of the estimators for small samples.     

Minimaxity of empirical bayes estimators of the means of independent normal variables with unequal variances

The problem of simultaneous estimation of normal means is considered when variances are unequal and the loss is sum of squared errors. Minimaxity or non-minimaxity of empirical Bayes estimators is investigated when the common prior distribution is given by normal one with mean 0. Minimaxity results for the case when the loss is a weighted sum of squared errors is also given. Monte Carlo simulation results are given to compare the risk behavior of the empirical Bayes estimator with those of other minimax ones.     

Estimating stage occupation probabilities in non-Markov models

We study non-Markov multistage models under dependent censoring regarding estimation of stage occupation probabilities. The individual transition and censoring mechanisms are linked together through covariate processes that affect both the transition intensities and the censoring hazard for the corresponding subjects. In order to adjust for the dependent censoring, an additive hazard regression model is applied to the censoring times, and all observed counting and “at risk” processes are subsequently given an inverse probability of censoring weighted form. We examine the bias of the Datta–Satten and Aalen–Johansen estimators of stage occupation probability, and also consider the variability of these estimators by studying their estimated standard errors and mean squared errors. Results from different simulation studies of frailty models indicate that the Datta–Satten estimator is approximately unbiased, whereas the Aalen–Johansen estimator either under- or overestimates the stage occupation probability due to the dependent nature of the censoring process. However, in our simulations, the mean squared error of the latter estimator tends to be slightly smaller than that of the former estimator. Studies on development of nephropathy among diabetics and on blood platelet recovery among bone marrow transplant patients are used as demonstrations on how the two estimation methods work in practice. Our analyses show that the Datta–Satten estimator performs well in estimating stage occupation probability, but that the censoring mechanism has to be quite selective before a deviation from the Aalen-Johansen estimator is of practical importance. N. Gunnes—Supported by a grant from the Norwegian Cancer Society.     

Exponential-Type Estimators of the Mean of a Sensitive Variable in the Presence of Nonsensitive Auxiliary Information

Sousa et al. and Gupta et al. suggested ratio and regression-type estimators of the mean of a sensitive variable using nonsensitive auxiliary variable. This article proposes exponential-type estimators using one and two auxiliary variables to improve the efficiency of mean estimator based on a randomized response technique. The expressions for the mean squared errors (MSEs) and bias, up to first-order approximation, have been obtained. It is shown that the proposed exponential-type estimators are more efficient than the existing estimators. The gain in efficiency over the existing estimators has also been shown with a simulation study and by using real data.     

Panel discussion by journal editors

The smooth PL quantile estimator is proposed and the analog of Bahadur-Kiefer type process is constructed based on the PL estimator and the smooth PL quantile estimator when the data are subject to censorship. Pointwise and uniform strong limit theorems for this process are established, The theorems are sharp and give the exact convergent rates of Bahadur type representation for the smooth PL quantile estimator.     

Comparison of the Stein and the usual estimators for the regression error variance under the Pitman nearness criterion when variables are omitted

This paper compares the Stein and the usual estimators of the error variance under the Pitman nearness (PN) criterion in a regression model which is mis-specified due to missing relevant explanatory variables. The exact expression of the PN-probability is derived and numerically evaluated. Contrary to the well-known result under mean squared errors (MSE), with the PN criterion the Stein variance estimator is uniformly dominated by the usual estimator when no relevant variables are excluded from the model. With an increased degree of model mis-specification, neither estimator strictly dominates the other. The authors are grateful to two anonymous referees for their valuable comments. Also, the first author is grateful to the Japan Society for the Promotion of Science for partial financial support.     

A modified Liu-type estimator with an intercept term under mixture experiments

We consider ridge regression with an intercept term under mixture experiments. We propose a new estimator which is shown to be a modified version of the Liu-type estimator. The so-called compound covariate estimator is applied to modify the Liu-type estimator. We then derive a formula of the total mean squared error (TMSE) of the proposed estimator. It is shown that the new estimator improves upon existing estimators in terms of the TMSE, and the performance of the new estimator is invariant under the change of the intercept term. We demonstrate the new estimator using a real dataset on mixture experiments.     

More on the restricted Liu estimator in the logistic regression model

?iray et al. proposed a restricted Liu estimator to overcome multicollinearity in the logistic regression model. They also used a Monte Carlo simulation to study the properties of the restricted Liu estimator. However, they did not present the theoretical result about the mean squared error properties of the restricted estimator compared to MLE, restricted maximum likelihood estimator (RMLE) and Liu estimator. In this article, we compare the restricted Liu estimator with MLE, RMLE and Liu estimator in the mean squared error sense and we also present a method to choose a biasing parameter. Finally, a real data example and a Monte Carlo simulation are conducted to illustrate the benefits of the restricted Liu estimator.