A dual problem of calibration of design weights

In this note, a dual problem to the calibration of design weights of the Deville and Särndal [Calibration estimators in survey sampling, J. Amer. Statist. Assoc. 87 (1992), pp. 376–382] method has been considered. We conclude that the chi-squared distance between the design weights and the calibrated weights equals the square of the standardized Z-score obtained by the difference between the known population total of the auxiliary variable and its corresponding Horvitz and Thompson [A generalization of sampling without replacement from a finite universe, J. Amer. Statist. Assoc. 47 (1952), pp. 663–685] estimator divided by the sample standard deviation of the auxiliary variable to obtain the linear regression estimator in survey sampling.     

VARIANCE ESTIMATION IN TWO-PHASE SAMPLING

Two‐phase sampling is often used for estimating a population total or mean when the cost per unit of collecting auxiliary variables, x, is much smaller than the cost per unit of measuring a characteristic of interest, y. In the first phase, a large sample s₁ is drawn according to a specific sampling design p(s₁) , and auxiliary data x are observed for the units i∈s₁ . Given the first‐phase sample s₁ , a second‐phase sample s₂ is selected from s₁ according to a specified sampling design {p(s₂∣s₁) } , and (y, x) is observed for the units i∈s₂ . In some cases, the population totals of some components of x may also be known. Two‐phase sampling is used for stratification at the second phase or both phases and for regression estimation. Horvitz–Thompson‐type variance estimators are used for variance estimation. However, the Horvitz–Thompson ( Horvitz & Thompson, J. Amer. Statist. Assoc. 1952 ) variance estimator in uni‐phase sampling is known to be highly unstable and may take negative values when the units are selected with unequal probabilities. On the other hand, the Sen–Yates–Grundy variance estimator is relatively stable and non‐negative for several unequal probability sampling designs with fixed sample sizes. In this paper, we extend the Sen–Yates–Grundy ( Sen , J. Ind. Soc. Agric. Statist. 1953; Yates & Grundy , J. Roy. Statist. Soc. Ser. B 1953) variance estimator to two‐phase sampling, assuming fixed first‐phase sample size and fixed second‐phase sample size given the first‐phase sample. We apply the new variance estimators to two‐phase sampling designs with stratification at the second phase or both phases. We also develop Sen–Yates–Grundy‐type variance estimators of the two‐phase regression estimators that make use of the first‐phase auxiliary data and known population totals of some of the auxiliary variables.     

Exact confidence intervals for the shape parameter of the gamma distribution

In this paper exact confidence intervals (CIs) for the shape parameter of the gamma distribution are constructed using the method of Bølviken and Skovlund [Confidence intervals from Monte Carlo tests. J Amer Statist Assoc. 1996;91:1071–1078]. The CIs which are based on the maximum likelihood estimator or the moment estimator are compared to bootstrap CIs via a simulation study.     

Doubly robust empirical likelihood inference in covariate-missing data problems

Missing covariate data occurs often in regression analysis. We study methods for estimating the regression coefficients in an assumed conditional mean function when some covariates are completely observed but other covariates are missing for some subjects. We adopt the semiparametric perspective of Robins et al. [Estimation of regression coefficients when some regressors are not always observed. J Amer Statist Assoc. 1994;89:846–866] on regression analyses with missing covariates, in which they pioneered the use of two working models, the working propensity score model and the working conditional score model. A recent approach to missing covariate data analysis is the empirical likelihood method of Qin et al. [Empirical likelihood in missing data problems. J Amer Statist Assoc. 2009;104:1492–1503], which effectively combines unbiased estimating equations. In this paper, we consider an alternative likelihood approach based on the full likelihood of the observed data. This full likelihood-based method enables us to generate estimators for the vector of the regression coefficients that are (a) asymptotically equivalent to those of Qin et al. [Empirical likelihood in missing data problems. J Amer Statist Assoc. 2009;104:1492–1503] when the working propensity score model is correctly specified, and (b) doubly robust, like the augmented inverse probability weighting (AIPW) estimators of Robins et al. [Estimation of regression coefficients when some regressors are not always observed. J Am Statist Assoc. 1994;89:846–866]. Thus, the proposed full likelihood-based estimators improve on the efficiency of the AIPW estimators when the working propensity score model is correct but the working conditional score model is possibly incorrect, and also improve on the empirical likelihood estimators of Qin, Zhang and Leung [Empirical likelihood in missing data problems. J Amer Statist Assoc. 2009;104:1492–1503] when the reverse is true, that is, the working conditional score model is correct but the working propensity score model is possibly incorrect. In addition, we consider a regression method for estimation of the regression coefficients when the working conditional score model is correctly specified; the asymptotic variance of the resulting estimator is no greater than the semiparametric variance bound characterized by the theory of Robins et al. [Estimation of regression coefficients when some regressors are not always observed. J Amer Statist Assoc. 1994;89:846–866]. Finally, we compare the finite-sample performance of various estimators in a simulation study.     

A new unrelated question randomized response model

In this paper, we extend the work of Gjestvang and Singh [A new randomized response model, J. R. Statist. Soc. Ser. B (Methodological) 68 (2006), pp. 523–530] to propose a new unrelated question randomized response model that can be used for any sampling scheme. The interesting thing is that the estimator based on one sample is free from the use of known proportion of an unrelated character, unlike Horvitz et al. [The unrelated question randomized response model, Social Statistics Section, Proceedings of the American Statistical Association, 1967, pp. 65–72], Greenberg et al. [The unrelated question randomized response model: Theoretical framework, J. Amer. Statist. Assoc. 64 (1969), pp. 520–539] and Mangat et al. [An improved unrelated question randomized response strategy, Calcutta Statist. Assoc. Bull. 42 (1992), pp. 167–168] models. The relative efficiency of the proposed model with respect to the existing competitors has been studied.     

Optional versus compulsory randomized response techniques in complex surveys

In estimating the proportion of people bearing a sensitive attribute in a community, to mitigate possible evasive answer biases, Warner (J. Amer. Statist. Assoc. 60 (1965) 63) introduced a technique of randomized response (RR) in human surveys, by way of protecting individual privacy. Chaudhuri and Mukerjee (Calcutta Statist. Assoc. Bull. 34 (1985) 225; Randomized Response: Theory and Techniques, Marcel Dekker, New York) presented a modification allowing a direct response (DR) option to whom the attribute does not appear to be stigmatizing enough. Warner himself and many of his followers restrict the application of their RR devices to surveys with selection exclusively by ‘simple random sampling with replacement’. Chaudhuri (J. Statist. Plann. Inference 34 (2001a) 37; Pakistan J. Statist. 17 (3) (2001b) 259; Calcutta Statist. Assoc. Bull. 52 (205–208) (2002) 315) showed the efficacy of some of these devices when sample selection is by general unequal probabilities possibly even without replacement. Here, we present theories for unbiased estimation of the proportion along with unbiased estimation of the variances of the estimators when ‘compulsory’ or ‘optional’ RR's are gathered from persons sampled with varying probabilities. Gains in efficiency by allowing DR option rather than RR compulsion are illustrated numerically through simulation from data.     

On the distribution of the adaptive LASSO estimator

We study the distribution of the adaptive LASSO estimator [Zou, H., 2006. The adaptive LASSO and its oracle properties. J. Amer. Statist. Assoc. 101, 1418–1429] in finite samples as well as in the large-sample limit. The large-sample distributions are derived both for the case where the adaptive LASSO estimator is tuned to perform conservative model selection as well as for the case where the tuning results in consistent model selection. We show that the finite-sample as well as the large-sample distributions are typically highly nonnormal, regardless of the choice of the tuning parameter. The uniform convergence rate is also obtained, and is shown to be slower than n^-1/2$n^{-1/2}$ in case the estimator is tuned to perform consistent model selection. In particular, these results question the statistical relevance of the ‘oracle’ property of the adaptive LASSO estimator established in Zou [2006. The adaptive LASSO and its oracle properties. J. Amer. Statist. Assoc. 101, 1418–1429]. Moreover, we also provide an impossibility result regarding the estimation of the distribution function of the adaptive LASSO estimator. The theoretical results, which are obtained for a regression model with orthogonal design, are complemented by a Monte Carlo study using nonorthogonal regressors.     

A theoretical analysis of the power of biased coin designs

Outlining some recently obtained results of Hu and Rosenberger [2003. Optimality, variability, power: evaluating response-adaptive randomization procedures for treatment comparisons. J. Amer. Statist. Assoc. 98, 671–678] and Chen [2006. The power of Efron's biased coin design. J. Statist. Plann. Inference 136, 1824–1835] on the relationship between sequential randomized designs and the power of the usual statistical procedures for testing the equivalence of two competing treatments, the aim of this paper is to provide theoretical proofs of the numerical results of Chen [2006. The power of Efron's biased coin design. J. Statist. Plann. Inference 136, 1824–1835]. Furthermore, we prove that the Adjustable Biased Coin Design [Baldi Antognini A., Giovagnoli, A., 2004. A new “biased coin design” for the sequential allocation of two treatments. J. Roy. Statist. Soc. Ser. C 53, 651–664] is uniformly more powerful than the other “coin” designs proposed in the literature for any sample size.     

On the uth geometric conditional quantile

Motivated by Chaudhuri's work [1996. On a geometric notion of quantiles for multivariate data. J. Amer. Statist. Assoc. 91, 862–872] on unconditional geometric quantiles, we explore the asymptotic properties of sample geometric conditional quantiles, defined through kernel functions, in high-dimensional spaces. We establish a Bahadur-type linear representation for the geometric conditional quantile estimator and obtain the convergence rate for the corresponding remainder term. From this, asymptotic normality including bias on the estimated geometric conditional quantile is derived. Based on these results, we propose confidence ellipsoids for multivariate conditional quantiles. The methodology is illustrated via data analysis and a Monte Carlo study.     

A LAN based Neyman smooth test for Pareto distributions

The Pareto distribution is found in a large number of real world situations and is also a well-known model for extreme events. In the spirit of Neyman [1937. Smooth tests for goodness of fit. Skand. Aktuarietidskr. 20, 149–199] and Thomas and Pierce [1979. Neyman's smooth goodness-of-fit test when the hypothesis is composite. J. Amer. Statist. Assoc. 74, 441–445], we propose a smooth goodness of fit test for the Pareto distribution family which is motivated by LeCam's theory of local asymptotic normality (LAN). We establish the behavior of the associated test statistic firstly under the null hypothesis that the sample follows a Pareto distribution and secondly under local alternatives using the LAN framework. Finally, simulations are provided in order to study the finite sample behavior of the test statistic.     

Predicting random effects with an expanded finite population mixed model

Prediction of random effects is an important problem with expanding applications. In the simplest context, the problem corresponds to prediction of the latent value (the mean) of a realized cluster selected via two-stage sampling. Recently, Stanek and Singer [Predicting random effects from finite population clustered samples with response error. J. Amer. Statist. Assoc. 99, 119–130] developed best linear unbiased predictors (BLUP) under a finite population mixed model that outperform BLUPs from mixed models and superpopulation models. Their setup, however, does not allow for unequally sized clusters. To overcome this drawback, we consider an expanded finite population mixed model based on a larger set of random variables that span a higher dimensional space than those typically applied to such problems. We show that BLUPs for linear combinations of the realized cluster means derived under such a model have considerably smaller mean squared error (MSE) than those obtained from mixed models, superpopulation models, and finite population mixed models. We motivate our general approach by an example developed for two-stage cluster sampling and show that it faithfully captures the stochastic aspects of sampling in the problem. We also consider simulation studies to illustrate the increased accuracy of the BLUP obtained under the expanded finite population mixed model.     

A note on Dean's overdispersion test

This note discusses an extension to the score test statistics for overdispersion in Poisson and binomial regression models [Dean, C.B., 1992. Testing for overdispersion in Poisson and binomial regression models. J. Amer. Statist. Assoc. 87, 451–457]. Examples illustrate the application of the extended results.     

Rate of convergence for asymptotic variance of the Horvitz–Thompson estimator

Drawing distinct units without replacement and with unequal probabilities from a population is a problem often considered in the literature (e.g. Hanif and Brewer, 1980, Int. Statist. Rev. 48, 317–355). In such a case, the sample mean is a biased estimator of the population mean. For this reason, we use the unbiased Horvitz–Thompson estimator (1951). In this work, we focus our interest on the variance of this estimator. The variance is cumbersome to compute because it requires the calculation of a large number of second-order inclusion probabilities. It would be helpful to use an approximation that does not need heavy calculations. The Hájek (1964) variance approximation provides this advantage as it is free of second-order inclusion probabilities. Hájek (1964) proved that this approximation is valid under restrictive conditions that are usually not fulfilled in practice. In this paper, we give more general conditions and we show that this approximation remains acceptable for most practical problems.     

Tests for assessment of agreement using probability criteria

For the assessment of agreement using probability criteria, we obtain an exact test, and for sample sizes exceeding 30, we give a bootstrap-t$t$ test that is remarkably accurate. We show that for assessing agreement, the total deviation index approach of Lin [2000. Total deviation index for measuring individual agreement with applications in laboratory performance and bioequivalence. Statist. Med. 19, 255–270] is not consistent and may not preserve its asymptotic nominal level, and that the coverage probability approach of Lin et al. [2002. Statistical methods in assessing agreement: models, issues and tools. J. Amer. Statist. Assoc. 97, 257–270] is overly conservative for moderate sample sizes. We also show that the nearly unbiased test of Wang and Hwang [2001. A nearly unbiased test for individual bioequivalence problems using probability criteria. J. Statist. Plann. Inference 99, 41–58] may be liberal for large sample sizes, and suggest a minor modification that gives numerically equivalent approximation to the exact test for sample sizes 30 or less. We present a simple and accurate sample size formula for planning studies on assessing agreement, and illustrate our methodology with a real data set from the literature.     

Likelihood ratio tests for variance components in linear mixed models

Although the asymptotic distributions of the likelihood ratio for testing hypotheses of null variance components in linear mixed models derived by Stram and Lee [1994. Variance components testing in longitudinal mixed effects model. Biometrics 50, 1171–1177] are valid, their proof is based on the work of Self and Liang [1987. Asymptotic properties of maximum likelihood estimators and likelihood tests under nonstandard conditions. J. Amer. Statist. Assoc. 82, 605–610] which requires identically distributed random variables, an assumption not always valid in longitudinal data problems. We use the less restrictive results of Vu and Zhou [1997. Generalization of likelihood ratio tests under nonstandard conditions. Ann. Statist. 25, 897–916] to prove that the proposed mixture of chi-squared distributions is the actual asymptotic distribution of such likelihood ratios used as test statistics for null variance components in models with one or two random effects. We also consider a limited simulation study to evaluate the appropriateness of the asymptotic distribution of such likelihood ratios in moderately sized samples.     

Non-parametric bootstrap recycling

The double bootstrap provides diagnostics for bootstrap calculations and, if need be, appropriate adjustments. The amount of computation involved is usually considerable, and recycling provides a less computer intensive alternative. Recycling consists of using repeatedly the same samples drawn from a recycling distribution G for estimation under each first-level bootstrap distribution, rather than independently repeating the simulation and estimation steps for each of these.Recycling is successful in parametric applications of the bootstrap, as demonstrated by M.A. Newton and C.J. Geyer (J. Amer. Statist. Assoc. 89: 905–912, 1994). We show that it is bound to fail in non-parametric bootstrap applications, and suggest a modification that makes the method work. The modification consists of smoothing the first-level bootstrap distributions, with the desired consequence that this removes the zero probabilities in the multinomial distributions that define them. We also discuss efficient choices of recycling distributions, both in terms of estimator efficiency and simulation efficiency.     

Seemingly unrelated reduced-rank regression model

Reduced-rank regression models proposed by Anderson [1951. Estimating linear restrictions on regression coefficients for multivariate normal distributions. Ann. Math. Statist. 22, 327–351] have been used in various applications in social and natural sciences. In this paper we combine the features of these models with another popular, seemingly unrelated regression model proposed by Zellner [1962. An efficient method of estimating seemingly unrelated regressions and tests for aggregation bias. J. Amer. Statist. Assoc. 57, 348–368]. In addition to estimation and inference aspects of the new model, we also discuss an application in the area of marketing.     

Pseudo-Bayes and pseudo-empirical Bayes estimators in randomized response sampling

In this article, new pseudo-Bayes and pseudo-empirical Bayes estimators for estimating the proportion of a potentially sensitive attribute in a survey sampling have been introduced. The proposed estimators are compared with the recent estimator proposed by Odumade and Singh [Efficient use of two decks of cards in randomized response sampling, Comm. Statist. Theory Methods 38 (2009), pp. 439–446] and Warner [Randomized response: A survey technique for eliminating evasive answer bias, J. Amer. Statist. Assoc. 60 (1965), pp. 63–69].     

A new approach to use multivariate auxiliary information in sample surveys

A new approach to form multivariate difference estimator is suggested which does not require the knowledge of unknown population parameters as such. It gives minimum variance among the class of multivariate difference estimators. The performance of this estimator with respect to Des Raj's (J. Amer. Statist. Assoc. 60 (1965), 270–277) multivariate difference estimator is illustrated. Using the information on two auxiliary variates, the robustness of Des Raj's estimator y_d is studied empirically. Two new estimators to estimate population mean/total are developed on the same lines as that of y_d. The performance of these estimators is studied for a wide variety of populations.     

Calibrated linear unbiased estimators in finite population sampling

Sugden and Smith [2002. Exact linear unbiased estimation in survey sampling. J. Stat. Plann. Inf. 102, 25–38] and Rao [2002. Discussion of “Exact linear unbiased estimation in survey sampling”. J. Stat. Plann. Inf. 102, 39–40] suggested some useful techniques of deriving a linear unbiased estimator of a finite population total by modifying a given linear estimator. In this paper we suggest various generalizations of their results. In particular, we search for estimators satisfying the calibration property with respect to a related auxiliary variable and obtain some new calibrated unbiased ratio-type estimators for arbitrary sampling designs. We also explore a few properties of one of the estimators suggested in Sugden and Smith [2002. Exact linear unbiased estimation in survey sampling. J. Stat. Plann. Inf. 102, 25–38].