Root-n-consistent Estimation in Partial Linear Models with Long-memory Errors

We consider estimation of β in the semiparametric regression model y ( i ) - x ^T( i )β + f ( i / n ) + ε( i ) where x ( i ) = g ( i )/ n ) + e ( i , f and g are unknown smooth functions and the processes ε( i ) and e ( i ) are stationary with short- or long-range dependence. For the case of i.i.d. errors, Speckman (1988) proposed a √ n –consistent estimator of β. In this paper it is shown that, under suitable regularity conditions, this estimator is asymptotically unbiased and √ n –consistent even if the errors exhibit long-range dependence. The orders of the finite sample bias and of the required bandwidth depend on the long-memory parameters. Simulations and a data example illustrate the method     

A package of four edited books on structural equations modeling

We consider two analytical and a bootstrap bias correction scheme existing in the literature for maximum likelihood estimators (MLEs) in the special case of a particular biparametric exponential family, the estimators being obtained from i.i.d. samples. We assess the performances of the estimators through numerical simulations for three particular cases of the family explored here. We observe that the two analytical proposals display very similar behavior for these distributions and that all proposed estimators are effective in reducing bias and mean square error of the MLEs.     

Estimating Archimedean Copulas in High Dimensions

Abstract. This article presents a novel estimation procedure for high‐dimensional Archimedean copulas. In contrast to maximum likelihood estimation, the method presented here does not require derivatives of the Archimedean generator. This is computationally advantageous for high‐dimensional Archimedean copulas in which higher‐order derivatives are needed but are often difficult to obtain. Our procedure is based on a parameter‐dependent transformation of the underlying random variables to a one‐dimensional distribution where a minimum‐distance method is applied. We show strong consistency of the resulting minimum‐distance estimators to the case of known margins as well as to the case of unknown margins when pseudo‐observations are used. Moreover, we conduct a simulation comparing the performance of the proposed estimation procedure with the well‐known maximum likelihood approach according to bias and standard deviation.     

Estimation of Stigmatized Characteristics of a Hidden Gang in a Finite Population

This paper considers the problem of estimating the size and mean value of a stigmatized quantitative character of a hidden gang in a finite population. The proposed method may be applied to solve domestic problems in a particular country or across countries: for example, a government may be interested in estimating the average income of victims or perpetrators of domestic violence. The proposed method is based on the technique introduced by Warner (1965) to estimate the proportion of a sensitive attribute in a finite population without threatening the privacy of the respondents. Expressions for the bias and variance of the proposed estimators are given, to a first order of approximation. Circumstances in which the method can be applied are studied and illustrated using a numerical example.     

Variance estimation based on blocked 3×2 cross-validation in high-dimensional linear regression

In high-dimensional linear regression, the dimension of variables is always greater than the sample size. In this situation, the traditional variance estimation technique based on ordinary least squares constantly exhibits a high bias even under sparsity assumption. One of the major reasons is the high spurious correlation between unobserved realized noise and several predictors. To alleviate this problem, a refitted cross-validation (RCV) method has been proposed in the literature. However, for a complicated model, the RCV exhibits a lower probability that the selected model includes the true model in case of finite samples. This phenomenon may easily result in a large bias of variance estimation. Thus, a model selection method based on the ranks of the frequency of occurrences in six votes from a blocked 3×2 cross-validation is proposed in this study. The proposed method has a considerably larger probability of including the true model in practice than the RCV method. The variance estimation obtained using the model selected by the proposed method also shows a lower bias and a smaller variance. Furthermore, theoretical analysis proves the asymptotic normality property of the proposed variance estimation.     

A characterization of power method transformations through the method of percentiles

This article derives closed-form solutions for fifth-ordered power method polynomial transformations based on the Method of Percentiles (MOP). A proposed MOP univariate procedure is compared with the Method of Moments (MOM) in the context of distribution fitting and estimating the shape functions. The MOP is also extended from univariate to multivariate data generation. The MOP procedure has an advantage because it does not require numerical integration to compute intermediate correlations and can be applied to distributions, where conventional moments do not exist. Simulation results demonstrate that the proposed MOP procedure is superior in terms of estimation, bias, and error.     

Towards a unified definition of maximum likelihood

A unified definition of maximum likelihood (ml) is given. It is based on a pairwise comparison of probability measures near the observed data point. This definition does not suffer from the usual inadequacies of earlier definitions, i.e., it does not depend on the choice of a density version in the dominated case. The definition covers the undominated case as well, i.e., it provides a consistent approach to nonparametric ml problems, which heretofore have been solved on a more less ad hoc basis. It is shown that the new ml definition is a true extension of the classical ml approach, as it is practiced in the dominated case. Hence the classical methodology can simply be subsumed. Parametric and nonparametric examples are discussed.     

Bias-corrected maximum semiparametric likelihood estimation under logistic regression models based on case–control data

We consider the corrective approach (Theoretical Statistics, Chapman & Hall, London, 1974, p. 310) and preventive approach (Biometrica 80 (1993) 27) to bias reduction of maximum likelihood estimators under the logistic regression model based on case–control data. The proposed bias-corrected maximum likelihood estimators are based on the semiparametric profile log likelihood function under a two-sample semiparametric model, which is equivalent to the assumed logistic regression model. We show that the prospective and retrospective analyses on the basis of the corrective approach to bias reduction produce identical bias-corrected maximum likelihood estimators of the odds ratio parameter, but this does not hold when using the preventive approach unless the case and control sample sizes are identical. We present some results on simulation and on the analysis of two real data sets.     

Efficient M-estimators with auxiliary information

This paper introduces a new class of M-estimators based on generalised empirical likelihood (GEL) estimation with some auxiliary information available in the sample. The resulting class of estimators is efficient in the sense that it achieves the same asymptotic lower bound as that of the efficient generalised method of moment (GMM) estimator with the same auxiliary information. The paper also shows that in case of smooth estimating equations the proposed estimators enjoy a small second order bias property compared to both efficient GMM and full GEL estimators. Analytical formulae to obtain bias corrected estimators are also provided. Simulations show that with correctly specified auxiliary information the proposed estimators and in particular those based on empirical likelihood outperform standard M and efficient GMM estimators both in terms of finite sample bias and efficiency. On the other hand with moderately misspecified auxiliary information estimators based on the nonparametric tilting method are typically characterised by the best finite sample properties.     

Robust quasi-randomization-based estimation with ensemble learning for missing data

Missing data analysis requires assumptions about an outcome model or a response probability model to adjust for potential bias due to nonresponse. Doubly robust (DR) estimators are consistent if at least one of the models is correctly specified. Multiply robust (MR) estimators extend DR estimators by allowing for multiple models for both the outcome and/or response probability models and are consistent if at least one of the multiple models is correctly specified. We propose a robust quasi-randomization-based model approach to bring more protection against model misspecification than the existing DR and MR estimators, where any multiple semiparametric, nonparametric or machine learning models can be used for the outcome variable. The proposed estimator achieves unbiasedness by using a subsampling Rao–Blackwell method, given cell-homogenous response, regardless of any working models for the outcome. An unbiased variance estimation formula is proposed, which does not use any replicate jackknife or bootstrap methods. A simulation study shows that our proposed method outperforms the existing multiply robust estimators.     

The cross-product ratio in bivariate lognormal and gamma distributions,with an application to non-randomized trials

Non-randomized trials can give a biased impression of the effectiveness of any intervention. We consider trials in which incidence rates are compared in two areas over two periods. Typically, one area receives an intervention, whereas the other does not. We outline and illustrate a method to estimate the bias in such trials under two different bivariate models. The illustrations use data in which no particular intervention is operating. The purpose is to illustrate the size of the bias that could be observed purely due to regression towards the mean (RTM). The illustrations show that the bias can be appreciably different from zero, and even when centred on zero, the variance of the bias can be large. We conclude that the results of non-randomized trials should be treated with caution, as interventions which show small effects could be explained as artefacts of RTM.     

Monte Carlo Approximations of the Quantiles of a Sample Statistic

We consider in this article the problem of numerically approximating the quantiles of a sample statistic for a given population, a problem of interest in many applications, such as bootstrap confidence intervals. The proposed Monte Carlo method can be routinely applied to handle complex problems that lack analytical results. Furthermore, the method yields estimates of the quantiles of a sample statistic of any sample size though Monte Carlo simulations for only two optimally selected sample sizes are needed. An analysis of the Monte Carlo design is performed to obtain the optimal choices of these two sample sizes and the number of simulated samples required for each sample size. Theoretical results are presented for the bias and variance of the numerical method proposed. The results developed are illustrated via simulation studies for the classical problem of estimating a bivariate linear structural relationship. It is seen that the size of the simulated samples used in the Monte Carlo method does not have to be very large and the method provides a better approximation to quantiles than those based on an asymptotic normal theory for skewed sampling distributions.     

Choosing between two unknown intervals: an empirical bayes testing approach to a classification problem

Let X₁,X₂…be i.i.d. observations from a mixture density. The support of the unknown prior distribution is the union of two unknown intervals. The paper deals with an empirical Bayes testing approach (?≤ c against>c where c is an unknown parameter to be estimated) in order to classify the observed variables as coming from one population or the other as ? belongs to one or the other unknown interval. Two methods are proposed in which asymptotically optimal decision rules are constructed avoiding the estimation of the unknown prior. The first method deals with the case of exponential families and is a generalization of the method of Johns and Van Ryzin (1971, 1972) whereas the second one deals with families that are closed under convolution and is a Fourier method. The application of the Fourier method to some densities (i.e. contaminated Gaussian distributions, exponential distribution, double-exponential distribution) which are interesting in view of applications and which cannot be studied by means of the direct method, is also considered herein.     

Continuous covariate frailty models for censored and truncated clustered data

Using some logarithmic and integral transformation we transform a continuous covariate frailty model into a polynomial regression model with a random effect. The responses of this mixed model can be ‘estimated’ via conditional hazard function estimation. The random error in this model does not have zero mean and its variance is not constant along the covariate and, consequently, these two quantities have to be estimated. Since the asymptotic expression for the bias is complicated, the two-large-bandwidth trick is proposed to estimate the bias. The proposed transformation is very useful for clustered incomplete data subject to left truncation and right censoring (and for complex clustered data in general). Indeed, in this case no standard software is available to fit the frailty model, whereas for the transformed model standard software for mixed models can be used for estimating the unknown parameters in the original frailty model. A small simulation study illustrates the good behavior of the proposed method. This method is applied to a bladder cancer data set.     

Bias Reduction through First-order Mean Correction, Bootstrapping and Recursive Mean Adjustment

Standard methods of estimation for autoregressive models are known to be biased in finite samples, which has implications for estimation, hypothesis testing, confidence interval construction and forecasting. Three methods of bias reduction are considered here: first-order bias correction, FOBC, where the total bias is approximated by the O(T^-1) bias; bootstrapping; and recursive mean adjustment, RMA. In addition, we show how first-order bias correction is related to linear bias correction. The practically important case where the AR model includes an unknown linear trend is considered in detail. The fidelity of nominal to actual coverage of confidence intervals is also assessed. A simulation study covers the AR(1) model and a number of extensions based on the empirical AR(p) models fitted by Nelson & Plosser (1982). Overall, which method dominates depends on the criterion adopted: bootstrapping tends to be the best at reducing bias, recursive mean adjustment is best at reducing mean squared error, whilst FOBC does particularly well in maintaining the fidelity of confidence intervals.     

Edgeworth expansions for nonparametric distribution estimation with applications

In this paper, we will investigate the nonparametric estimation of the distribution function F of an absolutely continuous random variable. Two methods are analyzed: the first one based on the empirical distribution function, expressed in terms of i.i.d. lattice random variables and, secondly, the kernel method, which involves nonlattice random vectors dependent on the sample size n; this latter procedure produces a smooth distribution estimator that will be explicitly corrected to reduce the effect of bias or variance. For both methods, the non-Studentized and Studentized statistics are considered as well as their bootstrap counterparts and asymptotic expansions are constructed to approximate their distribution functions via the Edgeworth expansion techniques. On this basis, we will obtain confidence intervals for F(x) and state the coverage error order achieved in each case.     

Assessing large sample bias in misspecified model scenarios with reference to exposure model misspecification in errors-in-variable regression: A new computational approach

In this paper, we develop a numerical method for evaluating the large sample bias in estimated regression coefficients arising due to exposure model misspecification while adjusting for measurement errors in errors-in-variable regression. The application of the proposed method has been demonstrated in the case of a logistic errors-in-variable regression model. The method is based on the combination of Monte-Carlo, numerical and, in some special cases, analytic integration techniques. The proposed method facilitates the investigation of the limiting bias in the estimated regression parameters based on a single data set rather than on repeated data sets as required by the conventional repeated sample method. Simulation studies demonstrate that the proposed method provides very similar estimates of bias in the estimated regression parameters under exposure model misspecification in logistic errors-in-variable regression with a higher degree of precision as compared to the conventional repeated sample method.     

Estimation of the correlation coefficient in probability proportional to size with replacement sampling

g of the population correlation coefficient has been suggested in case of probability proportional to size with replacement sampling. The asymptotic bias, variance and the estimate of the variance of the estimator r_g have been obtained. A comparison of this estimator has been made with the estimator r given by Gupta et al (1993) and usual estimator r₁ for PPSWR sampling. The proposed estimator r_g satisfies the condition −1≤r_g≤1 which the estimator r does not satisfy. Received: September 1, 1999; revised version: May 29, 2001     

Extrapolation of subsampling distribution estimators: The i.i.d. and strong mixing cases

Politis & Romano (1994) proposed a general subsampling methodology for the construction of large‐sample confidence regions for an arbitrary parameter under minimal conditions. Nevertheless, the subsampling distribution estimators may sometimes be inefficient (in the case of the sample mean of i.i.d. data, for instance) as compared to alternative estimators such as the bootstrap and/or the asymptotic normal distribution (with estimated variance). The authors investigate here the extent to which the performance of subsampling distribution estimators can be improved by interpolation and extrapolation techniques, while at the same time retaining the robustness property of consistent distribution estimation even in nonregular cases; both i.i.d. and weakly dependent (mixing) observations are considered.     

Heterogeneity and study size in random-effects meta-analysis

It is well known that heterogeneity between studies in a meta-analysis can be either caused by diversity, for example, variations in populations and interventions, or caused by bias, that is, variations in design quality and conduct of the studies. Heterogeneity that is due to bias is difficult to deal with. On the other hand, heterogeneity that is due to diversity is taken into account by a standard random-effects model. However, such a model generally assumes that heterogeneity does not vary according to study-level variables such as the size of the studies in the meta-analysis and the type of study design used. This paper develops models that allow for this type of variation in heterogeneity and discusses the properties of the resulting methods. The models are fitted using the maximum-likelihood method and by modifying the Paule–Mandel method. Furthermore, a real-world argument is given to support the assumption that the inter-study variance is inversely proportional to study size. Under this assumption, the corresponding random-effects method is shown to be connected with standard fixed-effect meta-analysis in a way that may well appeal to many clinicians. The models and methods that are proposed are applied to data from two large systematic reviews.