Generalized estimating equations for mixtures with varying concentrations

A finite mixture model is considered in which the mixing probabilities vary from observation to observation. A parametric model is assumed for one mixture component distribution, while the others are nonparametric nuisance parameters. Generalized estimating equations (GEE) are proposed for the semi‐parametric estimation. Asymptotic normality of the GEE estimates is demonstrated and the lower bound for their dispersion (asymptotic covariance) matrix is derived. An adaptive technique is developed to derive estimates with nearly optimal small dispersion. An application to the sociological analysis of voting results is discussed. The Canadian Journal of Statistics 41: 217–236; 2013 © 2013 Statistical Society of Canada     

Exact likelihood ratio and score confidence intervals for the binomial proportion

Many methods are available for computing a confidence interval for the binomial parameter, and these methods differ in their operating characteristics. It has been suggested in the literature that the use of the exact likelihood ratio (LR) confidence interval for the binomial proportion should be considered. This paper provides an evaluation of the operating characteristics of the two‐sided exact LR and exact score confidence intervals for the binomial proportion and compares these results to those for three other methods that also strictly maintain nominal coverage: Clopper‐Pearson, Blaker, and Casella. In addition, the operating characteristics of the two‐sided exact LR method and exact score method are compared with those of the corresponding asymptotic methods to investigate the adequacy of the asymptotic approximation. Copyright © 2013 John Wiley & Sons, Ltd.     

A Copula‐Based Non‐parametric Measure of Regression Dependence

Abstract. This article presents a framework for comparing bivariate distributions according to their degree of regression dependence. We introduce the general concept of a regression dependence order (RDO). In addition, we define a new non‐parametric measure of regression dependence and study its properties. Besides being monotone in the new RDOs, the measure takes on its extreme values precisely at independence and almost sure functional dependence, respectively. A consistent non‐parametric estimator of the new measure is constructed and its asymptotic properties are investigated. Finally, the finite sample properties of the estimate are studied by means of a small simulation study.     

Flexible Copula Density Estimation with Penalized Hierarchical B‐splines

The paper introduces a new method for flexible spline fitting for copula density estimation. Spline coefficients are penalized to achieve a smooth fit. To weaken the curse of dimensionality, instead of a full tensor spline basis, a reduced tensor product based on so called sparse grids (Notes Numer. Fluid Mech. Multidiscip. Des., 31, 1991, 241‐251) is used. To achieve uniform margins of the copula density, linear constraints are placed on the spline coefficients, and quadratic programming is used to fit the model. Simulations and practical examples accompany the presentation.     

Extended generalised Pareto models for tail estimation

The most popular approach in extreme value statistics is the modelling of threshold exceedances using the asymptotically motivated generalised Pareto distribution. This approach involves the selection of a high threshold above which the model fits the data well. Sometimes, few observations of a measurement process might be recorded in applications and so selecting a high quantile of the sample as the threshold leads to almost no exceedances. In this paper we propose extensions of the generalised Pareto distribution that incorporate an additional shape parameter while keeping the tail behaviour unaffected. The inclusion of this parameter offers additional structure for the main body of the distribution, improves the stability of the modified scale, tail index and return level estimates to threshold choice and allows a lower threshold to be selected. We illustrate the benefits of the proposed models with a simulation study and two case studies.     

Estimation of the association for bivariate doubly censored data

We study the problem of estimating the association between two related survival variables when they follow a copula model and the bivariate doubly censored data is available. A two-stage estimation procedure is proposed and the asymptotic properties of the proposed estimator are established. Simulation studies are conducted to investigate the finite sample properties of the proposed estimate.     

Nonparametric Bayes factors based on empirical likelihood ratios

Bayes methodology provides posterior distribution functions based on parametric likelihoods adjusted for prior distributions. A distribution-free alternative to the parametric likelihood is use of empirical likelihood (EL) techniques, well known in the context of nonparametric testing of statistical hypotheses. Empirical likelihoods have been shown to exhibit many of the properties of conventional parametric likelihoods. In this paper, we propose and examine Bayes factors (BF) methods that are derived via the EL ratio approach. Following Kass and Wasserman (1995), we consider Bayes factors type decision rules in the context of standard statistical testing techniques. We show that the asymptotic properties of the proposed procedure are similar to the classical BF's asymptotic operating characteristics. Although we focus on hypothesis testing, the proposed approach also yields confidence interval estimators of unknown parameters. Monte Carlo simulations were conducted to evaluate the theoretical results as well as to demonstrate the power of the proposed test.     

Pmc-optimal nonparametric quantile estimator

According to Pitman's Measure of Closeness, if T₁and T₂are two estimators of a real parameter $[d], then T₁is better than T₂if Po[d]{T₁-o[d] < T₂-0[d]} > 1/2 for all 0[d]. It may however happen that while T₁is better than T₂and T₂is better than T₃, T₃is better than T₁. Given q ? (0,1) and a sample X₁, X₂, ..., X_nfrom an unknown F ? F, an estimator T* = T*(X₁,X₂...X_n)of the q-th quantile of the distribution F is constructed such that P_F{F(T*)-q <[d] F(T)-q} >[d] 1/2 for all F?F and for all T€T, where F is a nonparametric family of distributions and T is a class of estimators. It is shown that T* =X_j:n'for a suitably chosen jth order statistic.     

Progressive type II censored order statistics from exponential distributions

In the model of progressive type II censoring, point and interval estimation as well as relations for single and product moments are considered. Based on two-parameter exponential distributions, maximum likelihood estimators (MLEs), uniformly minimum variance unbiased estimators (UMVUEs) and best linear unbiased estimators (BLUEs) are derived for both location and scale parameters. Some properties of these estimators are shown. Moreover, results for single and product moments of progressive type II censored order statistics are presented to obtain recurrence relations from exponential and truncated exponential distributions. These relations may then be used to compute all the means, variances and covariances of progressive type II censored order statistics based on exponential distributions for arbitrary censoring schemes. The presented recurrence relations simplify those given by Aggarwala and Balakrishnan (1996)     

On optimising the estimation of high quantiles of a probability distribution

One of the major aims of one-dimensional extreme-value theory is to estimate quantiles outside the sample or at the boundary of the sample. The underlying idea of any method to do this is to estimate a quantile well inside the sample but near the boundary and then to shift it somehow to the right place. The choice of this “anchor quantile” plays a major role in the accuracy of the method. We present a bootstrap method to achieve the optimal choice of sample fraction in the estimation of either high quantile or endpoint estimation which extends earlier results by Hall and Weissman (1997) in the case of high quantile estimation. We give detailed results for the estimators used by Dekkers et al. (1989). An alternative way of attacking problems like this one is given in a paper by Drees and Kaufmann (1998).