Consistency of semiparametric maximum likelihood estimators for two‐phase sampling

Semiparametric maximum likelihood estimators have recently been proposed for a class of two‐phase, outcome‐dependent sampling models. All of them were “restricted” maximum likelihood estimators, in the sense that the maximization is carried out only over distributions concentrated on the observed values of the covariate vectors. In this paper, the authors give conditions for consistency of these restricted maximum likelihood estimators. They also consider the corresponding unrestricted maximization problems, in which the “absolute” maximum likelihood estimators may then have support on additional points in the covariate space. Their main consistency result also covers these unrestricted maximum likelihood estimators, when they exist for all sample sizes.     

Reliability estimation for the exponential distribution

This paper is concerned with classical statistical estimation of the reliability function for the exponential density with unknown mean failure time θ, and with a known and fixed mission time τ. The minimum variance unbiased (MVU) estimator and the maximum likelihood (ML) estimator are reviewed and their mean square errors compared for different sample sizes. These comparisons serve also to extend previous work, and reinforce further the nonexistence of a uniformly best estimator. A class of shrunken estimators is then defined, and it produces a shrunken quasi-estimator and a shrunken estimator. The mean square errors for both these estimators are compared to the mean square errors of the MVU and ML estimators, and the new estimators are found to perform very well. Unfortunately, these estimators are difficult to compute for practical applications. A second class of estimators, which is easy to compute is also developed. Its mean square error properties are compared to the other estimators, and it outperforms all the contending estimators over the high and low reliability parameter space. Since, for all the estimators, analytical mean square error comparisons are not tractable, extensive numerical analyses are done in obtaining both the exact small sample and large sample results.     

Estimating spatial means with an application to remotely sensed data

The paper examines alternative estimators for the mean of a spatial process where observations are not independent. Properties of the sample mean and its standard error are contrasted with those of maximum likelihood estimators derived for three spatial models. The information loss caused by spatial dependency in the data is examined. The distribution theory for the estimators is reviewed and the paper concludes with an empirical example illustrating the properties of the estimators and the practical benefits of the maximum likelihood procedure.     

Robust linear discriminant analysis using S‐estimators

The authors consider a robust linear discriminant function based on high breakdown location and covariance matrix estimators. They derive influence functions for the estimators of the parameters of the discriminant function and for the associated classification error. The most B‐robust estimator is determined within the class of multivariate S‐estimators. This estimator, which minimizes the maximal influence that an outlier can have on the classification error, is also the most B‐robust location S‐estimator. A comparison of the most B‐robust estimator with the more familiar biweight S‐estimator is made.     

On the application of extended quasi‐likelihood to the clustered data case

The author describes the relationship between the extended generalized estimating equations (EGEEs) of Hall & Severini (1998) and various similar methods. He proposes a true extended quasi‐likelihood approach for the clustered data case and explores restricted maximum likelihood‐like versions of the EGEE and extended quasi‐likelihood estimating equations. He also presents simulation results comparing the various estimators in terms of mean squared error of estimation based on three moderate sample size, discrete data situations.     

MAXIMUM LIKELIHOOD ESTIMATION FOR A POISSON RATE PARAMETER WITH MISCLASSIFIED COUNTS

This paper proposes a Poisson‐based model that uses both error‐free data and error‐prone data subject to misclassification in the form of false‐negative and false‐positive counts. It derives maximum likelihood estimators (MLEs) for the Poisson rate parameter and the two misclassification parameters — the false‐negative parameter and the false‐positive parameter. It also derives expressions for the information matrix and the asymptotic variances of the MLE for the rate parameter, the MLE for the false‐positive parameter, and the MLE for the false‐negative parameter. Using these expressions the paper analyses the value of the fallible data. It studies characteristics of the new double‐sampling rate estimator via a simulation experiment and applies the new MLE estimators and confidence intervals to a real dataset.     

Estimation of two order restricted normal means with unknown and possibly unequal variances

Estimation of each of and linear functions of two order restricted normal means is considered when variances are unknown and possibly unequal. We replace unknown variances with sample variances and construct isotonic regression estimators, which we call in our paper the plug-in estimators, to estimate ordered normal means. Under squared error loss, a necessary and sufficient condition is given for the plug-in estimators to improve upon the unrestricted maximum likelihood estimators uniformly. As for the estimation of linear functions of ordered normal means, we also show that when variances are known, the restricted maximum likelihood estimator always improves upon the unrestricted maximum likelihood estimator uniformly, but when variances are unknown, the plug-in estimator does not always improve upon the unrestricted maximum likelihood estimator uniformly.     

Estimation for Location-Scale Models with Censored Data

This article considers a class of estimators for the location and scale parameters in the location-scale model based on ‘synthetic data’ when the observations are randomly censored on the right. The asymptotic normality of the estimators is established using counting process and martingale techniques when the censoring distribution is known and unknown, respectively. In the case when the censoring distribution is known, we show that the asymptotic variances of this class of estimators depend on the data transformation and have a lower bound which is not achievable by this class of estimators. However, in the case that the censoring distribution is unknown and estimated by the Kaplan–Meier estimator, this class of estimators has the same asymptotic variance and attains the lower bound for variance for the case of known censoring distribution. This is different from censored regression analysis, where asymptotic variances depend on the data transformation. Our method has three valuable advantages over the method of maximum likelihood estimation. First, our estimators are available in a closed form and do not require an iterative algorithm. Second, simulation studies show that our estimators being moment-based are comparable to maximum likelihood estimators and outperform them when sample size is small and censoring rate is high. Third, our estimators are more robust to model misspecification than maximum likelihood estimators. Therefore, our method can serve as a competitive alternative to the method of maximum likelihood in estimation for location-scale models with censored data. A numerical example is presented to illustrate the proposed method.     

The Double Gaussian Approximation for High Frequency Data

Abstract High frequency data have become an important feature of many areas of research. They permit the creation of estimators in highly non‐parametric classes of continuous‐time models. In the context of continuous semi‐martingale models, we here provide a locally parametric ‘double Gaussian’ approximation, to facilitate the analysis of estimators. As in Mykland and Zhang (Econometrica, 77, 2009, p. 1403), the error in the approximation can be offset with a postasymptotic likelihood correction. The current approximation is valid in large neighbourhoods, permitting a sharp analysis of estimators that use local behaviour over asymptotically increasing numbers of observations.     

Variance least squares estimators for multivariate linear mixed model

Non-iterative, distribution-free, and unbiased estimators of variance components by least squares method are derived for multivariate linear mixed model. A general inter-cluster variance matrix, a same-member only general inter-response variance matrix, and an uncorrelated intra-cluster error structure for each response are assumed. Projection method is suggested when unbiased estimators of variance components are not nonnegative definite matrices. A simulation study is conducted to investigate the properties of the proposed estimators in terms of bias and mean square error with comparison to the Gaussian (restricted) maximum likelihood estimators. The proposed estimators are illustrated by an application of gene expression familial study.     

Generalised quasi‐likelihood inference in a semi‐parametric binary dynamic mixed logit model

There exists a recent study where dynamic mixed‐effects regression models for count data have been extended to a semi‐parametric context. However, when one deals with other discrete data such as binary responses, the results based on count data models are not directly applicable. In this paper, we therefore begin with existing binary dynamic mixed models and generalise them to the semi‐parametric context. For inference, we use a new semi‐parametric conditional quasi‐likelihood (SCQL) approach for the estimation of the non‐parametric function involved in the semi‐parametric model, and a semi‐parametric generalised quasi‐likelihood (SGQL) approach for the estimation of the main regression, dynamic dependence and random effects variance parameters. A semi‐parametric maximum likelihood (SML) approach is also used as a comparison to the SGQL approach. The properties of the estimators are examined both asymptotically and empirically. More specifically, the consistency of the estimators is established and finite sample performances of the estimators are examined through an intensive simulation study.     

Empirical Likelihood Local Polynomial Regression Analysis of Clustered Data

Abstract. In this article, a naive empirical likelihood ratio is constructed for a non‐parametric regression model with clustered data, by combining the empirical likelihood method and local polynomial fitting. The maximum empirical likelihood estimates for the regression functions and their derivatives are obtained. The asymptotic distributions for the proposed ratio and estimators are established. A bias‐corrected empirical likelihood approach to inference for the parameters of interest is developed, and the residual‐adjusted empirical log‐likelihood ratio is shown to be asymptotically chi‐squared. These results can be used to construct a class of approximate pointwise confidence intervals and simultaneous bands for the regression functions and their derivatives. Owing to our bias correction for the empirical likelihood ratio, the accuracy of the obtained confidence region is not only improved, but also a data‐driven algorithm can be used for selecting an optimal bandwidth to estimate the regression functions and their derivatives. A simulation study is conducted to compare the empirical likelihood method with the normal approximation‐based method in terms of coverage accuracies and average widths of the confidence intervals/bands. An application of this method is illustrated using a real data set.     

Estimation of three-parameter exponentiated-Weibull distribution under type-II censoring

The present article obtains the point estimators of the exponentiated-Weibull parameters when all the three parameters of the distribution are unknown. Maximum likelihood estimator generalized maximum likelihood estimator and Bayes estimators are proposed for three-parameter exponentiated-Weibull distribution when available sample is type-II censored. Independent non-informative types of priors are considered for the unknown parameters to develop generalized maximum likelihood estimator and Bayes estimators. Although the proposed estimators cannot be expressed in nice closed forms, these can be easily obtained through the use of appropriate numerical techniques. The performances of these estimators are studied on the basis of their risks, computed separately under LINEX loss and squared error loss functions through Monte-Carlo simulation technique. An example is also considered to illustrate the estimators.     

The Information Geometric Structure of Generalized Empirical Likelihood Estimators

The generalized empirical likelihood (GEL) method produces a class of estimators of parameters defined via general estimating equations. This class includes several important estimators, such as empirical likelihood (EL), exponential tilting (ET), and continuous updating estimators (CUE). We examine the information geometric structure of GEL estimators. We introduce a class of estimators closely related to the class of minimum divergence (MD) estimators and show that there is a one-to-one correspondence between this class and the class GEL.     

Measurement Error Correction by Exploiting Gene–Environment Independence in Family‐Based Case–Control Studies

Abstract. Family‐based case–control designs are commonly used in epidemiological studies for evaluating the role of genetic susceptibility and environmental exposure to risk factors in the etiology of rare diseases. Within this framework, it is often reasonable to assume genetic susceptibility and environmental exposure being conditionally independent of each other within families in the source population. We focus on this setting to explore the situation of measurement error affecting the assessment of the environmental exposure. We correct for measurement error through a likelihood‐based method. We exploit a conditional likelihood approach to relate the probability of disease to the genetic and the environmental risk factors. We show that this approach provides less biased and more efficient results than that based on logistic regression. Regression calibration, instead, provides severely biased estimators of the parameters. The comparison of the correction methods is performed through simulation, under common measurement error structures.     

Constrained nonparametric maximum likelihood estimation of stochastically ordered survivor functions

This paper considers estimators of survivor functions subject to a stochastic ordering constraint based on right censored data. We present the constrained nonparametric maximum likelihood estimator (C‐NPMLE) of the survivor functions in one‐and two‐sample settings where the survivor distributions could be discrete or continuous and discuss the non‐uniqueness of the estimators. We also present a computationally efficient algorithm to obtain the C‐NPMLE. To address the possibility of non‐uniqueness of the C‐NPMLE of $S_1(t)$ when $S_1(t)\le S_2(t)$ , we consider the maximum C‐NPMLE (MC‐NPMLE) of $S_1(t)$ . In the one‐sample case with arbitrary upper bound survivor function $S_2(t)$ , we present a novel and efficient algorithm for finding the MC‐NPMLE of $S_1(t)$ . Dykstra ( 1982 ) also considered constrained nonparametric maximum likelihood estimation for such problems, however, as we show, Dykstra's method has an error and does not always give the C‐NPMLE. We corrected this error and simulation shows improvement in efficiency compared to Dykstra's estimator. Confidence intervals based on bootstrap methods are proposed and consistency of the estimators is proved. Data from a study on larynx cancer are analysed to illustrate the method. The Canadian Journal of Statistics 40: 22–39; 2012 © 2012 Statistical Society of Canada     

Estimating nonlinear additive models with nonstationarities and correlated errors

In this paper, we study a nonparametric additive regression model suitable for a wide range of time series applications. Our model includes a periodic component, a deterministic time trend, various component functions of stochastic explanatory variables, and an AR(p) error process that accounts for serial correlation in the regression error. We propose an estimation procedure for the nonparametric component functions and the parameters of the error process based on smooth backfitting and quasimaximum likelihood methods. Our theory establishes convergence rates and the asymptotic normality of our estimators. Moreover, we are able to derive an oracle‐type result for the estimators of the AR parameters: Under fairly mild conditions, the limiting distribution of our parameter estimators is the same as when the nonparametric component functions are known. Finally, we illustrate our estimation procedure by applying it to a sample of climate and ozone data collected on the Antarctic Peninsula.     

On the failure rate estimation of the inverse gaussian distribution

New estimators of the inverse Gaussian failure rate are proposed based on the maximum likelihood predictive densities derived by Yang (1999). These estimators are compared, via Monte Carlo simulation, with the usual maximum likelihood estimators of the failure rate and found to be superior in terms of bias and mean squared error. Sensitivity of the estimators against the departure from the inverse Gaussian distribution is studied.     

Computational algorithms for the factor model

Algorithms for computing the maximum likelihood estimators and the estimated covariance matrix of the estimators of the factor model are derived. The algorithms are particularly suitable for large matrices and for samples that give zero estimates of some error variances. A method of constructing estimators for reduced models is presented. The algorithms can also be used for the multivariate errors-in-variables model with known error covariance matrix.     

Estimators for the Finite Mixture of Rayleigh Model Based on Progressively Censored Data

In this article, based on progressively Type-II censored samples from a heterogeneous population that can be represented by a finite mixture of two-component Rayleigh lifetime model, the problem of estimating the parameters and some lifetime parameters (reliability and hazard functions) are considered. Both Bayesian and maximum likelihood estimators are of interest. A class of natural conjugate prior densities is considered in the Bayesian setting. The Bayes estimators are obtained using both the symmetric (squared error) loss function, and the asymmetric (LINEX and General Entropy) loss functions. It has been seen that the estimators obtained can be easily evaluated for this type of censoring by using suitable numerical methods. Finally, the performance of the estimates have been compared on the basis of their simulated maximum square error via a Monte Carlo simulation study.