Local Influence in Generalized Estimating Equations

Abstract.  We investigate the influence of subjects or observations on regression coefficients of generalized estimating equations (GEEs) using local influence. The GEE approach does not require the full multivariate distribution of the response vector. We extend the likelihood displacement to a quasi-likelihood displacement, and propose local influence diagnostics under several perturbation schemes. An illustrative example in GEEs is given and we compare the results using the local influence and deletion methods.     

Semiparametric Mixtures of Symmetric Distributions

We consider in this paper the semiparametric mixture of two unknown distributions equal up to a location parameter. The model is said to be semiparametric in the sense that the mixed distribution is not supposed to belong to a parametric family. To insure the identifiability of the model, it is assumed that the mixed distribution is zero symmetric, the model being then defined by the mixing proportion, two location parameters and the probability density function of the mixed distribution. We propose a new class of M‐estimators of these parameters based on a Fourier approach and prove that they are ‐consistent under mild regularity conditions. Their finite sample properties are illustrated by a Monte Carlo study, and a benchmark real dataset is also studied with our method.     

Estimated Generalized Estimating Equation for Correlated Failure Time Data with Auxiliary Covariates

In this article, we study a marginal hazard model with common baseline hazard for correlated failure time data. We assume that the true covariate is measured precisely in a subset of the whole study cohort, whereas an auxiliary information for the true covariate is available for the whole cohort. We first estimate the relative risk function empirically. Then we obtain the estimator for the regression parameter by replacing the relative risk function with its estimator in a generalized estimating equation (GEE) proposed by Cai (1992 Cai , J. ( 1992 ). Generalized estimation equations for censored multivariate failure time data. Ph.D. thesis, University of Washington, Seattle, Washington . [Google Scholar]). A key feature of this method is that it is nonparametric with respect to the association between the missing covariate and the observed auxiliary covariate. The proposed estimator is shown to be consistent and asymptotically normal. Furthermore, we present a corrected Breslow-type estimator for the cumulative hazard function. Simulation studies are conducted to evaluate the proposed method.     

Generalized Estimating Equations to Binary Probit Model

Inference in generalized linear mixed models with multivariate random effects is often made cumbersome by the high-dimensional intractable integrals involved in the marginal likelihood. This article presents an inferential methodology based on the generalized estimating equations for the probit latent traits models. This method belonging to the broad class of semi parametric approaches involves marginal joint moments of order 1 and 2, which has analytical expression. The different results are illustrated with a simulation study.     

Model Selection Criterion Based on the Multivariate Quasi‐Likelihood for Generalized Estimating Equations

The generalized estimating equations (GEE) approach has attracted considerable interest for the analysis of correlated response data. This paper considers the model selection criterion based on the multivariate quasi‐likelihood (MQL) in the GEE framework. The GEE approach is closely related to the MQL. We derive a necessary and sufficient condition for the uniqueness of the risk function based on the MQL by using properties of differential geometry. Furthermore, we establish a formal derivation of model selection criterion as an asymptotically unbiased estimator of the prediction risk under this condition, and we explicitly take into account the effect of estimating the correlation matrix used in the GEE procedure.     

Analysis of Circular Longitudinal Data Based on Generalized Estimating Equations

This paper derives estimating equations for modelling circular data with longitudinal structure for a family of circular distributions with two parameters. Estimating equations for modelling the circular mean and the resultant length are given separately. Estimating equations are then derived for a mixed model. This paper shows that the estimators that follow from these equations are consistent and asymptotically normal. The results are illustrated by an example about the direction taken by homing pigeons.     

A modified likelihood ratio test for homogeneity in finite mixture models

Testing for homogeneity in finite mixture models has been investigated by many researchers. The asymptotic null distribution of the likelihood ratio test (LRT) is very complex and difficult to use in practice. We propose a modified LRT for homogeneity in finite mixture models with a general parametric kernel distribution family. The modified LRT has a χ-type of null limiting distribution and is asymptotically most powerful under local alternatives. Simulations show that it performs better than competing tests. They also reveal that the limiting distribution with some adjustment can satisfactorily approximate the quantiles of the test statistic, even for moderate sample sizes.     

M-Estimator of a Generalized Linear Model with Measurement Errors

In this article, we propose a generalized linear model and estimate the unknown parameters using robust M-estimator. Under suitable conditions and by the strong law of large numbers and central limits theorem, the proposed M-estimators are proved to be consistent and asymptotically normal. We also evaluate the finite sample performance of our estimator through a Monte Carlo study.     

Simple and Explicit Estimating Functions for a Discretely Observed Diffusion Process

We consider a one-dimensional diffusion process X , with ergodic property, with drift b ( x , θ) and diffusion coefficient a ( x , θ) depending on an unknown parameter θ that may be multidimensional. We are interested in the estimation of θ and dispose, for that purpose, of a discretized trajectory, observed at n equidistant times t_i = iΔ , i = 0, ..., n . We study a particular class of estimating functions of the form ∑ f (θ, X _{t i −1}) which, under the assumption that the integral of f with respect to the invariant measure is null, provide us with a consistent and asymptotically normal estimator. We determine the choice of f that yields the estimator with minimum asymptotic variance within the class and indicate how to construct explicit estimating functions based on the generator of the diffusion. Finally the theoretical study is completed with simulations.     

Computational Aspects Related to Martingale Estimating Functions for a Discretely Observed Diffusion

Martingale estimating functions for a discretely observed diffusion have turned out to provide estimators with nice asymptotic properties. However, their expression usually involves some conditional expectation that has to be evaluated through Monte Carlo simulations giving rise to an approximated estimator. In this work we study, for ergodic models, the asymptotic properties of the approximated estimator and describe the influence of the number of independent simulated trajectories involved in the Monte Carlo method as well as of the approximation scheme used. Our results are of practical relevance to assess the implementation of martingale estimating functions for discretely observed diffusions.     

Saddlepoint-Based Bootstrap Inference for Quadratic Estimating Equations

Abstract.  We propose an easy to implement method for making small sample parametric inference about the root of an estimating equation expressible as a quadratic form in normal random variables. It is based on saddlepoint approximations to the distribution of the estimating equation whose unique root is a parameter's maximum likelihood estimator (MLE), while substituting conditional MLEs for the remaining (nuisance) parameters. Monotoncity of the estimating equation in its parameter argument enables us to relate these approximations to those for the estimator of interest. The proposed method is equivalent to a parametric bootstrap percentile approach where Monte Carlo simulation is replaced by saddlepoint approximation. It finds applications in many areas of statistics including, nonlinear regression, time series analysis, inference on ratios of regression parameters in linear models and calibration. We demonstrate the method in the context of some classical examples from nonlinear regression models and ratios of regression parameter problems. Simulation results for these show that the proposed method, apart from being generally easier to implement, yields confidence intervals with lengths and coverage probabilities that compare favourably with those obtained from several competing methods proposed in the literature over the past half-century.     

Generalized estimating equations for mixtures with varying concentrations

A finite mixture model is considered in which the mixing probabilities vary from observation to observation. A parametric model is assumed for one mixture component distribution, while the others are nonparametric nuisance parameters. Generalized estimating equations (GEE) are proposed for the semi‐parametric estimation. Asymptotic normality of the GEE estimates is demonstrated and the lower bound for their dispersion (asymptotic covariance) matrix is derived. An adaptive technique is developed to derive estimates with nearly optimal small dispersion. An application to the sociological analysis of voting results is discussed. The Canadian Journal of Statistics 41: 217–236; 2013 © 2013 Statistical Society of Canada     

Separation and Lack of Separation of Subpopulation in the Mixed Distributions

This is a comparative study between the estimates of parameters of mixed distributions in the case of the possibility of separating the units of subpopulation or the absence of that possibility under the progressive type I censored test data. An iterative procedure is developed and tested numerically to obtain new estimators and their variance–covariance matrix. Finally, we will use the exact distribution of the maximum likelihood estimators as well as its asymptotic distribution and the parametric bootstrap method; then, we will discuss the construction of confidence intervals for the mean parameter and their performance is assessed through Monte Carlo simulations.     

A Generalized Estimating Equations Approach for Analysis of the Impact of New Technology on a Trawl Fishery

The article describes a generalized estimating equations approach that was used to investigate the impact of technology on vessel performance in a trawl fishery during 1988–96, while accounting for spatial and temporal correlations in the catch-effort data. Robust estimation of parameters in the presence of several levels of clustering depended more on the choice of cluster definition than on the choice of correlation structure within the cluster. Models with smaller cluster sizes produced stable results, while models with larger cluster sizes, that may have had complex within-cluster correlation structures and that had within-cluster covariates, produced estimates sensitive to the correlation structure. The preferred model arising from this dataset assumed that catches from a vessel were correlated in the same years and the same areas, but independent in different years and areas. The model that assumed catches from a vessel were correlated in all years and areas, equivalent to a random effects term for vessel, produced spurious results. This was an unexpected finding that highlighted the need to adopt a systematic strategy for modelling. The article proposes a modelling strategy of selecting the best cluster definition first, and the working correlation structure (within clusters) second. The article discusses the selection and interpretation of the model in the light of background knowledge of the data and utility of the model, and the potential for this modelling approach to apply in similar statistical situations.     

Criterion for the Selection of a Working Correlation Structure in the Generalized Estimating Equation Approach for Longitudinal Balanced Data

The generalized estimating equation is a popular method for analyzing correlated response data. It is important to determine a proper working correlation matrix at the time of applying the generalized estimating equation since an improper selection sometimes results in inefficient parameter estimates. We propose a criterion for the selection of an appropriate working correlation structure. The proposed criterion is based on a statistic to test the hypothesis that the covariance matrix equals a given matrix, and also measures the discrepancy between the covariance matrix estimator and the specified working covariance matrix. We evaluated the performance of the proposed criterion through simulation studies assuming that for each subject, the number of observations remains the same. The results revealed that when the proposed criterion was adopted, the proportion of selecting a true correlation structure was generally higher than that when other competing approaches were adopted. The proposed criterion was applied to longitudinal wheeze data, and it was suggested that the resultant correlation structure was the most accurate.     

Asymptotic Normality for the Partially Linear EV Models with Longitudinal Data

In this article, we consider a partially linear EV regression model under longitudinal data. By using a weighted kernel method and modified least-squared method, the estimators of unknown parameter, the unknown function are constructed and the asymptotic normality of the estimators are derived. Simulation studies are conducted to illustrate the finite-sample performance of the proposed method.     

Empirical Likelihood-based Inference for Stationary-ergodicity of the Generalized Random Coefficient Autoregressive Model

In this article, we consider the application of the empirical likelihood method to the generalized random coefficient autoregressive (GRCA) model. When the order of the model is 1, we derive an empirical likelihood ratio test statistic to test the stationary-ergodicity. Some simulation studies are also conducted to investigate the finite sample performances of the proposed test.     

Penalized likelihood-ratio test for finite mixture models with multinomial observations

Due to the irregularity of finite mixture models, the commonly used likelihood-ratio statistics often have complicated limiting distributions. We propose to add a particular type of penalty function to the log-likelihood function. The resulting penalized likelihood-ratio statistics have simple limiting distributions when applied to finite mixture models with multinomial observations. The method is especially effective in addressing the problems discussed by Chernoff and Lander (1995). The theory developed and simulations conducted show that the penalized likelihood method can give very good results, better than the well-known C(α) procedure, for example. The paper does not, however, fully explore the choice of penalty function and weight. The full potential of the new procedure is to be explored in the future.     

Exact Likelihood Equations for Autoregression Models with Multivariate Elliptically Contoured Distributions

Abstract

The multivariate elliptically contoured distributions provide a viable framework for modeling time-series data. It includes the multivariate normal, power exponential, t, and Cauchy distributions as special cases. For multivariate elliptically contoured autoregressive models, we derive the exact likelihood equations for the model parameters. They are closely related to the Yule-Walker equations and involve simple function of the data. The maximum likelihood estimators are obtained by alternately solving two linear systems and illustrated using the simulation data.     

Kernel Estimators for Additive Models with Dependent Observations from Random Fields

Nonparametric estimation of the regression function for additive models is investigated in cases where the observed data are dependent. An additive kernel estimator for the regression function under some general mixing conditions is proposed. Under the mixing conditions, the additive kernel estimator is shown to be asymptotically normal.