Generalized linear models with covariate measurement error and unknown link function

Generalized linear models (GLMs) with error-in-covariates are useful in epidemiological research due to the ubiquity of non-normal response variables and inaccurate measurements. The link function in GLMs is chosen by the user depending on the type of response variable, frequently the canonical link function. When covariates are measured with error, incorrect inference can be made, compounded by incorrect choice of link function. In this article we propose three flexible approaches for handling error-in-covariates and estimating an unknown link simultaneously. The first approach uses a fully Bayesian (FB) hierarchical framework, treating the unobserved covariate as a latent variable to be integrated over. The second and third are approximate Bayesian approach which use a Laplace approximation to marginalize the variables measured with error out of the likelihood. Our simulation results show support that the FB approach is often a better choice than the approximate Bayesian approaches for adjusting for measurement error, particularly when the measurement error distribution is misspecified. These approaches are demonstrated on an application with binary response.     

Generalized linear models for the analysis of quality-improvement experiments

Generalized linear models provide a useful tool for analyzing data from quality-improvement experiments. We discuss why analysis must be done for all the data, not just for summarizing quantities, and show by examples how residuals can be used for model checking. A restricted-maximum-likelihood-type adjustment for the dispersion analysis is developed.     

Note on sums of a random number of random variables with exponential family distributions

With the help of the result that exponential-type families are determined by their mean value functions it is shown that stochastic independence of the random variables S_N and N-S_N characterizes the Poisson and Bernoulli distributions simultaneously.     

Adjusted Pearson residuals in exponential family nonlinear models

In this paper, we give matrix formulae of order 𝒪(n ^?1), where n is the sample size, for the first two moments of Pearson residuals in exponential family nonlinear regression models [G.M. Cordeiro and G.A. Paula, Improved likelihood ratio statistic for exponential family nonlinear models, Biometrika 76 (1989), pp. 93–100.]. The formulae are applicable to many regression models in common use and generalize the results by Cordeiro [G.M. Cordeiro, On Pearson's residuals in generalized linear models, Statist. Prob. Lett. 66 (2004), pp. 213–219.] and Cook and Tsai [R.D. Cook and C.L. Tsai, Residuals in nonlinear regression, Biometrika 72(1985), pp. 23–29.]. We suggest adjusted Pearson residuals for these models having, to this order, the expected value zero and variance one. We show that the adjusted Pearson residuals can be easily computed by weighted linear regressions. Some numerical results from simulations indicate that the adjusted Pearson residuals are better approximated by the standard normal distribution than the Pearson residuals.     

Local predictive influence in bayesian linear models with conjugate priors

Cook (1986) presented the idea of local influence to study the sensitivity of inferences to model assumptions:introduce a vector δ of perturbations to the model; choose a discrepancy function D to measure differences between the original inference and the inference under the perturbed model; study the behavior of D near δ = 0, the original model, usually by taking derivatives. Johnson and Geisser (1983) measure influence in Bayesian inference by the Kullback-Leibler divergence between predictive distributions. I~IcCulloch (1989) is a synthesis of Cook and Johnson and Geisser, using Kullback-Leibler divergence between posterior or predictive distributions as the discrepancy function in Bayesian local influence analyses. We analyze a special case for which McCulloch gives the general theory; namely, the linear model with conjugate prior. We present specific formulae for local influence measures for 1) changes in the parameters of the gamma prior for the precision, 2) changes in the mean of the normal prior for the regression coefficients, 3) changes in the covariance matrix of the normal prior for the regression coefficients and 4) changes in the case weights. Our method is an easy way to find locally influential subsets of points without knowing in advance the sizes of the subsets. The techniques are illustrated with a regression example.     

The beta generalized linear exponential distribution

In this paper, a new five-parameter lifetime distribution called beta generalized linear exponential distribution (BGLED) is introduced. It includes at least 17 popular sub-models as special cases such as the beta linear exponential, the beta generalized exponential, and the exponentiated generalized linear distributions. Mathematical and statistical properties of the proposed distribution are discussed in details. In particular, explicit expression for the density function, moments, asymptotics distributions for sample extreme statistics, and other statistical measures are obtained. The estimation of the parameters by the method of maximum-likelihood is discussed and the finite sample properties of the maximum-likelihood estimators (MLEs) are investigated numerically. A real data set is used to demonstrate its superior performance fit over several existing popular lifetime models.     

Quasi-complete separation in random effects of binary response mixed models

ABSTRACT

Clustered observations such as longitudinal data are often analysed with generalized linear mixed models (GLMM). Approximate Bayesian inference for GLMMs with normally distributed random effects can be done using integrated nested Laplace approximations (INLA), which is in general known to yield accurate results. However, INLA is known to be less accurate for GLMMs with binary response. For longitudinal binary response data it is common that patients do not change their health state during the study period. In this case the grouping covariate perfectly predicts a subset of the response, which implies a monotone likelihood with diverging maximum likelihood (ML) estimates for cluster-specific parameters. This is known as quasi-complete separation. In this paper we demonstrate, based on longitudinal data from a randomized clinical trial and two simulations, that the accuracy of INLA decreases with increasing degree of cluster-specific quasi-complete separation. Comparing parameter estimates by INLA, Markov chain Monte Carlo sampling and ML shows that INLA increasingly deviates from the other methods in such a scenario.     

On additive and multiplicative damage models and the characterizations of linear and logarithmic exponential families

Rao (1963) has formulated a damage model which we call an additive damage model. A suitable damage model, which we call a multiplicative damage model, has been considered by Krishnaji (1970) for income-related problems. In these models, an original observation is subjected to damage, e.g., death or under-reporting, according to a specified probability law. Within the framework of an additive damage model, with a special form of damage, characterizations of the linear and logarithmic exponential families are formulated using regression properties of the damaged part on the undamaged part. The characterizations of the gamma and Pareto distributions that have been found of some use in the theory of income distributions, are obtained as special cases. Similar results are investigated within the framework of the multiplicative damage model.     

Asymptotic properties of the score test for varying dispersion in exponential family nonlinear models

Wei et al. [B.C. Wei, J.Q. Shi, W.K. Fung, and Y.Q. Hu, Testing for varying dispersion in exponential family nonlinear models, Ann. Inst. Statist. Math. 50 (1998), pp. 277–294.] developed the score diagnostics for varying dispersion in exponential family nonlinear models, such as the normal, inverse Gaussian, and gamma models, and investigated the powers of these tests through Monte Carlo simulations. In this paper, the asymptotic behaviours, including asymptotic chi-square and approximate powers under local alternatives of the score tests, are studied and examined by Monte Carlo simulations. The methods to estimate local powers of the score tests are illustrated with Grass yield data [P. McCullagh, and J.A. Nelder, Generalized Linear Models, Chapman and Hall, London (1989).].     

On linear combinations of independent exponential variables

The exact distribution of a linear combination of n indepedent negative exponential random variables , when the coefficients cf the linear combination are distinct and positive , is well-known. Recently Ali and Obaidullah (1982) extended this result by taking the coeff icients to be arbitrary real numbers. They used a lengthy geometric.

al approach to arrive at the result . This article gives a simple derivation of the result with the help of a generalized partial fraction technique. This technique also works when the variables involved are gamma variables with certain types of parameters. Results are presented in a form which can easily be programmed for computational purposes. Connection of this problem t o various problems in different fields is also pointed out.     

On an exponential family

This paper considers a generalization of the exponential type distributions in the class of exponential families. A characterization and a method of generating an exponential family from a given family are given. In particular the generalized gamma, the generalized Poisson, the inverse Gaussian distributions belonging to this family are discussed. The approximations of the cumulative sums for the generalized gamma and the generalized Poisson by the Chi-square are considered. Some of the results are extended to the bivariate case.     

Generalized additive mixed models

Following the extension from linear mixed models to additive mixed models, extension from generalized linear mixed models to generalized additive mixed models is made, Algorithms are developed to compute the MLE's of the nonlinear effects and the covariance structures based on the penalized marginal likelihood. Convergence of the algorithms and selection of the smooth param¬eters are discussed.     

Generalized linear models with functional predictors

Summary. We present a technique for extending generalized linear models to the situation where some of the predictor variables are observations from a curve or function. The technique is particularly useful when only fragments of each curve have been observed. We demonstrate, on both simulated and real data sets, how this approach can be used to perform linear, logistic and censored regression with functional predictors. In addition, we show how functional principal components can be used to gain insight into the relationship between the response and functional predictors. Finally, we extend the methodology to apply generalized linear models and principal components to standard missing data problems.     

Double hierarchical generalized linear models (with discussion)

Summary.  We propose a class of double hierarchical generalized linear models in which random effects can be specified for both the mean and dispersion. Heteroscedasticity between clusters can be modelled by introducing random effects in the dispersion model, as is heterogeneity between clusters in the mean model. This class will, among other things, enable models with heavy-tailed distributions to be explored, providing robust estimation against outliers. The h -likelihood provides a unified framework for this new class of models and gives a single algorithm for fitting all members of the class. This algorithm does not require quadrature or prior probabilities.     

A doubly restricted exponential dispersion model

In this paper, we propose and develop a doubly restricted exponential dispersion model, i.e. a varying dispersion generalized linear model with two sets of restrictions, a set of linear restrictions for the mean response, and at the same time, for another set of linear restrictions for the dispersion of the distribution. This model would be useful to consider several situations where it is necessary to control/analyze drug-doses, active effects in factorial experiments, mean-variance relationships, among other situations. A penalized likelihood function is proposed and developed in order to achieve the restricted parameters and to develop the inferential results. Several special cases from the literature are commented on. A simply restricted varying dispersion beta regression model is exemplified by means of real and simulated data. Satisfactory and promising results are found.     

Bayesian process monitoring schemes for the two-parameter exponential distribution

In this paper a Bayesian procedure is applied to obtain control limits for the location and scale parameters, as well as for a one-sided upper tolerance limit in the case of the two-parameter exponential distribution. An advantage of the upper tolerance limit is that it monitors the location and scale parameter at the same time. By using Jeffreys’ non-informative prior, the predictive distributions of future maximum likelihood estimators of the location and scale parameters are derived analytically. The predictive distributions are used to determine the distribution of the “run-length” and expected “run-length”. A dataset given in Krishnamoorthy and Mathew (2009 Krishnamoorthy, K., and T. Mathew. 2009. Statistical Tolerance Regions: Theory, Applications and Computation. Wiley Series in Probability and Statistics.[Crossref] , [Google Scholar]) are used for illustrative purposes. The data are the mileages for some military personnel carriers that failed in service. The paper illustrates the flexibility and unique features of the Bayesian simulation method.     

Generalized symmetrical partial linear model

In this work, we propose a new model called generalized symmetrical partial linear model, based on the theory of generalized linear models and symmetrical distributions. In our model the response variable follows a symmetrical distribution such a normal, Student-t, power exponential, among others. Following the context of generalized linear models we consider replacing the traditional linear predictors by the more general predictors in whose case one covariate is related with the response variable in a non-parametric fashion, that we do not specified the parametric function. As an example, we could imagine a regression model in which the intercept term is believed to vary in time or geographical location. The backfitting algorithm is used for estimating the parameters of the proposed model. We perform a simulation study for assessing the behavior of the penalized maximum likelihood estimators. We use the quantile residuals for checking the assumption of the model. Finally, we analyzed real data set related with pH rivers in Ireland.     

Bayesian variable selection in a finite mixture of linear mixed-effects models

Mixture of linear mixed-effects models has received considerable attention in longitudinal studies, including medical research, social science and economics. The inferential question of interest is often the identification of critical factors that affect the responses. We consider a Bayesian approach to select the important fixed and random effects in the finite mixture of linear mixed-effects models. To accomplish our goal, latent variables are introduced to facilitate the identification of influential fixed and random components and to classify the membership of observations in the longitudinal data. A spike-and-slab prior for the regression coefficients is adopted to sidestep the potential complications of highly collinear covariates and to handle large p and small n issues in the variable selection problems. Here we employ Markov chain Monte Carlo (MCMC) sampling techniques for posterior inferences and explore the performance of the proposed method in simulation studies, followed by an actual psychiatric data analysis concerning depressive disorder.