Adjusted Pearson residuals in exponential family nonlinear models

In this paper, we give matrix formulae of order 𝒪(n ^?1), where n is the sample size, for the first two moments of Pearson residuals in exponential family nonlinear regression models [G.M. Cordeiro and G.A. Paula, Improved likelihood ratio statistic for exponential family nonlinear models, Biometrika 76 (1989), pp. 93–100.]. The formulae are applicable to many regression models in common use and generalize the results by Cordeiro [G.M. Cordeiro, On Pearson's residuals in generalized linear models, Statist. Prob. Lett. 66 (2004), pp. 213–219.] and Cook and Tsai [R.D. Cook and C.L. Tsai, Residuals in nonlinear regression, Biometrika 72(1985), pp. 23–29.]. We suggest adjusted Pearson residuals for these models having, to this order, the expected value zero and variance one. We show that the adjusted Pearson residuals can be easily computed by weighted linear regressions. Some numerical results from simulations indicate that the adjusted Pearson residuals are better approximated by the standard normal distribution than the Pearson residuals.     

Asymptotic properties of the score test for varying dispersion in exponential family nonlinear models

Wei et al. [B.C. Wei, J.Q. Shi, W.K. Fung, and Y.Q. Hu, Testing for varying dispersion in exponential family nonlinear models, Ann. Inst. Statist. Math. 50 (1998), pp. 277–294.] developed the score diagnostics for varying dispersion in exponential family nonlinear models, such as the normal, inverse Gaussian, and gamma models, and investigated the powers of these tests through Monte Carlo simulations. In this paper, the asymptotic behaviours, including asymptotic chi-square and approximate powers under local alternatives of the score tests, are studied and examined by Monte Carlo simulations. The methods to estimate local powers of the score tests are illustrated with Grass yield data [P. McCullagh, and J.A. Nelder, Generalized Linear Models, Chapman and Hall, London (1989).].     

Adjusted Pearson residuals in beta regression models

In this paper, matrix formulae of order n^?1, where n is the sample size, for the first two moments of Pearson residuals are obtained in beta regression models. Adjusted Pearson residuals are also obtained, having, to this order, expected value zero and variance one. Monte Carlo simulation results are presented illustrating the behaviour of both adjusted and unadjusted residuals.     

Local power of some tests in exponential family nonlinear models

In this paper we obtain asymptotic expansions up to order n^−1/2 for the nonnull distribution functions of the likelihood ratio, Wald, score and gradient test statistics in exponential family nonlinear models (Cordeiro and Paula, 1989), under a sequence of Pitman alternatives. The asymptotic distributions of all four statistics are obtained for testing a subset of regression parameters and for testing the dispersion parameter, thus generalising the results given in Cordeiro et al. (1994) and Ferrari et al. (1997). We also present Monte Carlo simulations in order to compare the finite-sample performance of these tests.     

The extreme residuals in logistic regression models

Goodness-of-fit tests for logistic regression models using extreme residuals are considered. Approximations to the moments of the Pearson residuals are given for model fits made by maximum likelihood, minimum chi-square and weighted least squares and used to define modified residuals. Approximations to the critical values of the extreme statistics based on the ordinary and modified Pearson residuals are developed and assessed for the case of a single explanatory variable.     

Influence diagnostics in the Gamma regression model with adjusted deviance residuals

In this study, we develop the adjusted deviance residuals for the gamma regression model (GRM) by following Cordeiro's (2004) method. These adjusted deviance residuals under the GRM are used for influence diagnostics. A comparative analysis has been sorted out between our proposed method of the adjusted deviance residuals and an existing method for influence diagnostics. These results are illustrated by a simulation study and using a real data set. They are presented for different values of dispersion and sample sizes and indicate the significant role of the GRM inferences.     

Bias correction and improved residuals for non-exponential family nonlinear models

In this paper we derive general formulae for the biases to order n ^?1 of the parameter estimates in a general class of nonlinear regression models, where n is the sample size. The formulae are related to those of Cordeiro and McCullagh (1991) and Paula (1992) and may be viewed as extensions of their results, Correction factors are derived for the score and deviance component residuals in these models. The practical use of such corrections is illustrated for the log-gamma model.     

Generalized linear models with random effects in the two-parameter exponential family

In this paper, we develop a new class of double generalized linear models, introducing a random-effect component in the link function describing the linear predictor related to the precision parameter. This is a useful procedure to take into account extra variability and also to make the model more robust. The Bayesian paradigm is adopted to make inference in this class of models. Samples of the joint posterior distribution are drawn using standard Monte Carlo Markov Chain procedures. Finally, we illustrate this algorithm by considering simulated and real data sets.     

Testing for departures from nominal dispersion in generalized nonlinear models with varying dispersion and/or additive random effects

This paper discusses the tests for departures from nominal dispersion in the framework of generalized nonlinear models with varying dispersion and/or additive random effects. We consider two classes of exponential family distributions. The first is discrete exponential family distributions, such as Poisson, binomial, and negative binomial distributions. The second is continuous exponential family distributions, such as normal, gamma, and inverse Gaussian distributions. Correspondingly, we develop a unifying approach and propose several tests for testing for departures from nominal dispersion in two classes of generalized nonlinear models. The score test statistics are constructed and expressed in simple, easy to use, matrix formulas, so that the tests can easily be implemented using existing statistical software. The properties of test statistics are investigated through Monte Carlo simulations.     

The generalized exponential family of distributions and its characteristics

In this paper we generalize the exponential family (EF) of distributions into a wider family which includes important distributions such as the normal, log-normal, Student-t, Cauchy, logistic and Birnbaum–Saunders distributions. Furthermore, we derive several characteristics of the proposed family. The importance of such family is also discussed.     

On the disribution of residuals form fitted parametric models

Results of a simulation study of the fit of data to an estimated parametric model are reported. Three particular models including the two-parameter normal and exponential distributions, and the simple linear regression model are considered. A number of scaled versions of the least squares residuals from the regression model and quantities that we call residuals from the other two models arc seen follow the parent distribution form loo well. i.e., to be supernormal and superexponential. A point of particular interest is that this tendency does not appear to decrease with increasing sample size, at least for the sample sizes considered here.     

Recursive residuals in generalised linear models

Recursive estimation and recursive residuals are introduced for generalised linear models (GLIM). Their definitions parallel those of normal theory regression models and relate to one of the outlier model definitions of GLIM residuals. An example illustrates their use.     

A generalized Pearson system useful in reliability analysis

In the present note, we study an extended class of Pearson system of distributions in the context of reliability. It is shown that the proposed class of models can be characterized by a relatioaship between the failure rate and the conditional moments. Further, we develop a procedure to identify an increasing (decreasing) failure rate model in the generalized Pearson system.     

Sufficiency,generalized likelihood function and exponential family

The problem of characterizing an exponential family by sufficiency of certain statistics is considered. In distinction to most of the papers on this subject we do not want to characterize an exponential family of order less than or equal to k by the existence of a-dimensional sufficient statis tics in.GepenoenX' oi inc sample size. Since such a characterization is only valid under regularity assumptions, which is shown in the paper, we consider a stronger property of an exponential family which turns out to be a characteristic one. At this the concept of generalized likelihood functions will play an important role.     

On some reliability aspects of Pearson family of distributions

We characterize the Pearson family of distributions by finding a relationship between the failure rate and the higher order moments of residual life. We also present a characterization theorem of IFR(DFR) class of distributions in the Pearson family.     

Bayesian D-optimal designs for exponential regression models

We consider the Bayesian D-optimal design problem for exponential growth models with one, two or three parameters. For the one-parameter model conditions on the shape of the density of the prior distribution and on the range of its support are given guaranteeing that a one-point design is also Bayesian D-optimal within the class of all designs. In the case of two parameters the best two-point designs are determined and for special prior distributions it is proved that these designs are Bayesian D-optimal. Finally, the exponential growth model with three parameters is investigated. The best three-point designs are characterized by a nonlinear equation. The global optimality of these designs cannot be proved analytically and it is demonstrated that these designs are also Bayesian D-optimal within the class of all designs if gamma-distributions are used as prior distributions.     

Bias correction for exponential family nonlinear modles

In this paper we discuss the computation of the bias to order n ^-1 for the parameter estimates in a general class of nonlinear regression models. Simple formulae are given to some special models. Diagnostic methods to assess the relationship between bias and observations are presented. Finally the proposed methods are illustrated by two examples.     

Monitoring distributional changes of squared residuals in GARCH models

Change point monitoring for distributional changes in time-series models is an important issue. In this article, we propose two monitoring procedures to detect distributional changes of squared residuals in GARCH models. The asymptotic properties of our monitoring statistics are derived under both the null of no change in distribution and the alternative of a change in distribution. The finite sample properties are investigated by a simulation.     

Asymptotic properties of approximate maximum quasi-likelihood estimator in quasi-likelihood nonlinear models with random effects

Quasi-likelihood nonlinear models with random effects (QLNMWRE) include generalized linear models with random effects and quasi-likelihood nonlinear models as special cases. In this paper, some regularity conditions analogous to those given by Breslow and Clatyton (1993) are proposed. On the basis of the proposed regularity conditions and Laplace approximation, the existence, the strong consistency and asymptotic normality of the approximate maximum quasi-likelihood estimation of the fixed effects are proved in QLNMWRE.     

Asymptotic properties of maximum quasi-likelihood estimator in quasi-likelihood nonlinear models with misspecified variance function

The quasi-likelihood function proposed by Wedderburn [Quasi-likelihood functions, generalized linear models, and the Gauss–Newton method. Biometrika. 1974;61:439–447] broadened the application scope of generalized linear models (GLM) by specifying the mean and variance function instead of the entire distribution. However, in many situations, complete specification of variance function in the quasi-likelihood approach may not be realistic. Following Fahrmeir's [Maximum likelihood estimation in misspecified generalized linear models. Statistics. 1990;21:487–502] treating with misspecified GLM, we define a quasi-likelihood nonlinear models (QLNM) with misspecified variance function by replacing the unknown variance function with a known function. In this paper, we propose some mild regularity conditions, under which the existence and the asymptotic normality of the maximum quasi-likelihood estimator (MQLE) are obtained in QLNM with misspecified variance function. We suggest computing MQLE of unknown parameter in QLNM with misspecified variance function by the Gauss–Newton iteration procedure and show it to work well in a simulation study.