RECURSIVE RESIDUALS FOR MULTIVARIATE REGRESSION MODELS

Recursive residuals and their relationship to the recursive estimation of regression parameters have been developed for unvaried regression mod els. Such residuals and estimates have been used to test the constancy of regression over time. The current paper extends this work to multivariate regression modal.     

Fitting a mixture distribution to complex censored survival data using generalized linear models

Mixture models may arise for a variety of reasons in survival data analysis. This paper shows how such models that involve potentially complex cross-classification by covariates may be easily fitted using a package such as GLIM. The method employs an auxiliary Poisson-binomial model in order to find the maximum-likelihood estimates of the model parameters, and has been implemented using GLIM macros.     

On Christensen's conjecture

In this paper we give solution to a conjecture appearing in Christensen (1997, p. 360) in relation to the definitions of standardized residuals in loglinear models. Work done when he was visiting as the Distinguished Lukacs Professor on leave from the Complutense University of Madrid. An erratum to this article is available at .     

Testing for random individual effects using recursive residuals

This paper derives a simple ANOVA-F-statistic which tests for random individual effects in a one-way error component model, using recursive residuals. Power comparisons are performed for this F-test when it is computed using true disturbances and recursive residuals from a panel data regression. Under the null, both statistics have an exact F distribution. The standardized version of the Breusch and Pagan (1980) Lagrange Multiplier test (SLM) as well as a fixed effects F-statistic (FE) recommended by Moulton and Randolph (1989), are also included in this comparison. The exact power function can be computed in all cases using Imhof's (1961) procedure. Our results suggest that the F-test based on recursive residuals is inferior to the popular SLM and FE tests based on computational simplicity, power comparisons and its sensitivity to the K observations starting the recursion.     

Some properties of,and relationships among,several uncorrelated and homoscedastic residual vectors

In this paper we examine the properties of four types of residual vectors, arising from fitting a linear regression model to a set of data by least squares. The four types of residuals are (i) the Stepwise residuals (Hedayat and Robson, 1970), (ii) the Recursive residuals (Brown, Durbin, and Evans, 1975), (iii) the Sequentially Adjusted residuals (to be defined herein), and (iv) the BLUS residuals (Theil, 1965, 1971). We also study the relationships among the four residual vectors. It is found that, for any given sequence of observations, (i) the first three sets of residuals are identical, (ii) each of the first three sets, being identical, is a member of Thei’rs (1965, 1971) family of residuals; specifically, they are Linear Unbiased with a Scalar covariance matrix (LUS) but not Best Linear Unbiased with a Scalar covariance matrix (BLUS). We find the explicit form of the transformation matrix and show that the first three sets of residual vectors can be written as an orthogonal transformation of the BLUS residual vector. These and other properties may prove to be useful in the statistical analysis of residuals.     

A power study of k-linear-r-ahead recursive residuals test for change-point in finite sequences

A change-point problem in finite sequences is considered along with, so-called, k-linear-r-ahead recursive residuals and a test procedure proposed by ?o?a¸d? et al. [?o?a¸d?, J.A., Szkutnik, Z., Majerczak, J. and Duda, K. 1998, Detection of change point in oxygen uptake during an incremental exercise test using recursive residuals: relationship to the plasma lactate accumulation and blood acid base balance. European Journal of Applied Physiology, 78, 369–377.]. Theoretical significance levels of that (conservative) test are compared with its simulated sizes. Numerical approximations to the powers against various alternatives are given. Properties of the k-linear-r-ahead recursive residuals are described and the consistency of the test is proved, when the noise level goes to zero.     

Diagnostics for glms with linear inequality parameter constraints

This paper proposes an iterative process, that can be implemented using GLIM, for fitting generalized linear models with linear inequality parameter constraints, when the maximum likelihood estimates exist and are unique. A one-step estimate is also introduced and some diagnostic measures are obtained. Finally an example is given for illustration.     

The analysis of prospective studies of disease aetiology

This paper reviews the analysis of prospective epidemiological studies using general linear models to describe disease Incidence, It is shown that, apart from problems arising from the large size of most studies of this type, these models may be fitted by maximum likelihood (using GLIM, for example) assuming a Poisson likelihood.Alternative methods for dealing with large-scale data are discussed, and some simple procedures for dealing with common problems are outlined.The relationship of the approach to multiple logistic analyses is indicated.     

Regression modelling of interval-censored failure time data using the Weibull distribution

A method is described for fitting the Weibull distribution to failure-time data which may be left, right or interval censored. The method generalizes the auxiliary Poisson approach and, as such, means that it can be easily programmed in statistical packages with macro programming capabilities. Examples are given of fitting such models and an implementation in the GLIM package is used for illustration.     

Linear models with an inverse gaussian poisson error distribution

The inverse Gaussian-Poisson (two-parameter Sichel) distribution is useful in fitting overdispersed count data. We consider linear models on the mean of a response variable, where the response is in the form of counts exhibiting extra-Poisson variation, and assume an IGP error distribution. We show how maximum likelihood estimation may be carried out using iterative Newton-Raphson IRLS fitting, where GLIM is used for the IRLS part of the maximization. Approximate likelihood ratio tests are given.     

Pseudo latent models: Goodness of fit measures, residuals, estimation, testing, and simulation

Binary response models consider pseudo-R ² measures which are not based on residuals while several concepts of residuals were developed for tests. In this paper the endogenous variable of the latent model corresponding to the binary observable model is substituted by a pseudo variable. Then goodness of fit measures and tests can be based on a joint concept of residuals as for linear models. Different kinds of residuals based on probit ML estimates are employed. The analytical investigations and the simulation results lead to the recommendation to use standardized residuals where there is no difference between observed and generalized residuals. In none of the investigated situations this estimator is far away from the best result. While in large samples all considered estimators are very similar, small sample properties speak in favour of residuals which are modifications of those suggested in the literature. An empirical application demonstrates that it is not necessary to develop new testing procedures for the observable models with dichotomous regressands. Well-know approaches for linear models with continuous endogenous variables which are implemented in usual econometric packages can be used for pseudo latent models. An erratum to this article is available at .     

Modelling the effect of subject-specific covariates in paired comparison studies with an application to university rankings

Preference decisions will usually depend on the characteristics of both the judges and the objects being judged. In the analysis of paired comparison data concerning European universities and students' characteristics, it is demonstrated how to incorporate subject-specific information into Bradley–Terry-type models. Using this information it is shown that preferences for universities and therefore university rankings are dramatically different for different groups of students. A log-linear representation of a generalized Bradley–Terry model is specified which allows simultaneous modelling of subject- and object-specific covariates and interactions between them. A further advantage of this approach is that standard software for fitting log-linear models, such as GLIM, can be used.     

Ancillarity properties of generalized residuals with applications in failure time models

This paper addresses the issue of when residuals from failure time models, which are useful in model validation and diagnostics, possess a conditional ancillarity property. This property states that the distribution of the residuals depends on the model parameters only through a many-to-one function of these parameters, which in certain models turn out to be the censoring proportion. Concrete results are obtained for models which possess an invariance structure, and these results are applied to commonly used failure time models. Aside from furthering our understanding of the distributional structure of residuals, this conditional ancillarity property can be exploited to study in a more efficient manner the distributional properties of residuals either analytically and/or through numerical methods.     

Measurement error in the generalised linear model

This paper considers the problem of estimating the linear parameters of a Generalised Linear Model (GLM) when the explanatory variable is subject to measurement error. In this situation the induced model for dependence on the approximate explanatory variable is not usually of GLM form. However, when the distribution of measurement error is known or estimated from replicated measurements, application of the GLIM iteratively reweighted least squares algorithm with transformed data and weighting is shown to produce maximum quasi likelihood estimates in many cases. Details of this approach are given for two particular generalized linear models; simulation results illustrate the usefulness of the theory for these models.     

Residual analysis for spatial point processes (with discussion)

Summary.  We define residuals for point process models fitted to spatial point pattern data, and we propose diagnostic plots based on them. The residuals apply to any point process model that has a conditional intensity; the model may exhibit spatial heterogeneity, interpoint interaction and dependence on spatial covariates. Some existing ad hoc methods for model checking (quadrat counts, scan statistic, kernel smoothed intensity and Berman's diagnostic) are recovered as special cases. Diagnostic tools are developed systematically, by using an analogy between our spatial residuals and the usual residuals for (non-spatial) generalized linear models. The conditional intensity λ plays the role of the mean response. This makes it possible to adapt existing knowledge about model validation for generalized linear models to the spatial point process context, giving recommendations for diagnostic plots. A plot of smoothed residuals against spatial location, or against a spatial covariate, is effective in diagnosing spatial trend or co-variate effects. Q – Q -plots of the residuals are effective in diagnosing interpoint interaction.     

Diagnostic checks for integer-valued autoregressive models using expected residuals

Integer-valued time series models make use of thinning operators for coherency in the nature of count data. However, the thinning operators make residuals unobservable and are the main difficulty in developing diagnostic tools for autocorrelated count data. In this regard, we introduce a new residual, which takes the form of predictive distribution functions, to assess probabilistic forecasts, and this new residual is supplemented by a modified usual residuals. Under integer-valued autoregressive (INAR) models, the properties of these two residuals are investigated and used to evaluate the predictive performance and model adequacy of the INAR models. We compare our residuals with the existing residuals through simulation studies and apply our method to select an appropriate INAR model for an over-dispersed real data.     

The extreme residuals in logistic regression models

Goodness-of-fit tests for logistic regression models using extreme residuals are considered. Approximations to the moments of the Pearson residuals are given for model fits made by maximum likelihood, minimum chi-square and weighted least squares and used to define modified residuals. Approximations to the critical values of the extreme statistics based on the ordinary and modified Pearson residuals are developed and assessed for the case of a single explanatory variable.     

Latent variable techniques for categorical data

Two useful statistical methods for generating a latent variable are described and extended to incorporate polytomous data and additional covariates. Item response analysis is not well-known outside its area of application, mainly because the procedures to fit the models are computer intensive and not routinely available within general statistical software packages. The linear score technique is less computer intensive, straightforward to implement and has been proposed as a good approximation to item response analysis. Both methods have been implemented in the standard statistical software package GLIM 4.0, and are compared to determine their effectiveness.     

On beta regression residuals

We propose two new residuals for the class of beta regression models, and numerically evaluate their behaviour relative to the residuals proposed by Ferrari and Cribari-Neto. Monte Carlo simulation results and empirical applications using real and simulated data are provided. The results favour one of the residuals we propose.     

Log-linear modelling of data from matched case-control studies

A log-linear modelling approach is proposed for dealing with polytomous, unordered exposure variables in case-control epidemiological studies with matched pairs. Hypotheses concerning epidemiological parameters are shown to be expressable in terms of log-linear models for the expected frequencies of the case-by-control square concordance table representation of the matched data; relevant maximum likelihood estimates and goodness-of-fit statistics are presented. Possible extensions to account for ordered categorical risk factors and multiple controls are illustrated, and comparisons with previous work are discussed. Finally, the possibility of implementing the proposed method with GLIM is illustrated within the context of a data set already analyzed by other authors.