TESTING THE STABILITY OF REGRESSION COEFFICIENTS USING GENERALIZED RECURSIVE RESIDUALS

Simple but flexible methods to detect deviations from the assumption of constant coefficients in linear regression are presented. Based on recursive residuals a runs test is developed as an alternative to CUSUM- and MOSUM-techniques. Finally a simulation study gives insight into the new method.     

THE EXAMINATION AND ANALYSIS OF RESIDUALS FOR SOME BIASED ESTIMATORS IN LINEAR REGRESSION

In the presence of collinearity certain biased estimation procedures like ridge regression, generalized inverse estimator, principal component regression, Liu estimator, or improved ridge and Liu estimators are used to improve the ordinary least squares (OLS) estimates in the linear regression model. In this paper new biased estimator (Liu estimator), almost unbiased (improved) Liu estimator and their residuals will be analyzed and compared with OLS residuals in terms of mean-squared error.     

BAYESIAN ANALYSIS OF THE LINEAR REGRESSION MODEL WITH NON-NORMAL DISTURBANCES

This paper considers the Bayesian analysis of a linear regression model with identically independently distributed non-normal disturbances. The distribution of disturbances is approximated by an Edgeworth series distribution with cumulants, of order higher than fourth, negligible. The posterior distribution of the regression coefficients vector is obtained under the assumption of a g-prior distribution for the parameters of the model. The Bayes estimator and its Bayes risk of the estimator are derived under a quadratic loss structure.     

A CONSISTENT MODEL SPECIFICATION TEST BASED ON THE KERNEL SUM OF SQUARES OF RESIDUALS

This paper constructs a consistent model specification test based on the difference between the nonparametric kernel sum of squares of residuals and the sum of squares of residuals from a parametric null model. We establish the asymptotic normality of the proposed test statistic under the null hypothesis of correct parametric specification and show that the wild bootstrap method can be used to approximate the null distribution of the test statistic. Results from a small simulation study are reported to examine the finite sample performance of the proposed tests.     

A Simple Approach to Inference in Random Coefficient Models

Random coefficient regression models have been used to analyze cross-sectional and longitudinal data in economics and growth-curve data from biological and agricultural experiments. In the literature several estimators, including the ordinary least squares and the estimated generalized least squares (EGLS), have been considered for estimating the parameters of the mean model. Based on the asymptotic properties of the EGLS estimators, test statistics have been proposed for testing linear hypotheses involving the parameters of the mean model. An alternative estimator, the simple mean of the individual regression coefficients, provides estimation and hypothesis-testing procedures that are simple to compute and teach. The large sample properties of this simple estimator are shown to be similar to that of the EGLS estimator. The performance of the proposed estimator is compared with that of the existing estimators by Monte Carlo simulation.     

ADJUSTING RESIDUALS IN ESTIMATION OF DISPERSION EFFECTS

This paper studies a method of adjusting the ordinary least squares residuals, when estimating and comparing dispersions, at various levels of factors in a replicated factorial experiment. Using a general dispersion model, theoretical results demonstrate the benefits of the method of adjusting residuals. An illustrative example is included.     

RECURSIVE ESTIMATION OF THE GENERAL LINEAR MODEL WITH DEPENDENT ERRORS AND MULTIPLE ADDITIONAL OBSERVATIONS1

The techniques for recursive estimation of the general linear model with dependent errors and known second order properties, is generalised to allow for simultaneous addition of an arbitrary number of additional observations. Computational formulae for recursive updating of parameter estimates are derived, together with a sequence of univariate recursive residuals for testing the constancy of the regression relation over time.     

A SEMIPARAMETRIC HIERARCHICAL METHOD FOR A REGRESSION MODEL WITH AN INTERVAL-CENSORED COVARIATE

A Bayesian framework is proposed for analysing regression models in which one of the covariates is interval‐censored. Such a situation was encountered in an AIDS clinical trial in which the goal was to examine the association between delays in initiating a new treatment after Indinavir failure and the subsequent viral load level of patients at the time of enrolment into the new treatment. The new method uses a mixture of Dirichlet processes allowing all the components in the model to be specified parametrically, except for the distribution of the interval‐censored covariate, which is treated non‐parametrically. The paper explains the proposed method for the linear regression model in detail. The performance of the method is assessed by simulations and illustrated using the AIDS clinical trial.     

A NOTE ON ESTIMATING LINEAR TREND IN A REGRESSION MODEL WITH SERIALLY CORRELATED ERROR COMPONENTS

ABSTRACT

We consider a linear trend regression model when the disturbances follow a serially correlated one-way error component model. In this model, we investigate the performance of the Ordinary Least Squares Esitmator (OLSE), First Difference Estimator (FDE), Generalized Least Squares Estimator (GLSE) and the Cochrane-Orcutt-Transformation Estimator (COTE) of slope coefficient in terms of efficiency. The main findings are as follows: (1) when the autocorrelation is close to unity, then the FDE is approximately the GLSE; (2) the OLSE is better than the COTE; and (3) when the value of the autocorrelation is kept constant and T → ∞, the OLSE, COTE and GLSE are asymptotically equivalent whereas the FDE is worse than the other estimators in terms of efficiency.     

A SEMIPARAMETRIC REGRESSION MODEL WITH MISSING COVARIATES IN CONTINUOUS-TIME CAPTURE-RECAPTURE STUDIES

Covariate data were missing when a semiparametric regression model was used to study bird abundance in the Mai Po Sanctuary, Hong Kong. This paper proposes an EM‐type algorithm to estimate the regression parameters for that study. Analytical calculation of the expectation in the EM method is difficult, or even impossible, especially when missing covariates are continuous. A Monte Carlo method is used in the EM algorithm to ease the calculation complexity. Asymptotic variances of the parameter estimates are also derived. Properties of the proposed estimators are assessed through numerical simulations and a real example.     

SOME SECOND ORDER ASYMPTOTICS IN EXPONENTIAL FAMILY NON-LINEAR REGRESSION MODELS (A GEOMETRIC APPROACH)

The differential geometric framework of Amari (1982a, 1985) is applied to the study of some second order asymptotics related to the curvatures for exponential family nonlinear regression models, in which the observations are independent but not necessarily identically distributed. This paper presents a set of reasonable regularity conditions which are needed to study asymptotics from a geometric point of view in regression models. A new stochastic expansion of a first order efficient estimator is derived and used to study several asymptotic problems related to Fisher information in terms of curvatures. The bias and the covariance of the first order efficient estimator are also calculated according to the expansion.     

JAMES-STEIN RULE ESTIMATORS IN LINEAR REGRESSION MODELS WITH MULTIVARIATE-t DISTRIBUTED ERROR

This paper considers estimation of β in the regression model y =Xβ+μ, where the error components in μ have the jointly multivariate Student-t distribution. A family of James-Stein type estimators (characterised by nonstochastic scalars) is presented. Sufficient conditions involving only X are given, under which these estimators are better (with respect to the risk under a general quadratic loss function) than the usual minimum variance unbiased estimator (MVUE) of β. Approximate expressions for the bias, the risk, the mean square error matrix and the variance-covariance matrix for the estimators in this family are obtained. A necessary and sufficient condition for the dominance of this family over MVUE is also given.     

THE OPTIMAL CRITICAL VALUE OF A PRE-TEST FOR AN INEQUALITY RESTRICTION IN A MIS-SPECIFIED REGRESSION MODEL

Optimal critical values are derived for a pre-test of an inequality restriction in a model where relevant regressors are unwittingly omitted. The criterion adopted is either that of the minimum average relative risk, or that of the mini-max regret. The latter approach yields an optimal critical value which is sensitive to the degree of model mis-specification, while the former criterion always leads to the choice of the unrestricted estimator.     

Theory & Methods: Residual Diagnostic Plots for Checking for Model Mis‐specification in Time Series Regression

This paper considers residuals for time series regression. Despite much literature on visual diagnostics for uncorrelated data, there is little on the autocorrelated case. To examine various aspects of the fitted time series regression model, three residuals are considered. The fitted regression model can be checked using orthogonal residuals; the time series error model can be analysed using marginal residuals; and the white noise error component can be tested using conditional residuals. When used together, these residuals allow identification of outliers, model mis‐specification and mean shifts. Due to the sensitivity of conditional residuals to model mis‐specification, it is suggested that the orthogonal and marginal residuals be examined first.     

AN ITERATIVE METHOD FOR ESTIMATION OF PARAMETERS IN A CLUSTERED SAMPLING MODEL

This paper considers an iterative method for obtaining maximum likelihood estimates for a contingency table derived from a clustered sampling model. Comparisons are made with other methods proposed in the literature.     

LOSS OF INFORMATION ASSOCIATED WITH THE ORDER STATISTICS AND RELATED ESTIMATORS IN THE DOUBLE EXPONENTIAL DISTRIBUTION CASE

Fisher (1934) derived the loss of information of the maximum likelihood estimator (MLE) of the location parameter in the case of the double exponential distribution. Takeuchi & Akahira (1976) showed that the MLE is not second order asymptotically efficient. This paper extends these results by obtaining the (asymptotic) losses of information of order statistics and related estimators, and by comparing them via their asymptotic distributions up to the second order.