Correlated linear models for the analysis of familial correlations

The problems of estimation and hypotheses testing on the parameters of two correlated linear models are discussed. Such models are known to have direct applications in epidemiologic research, particularly in the field of family studies. When the data are unbalanced, the maximum-likelihood estimation of the parameters is achieved by adopting a fairly simple numerical algorithm. The asymptotic variances and covariances of the estimators are derived, and the procedures are illustrated on arterial-blood-pressure data from the literature.     

Prediction in linear mixed models

Following estimation of effects from a linear mixed model, it is often useful to form predicted values for certain factor/variate combinations. The process has been well defined for linear models, but the introduction of random effects into the model means that a decision has to be made about the inclusion or exclusion of random model terms from the predictions. This paper discusses the interpretation of predictions formed including or excluding random terms. Four datasets are used to illustrate circumstances where different prediction strategies may be appropriate: in an orthogonal design, an unbalanced nested structure, a model with cubic smoothing spline terms and for kriging after spatial analysis. The examples also show the need for different weighting schemes that recognize nesting and aliasing during prediction, and the necessity of being able to detect inestimable predictions.     

Large sample bias of maximum likeihood estimates from a series of sparse ixj tables

For a large series of IxJ tables, each containing two observations, the bias of the maximum likelihood estimates of log linear partial association parameters is shown to be equal to the parameters, regardless of the size of I and J. The partial association considered is that between row and column variables; the three way interactions are assumed to be O. This is a generalization of Andersen's results (1973a, 1973b) for a series of 2x2 tables.     

ASYMPTOTIC INFERENCE FOR A CLASS OF CHAIN BINOMIAL MODELS

Chain binomial models axe commonly used to model the spread of an epidemic through a population. This paper shows that for a flexible class of chain binomial models an approximate maximum likelihood estimator of the infection rate, derived from a Poisson approximation to the binomial distribution, has an asymptotically normal distribution, as do some other related'estimators.     

Multivariate parabolic bioassay

A general linear model approach to quantitative parabolic bioassays with multivariate responses is proposed. The point and interval estimator of the relative potency and an associated test for validity is presented. The relationships with known univariate methods are illustrated.     

Estimation and tests of hypotheses for the initial mean and covariance in the kalman filter model

Kalman filtering techniques are widely used by engineers to recursively estimate random signal parameters which are essentially coefficients in a large-scale time series regression model. These Bayesian estimators depend on the values assumed for the mean and covariance parameters associated with the initial state of the random signal. This paper considers a likelihood approach to estimation and tests of hypotheses involving the critical initial means and covariances. A computationally simple convergent iterative algorithm is used to generate estimators which depend only on standard Kalman filter outputs at each successive stage. Conditions are given under which the maximum likelihood estimators are consistent and asymptotically normal. The procedure is illustrated using a typical large-scale data set involving 10-dimensional signal vectors.     

Errors-in-variables with systematic biases

A structural regression model is considered in which some of the variables are measured with error. Instead of additive measurement errors, systematic biases are allowed by relating true and observed values via simple linear regressions. Additional data is available, based on standards, which allows for “calibration” of the measuring methods involved. Using only moment assumptions, some simple estimators are proposed and their asymptotic properties are developed. The results parallel and extend those given by Fuller (1987) in which the errors are additive and the error covariance is estimated. Maximum likelihood estimation is also discussed and the problem is illustrated using data from an acid rain study in which the relationship between pH and alkalinity is of interest but neither variable is observed exactly.     

Double hierarchical generalized linear models (with discussion)

Summary.  We propose a class of double hierarchical generalized linear models in which random effects can be specified for both the mean and dispersion. Heteroscedasticity between clusters can be modelled by introducing random effects in the dispersion model, as is heterogeneity between clusters in the mean model. This class will, among other things, enable models with heavy-tailed distributions to be explored, providing robust estimation against outliers. The h -likelihood provides a unified framework for this new class of models and gives a single algorithm for fitting all members of the class. This algorithm does not require quadrature or prior probabilities.     

Econometric Reviews

This paper considers the problem of estimating a nonlinear statistical model subject to stochastic linear constraints among unknown parameters. These constraints represent prior information which originates from a previous estimation of the same model using an alternative database. One feature of this specification allows for the disign matrix of stochastic linear restrictions to be estimated. The mixed regression technique and the maximum likelihood approach are used to derive the estimator for both the model coefficients and the unknown elements of this design matrix. The proposed estimator whose asymptotic properties are studied, contains as a special case the conventional mixed regression estimator based on a fixed design matrix. A new test of compatibility between prior and sample information is also introduced. Thesuggested estimator is tested empirically with both simulated and actual marketing data.     

Generalized mixed estimator for nonlinear models: a maximum likelihood approach

This paper considers the problem of estimating a nonlinear statistical model subject to stochastic linear constraints among unknown parameters. These constraints represent prior information which originates from a previous estimation of the same model using an alternative database. One feature of this specification allows for the disign matrix of stochastic linear restrictions to be estimated. The mixed regression technique and the maximum likelihood approach are used to derive the estimator for both the model coefficients and the unknown elements of this design matrix. The proposed estimator whose asymptotic properties are studied, contains as a special case the conventional mixed regression estimator based on a fixed design matrix. A new test of compatibility between prior and sample information is also introduced. Thesuggested estimator is tested empirically with both simulated and actual marketing data.     

A COMPARISON OF MIXED MODEL SPLINES FOR CURVE FITTING

Three types of polynomial mixed model splines have been proposed: smoothing splines, P‐splines and penalized splines using a truncated power function basis. The close connections between these models are demonstrated, showing that the default cubic form of the splines differs only in the penalty used. A general definition of the mixed model spline is given that includes general constraints and can be used to produce natural or periodic splines. The impact of different penalties is demonstrated by evaluation across a set of functions with specific features, and shows that the best penalty in terms of mean squared error of prediction depends on both the form of the underlying function and the signal:noise ratio.     

Empirical likelihood for generalized linear models with fixed and adaptive designs

Empirical likelihood inference for generalized linear models with fixed and adaptive designs is considered. It is shown that the empirical log-likelihood ratio at the true parameters converges to the standard chi-square distribution. Furthermore, we obtain the maximum empirical likelihood estimate of the unknown parameter and the resulting estimator is shown to be asymptotically normal. Some simulations are conducted to illustrate the proposed method.     

A Sparse Implementation of the Average Information Algorithm for Factor Analytic and Reduced Rank Variance Models

Factor analytic variance models have been widely considered for the analysis of multivariate data particularly in the psychometrics area. Recently Smith, Cullis & Thompson (2001) have considered their use in the analysis of multi‐environment data arising from plant improvement programs. For these data, the size of the problem and the complexity of the variance models chosen to account for spatial heterogeneity within trials implies that standard algorithms for fitting factor analytic models can be computationally expensive. This paper presents a sparse implementation of the average information algorithm (Gilmour, Thompson & Cullis, 1995) for fitting factor analytic and reduced rank variance models.     

Consistency of regression estimates when some variables are subject to error

For a general univariate “errors-in-variables” model, the maximum likelihood estimate of the parameter vector (assuming normality of the errors), which has been described in the literature, can be expressed in an alternative form. In this form, the estimate is computationally simpler, and deeper investigation of its properties is facilitated. In particular, w demonstrate that, under conditions a good deal less restrictive than those which have been previously assumed, the estimate is weakly consistent.