ROBUST ESTIMATION FOR EPIDEMIC MODELS

A robust approach to the analysis of epidemic data is suggested. This method is based on a natural extension of M-estimation for i.i.d. observations where the distribution may be asymmetric. It is discussed initially in the context of a general discrete time stochastic process before being applied to previously studied epidemic models. In particular we consider a class of chain binomial models and models based on time dependent branching processes. Robustness and efficiency properties are studied through simulation and some previously analysed data sets are considered.     

SKEWNESS FOR PARAMETERS IN GENERALIZED LINEAR MODELS

In this paper we give an asymptotic formula of order n ^?1/2, where n is the sample size, for the skewness of the distribution of the maximum likelihood estimates of the linear parameters in generalized linear models. The formula is given in matrix notation and is very suitable for computer implementation. Several special cases are discussed. We also give asymptotic formulae for the skewness of the distribution of the maximum likelihood estimates of the dispersion and precision parameters.     

ROBUST ESTIMATION AND HYPOTHESIS TESTS FOR FIRST-ORDER THRESHOLD AUTOREGRESSIVE MODELS

Results of Petrucelli & Woolford (1984) for a first-order threshold autoregressive model are considered from a robust point of view. Robust estimators of the threshold parameters of the model are obtained and their asymptotic normality is proved. Testing the equality of the threshold parameters is considered using the robust analogues of Wald and score test statistics. Limiting distributions of these statistics are given under both null and alternative hypotheses.     

ROBUST METHODS FOR DEPENDENT CELL PEDIGREE DATA

This paper studies a robust approach to the analysis of cell pedigree data, building on the work of Huggins & Marschner (1991) which discussed M-estimation for the so-called bifurcating autoregressive process. The study allows for incomplete observation of the pedigree, and incorporates the possibility of additive effects outliers, as discussed in the time series literature. Some properties of the proposed estimation procedure are studied, including a Monte Carlo investigation of robustness in the presence of contamination.     

AN IMPROVED COMPOUND ESTIMATOR FOR ROBUST REGRESSION

ABSTRACT

Advances in statistical computing software have led to a substantial increase in the use of ordinary least squares (OLS) regression models in the engineering and applied statistics communities. Empirical evidence suggests that data sets can routinely have 10% or more outliers in many processes. Unfortunately, these outliers typically will render the OLS parameter estimates useless. The OLS diagnostic quantities and graphical plots can reliably identify a few outliers; however, they significantly lose power with increasing dimension and number of outliers. Although there have been recent advances in the methods that detect multiple outliers, improvements are needed in regression estimators that can fit well in the presence of outliers. We introduce a robust regression estimator that performs well regardless of outlier quantity and configuration. Our studies show that the best available estimators are vulnerable when the outliers are extreme in the regressor space (high leverage). Our proposed compound estimator modifies recently published methods with an improved initial estimate and measure of leverage. Extensive performance evaluations indicate that the proposed estimator performs the best and consistently fits the bulk of the data when outliers are present. The estimator, implemented in standard software, provides researchers and practitioners a tool for the model-building process to protect against the severe impact from multiple outliers.     

ESTIMATION AND TESTING FOR PARTIALLY LINEAR SINGLE-INDEX MODELS

In partially linear single-index models, we obtain the semiparametrically efficient profile least-squares estimators of regression coefficients. We also employ the smoothly clipped absolute deviation penalty (SCAD) approach to simultaneously select variables and estimate regression coefficients. We show that the resulting SCAD estimators are consistent and possess the oracle property. Subsequently, we demonstrate that a proposed tuning parameter selector, BIC, identifies the true model consistently. Finally, we develop a linear hypothesis test for the parametric coefficients and a goodness-of-fit test for the nonparametric component, respectively. Monte Carlo studies are also presented.     

A NOTE ON MULTIVARIATE LINEAR MODELS WITH NON-ADDITIVITY

Tukey's non-additivity test in an analysis of variance model is extended to a multivariate linear model with covariates. If non-additivity is found to exist, a Wilks's Lambda test for the dimensionality of the matrix of the non-additivity parameters is derived and the Lambda criterion is then factorized into two independent test criteria to test meaningful hypotheses concerning the multivariate model.     

BOOTSTRAP TESTS FOR THE ERROR DISTRIBUTION IN LINEAR AND NONPARAMETRIC REGRESSION MODELS

In this paper we investigate several tests for the hypothesis of a parametric form of the error distribution in the common linear and non‐parametric regression model, which are based on empirical processes of residuals. It is well known that tests in this context are not asymptotically distribution‐free and the parametric bootstrap is applied to deal with this problem. The performance of the resulting bootstrap test is investigated from an asymptotic point of view and by means of a simulation study. The results demonstrate that even for moderate sample sizes the parametric bootstrap provides a reliable and easy accessible solution to the problem of goodness‐of‐fit testing of assumptions regarding the error distribution in linear and non‐parametric regression models.     

ON THE ROBUST ANALYSIS OF VARIANCE COMPONENTS MODELS FOR PEDIGREE DATA

Quantitative traits measured over pedigrees of individuals may be analysed using maximum likelihood estimation, assuming that the trait has a multivariate normal distribution. This approach is often used in the analysis of mixed linear models. In this paper a robust version of the log likelihood for multivariate normal data is used to construct M-estimators which are resistant to contamination by outliers. The robust estimators are found using a minimisation routine which retains the flexible parameterisations of the multivariate normal approach. Asymptotic properties of the estimators are derived, computation of the estimates and their use in outlier detection tests are discussed, and a small simulation study is conducted.     

DYNAMIC FACTOR MODELS

This paper introduces nonlinear dynamic factor models for various applications related to risk analysis. Traditional factor models represent the dynamics of processes driven by movements of latent variables, called the factors. Our approach extends this setup by introducing factors defined as random dynamic parameters and stochastic autocorrelated simulators. This class of factor models can represent processes with time varying conditional mean, variance, skewness and excess kurtosis. Applications discussed in the paper include dynamic risk analysis, such as risk in price variations (models with stochastic mean and volatility), extreme risks (models with stochastic tails), risk on asset liquidity (stochastic volatility duration models), and moral hazard in insurance analysis.

We propose estimation procedures for models with the marginal density of the series and factor dynamics parameterized by distinct subsets of parameters. Such a partitioning of the parameter vector found in many applications allows to simplify considerably statistical inference. We develop a two- stage Maximum Likelihood method, called the Finite Memory Maximum Likelihood, which is easy to implement in the presence of multiple factors. We also discuss simulation based estimation, testing, prediction and filtering.     

A REPARAMETERISATION METHOD FOR EMBEDDED MODELS

ABSTRACT

A reparameterisation procedure is investigated for embedded model problems. The procedure is given by solving differential equations determined by indeterminate forms of limit. Some properties are provided for the existence of an embedded model. Note that an embedded model may include another embedded model. We introduce the concept of embedded model of kth generation and discuss the use of one-by-one elimination procedure to construct graphs of embedded models. As examples, we derive embedded models for some distributions, to which existing method cannot be applied. Our method includes the method given by Cheng et al. [1] Cheng, R.C.H., Evans, B.E. and Iles, T.C. 1992. Embedded Models in Non-Linear Regression. J. R. Statist. Soc. B, 54: 877–888.  [Google Scholar] as a special case.     

THE BOOTSTRAP RISK OF LINEAR EMPIRICAL BAYES ESTIMATES

This paper discusses the bootstrap risk of the linear empirical Bayes estimate of the form θ=Ǎ+B̌x, where x is the current observation, and Ǎ and B̌ are generally functions of the estimates of the prior parameters. The standard error of this risk is developed and ‘computations’ of both the bootstrap risk and its standard error are made.     

ROBUST RIDGE REGRESSION BASED ON AN M-ESTIMATOR

Consider the linear regression model y =β₀1 +Xβ+ in the usual notation. It is argued that the class of ordinary ridge estimators obtained by shrinking the least squares estimator by the matrix (X¹X + kI)^-1X'X is sensitive to outliers in the ^variable. To overcome this problem, we propose a new class of ridge-type M-estimators, obtained by shrinking an M-estimator (instead of the least squares estimator) by the same matrix. Since the optimal value of the ridge parameter k is unknown, we suggest a procedure for choosing it adaptively. In a reasonably large scale simulation study with a particular M-estimator, we found that if the conditions are such that the M-estimator is more efficient than the least squares estimator then the corresponding ridge-type M-estimator proposed here is better, in terms of a Mean Squared Error criteria, than the ordinary ridge estimator with k chosen suitably. An example illustrates that the estimators proposed here are less sensitive to outliers in the y-variable than ordinary ridge estimators.     

OPTIMAL QUADRATIC UNBIASED ESTIMATION FOR MODELS WITH LINEAR TOEPLITZ COVARIANCE STRUCTURE

This paper deals with the problem of quadratic unbiased estimation for models with linear Toeplitz covariance structure. These serial covariance models are very useful to modelize time or spatial correlations by means of linear models. Optimality and local optimality is examined in different ways. For the nested Toeplitz models, it is shown that there does not exist a Uniformly Minimum Variance Quadratic Unbiased Estimator for at least one linear combination of covariance parameters. Moreover, empirical unbiased estimators are identified as Locally Minimum Variance Quadratic Unbiased Estimators for a particular choice on covariance parameters corresponding to the case where the covariance matrix of the observed random vector is proportional to the identity matrix. The complete Toeplitz-circulant model is also studied. For this model, the existence of a Uniformly Minimum Variance Quadratic Unbiased Estimator for each covariance parameter is proved.     

A NOTE ON MULTIVARIATE LOGISTIC MODELS FOR CONTINGENCY TABLES

The log-linear model is a tool widely accepted for modelling discrete data given in a contingency table. Although its parameters reflect the interaction structure in the joint distribution of all variables, it does not give information about structures appearing in the margins of the table. This is in contrast to multivariate logistic parameters, recently introduced by Glonek & McCullagh (1995), which have as parameters the highest order log odds ratios derived from the joint table and from each marginal table. Glonek & McCullagh give the link between the cell probabilities and the multivariate logistic parameters, in an algebraic fashion. The present paper focuses on this link, showing that it is derived by general parameter transformations in exponential families. In particular, the connection between the natural, the expectation and the mixed parameterization in exponential families (Barndorff-Nielsen, 1978) is used; this also yields the derivatives of the likelihood equation and shows properties of the Fisher matrix. The paper emphasises the analysis of independence hypotheses in margins of a contingency table.     

INCOMPLETE DATA IN GENERALIZED LINEAR MODELS WITH CONTINUOUS COVARIATES

This paper proposes a method for estimating the parameters in a generalized linear model with missing covariates. The missing covariates are assumed to come from a continuous distribution, and are assumed to be missing at random. In particular, Gaussian quadrature methods are used on the E-step of the EM algorithm, leading to an approximate EM algorithm. The parameters are then estimated using the weighted EM procedure given in Ibrahim (1990). This approximate EM procedure leads to approximate maximum likelihood estimates, whose standard errors and asymptotic properties are given. The proposed procedure is illustrated on a data set.     

LONG-RANGE DEPENDENT COMMON FACTOR MODELS: A BAYESIAN APPROACH

We propose a simulation-based Bayesian approach to analyze multivariate time series with possible common long-range dependent factors. A state-space approach is used to represent the likelihood function in a tractable manner. The approach taken here allows for extension to fit a non-Gaussian multivariate stochastic volatility (MVSV) model with common long-range dependent components. The method is illustrated for a set of stock returns for companies having similar annual sales.     

COMBINING INFORMATION FROM LINEAR MODELS ON POSSIBLY DIFFERENT SCALES

This paper examines the joint statistical analysis of M independent data sets, the jth of which satisfies the model λ_j Y_j=X_jB +ε_j, where the λ_j are unknown and the ε_i are normally distributed with a known correlation structure. The maximum likelihood equations, their asymptotic covariance matrix, and the likelihood ratio test of the hypothesis that the λ_js are all equal are derived. These results are applied to two examples.     

EMPIRICAL LIKELIHOOD‐BASED INFERENCES FOR PARTIALLY LINEAR MODELS WITH MISSING COVARIATES

This paper considers statistical inference for partially linear models Y = X ^? β +ν(Z) +? when the linear covariate X is missing with missing probability π depending upon (Y, Z). We propose empirical likelihood‐based statistics to construct confidence regions for β and ν(z). The resulting empirical likelihood ratio statistics are shown to be asymptotically chi‐squared‐distributed. The finite‐sample performance of the proposed statistics is assessed by simulation experiments. The proposed methods are applied to a dataset from an AIDS clinical trial.