Robust estimates of ordered means in normal models

In this paper we consider the problem of estimating the locations of several normal populations when an order relation between them is known to be true. We compare the maximum likelihood estimator, the M-estimators based on Huber’s ψ function, a robust weighted likelihood estimator, the Gastworth estimator and the trimmed mean estimator. A Monte-Carlo study illustrates the performance of the methods considered.     

ASYMPTOTIC PROPERTIES OF RESTRICTED MAXIMUM LIKELIHOOD (REML) ESTIMATES FOR HIERARCHICAL MIXED LINEAR MODELS

This paper explores the asymptotic distribution of the restricted maximum likelihood estimator of the variance components in a general mixed model. Restricting attention to hierarchical models, central limit theorems are obtained using elementary arguments with only mild conditions on the covariates in the fixed part of the model and without having to assume that the data are either normally or spherically symmetrically distributed. Further, the REML and maximum likelihood estimators are shown to be asymptotically equivalent in this general framework, and the asymptotic distribution of the weighted least squares estimator (based on the REML estimator) of the fixed effect parameters is derived.     

Practical modeling strategies for unbalanced longitudinal data analysis

In practice, data are often measured repeatedly on the same individual at several points in time. Main interest often relies in characterizing the way the response changes in time, and the predictors of that change. Marginal, mixed and transition are frequently considered to be the main models for continuous longitudinal data analysis. These approaches are proposed primarily for balanced longitudinal design. However, in clinic studies, data are usually not balanced and some restrictions are necessary in order to use these models. This paper was motivated by a data set related to longitudinal height measurements in children of HIV-infected mothers that was recorded at the university hospital of the Federal University in Minas Gerais, Brazil. This data set is severely unbalanced. The goal of this paper is to assess the application of continuous longitudinal models for the analysis of unbalanced data set.     

A Bayesian hierarchical model for categorical longitudinal data from a social survey of immigrants

Summary.  The paper investigates a Bayesian hierarchical model for the analysis of categorical longitudinal data from a large social survey of immigrants to Australia. Data for each subject are observed on three separate occasions, or waves, of the survey. One of the features of the data set is that observations for some variables are missing for at least one wave. A model for the employment status of immigrants is developed by introducing, at the first stage of a hierarchical model, a multinomial model for the response and then subsequent terms are introduced to explain wave and subject effects. To estimate the model, we use the Gibbs sampler, which allows missing data for both the response and the explanatory variables to be imputed at each iteration of the algorithm, given some appropriate prior distributions. After accounting for significant covariate effects in the model, results show that the relative probability of remaining unemployed diminished with time following arrival in Australia.     

Percentage points of the statistics for testing hypotheses on mean vectors of multivariate normal distributions with missing observations

A problem of testing of hypotheses on the mean vector of a multivariate normal distribution with unknown and positive definite covariance matrix is considered when a sample with a special, though not unusual, pattern of missing observations from that population is available. The approximate percentage points of the test statistic are obtained and their accuracy has been checked by comparing them with some exact percentage points which are calculated for complete samples and some special incomplete samples. The approximate percentage points are in good agreement with exact percentage points. The above work is extended to the problem of testing the hypothesis of equality of two mean vectors of two multivariate normal distributions with the same, unknown covariance matrix     

Inference in flexible families of distributions with normal kernel

This paper addresses the inference problem for a flexible class of distributions with normal kernel known as skew-bimodal-normal family of distributions. We obtain posterior and predictive distributions assuming different prior specifications. We provide conditions for the existence of the maximum-likelihood estimators (MLE). An EM-type algorithm is built to compute them. As a by product, we obtain important results related to classical and Bayesian inferences for two special subclasses called bimodal-normal and skew-normal (SN) distribution families. We perform a Monte Carlo simulation study to analyse behaviour of the MLE and some Bayesian ones. Considering the frontier data previously studied in the literature, we use the skew-bimodal-normal (SBN) distribution for density estimation. For that data set, we conclude that the SBN model provides as good a fit as the one obtained using the location-scale SN model. Since the former is a more parsimonious model, such a result is shown to be more attractive.     

Maximum Likelihood Estimation for Stochastic Differential Equations with Random Effects

Abstract. We consider N independent stochastic processes (X _i (t), t ∈ [0,T _i ]), i=1,…, N, defined by a stochastic differential equation with drift term depending on a random variable φ _i . The distribution of the random effect φ _i depends on unknown parameters which are to be estimated from the continuous observation of the processes X_i. We give the expression of the exact likelihood. When the drift term depends linearly on the random effect φ _i and φ _i has Gaussian distribution, an explicit formula for the likelihood is obtained. We prove that the maximum likelihood estimator is consistent and asymptotically Gaussian, when T _i =T for all i and N tends to infinity. We discuss the case of discrete observations. Estimators are computed on simulated data for several models and show good performances even when the length time interval of observations is not very large.     

A condition for best asymptotic normality in a regular family of distributions

A theorem is presented which provides a simple sufficient condition for a weakly consistent estimator of a parameter in a regular family of distributions to be best asymptotically normal (B.A.N.). As a corollary the B.A.N. property of a maximum likelihood estimator is established under weaker conditions than those of Zacks (1971). Two examples are provided to illustrate the technique.     

Robustness of the posterior mean in normal hierarchical models

We consider the problem of robustness in hierarchical Bayes models. Let X = (X₁,X₂, … ,X_p)^τ be a random vector, the X₁ being independently distributed as N(θ₁,σ²) random variables (σ² known), while the θ₁ are thought to be exchangeable, modelled as i.i.d, N(μ,τ²). The hyperparameter µ is given a noninformative prior distribution π(μ) = 1 and τ² is assumed to be independent of µ having a distribution g(τ²) lying in a certain class of distributions g. For several g's, including e-contaminations classes and density ratio classes we determine the range of the posterior mean of θ₁ as g ranges over g.     

Estimation for two-way analysis of variance with correlated errors

We consider some estimation and distribution problems encountered in a two way analysis of variance model with only one observation per cell, errors correlated in one level, and the variances are not necessarily equal. The independence criteria for the row and interaction mean sum of squares and distribution of the maximum likelihood estimator of the correlation coefficient are given.     

Estimating the variance for heterogeneity in arm‐based network meta‐analysis

Network meta‐analysis can be implemented by using arm‐based or contrast‐based models. Here we focus on arm‐based models and fit them using generalized linear mixed model procedures. Full maximum likelihood (ML) estimation leads to biased trial‐by‐treatment interaction variance estimates for heterogeneity. Thus, our objective is to investigate alternative approaches to variance estimation that reduce bias compared with full ML. Specifically, we use penalized quasi‐likelihood/pseudo‐likelihood and hierarchical (h) likelihood approaches. In addition, we consider a novel model modification that yields estimators akin to the residual maximum likelihood estimator for linear mixed models. The proposed methods are compared by simulation, and 2 real datasets are used for illustration. Simulations show that penalized quasi‐likelihood/pseudo‐likelihood and h‐likelihood reduce bias and yield satisfactory coverage rates. Sum‐to‐zero restriction and baseline contrasts for random trial‐by‐treatment interaction effects, as well as a residual ML‐like adjustment, also reduce bias compared with an unconstrained model when ML is used, but coverage rates are not quite as good. Penalized quasi‐likelihood/pseudo‐likelihood and h‐likelihood are therefore recommended.     

Bayesian analysis of hierarchical linear mixed modeling using the multivariate t distribution

This article presents a fully Bayesian approach to modeling incomplete longitudinal data using the t linear mixed model with AR(p) dependence. Markov chain Monte Carlo (MCMC) techniques are implemented for computing posterior distributions of parameters. To facilitate the computation, two types of auxiliary indicator matrices are incorporated into the model. Meanwhile, the constraints on the parameter space arising from the stationarity conditions for the autoregressive parameters are handled by a reparametrization scheme. Bayesian predictive inferences for the future vector are also investigated. An application is illustrated through a real example from a multiple sclerosis clinical trial.     

Bayesian hierarchical model for the prediction of football results

The problem of modelling football data has become increasingly popular in the last few years and many different models have been proposed with the aim of estimating the characteristics that bring a team to lose or win a game, or to predict the score of a particular match. We propose a Bayesian hierarchical model to fulfil both these aims and test its predictive strength based on data about the Italian Serie A 1991–1992 championship. To overcome the issue of overshrinkage produced by the Bayesian hierarchical model, we specify a more complex mixture model that results in a better fit to the observed data. We test its performance using an example of the Italian Serie A 2007–2008 championship.     

Improved estimation of variance components in balanced hierarchical mixed models

The problem of simultaneous estimation of variance components is considered for a balanced hierarchical mixed model under a sum of squared error loss. A new class of estimators is suggested which dominate the usual sensible estimators. These estimators shrink towards the geometric mean of the component mean squares that appear in the ANOVA table. Numerical results are tabled to exhibit the improvement in risk under a simple model.     

Robust tests for equality of two population means under the normal model

A robust procedure is developed for testing the equality of means in the two sample normal model. This is based on the weighted likelihood estimators of Basu et al. (1993). When the normal model is true the tests proposed have the same asymptotic power as the two sample Student's t-statistic in the equal variance case. However, when the normality assumptions are only approximately true the proposed tests can be substantially more powerful than the classical tests. In a Monte Carlo study for the equal variance case under various outlier models the proposed test using Hellinger distance based weighted likelihood estimator compared favorably with the classical test as well as the robust test proposed by Tiku (1980).     

Estimation of reliability for a multicomponent survival stress-strength model based on exponential distributions

Uniformly minimum variance unbiased estimator (UMVUE) of reliability in stress-strength model (known stress) is obtained for a multicomponent survival model based on exponential distributions for parallel system. The variance of this estimator is compared with Cramer-Rao lower bound (CRB) for the variance of unbiased estimator of reliability, and the mean square error (MSE) of maximum likelihood estimator of reliability in case of two component system.     

Approximate bayes estimation for mixtures of two weibull distributions under type-2 censoring

The main object of this paper is the approximate Bayes estimation of the five dimensional vector of parameters and the reliability function of a mixture of two Weibull distributions under Type-2 censoring. Under Type-2 censoring, the posterior distribution is complicated, and the integrals involved cannot be obtained in a simple closed form. In this work, Lindley's (1980) approximate form of Bayes estimation is used in the case of a mixture of two Weibull distributions under Type-2 censoring. Through Monte Carlo simulation, the root mean squared errors (RMSE's) of the Bayes estimates are computed and compared with the corresponding estimated RMSE's of the maximum likelihood estimates.     

Pitman closeness for hierarchical bayes predictors in mixed linear models

The present article considers the Pitman Closeness (PC) criterion of certain hierarchical Bayes (HB) predictors derived under a normal mixed linear models for known ratios of variance components using a uniform prior for the vector of fixed effects and some proper or improper prior on the error variance. For a generalized Euclidean error, simultaneous HB predictors of several linear combinations of vector of effects are shown to be the Pitman-closest in the frequentist sense in the class of equivariant predictors for location group of transformations. The normality assumption can be relaxed to show that these HB predictors are the Pitman-closest for location-scale group of transformations for a wider family of elliptically symmetric distributions. Also for this family, the HB predictors turn out to be Pitman-closest in the class of all linear unbiased predictors (LUPs). All these results are extended for the HB predictor of finite population mean vector in the context of finite population sampling.     

Maximum likelihood estimation for generalized conditionally autoregressive models of spatial data

Conditionally autoregressive (CAR) models are often used to analyze a spatial process observed over a lattice or a set of irregular regions. The neighborhoods within a CAR model are generally formed deterministically using the inter-distances or boundaries between the regions. To accommodate directional and inherent anisotropy variation, a new class of spatial models is proposed that adaptively determines neighbors based on a bivariate kernel using the distances and angles between the centroid of the regions. The newly proposed model generalizes the usual CAR model in a sense of accounting for adaptively determined weights. Maximum likelihood estimators are derived and simulation studies are presented for the sampling properties of the estimates on the new model, which is compared to the CAR model. Finally the method is illustrated using a data set on the elevated blood lead levels of children under the age of 72 months observed in Virginia in the year of 2000.