ASYMPTOTIC PROPERTIES OF RESTRICTED MAXIMUM LIKELIHOOD (REML) ESTIMATES FOR HIERARCHICAL MIXED LINEAR MODELS

This paper explores the asymptotic distribution of the restricted maximum likelihood estimator of the variance components in a general mixed model. Restricting attention to hierarchical models, central limit theorems are obtained using elementary arguments with only mild conditions on the covariates in the fixed part of the model and without having to assume that the data are either normally or spherically symmetrically distributed. Further, the REML and maximum likelihood estimators are shown to be asymptotically equivalent in this general framework, and the asymptotic distribution of the weighted least squares estimator (based on the REML estimator) of the fixed effect parameters is derived.     

A RESTRICTED MAXIMUM LIKELIHOOD PROCEDURE FOR ESTIMATING THE VARIANCE FUNCTION OF AN IMMUNOASSAY

Restricted maximum likelihood (REML) is a procedure for estimating a variance function in a heteroscedastic linear model. Although REML has been extended to non-linear models, the case in which the data are dominated by replicated observations with unknown values of the independent variable of interest, such as the concentration of a substance in a blood sample, has not been considered. We derive a REML procedure for an immunoassay and show that the resulting estimator is superior to those currently being used. Some interesting properties of the REML estimator are derived, and its relationship to other estimators is discussed.     

ASYMPTOTIC PROPERTIES FOR MAXIMUM LIKELIHOOD ESTIMATORS FOR RELIABILITY AND FAILURE RATES OF MARKOV CHAINS

ABSTRACT

In this paper, we shall study a homogeneous ergodic, finite state, Markov chain with unknown transition probability matrix. Starting from the well known maximum likelihood estimator of transition probability matrix, we define estimators of reliability and its measurements. Our aim is to show that these estimators are uniformly strongly consistent and converge in distribution to normal random variables. The construction of the confidence intervals for availability, reliability, and failure rates are also given. Finally we shall give a numerical example for illustration and comparing our results with the usual empirical estimator results.     

ASYMPTOTIC OPTIMALITY OF LIKELIHOOD RATIO TESTS FOR EXPONENTIAL DISTRIBUTIONS UNDER TYPE II CENSORING

Consider the model of k two parameter exponential populations under a type II censoring scheme. In this paper we establish optimality in the sense of Bahadur of the likelihood ratio test for an arbitrary testing problem by requiring only Condition A in Hsieh (1979). This result unifies and generalizes the results in Samanta (1986).     

A CONDITIONAL DERIVATION OF RESIDUAL MAXIMUM LIKELIHOOD

Patterson & Thompson (1971) introduced residual maximum likelihood estimation in the case of unbalanced incomplete block designs. Harville (1974) and Cooper & Thompson (1977) give alternative derivations of the likelihood function. The purpose of this note is to provide another derivation of the likelihood function which may be useful in teaching.     

MAXIMUM LIKELIHOOD ESTIMATION IN LINEAR MODELS WITH EQUI-CORRELATED RANDOM ERRORS

Necessary and sufficient conditions for the existence of maximum likelihood estimators of unknown parameters in linear models with equi‐correlated random errors are presented. The basic technique we use is that these models are, first, orthogonally transformed into linear models with two variances, and then the maximum likelihood estimation problem is solved in the environment of transformed models. Our results generalize a result of Arnold, S. F. (1981) [The theory of linear models and multivariate analysis. Wiley, New York]. In addition, we give necessary and sufficient conditions for the existence of restricted maximum likelihood estimators of the parameters. The results of Birkes, D. & Wulff, S. (2003) [Existence of maximum likelihood estimates in normal variance‐components models. J Statist Plann. Inference. 113 , 35–47] are compared with our results and differences are pointed out.     

A NEW APPROACH TO MAXIMUM LIKELIHOOD ESTIMATION OF THE THREE-PARAMETER GAMMA AND WEIBULL DISTRIBUTIONS

A new approach, is proposed for maximum likelihood (ML) estimation in continuous univariate distributions. The procedure is used primarily to complement the ML method which can fail in situations such as the gamma and Weibull distributions when the shape parameter is, at most, unity. The new approach provides consistent and efficient estimates for all possible values of the shape parameter. Its performance is examined via simulations. Two other, improved, general methods of ML are reported for comparative purposes. The methods are used to estimate the gamma and Weibull distributions using air pollution data from Melbourne. The new ML method is accurate when the shape parameter is less than unity and is also superior to the maximum product of spacings estimation method for the Weibull distribution.     

LIKELIHOOD MOMENT ESTIMATION FOR THE GENERALIZED PARETO DISTRIBUTION

Traditional methods for estimating parameters in the generalized Pareto distribution have theoretical and computational defects. The moment estimator and the probability‐weighted moment estimator have low asymptotic efficiencies. They may not exist or may give nonsensical estimates. The maximum likelihood estimator, which sometimes does not exist, is asymptotically efficient, but its computation is complex and has convergence problems. The likelihood moment estimator is proposed, which is computationally easy and has high asymptotic efficiency.     

Semi-parametric modelling and likelihood estimation with estimating equations

This paper proposes a semi-parametric modelling and estimating method for analysing censored survival data. The proposed method uses the empirical likelihood function to describe the information in data, and formulates estimating equations to incorporate knowledge of the underlying distribution and regression structure. The method is more flexible than the traditional methods such as the parametric maximum likelihood estimation (MLE), Cox's (1972) proportional hazards model, accelerated life test model, quasi-likelihood (Wedderburn, 1974) and generalized estimating equations (Liang & Zeger, 1986). This paper shows the existence and uniqueness of the proposed semi-parametric maximum likelihood estimates (SMLE) with estimating equations. The method is validated with known cases studied in the literature. Several finite sample simulation and large sample efficiency studies indicate that when the sample size is larger than 100 the SMLE is compatible with the parametric MLE; and in all case studies, the SMLE is about 15% better than the parametric MLE with a mis-specified underlying distribution.     

ONE-SIDED ESTIMATING AND TESTING PROBLEMS FOR LOCATION MODELS FROM GROUPED SAMPLES

This article deals with one-sided problems for location models from grouped samples. Suppose the support region of a density function, which does not depend on parameters, is divided into some disjointed intervals, grouped samples are the number of observations falling in each intervals respectively. The studying of grouped samples may be dated back to the beginning of the century, in which only one sample location and/or scale models is considered. This article considers one-sided estimating and testing problems for location models. Some methods for computing the maximum likelihood estimates of the parameters subject to order restrictions are proposed and a numerical example by the method is given.     

Inference about regression parameters using highly stratified survey count data with over-dispersion and repeated measurements

We study methods to estimate regression and variance parameters for over-dispersed and correlated count data from highly stratified surveys. Our application involves counts of fish catches from stratified research surveys and we propose a novel model in fisheries science to address changes in survey protocols. A challenge with this model is the large number of nuisance parameters which leads to computational issues and biased statistical inferences. We use a computationally efficient profile generalized estimating equation method and compare it to marginal maximum likelihood (MLE) and restricted MLE (REML) methods. We use REML to address bias and inaccurate confidence intervals because of many nuisance parameters. The marginal MLE and REML approaches involve intractable integrals and we used a new R package that is designed for estimating complex nonlinear models that may include random effects. We conclude from simulation analyses that the REML method provides more reliable statistical inferences among the three methods we investigated.     

A BETA-BINOMIAL MODEL FOR ESTIMATING THE SIZE OF A HETEROGENEOUS POPULATION

This paper compares the properties of various estimators for a beta‐binomial model for estimating the size of a heterogeneous population. It is found that maximum likelihood and conditional maximum likelihood estimators perform well for a large population with a large capture proportion. The jackknife and the sample coverage estimators are biased for low capture probabilities. The performance of the martingale estimator is satisfactory, but it requires full capture histories. The Gibbs sampler and Metropolis‐Hastings algorithm provide reasonable posterior estimates for informative priors.     

AN EMPIRICAL LIKELIHOOD APPROACH FOR NON‐GAUSSIAN VECTOR STATIONARY PROCESSES AND ITS APPLICATION TO MINIMUM CONTRAST ESTIMATION

We develop the empirical likelihood approach for a class of vector‐valued, not necessarily Gaussian, stationary processes with unknown parameters. In time series analysis, it is known that the Whittle likelihood is one of the most fundamental tools with which to obtain a good estimator of unknown parameters, and that the score functions are asymptotically normal. Motivated by the Whittle likelihood, we apply the empirical likelihood approach to its derivative with respect to unknown parameters. We also consider the empirical likelihood approach to minimum contrast estimation based on a spectral disparity measure, and apply the approach to the derivative of the spectral disparity. This paper provides rigorous proofs on the convergence of our two empirical likelihood ratio statistics to sums of gamma distributions. Because the fitted spectral model may be different from the true spectral structure, the results enable us to construct confidence regions for various important time series parameters without assuming specified spectral structures and the Gaussianity of the process.     

ASYMPTOTIC INFERENCE FOR A CLASS OF CHAIN BINOMIAL MODELS

Chain binomial models axe commonly used to model the spread of an epidemic through a population. This paper shows that for a flexible class of chain binomial models an approximate maximum likelihood estimator of the infection rate, derived from a Poisson approximation to the binomial distribution, has an asymptotically normal distribution, as do some other related'estimators.     

A SEMIPARAMETRIC MIXTURE MODEL FOR THE ANALYSIS OF COMPETING RISKS DATA

This paper deals with the regression analysis of failure time data when there are censoring and multiple types of failures. We propose a semiparametric generalization of a parametric mixture model of Larson & Dinse (1985), for which the marginal probabilities of the various failure types are logistic functions of the covariates. Given the type of failure, the conditional distribution of the time to failure follows a proportional hazards model. A marginal like lihood approach to estimating regression parameters is suggested, whereby the baseline hazard functions are eliminated as nuisance parameters. The Monte Carlo method is used to approximate the marginal likelihood; the resulting function is maximized easily using existing software. Some guidelines for choosing the number of Monte Carlo replications are given. Fixing the regression parameters at their estimated values, the full likelihood is maximized via an EM algorithm to estimate the baseline survivor functions. The methods suggested are illustrated using the Stanford heart transplant data.     

A mixture of the manova and gmanova models

A mixture of the MANOVA and GMANOVA models is presented. The expected value of the response matrix in this model is the sum of two matrix components. The first component represents the GMANOVA portion and the second component represents the MANOVA portion. Maximum likelihood estimators are derived for the parameters in this model, and goodness-of-fit tests are constructed for fuller models via the likelihood ration criterion. Finally, likelihood ration tests for general liinear hypotheses are developed and a numerical example is presented.     

TEST FOR TREATMENT EFFECT BASED ON BINARY DATA WITH RANDOM SAMPLE SIZES

The problem of testing for treatment effect based on binary response data is considered, assuming that the sample size for each experimental unit and treatment combination is random. It is assumed that the sample size follows a distribution that belongs to a parametric family. The uniformly most powerful unbiased tests, which are equivalent to the likelihood ratio tests, are obtained when the probability of the sample size being zero is positive. For the situation where the sample sizes are always positive, the likelihood ratio tests are derived. These test procedures, which are unconditional on the random sample sizes, are useful even when the random sample sizes are not observed. Some examples are presented as illustration.     

AN ADAPTIVE TRIMMED LIKELIHOOD ALGORITHM FOR IDENTIFICATION OF MULTIVARIATE OUTLIERS

This article describes an algorithm for the identification of outliers in multivariate data based on the asymptotic theory for location estimation as described typically for the trimmed likelihood estimator and in particular for the minimum covariance determinant estimator. The strategy is to choose a subset of the data which minimizes an appropriate measure of the asymptotic variance of the multivariate location estimator. Observations not belonging to this subset are considered potential outliers which should be trimmed. For α less than about 0.5, the correct trimming proportion is taken to be that α > 0 for which the minimum of any minima of this measure of the asymptotic variance occurs. If no minima occur for an α > 0 then the data set will be considered outlier free.     

An alternative version of zero-inflated logarithmic series distribution and some of its applications

An important drawback of the standard logarithmic series distribution (LSD) in several practical applications is that it excludes the zero observation from its support. The LSD with non-negative support is not much studied in the literature. Recently Kumar and Riyaz [On the zero-inflated LSD and its modification. Statistica (accepted for publication). 2013] considered a distribution in this respect namely ‘zero-inflated logarithmic series distribution (ZILSD)’. Through this paper we propose an alternative form of the ZILSD and study some of its properties. We obtain expressions for its probability-generating function, mean and variance, and develop certain recurrence relations for its probabilities, raw moments and factorial moments. The parameters of the model are estimated by the method of moments and the method of maximum likelihood, and certain test procedures are considered for testing the significance of the additional parameter of the distribution. The distribution has been fitted to certain real-life data sets for illustrating its usefulness compared with certain existing models available in the literature. Further, a simulation study is conducted for assessing the performance of the estimators.