Maximum-likelihood estimation for constrained- or missing-data models

In statistical models involving constrained or missing data, likelihoods containing integrals emerge. In the case of both constrained and missing data, the result is a ratio of integrals, which for multivariate data may defy exact or approximate analytic expression. Seeking maximum-likelihood estimates in such settings, we propose Monte Carlo approximants for these integrals, and subsequently maximize the resulting approximate likelihood. Iteration of this strategy expedites the maximization, while the Gibbs sampler is useful for the required Monte Carlo generation. As a result, we handle a class of models broader than the customary EM setting without using an EM-type algorithm. Implementation of the methodology is illustrated in two numerical examples.     

Maximum-likelihood estimation and influence analysis in multivariate skew-normal reproductive dispersion mixed models for longitudinal data

Various mixed models were developed to capture the features of between- and within-individual variation for longitudinal data under the normality assumption of the random effect and the within-individual random error. However, the normality assumption may be violated in some applications. To this end, this article assumes that the random effect follows a skew-normal distribution and the within-individual error is distributed as a reproductive dispersion model. An expectation conditional maximization (ECME) algorithm together with the Metropolis-Hastings (MH) algorithm within the Gibbs sampler is presented to simultaneously obtain estimates of parameters and random effects. Several diagnostic measures are developed to identify the potentially influential cases and assess the effect of minor perturbation to model assumptions via the case-deletion method and local influence analysis. To reduce the computational burden, we derive the first-order approximations to case-deletion diagnostics. Several simulation studies and a real data example are presented to illustrate the newly developed methodologies.     

Maximum-likelihood estimation for the removal method

We prove that the profile log-likelihood function for the removal method of estimating population size is unimodal. The result is obtained by a variation-diminishing property of the Laplace transform. An implication of this result is that the likelihood-ratio confidence region for the population size is always an interval. Necessary and sufficient conditions for the existence of a finite maximum-likelihood estimator are presented. We also present evidence that the likelihood-ratio confidence interval for the population size has acceptable small-sample coverage properties.     

Maximum-likelihood estimation and presentation for the interaction between treatments in observational studies with a dichotomous outcome

In observational studies for the interaction between treatments, one needs to estimate and present both the treatment effects and the interaction to learn the significance of the interaction to the treatment effects. In this article, we estimate the treatment effects and the interaction jointly by using only one logistic model and based on maximum-likelihood. We present the interaction by (1) point estimate and confidence interval of the interaction, (2) point estimate and confidence region of (treatment effect, interaction), and (3) point estimate and confidence interval of the interaction when the maximum-likelihood estimate of one treatment effect falls into specified range.     

Semiparametric estimation in copula models

The author recalls the limiting behaviour of the empirical copula process and applies it to prove some asymptotic properties of a minimum distance estimator for a Euclidean parameter in a copula model. The estimator in question is semiparametric in that no knowledge of the marginal distributions is necessary. The author also proposes another semiparametric estimator which he calls “rank approximate Z‐estimator” and whose asymptotic normality he derives. He further presents Monte Carlo simulation results for the comparison of various estimators in four well‐known bivariate copula models.     

Parameter estimation in dynamic models

In this paper we study the parameter estimation of a first-order dynamic model for intervention and transfer function analysis, A new parameterization is proposed to avoid the “overshoot” problem in nonlinear estimation in a frequently used parameterization (Box and Tiao, 1975).     

Nonparametric models and their estimation

Summary Nonparametric models have become more and more popular over the last two decades. One reason for their popularity is software availability, which easily allows to fit smooth but otherwise unspecified functions to data. A benefit of the models is that the functional shape of a regression function is not prespecified in advance, but determined by the data. Clearly this allows for more insight which can be interpreted on a substance matter level. This paper gives an overview of available fitting routines, commonly called smoothing procedures. Moreover, a number of extensions to classical scatterplot smoothing are discussed, with examples supporting the advantages of the routines.     

Maximum-likelihood estimation of the random-clumped multinomial model as a prototype problem for large-scale statistical computing

Numerical methods are needed to obtain maximum-likelihood estimates (MLEs) in many problems. Computation time can be an issue for some likelihoods even with modern computing power. We consider one such problem where the assumed model is a random-clumped multinomial distribution. We compute MLEs for this model in parallel using the Toolkit for Advanced Optimization software library. The computations are performed on a distributed-memory cluster with low latency interconnect. We demonstrate that for larger problems, scaling the number of processes improves wall clock time significantly. An illustrative example shows how parallel MLE computation can be useful in a large data analysis. Our experience with a direct numerical approach indicates that more substantial gains may be obtained by making use of the specific structure of the random-clumped model.     

Improved estimation in Lognormal regression models

Lognormal regression model with unknown error variance is considered. We give a class of estimators of the regression coefficients vector improving upon traditional estimator when the number of independent variables is at least three. The relationship between these estimators on one hand and James-Stein type estimators of the normal mean and improved estimators of the normal variance on another hand is discussed.     

Feasible estimation in generalized structured models

This article introduces a feasible estimation method for a large class of semi and nonparametric models. We present the family of generalized structured models which we wish to estimate. After highlighting the main idea of the theoretical smooth backfitting estimators, we introduce a general estimation procedure. We consider modifications and practical issues, and discuss inference, cross validation, and asymptotic theory applying the theoretical framework of Mammen and Nielsen (Biometrika 90: 551–566, 2003). An extensive simulation study shows excellent performance of our method. Furthermore, real data applications from environmetrics and biometrics demonstrate its usefulness.     

Robust estimation in simultaneous equations models

In this paper we review existing work on robust estimation for simultaneous equations models. Then we sketch three strategies for obtaining estimators with a high breakdown point and a controllable efficiency: (a) robustifying three-stage least squares, (b) robustifying the full information maximum likelihood method by minimizing the determinant of a robust covariance matrix of residuals, and (c) generalizing multivariate tau-estimators (Lopuhaä, 1992, Can. J. Statist., 19, 307–321) to these models. They have the same order of computational complexity as high breakdown point multivariate estimators. The latter seems the most promising approach.     

Nonparametric Bayes estimation in repair models

Consider a sequence of dependent random variables _X1,_X2,…,_Xn$X_1,X_2,\dots ,X_n$, where _X1$X_1$ has distribution F (or probability measure P  ), and the distribution of _Xi+1$X_{i+1}$ given _X1,…,_Xi$X_1,\dots ,X_i$ and other covariates and environmental factors depends on F   and the previous data, i=1,…,n-1$i=1,\dots ,n-1$. General repair models give rise to such random variables as the failure times of an item subject to repair. There exist nonparametric non-Bayes methods of estimating F in the literature, for instance, Whitaker and Samaniego [1989. Estimating the reliability of systems subject to imperfect repair. J. Amer. Statist. Assoc. 84, 301–309], Hollander et al. [1992. Nonparametric methods for imperfect repair models. Ann. Statist. 20, 879–896] and Dorado et al. [1997. Nonparametric estimation for a general repair model. Ann. Statist. 25, 1140–1160], etc. Typically these methods apply only to special repair models and also require repair data on N independent items until exactly only one item is left awaiting a “perfect repair”.     

Smoothing spline estimation in varying-coefficient models

Summary.  Smoothing spline estimators are considered for inference in varying-coefficient models with one effect modifying covariate. Bayesian 'confidence intervals' are developed for the coefficient curves and efficient computational methods are derived for computing the curve estimators, fitted values, posterior variances and data-adaptive methods for selecting the levels of smoothing. The efficacy and utility of the methodology proposed are demonstrated through a small simulation study and the analysis of a real data set.     

Robust estimation in growth curve models

The growth curve model introduced by potthoff and Roy 1964 is a general statistical model which includes as special cases regression models and both univariate and multivariate analysis of variance models. The methods currently available for estimating the parameters of this model assume an underlying multivariate normal distribution of errors. In this paper, we discuss tw robst estimators of the growth curve loction and scatter parameters based upon M-estimation techniques and the work done by maronna 1976. The asymptotic distribution of these robust estimators are discussed and a numerical example given.     

Random effects and shrinkage estimation in capture-recapture models

We discuss the analysis of random effects in capture-recapture models, and outline Bayesian and frequentists approaches to their analysis. Under a normal model, random effects estimators derived from Bayesian or frequentist considerations have a common form as shrinkage estimators. We discuss some of the difficulties of analysing random effects using traditional methods, and argue that a Bayesian formulation provides a rigorous framework for dealing with these difficulties. In capture-recapture models, random effects may provide a parsimonious compromise between constant and completely time-dependent models for the parameters (e.g. survival probability). We consider application of random effects to band-recovery models, although the principles apply to more general situations, such as Cormack-Jolly-Seber models. We illustrate these ideas using a commonly analysed band recovery data set.     

Projectors and linear estimation in general linear models

The paper gives a self-contained account of minimum disper­sion linear unbiased estimation of the expectation vector in a linear model with the dispersion matrix belonging to some, rather arbitrary, set of nonnegative definite matrices. The approach to linear estimation in general linear models recommended here is a direct generalization of some ideas and results presented by Rao (1973, 19 74) for the case of a general Gauss-Markov model

A new insight into the nature of some estimation problems originaly arising in the context of a general Gauss-Markov model as well as the correspondence of results known in the literature to those obtained in the present paper for general linear models are also given. As preliminary results the theory of projectors defined by Rao (1973) is extended.