The exact solution to the mle of a decreasing density based on arbitrarily right censored data

Nonparametric maximum likelihood estimation of decreasing and unimodal density functions, based on observations subject to arbitrary right censorship, was considered by McNichols and Padgett(1982). In order to compute their estimators, however, nonlinear equations with linear constraints had to be maximized using numerical techniques. The exact solution to this problem can now be found. An example illustrates the simplicity of the method.     

Moving truncations barrier-function methos for estimation in three-parameter lognormal models

A method of centres algorithm for maximum likelihood estimation in the three-parameter lognormal model is presented and discussed, The algorithm is a member of the class of moving truncations algorithms for solving nonlinear programming problems and is able to move the numerical search out of the region of the infinite maximum of the conditional likelihood function, thereby permitting convergence to an interior relative maximum of this function. The algorithm also includes an optimality test to locate the primary relative maximum of the likelihood function.     

AN EXTENSION OF THE EM ALGORITHM FOR OPTIMIZATION OF CONSTRAINED LIKELIHOOD: AN APPLICATION IN TOXICOLOGY

Since its introduction in the mid 1970's, the EM algorithm has found a widespread popularity for solving the likelihood equations. Several investigators have used the algorithm in a variety of problems with incomplete information to obtain maximum likelihood estimates in numerous applications. The algorithm, however, becomes inappropriate when the underlying equations are subject to some constraints. Although an extension has been proposed to derive solutions when the parameters are subject to a set of linear constraints, the evaluation of likelihood equations from incomplete data when the equations are subject to a nonlinear constraint is still an open problem. Here, we consider a mixture model, a classical example of incomplete data, and discuss the problem of maximum likelihood estimation of the model parameters when the parameters have to satisfy a nonlinear constraint. An extension of the EM algorithm based on the celebrated Lagrange multiplier will be proposed to solve the equations. An application of the methodology in animal bioassay experiments for risk assessment of toxic substances will be described and data from a toxicological experiment will be used to illustrate the results.     

Covariate Decomposition Methods for Longitudinal Missing‐at‐Random Data and Predictors Associated with Subject‐Specific Effects

Investigators often gather longitudinal data to assess changes in responses over time within subjects and to relate these changes to within‐subject changes in predictors. Missing data are common in such studies and predictors can be correlated with subject‐specific effects. Maximum likelihood methods for generalized linear mixed models provide consistent estimates when the data are ‘missing at random’ (MAR) but can produce inconsistent estimates in settings where the random effects are correlated with one of the predictors. On the other hand, conditional maximum likelihood methods (and closely related maximum likelihood methods that partition covariates into between‐ and within‐cluster components) provide consistent estimation when random effects are correlated with predictors but can produce inconsistent covariate effect estimates when data are MAR. Using theory, simulation studies, and fits to example data this paper shows that decomposition methods using complete covariate information produce consistent estimates. In some practical cases these methods, that ostensibly require complete covariate information, actually only involve the observed covariates. These results offer an easy‐to‐use approach to simultaneously protect against bias from both cluster‐level confounding and MAR missingness in assessments of change.     

A semiparametric approach for modelling multivariate nonlinear time series

In this article, a semiparametric time‐varying nonlinear vector autoregressive (NVAR) model is proposed to model nonlinear vector time series data. We consider a combination of parametric and nonparametric estimation approaches to estimate the NVAR function for both independent and dependent errors. We use the multivariate Taylor series expansion of the link function up to the second order which has a parametric framework as a representation of the nonlinear vector regression function. After the unknown parameters are estimated by the maximum likelihood estimation procedure, the obtained NVAR function is adjusted by a nonparametric diagonal matrix, where the proposed adjusted matrix is estimated by the nonparametric kernel estimator. The asymptotic consistency properties of the proposed estimators are established. Simulation studies are conducted to evaluate the performance of the proposed semiparametric method. A real data example on short‐run interest rates and long‐run interest rates of United States Treasury securities is analyzed to demonstrate the application of the proposed approach. The Canadian Journal of Statistics 47: 668–687; 2019 © 2019 Statistical Society of Canada     

Abundance estimation with a categorical covariate subject to missing in continuous-time capture-recapture studies

Abstract

In continuous-time capture-recapture experiments, individual heterogeneity has a large effect on the capture probability. To account for the heterogeneity, we consider an individual covariate, which is categorical and subject to missing. In this article, we develop a general model to summarize three kinds of missing mechanisms, and propose a maximum likelihood estimator of the abundance. A likelihood ratio confidence interval of the abundance is also proposed. We illustrate the proposed methods by simulation studies and a real data example of a bird species prinia subflava in Hong Kong.     

Large-sample comparisons of calibration procedures when both measurements are subject to error: the unreplicated case

A predictive functional relationship model is presented for the calibration problem in which the standard as well as the nonstandard measurements are subject to error. For the estimation of the relationship between the two measurements, the ordinary least squares and maximum likelihood estimation methods are considered, while for the prediction of unknown standard measurements we consider direct and inverse approaches. Relative performances of those calibration procedures are compared in terms of the asymptotic mean square error of prediction.     

Unimodality of the pareto distribution likelihood function for multicensored samples and implications for estimation

This paper discusses maximum likelihood parameter estimation in the Pareto distribution for multicensored samples. In particu-

lar, the modality of the associated conditional log-likelihood function is investigated in order to resolve questions concerninc

the existence and uniqurneas of the lnarimum likelihood estimates.For the cases with one parameter known, the maximum likelihood

estimates of the remaining unknown parameters are shown to exist and to be unique. When both parameters are unknown, the maximum likelihood estimates may or may not exist and be unique. That is, their existence and uniqueness would seem to depend solely upon the information inherent in the sample data. In viav of the possible nonexistence and/or non-uniqueness of the maximum likelihood estimates when both parameters are unknown, alternatives to standard iterative numerical methods are explored.     

Maximum penalized likelihood estimation of mixed proportional hazard models

Unobservable individual effects in models of duration will cause estimation bias that include the structural parameters as well as the duration dependence. The maximum penalized likelihood estimator is examined as an estimator for the survivor model with heterogeneity. Proofs of the existence and uniqueness of the maximum penalized likelihood estimator in duration model with general forms of unobserved heterogeneity are provided. Some small sample evidence on the behavior of the maximum penalized likelihood estimator is given. The maximum penalized likelihood estimator is shown to be computationally feasible and to provide reasonable estimates in most cases.     

On MLE of a nonlinear discriminant function from a mixture of two Gompertz distributions based on small sample size

The property of identifiability is an important consideration on estimating the parameters in a mixture of distributions. Also classification of a random variable based on a mixture can be meaning fully discussed only if the class of all finite mixtures is identifiable. The problem of identifiability of finite mixture of Gompertz distributions is studied. A procedure is presented for finding maximum likelihood estimates of the parameters of a mixture of two Gompertz distributions, using classified and unclassified observations. Based on small sample size, estimation of a nonlinear discriminant function is considered. Throughout simulation experiments, the performance of the corresponding estimated nonlinear discriminant function is investigated.     

Nonlinear semiparametric AR(1) model with skew-symmetric innovations

In this paper, we expand a first-order nonlinear autoregressive (AR) model with skew normal innovations. A semiparametric method is proposed to estimate a nonlinear part of model by using the conditional least squares method for parametric estimation and the nonparametric kernel approach for the AR adjustment estimation. Then computational techniques for parameter estimation are carried out by the maximum likelihood (ML) approach using Expectation-Maximization (EM) type optimization and the explicit iterative form for the ML estimators are obtained. Furthermore, in a simulation study and a real application, the accuracy of the proposed methods is verified.     

Parameter estimation in semi-linear models using a maximal invariant likelihood function

In this paper, we consider the problem of estimation of semi-linear regression models. Using invariance arguments, Bhowmik and King [2007. Maximal invariant likelihood based testing of semi-linear models. Statist. Papers 48, 357–383] derived the probability density function of the maximal invariant statistic for the non-linear component of these models. Using this density function as a likelihood function allows us to estimate these models in a two-step process. First the non-linear component parameters are estimated by maximising the maximal invariant likelihood function. Then the non-linear component, with the parameter values replaced by estimates, is treated as a regressor and ordinary least squares is used to estimate the remaining parameters. We report the results of a simulation study conducted to compare the accuracy of this approach with full maximum likelihood and maximum profile-marginal likelihood estimation. We find maximising the maximal invariant likelihood function typically results in less biased and lower variance estimates than those from full maximum likelihood.     

Burr-XII Distribution Parametric Estimation and Estimation of Reliability of Multicomponent Stress-Strength

In this paper, we estimate multicomponent stress-strength reliability by assuming Burr-XII distribution. The research methodology adopted here is to estimate the parameter using maximum likelihood estimation. Reliability is estimated using the maximum likelihood method of estimation and results are compared using the Monte Carlo simulation for small samples. Using real data sets we illustrate the procedure clearly.     

Sequential estimation for nonhomogeneous Ornstein-Uhlenbeck processes

In this paper, we propose a stochastic process, which is a class of nonhomogeneous diffusion process from the perspective of the corresponding nonlinear stochastic differential equation. The parameter included in the drift term are estimated by sequential maximum likelihood methodology on the basis of continuous sampling of the process. The sequential estimators are proved to be closed, unbiased, strongly consistent, normally distributed, and optimal in the mean square sense.     

Penalized Maximum Likelihood Estimator for Normal Mixtures

The estimation of the parameters of a mixture of Gaussian densities is considered, within the framework of maximum likelihood. Due to unboundedness of the likelihood function, the maximum likelihood estimator fails to exist. We adopt a solution to likelihood function degeneracy which consists in penalizing the likelihood function. The resulting penalized likelihood function is then bounded over the parameter space and the existence of the penalized maximum likelihood estimator is granted. As original contribution we provide asymptotic properties, and in particular a consistency proof, for the penalized maximum likelihood estimator. Numerical examples are provided in the finite data case, showing the performances of the penalized estimator compared to the standard one.     

ONE-SIDED ESTIMATING AND TESTING PROBLEMS FOR LOCATION MODELS FROM GROUPED SAMPLES

This article deals with one-sided problems for location models from grouped samples. Suppose the support region of a density function, which does not depend on parameters, is divided into some disjointed intervals, grouped samples are the number of observations falling in each intervals respectively. The studying of grouped samples may be dated back to the beginning of the century, in which only one sample location and/or scale models is considered. This article considers one-sided estimating and testing problems for location models. Some methods for computing the maximum likelihood estimates of the parameters subject to order restrictions are proposed and a numerical example by the method is given.     

Estimation and Testing of Learning Curves

This article describes a new approach to learning curve estimation. Our approach is to formulate statistical procedures that conform to alternative learning curve theories. This leads to the development of nonlinear statistical models of the learning curves. For the three data sets analyzed, autocorrelation seems to be an important problem. Parameter estimates were derived using the maximum likelihood principle in the presence of first-order autocorrelation. Nonnested tests were used to select the appropriate formulation of the learning curve. Research conclusions are to use unit data when estimating a learning curve and to be prepared to treat autocorrelation if present.     

Assessing the bias of maximum likelihood estimates of contaminated garch models

It is well known that Gaussian maximum likelihood estimates of time series models are not robust. In this paper we prove this is also the case for the Generalized Autoregressive Conditional Heteroscedastic (GARCH) models. By expressing the Gaussian maximum likelihood estimates as Ψ estimates and by assuming the existence of a contaminated process, we prove they possess zero breakdown point and unbounded influence curves. By simulating GARCH processes under several proportions of contaminations we assess how much biased the maximum likelihood estimates may become and compare these results to a robust alternative. The t-student maximum likelihood estimates of GARCH models are also considered.     

Pseudo maximum likelihood estimation for the dirichlet-multinomial distribution

Pseudo maximum likelihood estimation (PML) for the Dirich-let-multinomial distribution is proposed and examined in this pa-per. The procedure is compared to that based on moments (MM) for its asymptotic relative efficiency (ARE) relative to the maximum likelihood estimate (ML). It is found that PML, requiring much less computational effort than ML and possessing considerably higher ARE than MM, constitutes a good compromise between ML and MM. PML is also found to have very high ARE when an estimate for the scale parameter in the Dirichlet-multinomial distribution is all that is needed.     

Smooth Plug‐in Inverse Estimators in the Current Status Continuous Mark Model

Abstract. We consider the problem of estimating the joint distribution function of the event time and a continuous mark variable when the event time is subject to interval censoring case 1 and the continuous mark variable is only observed in case the event occurred before the time of inspection. The non‐parametric maximum likelihood estimator in this model is known to be inconsistent. We study two alternative smooth estimators, based on the explicit (inverse) expression of the distribution function of interest in terms of the density of the observable vector. We derive the pointwise asymptotic distribution of both estimators.