Robust estimation of dropout models using hierarchical likelihood

It is very well known that analyses for missing data depend on untestable assumptions. As a consequence, in such settings, sensitivity analyses are often sensible. One such class of analyses assesses the dependence of conclusions on an explicit missing value mechanism. Inevitably, there is an association between such dependence and the actual (but unknown) distribution of the missing data. In a particular parametric framework for dropout in this paper, an approach is presented that reduces (but never removes) the impact of incorrect assumptions on the form of the association. It is shown how these models can be formulated and fitted relatively simply using hierarchical likelihood. These are applied directly to an example involving mastitis in dairy cattle, and an extensive simulation study is described to show the properties of the methods.     

Modified profile likelihood estimation for the Weibull regression models in survival analysis

In this study, adjustment of profile likelihood function of parameter of interest in presence of many nuisance parameters is investigated for survival regression models. Our objective is to extend the Barndorff–Nielsen’s technique to Weibull regression models for estimation of shape parameter in presence of many nuisance and regression parameters. We conducted Monte-Carlo simulation studies and a real data analysis, all of which demonstrate and suggest that the modified profile likelihood estimators outperform the profile likelihood estimators in terms of three comparison criterion: mean squared errors, bias and standard errors.     

On the uniqueness of the maximum likelihood estimator in truncated regression models

In this short note it is demonstrated that although the log-likelihood function for the truncated normal regression model may not be globally concave, it will possess a unique maximum if one exists. This is because the hessian matrix is negative semi-definite when evaluated at any possible solution to the likelihood equations. Since this rules out any saddle points or local minima, more than two local maxima occuring is impossible.     

Non parametric hazard estimation with dependent censoring using penalized likelihood and an assumed copula

This article introduces a novel non parametric penalized likelihood hazard estimation when the censoring time is dependent on the failure time for each subject under observation. More specifically, we model this dependence using a copula, and the method of maximum penalized likelihood (MPL) is adopted to estimate the hazard function. We do not consider covariates in this article. The non negatively constrained MPL hazard estimation is obtained using a multiplicative iterative algorithm. The consistency results and the asymptotic properties of the proposed hazard estimator are derived. The simulation studies show that our MPL estimator under dependent censoring with an assumed copula model provides a better accuracy than the MPL estimator under independent censoring if the sign of dependence is correctly specified in the copula function. The proposed method is applied to a real dataset, with a sensitivity analysis performed over various values of correlation between failure and censoring times.     

On the distribution of the likelihood ratio test of equality of normal populations

It has recently been shown by Perlman (1980) that when testing the equality of several normal distributions it is the likelihood ratio test which is unbiased rather than a test based on a modified statistic in common use. This paper gives expansions for the null distribution of the likelihood ratio statistic as well as for the nonnull distribution in a special case.     

A new extension of the FGM copula for negative association

In this paper we introduced a single parameter, absolutely continuous and radially symmetric bivariate extension of the Farlie-Gumbel-Morgenstern (FGM) family of copulas. Specifically, this extension measures the higher negative dependencies than most FGM extensions available in literature. Closed-form formulas for distribution, quantile, density, conditional distribution, regression, Spearman's rho, Kendall's tau, and Gini's gamma are obtained. In addition, a formula for random variate generations is presented in closed-form to facilitate simulation studies. We conduct both paired and multiple comparisons with Frank, Gaussian, and Plackett copulas to investigate the performance based on Vuong's test. Furthermore, the new copula is compared with Frank, Gaussian, and Plackett copulas using both Kolmogorov-Smirnov and Cramér-von Mises type test statistics. Finally, a bivariate dataset is analyzed to compare and illustrate the flexibility of the new copula for negative dependence.     

Maximum simulated likelihood estimation of the panel sample selection model

Heckman's (1976 Heckman, J. J. (1976). The common structure of statistical models of truncation, sample selection and limited dependent variables and a simple estimator for such models. Annals of Economic and Social Measurement 15:475–492. [Google Scholar], 1979 Heckman, J. J. (1979). Sample selection bias as a specification error. Econometrica 47(1):153–161.[Crossref], [Web of Science ®] , [Google Scholar]) sample selection model has been employed in many studies of linear and nonlinear regression applications. It is well known that ignoring the sample selectivity may result in inconsistency of the estimator due to the correlation between the statistical errors in the selection and main equations. In this article, we reconsider the maximum likelihood estimator for the panel sample selection model in Keane et al. (1988 Keane, M., Moffitt, R., Runkle, D. (1988). Real wages over the business cycle: Estimating the impact of heterogeneity with micro data. Journal of Political Economy 96:1232–1266.[Crossref], [Web of Science ®] , [Google Scholar]). Since the panel data model contains individual effects, such as fixed or random effects, the likelihood function is more complicated than that of the classical Heckman model. As an alternative to the existing derivation of the likelihood function in the literature, we show that the conditional distribution of the main equation follows a closed skew-normal (CSN) distribution, of which the linear transformation is still a CSN. Although the evaluation of the likelihood function involves high-dimensional integration, we show that the integration can be further simplified into a one-dimensional problem and can be evaluated by the simulated likelihood method. Moreover, we also conduct a Monte Carlo experiment to investigate the finite sample performance of the proposed estimator and find that our estimator provides reliable and quite satisfactory results.     

On the use of the selection matrix in the maximum likelihood estimation of normal distribution models with missing data

In this article, by using the constant and random selection matrices, several properties of the maximum likelihood (ML) estimates and the ML estimator of a normal distribution with missing data are derived. The constant selection matrix allows us to obtain an explicit form of the ML estimates and the exact relationship between the EM algorithm and the score function. The random selection matrix allows us to clarify how the missing-data mechanism works in the proof of the consistency of the ML estimator, to derive the asymptotic properties of the sequence by the EM algorithm, and to derive the information matrix.     

Maximum likelihood estimation of linear continuous time long memory processes with discrete time data

Summary.  We develop a new class of time continuous autoregressive fractionally integrated moving average (CARFIMA) models which are useful for modelling regularly spaced and irregu-larly spaced discrete time long memory data. We derive the autocovariance function of a stationary CARFIMA model and study maximum likelihood estimation of a regression model with CARFIMA errors, based on discrete time data and via the innovations algorithm. It is shown that the maximum likelihood estimator is asymptotically normal, and its finite sample properties are studied through simulation. The efficacy of the approach proposed is demonstrated with a data set from an environmental study.     

Extreme value index estimator using maximum likelihood and moment estimation

ABSTRACT

When a distribution function is in the max domain of attraction of an extreme value distribution, its tail can be well approximated by a generalized Pareto distribution. Based on this fact we use a moment estimation idea to propose an adapted maximum likelihood estimator for the extreme value index, which can be understood as a combination of the maximum likelihood estimation and moment estimation. Under certain regularity conditions, we derive the asymptotic normality of the new estimator and investigate its finite sample behavior by comparing with several classical or competitive estimators. A simulation study shows that the new estimator is competitive with other estimators in view of average bias, average MSE, and coefficient of variance of the new device for the optimal selection of the threshold.     

Empirical bayes estimation of the mean in a multivariate normal distribution

We consider the problem of estimating the mean vector of a multivariate normal distribution under a variety of assumed structures among the parameters of the sampling and prior distributions. We adopt a pragmatic approach. We adopt distributional familites, assess hyperparmeters, and adopt patterned mean and coveariance structures when it is relatively simple to do so; alternatively, we use the sample data to estimate hyperparameters of prior distributions when assessment is a formidable task; such as the task of assessing parameters of multidimensional problems. James-Stein-like estimators are found to result. In some cases, we've been abl to show that the estimators proposed uniformly dominate the MLE's when measured with respect to quadratic loss functions.     

Nonparametric estimation of regression models with mixed discrete and continuous covariates by the K-nn method

In this article we consider the problem of estimating a nonparametric conditional mean function with mixed discrete and continuous covariates by the nonparametric k-nearest-neighbor (k-nn) method. We derive the asymptotic normality result of the proposed estimator and use Monte Carlo simulations to demonstrate its finite sample performance. We also provide an illustrative empirical example of our method.     

Modern likelihood inference for the maximum/minimum of a bivariate normal vector

ABSTRACT

We consider the use of modern likelihood asymptotics in the construction of confidence intervals for the parameter which determines the skewness of the distribution of the maximum/minimum of an exchangeable bivariate normal random vector. Simulation studies were conducted to investigate the accuracy of the proposed methods and to compare them to available alternatives. Accuracy is evaluated in terms of both coverage probability and expected length of the interval. We furthermore illustrate the suitability of our proposals by means of two data sets, consisting of, respectively, measurements taken on the brains of 10 mono-zygotic twins and measurements of mineral content of bones in the dominant and non-dominant arms for 25 elderly women.     

On the small sample properties of norm-restricted maximum likelihood estimators for logistic regression models

This paper develops alternatives to maximum likelihood estimators (MLE) for logistic regression models and compares the mean squared error (MSE) of the estimators. The MLE for the vector of underlying success probabilities has low MSE only when the true probabilities are extreme (i.e., near 0 or 1). Extreme probabilities correspond to logistic regression parameter vectors which are large in norm. A competing “restricted” MLE and an empirical version of it are suggested as estimators with better performance than the MLE for central probabilities. An approximate EM-algorithm for estimating the restriction is described. As in the case of normal theory ridge estimators, the proposed estimators are shown to be formally derivable by Bayes and empirical Bayes arguments. The small sample operating characteristics of the proposed estimators are compared to the MLE via a simulation study; both the estimation of individual probabilities and of logistic parameters are considered.     

Reparameterization strategies for hidden Markov models and Bayesian approaches to maximum likelihood estimation

This paper synthesizes a global approach to both Bayesian and likelihood treatments of the estimation of the parameters of a hidden Markov model in the cases of normal and Poisson distributions. The first step of this global method is to construct a non-informative prior based on a reparameterization of the model; this prior is to be considered as a penalizing and bounding factor from a likelihood point of view. The second step takes advantage of the special structure of the posterior distribution to build up a simple Gibbs algorithm. The maximum likelihood estimator is then obtained by an iterative procedure replicating the original sample until the corresponding Bayes posterior expectation stabilizes on a local maximum of the original likelihood function.     

An alternative algorithm of the empirical likelihood estimation for the parameter of a linear regression model

ABSTRACT

Empirical likelihood (EL) is a nonparametric method based on observations. EL method is defined as a constrained optimization problem. The solution of this constrained optimization problem is carried on using duality approach. In this study, we propose an alternative algorithm to solve this constrained optimization problem. The new algorithm is based on a newton-type algorithm for Lagrange multipliers for the constrained optimization problem. We provide a simulation study and a real data example to compare the performance of the proposed algorithm with the classical algorithm. Simulation and the real data results show that the performance of the proposed algorithm is comparable with the performance of the existing algorithm in terms of efficiencies and cpu-times.     

Maximum likelihood estimation for arma models in the presence of ARMA errors

An ARMA(p, q) process observed with an ARMA(c, d) error has an ARMA (p + c, k) representation with k = max(c + q, p + d) whose parameters satisfy some nonlinear constraints. Identification of the model is discussed. We develop Newton-Raphson estimators for the ARMA(p + c, k) process which take advantage of the information contained in the nonlinear restrictions. Explicit expressions for the derivatives of the restrictions are derived.