Estimation of the parameters in a truncated normal distribution

This paper deals with the estimation of the parameters of doubly truncated and singly truncated normal distributions when truncation points are known. We derive, for these families, a necessary and sufficient condition for the maximum likelihood estimator(MLE) to be finite. Furthermore, the probability of the MLE being infinite is positive. A simulation study for single truncation is carried out to compare the modified maximum likelihood estimator, and the mixed estimator.     

Estimation of the parameters of a truncated gamma distribution

This paper deals with the estimation of the parameters of a truncated gamma distribution over (0,τ), where τ is assumed to be a real number. We obtain a necessary and sufficient condition for the existence of the maximum likelihood estimator(MLE). The probability of nonexistence of MLE is observed to be positive. A simulation study indicates that the modified maximum likelihood estimator and the mixed estimator, which exist with probability one,are to be preferred over MLE. The bias, the mean square error, and the probability of nearness form a basis of our simulation study.     

A package of four edited books on structural equations modeling

We consider two analytical and a bootstrap bias correction scheme existing in the literature for maximum likelihood estimators (MLEs) in the special case of a particular biparametric exponential family, the estimators being obtained from i.i.d. samples. We assess the performances of the estimators through numerical simulations for three particular cases of the family explored here. We observe that the two analytical proposals display very similar behavior for these distributions and that all proposed estimators are effective in reducing bias and mean square error of the MLEs.     

Level-specific correction for nonparametric likelihoods

The popular empirical likelihood method not only has a convenient chi-square limiting distribution but is also Bartlett correctable, leading to a high-order coverage precision of the resulting confidence regions. Meanwhile, it is one of many nonparametric likelihoods in the Cressie–Read power divergence family. The other likelihoods share many attractive properties but are not Bartlett correctable. In this paper, we develop a new technique to achieve the effect of being Bartlett correctable. Our technique is generally applicable to pivotal quantities with chi-square limiting distributions. Numerical experiments and an example reveal that the method is successful for several important nonparametric likelihoods.     

Penalized likelihood regression: General formulation and efficient approximation

The authors consider a formulation of penalized likelihood regression that is sufficiently general to cover canonical and noncanonical links for exponential families as well as accelerated life models with censored survival data. They present an asymptotic analysis of convergence rates to justify a simple approach to the lower‐dimensional approximation of the estimates. Such an approximation allows for much faster numerical calculation, paving the way to the development of algorithms that scale well with large data sets.     

Multivariate outbreak detection

Online monitoring is needed to detect outbreaks of diseases such as influenza. Surveillance is also needed for other kinds of outbreaks, in the sense of an increasing expected value after a constant period. Information on spatial location or other variables might be available and may be utilized. We adapted a robust method for outbreak detection to a multivariate case. The relation between the times of the onsets of the outbreaks at different locations (or some other variable) was used to determine the sufficient statistic for surveillance. The derived maximum-likelihood estimator of the outbreak regression was semi-parametric in the sense that the baseline and the slope were non-parametric while the distribution belonged to the one-parameter exponential family. The estimator was used in a generalized-likelihood ratio surveillance method. The method was evaluated with respect to robustness and efficiency in a simulation study and applied to spatial data for detection of influenza outbreaks in Sweden.     

An L 2 Comparison Between the Bootstrap and the Empirical Edgeworth Expansion

The Bootstrap estimate for studentized statistics is more accurate than both the normal approximation and the two-term empirical Edgeworth expansion. In this article, it will be shown that the three-term empirical Edgeworth expansion for studentized statistics compares well with the bootstrap. It is also shown that the three-term Edgeworth expansion is superior to the bootstrap in some cases, using more efficient estimators than sample moments in the Edgeworth expansion, such as using maximum likelihood estimators in the one-parameter exponential family.     

The power piecewise exponential model

In this paper an extension of the piecewise exponential distribution based on the distribution of the maximum of a random sample is considered. Properties of its density and hazard function are investigated. Maximum likelihood inference is discussed and the Fisher information matrix is identified. Results of two real data applications are reported, where model fitting is implemented by using maximum likelihood. The applications illustrate the better performance of the new distribution when compared with other recently proposed alternative models.     

The Effects of Rounding on Likelihood Procedures

The aim of this paper is to investigate the robustness properties of likelihood inference with respect to rounding effects. Attention is focused on exponential families and on inference about a scalar parameter of interest, also in the presence of nuisance parameters. A summary value of the influence function of a given statistic, the local-shift sensitivity, is considered. It accounts for small fluctuations in the observations. The main result is that the local-shift sensitivity is bounded for the usual likelihood-based statistics, i.e. the directed likelihood, the Wald and score statistics. It is also bounded for the modified directed likelihood, which is a higher-order adjustment of the directed likelihood. The practical implication is that likelihood inference is expected to be robust with respect to rounding effects. Theoretical analysis is supplemented and confirmed by a number of Monte Carlo studies, performed to assess the coverage probabilities of confidence intervals based on likelihood procedures when data are rounded. In addition, simulations indicate that the directed likelihood is less sensitive to rounding effects than the Wald and score statistics. This provides another criterion for choosing among first-order equivalent likelihood procedures. The modified directed likelihood shows the same robustness as the directed likelihood, so that its gain in inferential accuracy does not come at the price of an increase in instability with respect to rounding.     

Semi‐parametric small‐area estimation by combining time‐series and cross‐sectional data methods

In survey sampling, policymaking regarding the allocation of resources to subgroups (called small areas) or the determination of subgroups with specific properties in a population should be based on reliable estimates. Information, however, is often collected at a different scale than that of these subgroups; hence, the estimation can only be obtained on finer scale data. Parametric mixed models are commonly used in small‐area estimation. The relationship between predictors and response, however, may not be linear in some real situations. Recently, small‐area estimation using a generalised linear mixed model (GLMM) with a penalised spline (P‐spline) regression model, for the fixed part of the model, has been proposed to analyse cross‐sectional responses, both normal and non‐normal. However, there are many situations in which the responses in small areas are serially dependent over time. Such a situation is exemplified by a data set on the annual number of visits to physicians by patients seeking treatment for asthma, in different areas of Manitoba, Canada. In cases where covariates that can possibly predict physician visits by asthma patients (e.g. age and genetic and environmental factors) may not have a linear relationship with the response, new models for analysing such data sets are required. In the current work, using both time‐series and cross‐sectional data methods, we propose P‐spline regression models for small‐area estimation under GLMMs. Our proposed model covers both normal and non‐normal responses. In particular, the empirical best predictors of small‐area parameters and their corresponding prediction intervals are studied with the maximum likelihood estimation approach being used to estimate the model parameters. The performance of the proposed approach is evaluated using some simulations and also by analysing two real data sets (precipitation and asthma).     

Coordinate-free analysis of trends in British social mobility

This paper is intended to make a contribution to the ongoing debate about declining social mobility in Great Britain by analyzing mobility tables based on data from the 1991 British Household Panel Survey and the 2005 General Household Survey. The models proposed here generalize Hauser's levels models and allow for a semi-parametric analysis of change in social mobility. The cell frequencies are assumed to be equal to the product of three effects: the effect of the father's position for the given year, the effect of the son's position for the given year, and the mobility effect related to the difference between the father's and the son's positions. A generalization of the iterative proportional fitting procedure is proposed and applied to computing the maximum likelihood estimates of the cell frequencies. The standard errors of the estimated parameters are computed under the product-multinomial sampling assumption. The results indicate opposing trends of mobility between the two timepoints. Fewer steps up or down in the society became less likely, while more steps became somewhat more likely.     

Pseudo maximum likelihood estimation of the univariate GARCH (2,2) and asymptotic normality under dependent innovations

In this paper, we first consider the pseudo maximum likelihood estimation of the univariate GARCH (2,2) model and derive the underlying estimator. Then, we make use of the technique of martingales to establish the asymptotic normality of the pseudo-maximum likelihood estimator (PMLE) of the univariate GARCH (2,2) model. Contrary to previous approaches encountered in the statistical literature, the pseudo-likelihood function uses the general form of the density laws of the quadratic exponential family.     

A doubly restricted exponential dispersion model

In this paper, we propose and develop a doubly restricted exponential dispersion model, i.e. a varying dispersion generalized linear model with two sets of restrictions, a set of linear restrictions for the mean response, and at the same time, for another set of linear restrictions for the dispersion of the distribution. This model would be useful to consider several situations where it is necessary to control/analyze drug-doses, active effects in factorial experiments, mean-variance relationships, among other situations. A penalized likelihood function is proposed and developed in order to achieve the restricted parameters and to develop the inferential results. Several special cases from the literature are commented on. A simply restricted varying dispersion beta regression model is exemplified by means of real and simulated data. Satisfactory and promising results are found.     

Prediction Error Estimation Under Bregman Divergence for Non-Parametric Regression and Classification

Abstract.  Prediction error is critical to assess model fit and evaluate model prediction. We propose the cross-validation (CV) and approximated CV methods for estimating prediction error under the Bregman divergence (BD), which embeds nearly all of the commonly used loss functions in the regression, classification procedures and machine learning literature. The approximated CV formulas are analytically derived, which facilitate fast estimation of prediction error under BD. We then study a data-driven optimal bandwidth selector for local-likelihood estimation that minimizes the overall prediction error or equivalently the covariance penalty. It is shown that the covariance penalty and CV methods converge to the same mean-prediction-error-criterion. We also propose a lower-bound scheme for computing the local logistic regression estimates and demonstrate that the algorithm monotonically enhances the target local likelihood and converges. The idea and methods are extended to the generalized varying-coefficient models and additive models.     

Inference in a two-parameter generalized order statistics model

As a submodel of generalized order statistics with two unknown model parameters, m-generalized order statistics may serve as a simple model for ordered quantities in a given application. It is shown that the joint distribution of m-generalized order statistics has a representation as a regular exponential family in the model parameters, as it is the case for the comprising model. Utilizing this finding, a minimal sufficient and complete statistic is obtained along with distributional properties. Joint maximum likelihood estimation of the parameters is considered, and strong consistency and asymptotic efficiency of the estimator are established. A test is provided to decide whether a restriction to the submodel is reasonable.     

Conditional Generalized Liouville Distributions on the Simplex

Liouville and generalized Liouville distributions on the simplex have been proposed for modeling compositional data and have been shown to be free from the extreme independence structure that characterizes the Dirichlet class. In this article, generalized Liouville distributions are shown to be rich enough to distinguish some lesser modes of independence as well. Unfortunately, it is noted that the applicability of the Liouville family will be limited, owing to the lack of invariance with respect to the chosen fill-up value. As an alternative, a new family of simplex distributions is proposed, one that admits invariance with respect to choice of fill-up value, as well as the ability to differentiate among many forms of independence.     

Efficient Likelihood Estimators

If X ₁, …, X _n are identically and independently distributed, then as n ? ∞, there exists under suitable regularity conditions a sequence of solutions of the likelihood equation that is consistent and asymptotically efficient. However, this consistent solution is not necessarily the maximum likelihood estimate. Likelihood estimation should therefore emphasize the determination of a consistent sequence of solutions of the likelihood equations rather than maximizing the likelihood. The issues are illustrated on some examples.     

Likelihood

This article reviews some recent work on large-sample likelihood inference, in particular work related to conditional inference and ancillary statistics. The background discussion includes a relation between conditional inference and testing for model fit. There are brief comments on results for sequential estimation, also on the difficulties associated with multiparameter problems.     

On Unbiased Estimation of Positive Integral Powers of the Natural Parameter in Exponential Families

We explore the structure of one‐parameter exponential families admitting an unbiased estimator for a positive integral power of the natural parameter. It is seen that only exponential families dominated by Lebesgue measure can have this property. It is outlined that similar results can be obtained for other functions of the natural parameter.     

Transmuted generalized exponential distribution: A generalization of the exponential distribution with applications to survival data

In this article, we investigate the potential usefulness of the three-parameter transmuted generalized exponential distribution for analyzing lifetime data. We compare it with various generalizations of the two-parameter exponential distribution using maximum likelihood estimation. Some mathematical properties of the new extended model including expressions for the quantile and moments are investigated. We propose a location-scale regression model, based on the log-transmuted generalized exponential distribution. Two applications with real data are given to illustrate the proposed family of lifetime distributions.