Closed-Form Estimators for the Gamma Distribution Derived From Likelihood Equations

It is well-known that maximum likelihood (ML) estimators of the two parameters in a gamma distribution do not have closed forms. This poses difficulties in some applications such as real-time signal processing using low-grade processors. The gamma distribution is a special case of a generalized gamma distribution. Surprisingly, two out of the three likelihood equations of the generalized gamma distribution can be used as estimating equations for the gamma distribution, based on which simple closed-form estimators for the two gamma parameters are available. Intuitively, performance of the new estimators based on likelihood equations should be close to the ML estimators. The study consolidates this conjecture by establishing the asymptotic behaviors of the new estimators. In addition, the closed-forms enable bias-corrections to these estimators. The bias-correction significantly improves the small-sample performance.     

Maximum likelihood estimation for the generalized poisson distribution

The generalized Poisson distribution;containing two

parameters and studied by many researchers; describes the distribution of busy periods under a queueing system and has very interesting properties; The probabilities for successive classes depend upon the previous occurrences; The problem of admissible maximum likelihood estimators for for the parameters Is discussed and a necessary and sufficient condition is derived for which unique admissible maximum likelihood estimators exist; The first; order terms in the biases; variances and the covariance of these maximum likelihood estimators are obtained.     

Discriminant analysis of survey data

We consider the problem of the effect of sample designs on discriminant analysis. The selection of the learning sample is assumed to depend on the population values of auxiliary variables. Under a superpopulation model with a multivariate normal distribution, unbiasedness and consistency are examined for the conventional estimators (derived under the assumptions of simple random sampling), maximum likelihood estimators, probability-weighted estimators and conditionally unbiased estimators of parameters. Four corresponding sampled linear discriminant functions are examined. The rates of misclassification of these four discriminant functions and the effect of sample design on these four rates of misclassification are discussed. The performances of these four discriminant functions are assessed in a simulation study.     

Conditional Likelihood Estimators for Hidden Markov Models and Stochastic Volatility Models

ABSTRACT.  This paper develops a new contrast process for parametric inference of general hidden Markov models, when the hidden chain has a non-compact state space. This contrast is based on the conditional likelihood approach, often used for ARCH-type models. We prove the strong consistency of the conditional likelihood estimators under appropriate conditions. The method is applied to the Kalman filter (for which this contrast and the exact likelihood lead to asymptotically equivalent estimators) and to the discretely observed stochastic volatility models.     

Parameter estimation for a new distribution for the strength of brittle fibers: a simulation study

Parameter estimates of a new distribution for the strength of brittle fibers and composite materials are considered. An algorithm for generating random numbers from the distribution is suggested. Two parameter estimation methods, one based on a simple least squares procedure and the other based on the maximum likelihood principle, are studied using Monte Carlo simulation. In most cases, the maximum likelihood estimators were found to have somewhat smaller root mean squared error and bias than the least squares estimators. However, the least squares estimates are generally good and provide useful initial values for the numerical iteration used to find the maximum likelihood estimates.     

Estimating the minimum and maximum location parameters for two ig-exponential scale mixtures

Suppose that we have two components, each having a two-parameter exponential distribution. Suppose further that these components are conditionally independent, sharing a common random hazard rate and possessing unequal, fixed, unknown location parameters. We develop estimators for the minimum and maximum of these location parameters when the random hazard rate has an inverse Gaussian distribution. Performance comparisons are made among the proposed estimators. Maximum likelihood estimators are shown to be inadmissible.     

Estimation of p(y<x) in the burr case: a comparative study

This paper provides a simulation study which compares three estimators for R = P(Y<X) when Y and X are two independent but not identically distributed Burr random variables. These estimators are the minimum variance unbiased, the maximum likelihood and Bayes estimators. Moreover, the sensitivity of Bayes estimator to the prior parameters is considered.     

Interval estimation of the largest reliability of k weibull populations

A procedure is given for obtaining a random width confidence interval for the largest reliability of k Weibull populations. The procedure does not identify the populations for which the reliability would be a maximum. The maximum likelihood estimators or the simplified linear estimators of the reliability based on type II censored data are used. The cases considered include unknown shape parameters being equal or unequal. Simultaneous confidence intervals for the k reliabilities are also obtained. Tables for the lower and upper limits in selected cases are constructed using Monte Carlo methods.     

Estimation for Location-Scale Models with Censored Data

This article considers a class of estimators for the location and scale parameters in the location-scale model based on ‘synthetic data’ when the observations are randomly censored on the right. The asymptotic normality of the estimators is established using counting process and martingale techniques when the censoring distribution is known and unknown, respectively. In the case when the censoring distribution is known, we show that the asymptotic variances of this class of estimators depend on the data transformation and have a lower bound which is not achievable by this class of estimators. However, in the case that the censoring distribution is unknown and estimated by the Kaplan–Meier estimator, this class of estimators has the same asymptotic variance and attains the lower bound for variance for the case of known censoring distribution. This is different from censored regression analysis, where asymptotic variances depend on the data transformation. Our method has three valuable advantages over the method of maximum likelihood estimation. First, our estimators are available in a closed form and do not require an iterative algorithm. Second, simulation studies show that our estimators being moment-based are comparable to maximum likelihood estimators and outperform them when sample size is small and censoring rate is high. Third, our estimators are more robust to model misspecification than maximum likelihood estimators. Therefore, our method can serve as a competitive alternative to the method of maximum likelihood in estimation for location-scale models with censored data. A numerical example is presented to illustrate the proposed method.     

Estimation in the presence of incidental parameters

This paper considers the estimation of “structural” parameters when the number of unknown parameters increases with the sample size. Neyman and Scott (1948) had demonstrated that maximum likelihood estimators (MLE) of structural parameters may be inconsistent in this case. Patefield (1977) further observed that the asymptotic covariance matrix of the MLE is not equal to the inverse of the information matrix. In this paper we establish asymptotic properties of estimators (which include in particular the MLE) obtained via the usual likelihood approach when the incidental parameters are first replaced by their estimates (which are allowed to depend on the structural parameters). Conditions for consistency and asymptotic normality together with a proper formula for the asymptotic covariance matrix are given. The results are illustrated and applied to the problem of estimating linear functional relationships, and mild conditions on the incidental parameters for the MLE (or an adjusted MLE) to be consistent and asymptotically normal are obtained. These conditions are weaker than those imposed by previous authors.     

SURVIVAL ANALYSIS WITH TIME DEPENDENT FRAILTY USING A LONGITUDINAL MODEL

A method of estimation for generalised mixed models is applied to the estimation of regression parameters in a proportional hazards model with time dependent frailty. A parameter representing change over time is introduced and is modelled in turn into a fixed effect, a normally distributed random effect and a longitudinal effect in which the random component relates to the patient characteristics. Both maximum likelihood and residual maximum likelihood estimators are given.     

Estimating the negative binomial dispersion parameter with highly stratified surveys

We investigate several estimators of the negative binomial (NB) dispersion parameter for highly stratified count data for which the statistical model has a separate mean parameter for each stratum. If the number of samples per stratum is small then the model is highly parameterized and the maximum likelihood estimator (MLE) of the NB dispersion parameter can be biased and inefficient. Some of the estimators we investigate include adjustments for the number of mean parameters to reduce bias. We extend other estimators that were developed for the iid case, to reduce bias when there are many mean parameters. We demonstrate using simulations that an adjusted double extended quasi-likelihood estimator we proposed gives much improved estimates compared to the MLE. Adjusted extended quasi-likelihood and adjusted maximum likelihood estimators also give much-improved results. We illustrate the various estimators with stratified random bottom trawl survey data for cod (Gadus morhua) off the south coast of Newfoundland, Canada.     

A new geometric first-order integer-valued autoregressive (NGINAR(1)) process

A new stationary first-order integer-valued autoregressive process with geometric marginal distributions is introduced based on negative binomial thinning. Some properties of the process are established. Estimators of the parameters of the process are obtained using the methods of conditional least squares, Yule–Walker and maximum likelihood. Also, the asymptotic properties of the estimators are derived involving their distributions. Some numerical results of the estimators are presented with a discussion to the obtained results. Real data are used and a possible application is discussed.     

Estimation in the singly truncated weibull distribution with an unknown truncation point

When truncation points are unknown, they must be treated as additional parameters to be estimated from the sample data. In this article, estimators are derived for the truncation parameter in addition to basic parameters of both 1eft and riqht sing1y truncated Weibull distributions, Maximum likelihood estimators and estimators involving expected values of appropriate order statistics are derived, Asymptotic sampling errors of estimates are also given, Ill ustrative examples are inc1uded.     

Record-breaking data: a parametric comparison of the inverse-sampling and the random-sampling schemes

In many industrial quality control experiments and destructive stress testing, the only available data are successive minima (or maxima)i.e., record-breaking data. There are two sampling schemes used to collect record-breaking data: random sampling and inverse sampling. For random sampling, the total sample size is predetermined and the number of records is a random variable while in inverse-sampling the number of records to be observed is predetermined; thus the sample size is a random variable. The purpose of this papper is to determinevia simulations, which of the two schemes, if any, is more efficient. Since the two schemes are equivalent asymptotically, the simulations were carried out for small to moderate sized record-breaking samples. Simulated biases and mean square errors of the maximum likelihood estimators of the parameters using the two sampling schemes were compared. In general, it was found that if the estimators were well behaved, then there was no significant difference between the mean square errors of the estimates for the two schemes. However, for certain distributions described by both a shape and a scale parameter, random sampling led to estimators that were inconsistent. On the other hand, the estimated obtained from inverse sampling were always consistent. Moreover, for moderated sized record-breaking samples, the total sample size that needs to be observed is smaller for inverse sampling than for random sampling.     

Heteroscedastic and heavy-tailed regression with mixtures of skew Laplace normal distributions

Joint modelling skewness and heterogeneity is challenging in data analysis, particularly in regression analysis which allows a random probability distribution to change flexibly with covariates. This paper, based on a skew Laplace normal (SLN) mixture of location, scale, and skewness, introduces a new regression model which provides a flexible modelling of location, scale and skewness parameters simultaneously. The maximum likelihood (ML) estimators of all parameters of the proposed model via the expectation-maximization (EM) algorithm as well as their asymptotic properties are derived. Numerical analyses via a simulation study and a real data example are used to illustrate the performance of the proposed model.     

An asymptotic equivalence of the cross-data and predictive estimators

Abstract

Estimators using multiplicative tuning parameters for maximum likelihood estimators in cross-validation are called cross-data estimators in this paper. Single-sample versions of the cross-data estimators have been called predictive estimators in literatures, which are given by maximizing the expected log-likelihood, where the two-fold expectations are taken over the distributions of future and current data using maximum likelihood estimators based on current data. An asymptotic equivalence of the cross-data and predictive estimators is shown, which guarantees an optimality of the predictive estimator when an unknown population parameter vector is replaced by the sample counterpart. Examples using typical statistical distributions are shown.     

Estimation of the Mean and Standard Deviation of the Logistic Distribution Based on Multiply Type-II Censored Samples

In this paper, we discuss the problem of estimating the mean and standard deviation of a logistic population based on multiply Type-II censored samples. First, we discuss the best linear unbiased estimation and the maximum likelihood estimation methods. Next, by appropriately approximating the likelihood equations we derive approximate maximum likelihood estimators for the two parameters and show that these estimators are quite useful as they do not need the construction of any special tables (as required for the best linear unbiased estimators) and are explicit estimators (unlike the maximum likelihood estimators which need to be determined by numerical methods). We show that these estimators are also quite efficient, and derive the asymptotic variances and covariance of the estimators. Finally, we present an example to illustrate the methods of estimation discussed in this paper.     

Estimation with the generalized exponential distribution based on record values and inter-record times

The maximum likelihood and Bayesian approaches have been considered for the two-parameter generalized exponential distribution based on record values with the number of trials following the record values (inter-record times). The maximum likelihood estimates are obtained under the inverse sampling and the random sampling schemes. It is shown that the maximum likelihood estimator of the shape parameter converges in mean square to the true value when the scale parameter is known. The Bayes estimates of the parameters have been developed by using Lindley's approximation and the Markov Chain Monte Carlo methods due to the lack of explicit forms under the squared error and the linear-exponential loss functions. The confidence intervals for the parameters are constructed based on asymptotic and Bayesian methods. The Bayes and the maximum likelihood estimators are compared in terms of the estimated risk by the Monte Carlo simulations. The comparison of the estimators based on the record values and the record values with their corresponding inter-record times are performed by using Monte Carlo simulations.     

Generalised quasi‐likelihood inference in a semi‐parametric binary dynamic mixed logit model

There exists a recent study where dynamic mixed‐effects regression models for count data have been extended to a semi‐parametric context. However, when one deals with other discrete data such as binary responses, the results based on count data models are not directly applicable. In this paper, we therefore begin with existing binary dynamic mixed models and generalise them to the semi‐parametric context. For inference, we use a new semi‐parametric conditional quasi‐likelihood (SCQL) approach for the estimation of the non‐parametric function involved in the semi‐parametric model, and a semi‐parametric generalised quasi‐likelihood (SGQL) approach for the estimation of the main regression, dynamic dependence and random effects variance parameters. A semi‐parametric maximum likelihood (SML) approach is also used as a comparison to the SGQL approach. The properties of the estimators are examined both asymptotically and empirically. More specifically, the consistency of the estimators is established and finite sample performances of the estimators are examined through an intensive simulation study.