The Double Exponential Distribution: Using Calculus to Find a Maximum Likelihood Estimator

Lehmann (1983) discussed several examples of absurd uniform minimum variance unbiased (UMVU) estimators. He argued that these estimators arose because the amount of information available was inadequate for the estimation problem at hand. Here I argue that such absurd UMVU estimators result more from the property of unbiasedness than from inadequate information.     

On the umvu estimators after using a normalizing transformation

The conditional distribution given complete sufficient statistics is used along with the Rao-Blackwell theorem to obtain uniformly minimum variance unbiased (UMVU) estimators after a transformation to normality has been applied to data. The estimators considered are for the mean, the variance and the cumulative distribution of the original non-normal data. Previous procedures to obtain UMVU estimators have used Laplace transforms, Taylor expansions and the jackknife. An integration method developed in this paper requires only integrability of the normalizing transformation function. This method is easy to employ and it is always possible to obtain a numerical result.     

On the failure rate estimation of the inverse gaussian distribution

New estimators of the inverse Gaussian failure rate are proposed based on the maximum likelihood predictive densities derived by Yang (1999). These estimators are compared, via Monte Carlo simulation, with the usual maximum likelihood estimators of the failure rate and found to be superior in terms of bias and mean squared error. Sensitivity of the estimators against the departure from the inverse Gaussian distribution is studied.     

Improved estimation for the parameters of an inverse gaussian distribution

James-Stein estimators are proposed for the #-parameter of an inverse Gaussian #G# distribution. The estimators of this class have smaller expected quadratic loss than the maximum likelihood estimator usually employed when analysing real sets of data. This problem is also studied for the case of an unknown nuisance parameter. Finally, improved estimators are considered for # in the two sample problem.     

Estimation for the three-parameter inverse gaussian distribution

The three-parameter inverse Gaussian distribution is defined and moment estimators and maximum likelihood estimators are obtained. The moment estimators are found in closed form and their asymprotic normality is proven. A sufficient condition is provided for the existence of the maximum likelihood estimators.     

Linear regression through the origin with constant coefficient of variation for the inverse gaussian distribution

A simple linear regression model with no intercept term for the situation where the response variable obeys an inverse Gaussian distribution and the coefficient of variation is an unknown constant is discussed. Maximum likelihood estimators and the confidence limits of the regression parameter are obtained. Finally uniformly minimum variance unbiased estimators of parameters are given.     

A precise estimator for the log-normal mean

The log-normal distribution is frequently encountered in applications. The uniformly minimum variance unbiased (UMVU) estimator for the log-normal mean is given explicitly by a formula found by Finney in 1941. In contrast to this the most commonly used estimator for a log-normal mean is the sample mean. This is possibly due to the complexity of the formula given by Finney. A modified maximum likelihood estimator which approximates the UMVU estimator is derived here. It is sufficiently simple to be implemented in elementary spreadsheet applications. An elementary approximate formula for the root-mean-square error of the suggested estimator and the UMVU estimator is presented. The suggested estimator is compared with the sample mean, the maximum likelihood, and the UMVU estimators by Monte Carlo simulation in terms of root-mean-square error.     

Estimating the minimum and maximum location parameters for two ig-exponential scale mixtures

Suppose that we have two components, each having a two-parameter exponential distribution. Suppose further that these components are conditionally independent, sharing a common random hazard rate and possessing unequal, fixed, unknown location parameters. We develop estimators for the minimum and maximum of these location parameters when the random hazard rate has an inverse Gaussian distribution. Performance comparisons are made among the proposed estimators. Maximum likelihood estimators are shown to be inadmissible.     

Statistical inference in the partial linear models with the inverse gaussian kernel

Symmetric kernel smoothing is commonly used in estimating the nonparametric component in the partial linear regression models. In this article, we propose a new estimation method for the partial linear regression models using the inverse Gaussian kernel when the explanatory variable of the nonparametric component is non-negatively supported. As an asymmetric kernel function, the inverse Gaussian kernel is also supported on the non-negative half line. The asymptotic properties, including the asymptotic normality, uniform almost sure convergence, and the iterated logarithm laws, of the proposed estimators are thoroughly discussed for both homoscedastic and heteroscedastic cases. The simulation study is conducted to evaluate the finite sample performance of the proposed estimators.     

Fisher information and maximum-likelihood estimation of covariance parameters in Gaussian stochastic processes

The inverse of the Fisher information matrix is commonly used as an approximation for the covariance matrix of maximum-likelihood estimators. We show via three examples that for the covariance parameters of Gaussian stochastic processes under infill asymptotics, the covariance matrix of the limiting distribution of their maximum-likelihood estimators equals the limit of the inverse information matrix. This is either proven analytically or justified by simulation. Furthermore, the limiting behaviour of the trace of the inverse information matrix indicates equivalence or orthogonality of the underlying Gaussian measures. Even in the case of singularity, the estimator of the process variance is seen to be unbiased, and also its variability is approximated accurately from the information matrix.     

Bayesian shrinkage estimators for a measure of dispersion of an inverse gaussian distribution

The Bayesian shrinkage estimation for a measure of dispersion with known mean is studied for the inverse Gaussian distribution. An optimum choice of the shrinkage factor and the properties of the proposed Bayesian shrinkage estimators are being studied. It is shown that these estimators have smaller risk than the usual estimator of the reciprocal measure of dispersion.     

On shortest confidence intervals and their relation with uniformly minimum variance unbiased estimators

The aim of this paper is to investigate the possibility of constructing shortest-lenght confidence intervals and give some results and aspects concerning shortest confidence intervals and uniformly minimum variance unbiased (UMVU) estimators.     

Umvu estimators for the population mean and variance based on random effects models for lognormal data

Cross-classified data are often obtained in controlled experimental situations and in epidemiologic studies. As an example of the latter, occupational health studies sometimes require personal exposure measurements on a random sample of workers from one or more job groups, in one or more plant locations, on several different sampling dates. Because the marginal distributions of exposure data from such studies are generally right-skewed and well-approximated as lognormal, researchers in this area often consider the use of ANOVA models after a logarithmic transformation. While it is then of interest to estimate original-scale population parameters (e.g., the overall mean and variance), standard candidates such as maximum likelihood estimators (MLEs) can be unstable and highly biased. Uniformly minimum variance unbiased (UMVU) cstiniators offer a viable alternative, and are adaptable to sampling schemes that are typiral of experimental or epidemiologic studies. In this paper, we provide UMVU estimators for the mean and variance under two random effects ANOVA models for logtransformed data. We illustrate substantial mean squared error gains relative to the MLE when estimating the mean under a one-way classification. We illustrate that the results can readily be extended to encompass a useful class of purely random effects models, provided that the study data are balanced.     

Variances of UMVU Estimators for Means and Variances After Using a Normalizing Transformation

Suppose that the function f is of recursive type and the random variable X is normally distributed with mean μ and variance α². We set C = f(x). Neyman & Scott (1960) and Hoyle (1968) gave the UMVU estimators for the mean E(C) and for the variance Var(C) from independent and identically distributed random variables X₁,…, X_n(n ≧ 2) having a normal distribution with mean μ and variance σ², respectively. Shimizu & Iwase (1981) gave the variance of the UMVU estimator for E(C). In this paper, the variance of the UMVU estimator for Var(C) is given.     

Standard errors for the parameters of graphical Gaussian models

The comparison of an estimated parameter to its standard error, the Wald test, is a well known procedure of classical statistics. Here we discuss its application to graphical Gaussian model selection. First we derive the Fisher information matrix and its inverse about the parameters of any graphical Gaussian model. Both the covariance matrix and its inverse are considered and a comparative analysis of the asymptotic behaviour of their maximum likelihood estimators (m.l.e.s) is carried out. Then we give an example of model selection based on the standard errors. The method is shown to produce almost identical inference to likelihood ratio methods in the example considered.     

Effect of a new selection procedure on adaptive estimation

Adaptive estimation of parameters of some failure time distributionsis considered. A new procedure named the F-procedure has beendeveloped for selecting an appropriate model out of two possible models by Pandey et.al. (1991). Applying this F-procedure adaptive estimatorsof parameters of exponential, Wei bull, inverse Gaussian (IG) and Wald failure time distributions have been proposed in this paper. Comparison of these estimators has been undertaken with MLE's of the respective parameters and with some previous adaptiveestimators by simulation of samples using the Monte Carlo method.Adaptive estimation of parameters of some failure time distributions is considered. A new procedure named the F-procedure has been developedfor selecting an appropriate model out of two possible models by Pandey et.al. (1991). Applying this F-procedure adaptive estimators of parameters of exponential, Wei bull, inverse Gaussian (IG) and Wald failure time distributions have been proposed in this paper. Comparison of these estimators has been undertaken with MLE's of the respective parameters and with some previous adaptive estimators by simulation of samples using the Monte Carlo method.     

Inverse Gaussian Distribution for Modeling Conditional Durations in Finance

The durations between market activities such as trades and quotes provide useful information on the underlying assets while analyzing financial time series. In this article, we propose a stochastic conditional duration model based on the inverse Gaussian distribution. The non-monotonic nature of the failure rate of the inverse Gaussian distribution makes it suitable for modeling the durations in financial time series. The parameters of the proposed model are estimated by an efficient importance sampling method. A simulation experiment is conducted to check the performance of the estimators. These estimates are used to compute estimated hazard functions and to compare with the empirical hazard functions. Finally, a real data analysis is provided to illustrate the practical utility of the models.     

Using Weight Functions in Spatial Point Pattern Analysis with Application to Plant Ecology Data

This paper presents procedures for percentile estimation in the three-parameter inverse Gaussian (IG3) and the two-parameter inverse Gaussian (IG2) distributions. All procedures require first the estimation of distribution parameters and second the computation of the desired quantile at the estimated parameters. Parameter estimation is accomplished by maximum likelihood (ML) or a mixed moments (MXM) method. A Newton-Rahpson (NR) procedure is used for inverting the CDF. Simulation and asymptotic results are given for the resulting estimators. Two sets of real data are used to illustrate the procedures.     

Calibration for inverse gaussian regression

Inverse Gaussian regression models are useful for regression data where both variables are nonnegative and the variance of the dependent variable depends on the independent variable, Zero intercept inverse Gaussian regression models are presented with non-constant variance, constant ratio of variance to the mean and constant coefficient of variation, For purposes of calibration, the prediction band is used to give point and interval estimators for the independent variable, The results are illustrated with a real data set.     

A comparison of estimators for the mean in the inverse gaussian distribution with a known coefficient of variation

In this paper, we discuss an estimation problem of the mean in the inverse Gaussian distribution with a known coefficient of variation. Two types of linear estimators for the mean, the linear minimum variance unbiased estimator and the linear minimum mean squared error estimator, are constructed by using the squared error loss function and their properties are examined. It is observed that, for small samples the performance of the proposed estimators is better than that of the maximum likelihood estimator, when the coefficient of variation is large.