Fitting Second-Order Finite Mixture Models to Data with Many Censored Values Using Maximum Likelihood Estimation

Finite mixture models, that is, weighted averages of parametric distributions, provide a powerful way to extend parametric families of distributions to fit data sets not adequately fit by a single parametric distribution. First-order finite mixture models have been widely used in the physical, chemical, biological, and social sciences for over 100 years. Using maximum likelihood estimation, we demonstrate how a first-order finite mixture model can represent the large variability in data collected by the U.S. Environmental Protection Agency for the concentration of Radon 222 in drinking water supplied from ground water, even when 28% of the data fall at or below the minimum reporting level. Extending the use of maximum likelihood, we also illustrate how a second-order finite mixture model can separate and represent both the variability and the uncertainty in the data set.     

Estimation of a probability density function using interval aggregated data

ABSTRACT

In economics and government statistics, aggregated data instead of individual level data are usually reported for data confidentiality and for simplicity. In this paper we develop a method of flexibly estimating the probability density function of the population using aggregated data obtained as group averages when individual level data are grouped according to quantile limits. The kernel density estimator has been commonly applied to such data without taking into account the data aggregation process and has been shown to perform poorly. Our method models the quantile function as an integral of the exponential of a spline function and deduces the density function from the quantile function. We match the aggregated data to their theoretical counterpart using least squares, and regularize the estimation by using the squared second derivatives of the density function as the penalty function. A computational algorithm is developed to implement the method. Application to simulated data and US household income survey data show that our penalized spline estimator can accurately recover the density function of the underlying population while the common use of kernel density estimation is severely biased. The method is applied to study the dynamic of China's urban income distribution using published interval aggregated data of 1985–2010.     

Robustness of three power transformation estimation procedures

Maximum likelihood, goodness-of-fit, and symmetric percentile estimators of the power transformation parameterp, are considered. The comparative robustness of each estimation procedure is evaluated when the transformed data can be made symmetric, but may not necessarily be normal. Seven types of symmetric distributions are considered as well as four contaminated normal distributions over a range of six p values for samples of size 25, 50, and 100. The results indicate that the maximum likelihood estimator was slightly better than the goodness-of-fit estimator, but both were greatly superior to the percentile estimator. In general, the procedures were robust to distributional symmetric departures from normality, but increasing kurtosis caused appreciable increases in variation for estimated p values. The variability of p was found to decrease more than exponentially with decreases in the underlying normal distribution coefficient of variation. The standard likelihood ratio confidence interval procedure was found not to be generally useful.     

Estimation in Regressive Logistic Regression Analyses of Familial Data with Missing Outcomes

This paper examines a number of methods of handling missing outcomes in regressive logistic regression modelling of familial binary data, and compares them with an EM algorithm approach via a simulation study. The results indicate that a strategy based on imputation of missing values leads to biased estimates, and that a strategy of excluding incomplete families has a substantial effect on the variability of the parameter estimates. Recommendations are made which depend, amongst other factors, on the amount of missing data and on the availability of software.     

Cramér‐von Mises regression

Consider a linear regression model with unknown regression parameters β₀ and independent errors of unknown distribution. Block the observations into q groups whose independent variables have a common value and measure the homogeneity of the blocks of residuals by a Cramér‐von Mises q‐sample statistic T_q(β). This statistic is designed so that its expected value as a function of the chosen regression parameter β has a minimum value of zero precisely at the true value β₀. The minimizer β of T_q(β) over all β is shown to be a consistent estimate of β₀. It is also shown that the bootstrap distribution of T_q(β₀) can be used to do a lack of fit test of the regression model and to construct a confidence region for β₀     

Theory of nonparametric statistics for rounded-off data with applications

This article gives a unified account of nonparametric statistics, covering testing, estimating, multiple comparisons, analysis of variance and regression, for rounded-off data, with ties handled by the average scores method. The theory is illustrated by means of numerous applications to the Biomedical, Engineering and Behavioral Sciences.     

Estimating the location of the cauchy distribution by numerical global optimization

The log-likelihood function (LLF) of the single (location) parameter Cauchy distribution can exhibit up to n relative maxima, where n is the sample size. To compute the maximum likelihood estimate of the location parameter, previously published methods have advocated scanning the LLF over a suf-ficiently large portion of the real line to locate the absolute maximum. This note shows that, given an easily derived upper bound on the second derivative of the negative LLF, Brent's univariate numerical global optimization method can be used to locate the absolute maximum among several relative maxima of the LLF without performing an exhaustive search over the real line.     

Good ridge estimators based on prior information

Ridge regression is re-examined and ridge estimators based on prior information are introduced. A necessary and sufficient condition is given for such ridge estimators to yield estimators of every nonnull linear combination of the regression coefficients with smaller mean square error than that of the Gauss-Markov best linear unbiased estimator.     

Estimation of reliability for a multicomponent survival stress-strength model based on exponential distributions

Uniformly minimum variance unbiased estimator (UMVUE) of reliability in stress-strength model (known stress) is obtained for a multicomponent survival model based on exponential distributions for parallel system. The variance of this estimator is compared with Cramer-Rao lower bound (CRB) for the variance of unbiased estimator of reliability, and the mean square error (MSE) of maximum likelihood estimator of reliability in case of two component system.     

Kernel density estimation with binned data

Continuous data are often measured or used in binned or rounded form. In this paper we follow up on Hall's work analyzing the effect of using equally-spaced binned data in a kernel density estimator. It is shown that a surprisingly large amount of binning does not adversely affect the integrated mean squared error of a kernel estimate.