The maximum likelihood estimators of the parameters of the gamma distribution are always positively biased

Several authors have conjectured, on the basis of their numerical work, that the maximum likelihood estimators of the shape and scale parameters of the Gamma distribution are positively biased. It is proved that their conjecture is always true.     

Age-period-cohort analysis: an illustration of the problems in assessing interaction in one observation per cell data

This paper discusses the specific problems of age-period-cohort (A-P-C) analysis within the general framework of interaction assessment for two-way cross-classified data with one observation per cell. The A-P-C multiple classification model containing the effects of age groups (rows), periods of observation (columns), and birth cohorts (diagonals of the two-way table) is characterized as one of a special class of models involving interaction terms assumed to have very specific forms. The so-called A-P-C identification problem, which results from the use of a particular interaction structure for detecting cohort effects, is shown to manifest itself in the form of an exact linear dependency among the columns of the design matrix. The precise relationship holding among these columns is derived, as is an explicit formula for the bias in the parameter estimates resulting from an incorrect specification of an assumed restriction on the parameters required to solve the normal equations. Current methods for modeling A-P-C data are critically reviewed, an illustrative numerical example is presented, and one potentially promising analysis strategy is discussed. However, gien the large number of possible sources for error in A-P-C analyses, it is strongly recommended that the results of such analyses be interpreted with a great deal of caution.     

Maximum likelihood estimation for the generalized poisson distribution

The generalized Poisson distribution;containing two

parameters and studied by many researchers; describes the distribution of busy periods under a queueing system and has very interesting properties; The probabilities for successive classes depend upon the previous occurrences; The problem of admissible maximum likelihood estimators for for the parameters Is discussed and a necessary and sufficient condition is derived for which unique admissible maximum likelihood estimators exist; The first; order terms in the biases; variances and the covariance of these maximum likelihood estimators are obtained.     

Smoothing Splines with Boundary Correction

Regular smoothing splines are known to have a type of boundary bias problem that can reduce their estimation efficiency. In this paper, a boundary corrected smoothing spline with general order is designed in a way that the risk will decay at an optimal rate. An O(n) algorithm is also developed to compute the resultant estimator efficiently.     

An approximation for analyzing a broad class of implicitly and explicitly defined estimators

An approximation is presented that can be used to gain insight into the characteristics – such as outlier sensitivity, bias, and variability – of a wide class of estimators, including maximum likelihood and least squares. The approximation relies on a convenient form for an arbitrary order Taylor expansion in a multivariate setting. The implicit function theorem can be used to construct the expansion when the estimator is not defined in closed form. We present several finite-sample and asymptotic properties of such Taylor expansions, which are useful in characterizing the difference between the estimator and the expansion.     

Estimating with percentile grouped and truncated date from a scale parameter distribution

Data which is grouped and truncated is considered. We are given numbers n₁<…<n_k=n and we observe X_ni ),i=1,…k, and the tottal number of observations available (N> n_k is unknown. If the underlying distribution has one unknown parameter θ which enters as a scale parameter, we examine the form of the equations for both conditional, unconditional and modified maximum likelihood estimators of θ and N and examine when these estimators will be finite, and unique. We also develop expressions for asymptotic bias and search for modified estimators which minimize the maximum asymptotic bias. These results are specialized tG the zxponential distribution. Methods of computing the solutions to the likelihood equatims are also discussed.     

Peculiar bias properties of the ols estimator when applied to a dynamic model with autocorrelated disturbances

This study reveals that contrary to the conventional wisdom among econometricians, the bias of the OLS estimator can be quite small when the estimator is applied to a geometrically distributed lag model, y_t<ce:glyph name="dbnd6"/> α + βx _t+ λy _t-₁. + u_t, with autocorrelated disturbances, be they AR(1), MA(1), MA(2), AR(2), and ARMA(1,1). This happens when λ is large and x_tis smoothly trended (e.g., a real GNP series). In fact, the bias of the OLS estimator becomes zero at one parameter combination, and the OLS estimator performs well over a wide range around this parameter combination. By decomposing the disturbance term into two parts, the paper also explains why OLS shows such an unexpected property. These findings have both pedagogical and practical significance.     

Estimation of the smaller and larger of two exponential location parameters

Assume independent random samples are drawn from two populations which are exponentially distributed with unknown location parameters and a common known scale parameter. We want to estimate the maximum and the minimum of the unknowo location paremeters. In this paper several estimators are proposed which are better than the natural estimations in terms of absolute bias and /or meaqn squared error.     

Estimation of the location and scale parameters of the extreme value distmbution based on multiply type-II censored samples

In this paper, we consider the problem of estimating the location and scale parameters of an extreme value distribution based on multiply Type-II censored samples. We first describe the best linear unbiased estimators and the maximum likelihood estimators of these parameters. After observing that the best linear unbiased estimators need the construction of some tables for its coefficients and that the maximum likelihood estimators do not exist in an explicit algebraic form and hence need to be found by numerical methods, we develop approximate maximum likelihood estimators by appropriately approximating the likelihood equations. In addition to being simple explicit estimators, these estimators turn out to be nearly as efficient as the best linear unbiased estimators and the maximum likelihood estimators. Next, we derive the asymptotic variances and covariance of these estimators in terms of the first two single moments and the product moments of order statistics from the standard extreme value distribution. Finally, we present an example in order to illustrate all the methods of estimation of parameters discussed in this paper.     

Admissible minimum bias estimation of response surfaces

The minimum bias estimator was introduced as an alternative to the least squares estimator for approximating response functions by low-order polynomials. Here we show how to obtain an admissible estimator with smaller squared bias.