Estimation of parameters for the truncated exponential distribution

We consider the right truncated exponential distribution where the truncation point is unknown and show that the ML equation has a unique solution over an extended parameter space. In the case of the estimation of the truncation point T we show that the asymptotic distribution of the MLE is not centered at T. A modified MLE is introduced which outperforms all other considered estimators including the minimum variance unbiased estimator. Asymptotic as well as small sample properties of different estimators are investigated and compared. The truncated exponential distribution has an increasing failure rate, ideally suited for use as a survival distribution for biological and industrial data.     

Asymptotic properties of Bayes risk for one-sided tests

Consider a given sequence {T_n} of estimators for a real-valued parameter θ. This paper studies asymptotic properties of restricted Bayes tests of the following form: reject H₀:θ ≤ θ₀ in favour of the alternative θ > θ₀ if T_n ≤ C_n, where the critical point C_n is determined to minimize among all tests of this form the expected probability of error with respect to the prior distribution. Such tests may or may not be fully Bayes tests, and so are called T_n-Bayes. Under fairly broad conditions it is shown that and the T_n-Bayes risk where a_n is the order of the standard error of T_n, - is the prior density, and μ is the median of F, the limit distribution of (T_n – θ)/a_nb(θ). Several examples are given.     

On Projection‐type Estimators of Multivariate Isotonic Functions

Abstract. Let M be an isotonic real‐valued function on a compact subset of and let be an unconstrained estimator of M. A feasible monotonizing technique is to take the largest (smallest) monotone function that lies below (above) the estimator or any convex combination of these two envelope estimators. When the process is asymptotically equicontinuous for some sequence r_n→∞, we show that these projection‐type estimators are r_n‐equivalent in probability to the original unrestricted estimator. Our first motivating application involves a monotone estimator of the conditional distribution function that has the distributional properties of the local linear regression estimator. Applications also include the estimation of econometric (probability‐weighted moment, quantile) and biometric (mean remaining lifetime) functions.     

The superharmonic condition for simultaneous estimation of means in exponential familles

The mean vector associated with several independent variates from the exponential subclass of Hudson (1978) is estimated under weighted squared error loss. In particular, the formal Bayes and “Stein-like” estimators of the mean vector are given. Conditions are also given under which these estimators dominate any of the “natural estimators”. Our conditions for dominance are motivated by a result of Stein (1981), who treated the N_p (θ, I) case with p ≥ 3. Stein showed that formal Bayes estimators dominate the usual estimator if the marginal density of the data is superharmonic. Our present exponential class generalization entails an elliptic differential inequality in some natural variables. Actually, we assume that each component of the data vector has a probability density function which satisfies a certain differential equation. While the densities of Hudson (1978) are particular solutions of this equation, other solutions are not of the exponential class if certain parameters are unknown. Our approach allows for the possibility of extending the parametric Stein-theory to useful nonexponential cases, but the problem of nuisance parameters is not treated here.     

Constrained nonparametric maximum likelihood estimation of stochastically ordered survivor functions

This paper considers estimators of survivor functions subject to a stochastic ordering constraint based on right censored data. We present the constrained nonparametric maximum likelihood estimator (C‐NPMLE) of the survivor functions in one‐and two‐sample settings where the survivor distributions could be discrete or continuous and discuss the non‐uniqueness of the estimators. We also present a computationally efficient algorithm to obtain the C‐NPMLE. To address the possibility of non‐uniqueness of the C‐NPMLE of $S_1(t)$ when $S_1(t)\le S_2(t)$ , we consider the maximum C‐NPMLE (MC‐NPMLE) of $S_1(t)$ . In the one‐sample case with arbitrary upper bound survivor function $S_2(t)$ , we present a novel and efficient algorithm for finding the MC‐NPMLE of $S_1(t)$ . Dykstra ( 1982 ) also considered constrained nonparametric maximum likelihood estimation for such problems, however, as we show, Dykstra's method has an error and does not always give the C‐NPMLE. We corrected this error and simulation shows improvement in efficiency compared to Dykstra's estimator. Confidence intervals based on bootstrap methods are proposed and consistency of the estimators is proved. Data from a study on larynx cancer are analysed to illustrate the method. The Canadian Journal of Statistics 40: 22–39; 2012 © 2012 Statistical Society of Canada     

A note on the equivariant estimation of an exponential scale using progressively censored data

We consider the problem of estimating the scale parameter θ$\theta$ of the shifted exponential distribution with unknown location based on a type II progressively censored sample. Under a large class of bowl-shaped loss functions, a smooth estimator, that dominates the minimum risk equivariant estimator of θ$\theta$, is proposed. A numerical study is performed and shows that the improved estimator yields significant risk reduction over the MRE.     

LINEAR MINIMAX ESTIMATORS FOR ESTIMATING A FUNCTION OF THE PARAMETER

In this note we provide sufficient conditions for the minimaxity of linear estimators of the form aX+b in the one-parameter exponential family for estimating a differentiable function g(θ) with normalized quadratic loss. We provide some examples which show that the natural estimator X is minimax in estimating a function of the parameter (different from the mean).     

On Efficient Estimators of the Proportion of True Null Hypotheses in a Multiple Testing Setup

We consider the problem of estimating the proportion θ of true null hypotheses in a multiple testing context. The setup is classically modelled through a semiparametric mixture with two components: a uniform distribution on interval [0,1] with prior probability θ and a non‐parametric density f . We discuss asymptotic efficiency results and establish that two different cases occur whether f vanishes on a non‐empty interval or not. In the first case, we exhibit estimators converging at a parametric rate, compute the optimal asymptotic variance and conjecture that no estimator is asymptotically efficient (i.e. attains the optimal asymptotic variance). In the second case, we prove that the quadratic risk of any estimator does not converge at a parametric rate. We illustrate those results on simulated data.     

BETWEEN OLSE AND BLUE

Several estimators of X β under the general Gauss–Markov model are considered. Particular attention is paid to those estimators whose efficiency lies between that of the ordinary least squares estimator and that of the best linear unbiased estimator.     

Estimators of location based on Kolmogorov-Smirnov-type statistics

Two classes of estimators of a location parameter ø₀ are proposed, based on a nonnegative functional H₁^* of the pair (D₁^ø_N, G^ø_N), where and where F_N is the sample distribution function. The estimators of the first class are defined as a value of ø minimizing H₁^*; the estimators of the second class are linearized versions of those of the first. The asymptotic distribution of the estimators is derived, and it is shown that the Kolmogorov-Smirnov statistic, the signed linear rank statistics, and the Cramérvon Mises statistics are special cases of such functionals H₁^*;. These estimators are closely related to the estimators of a shift in the two-sample case, proposed and studied by Boulanger in B2 (pp. 271–284).     

Minimax Estimation of the Bounded Parameter of Some Discrete Distributions Under LINEX Loss Function

For a class of discrete distributions, including Poisson(θ), Generalized Poisson(θ), Borel(m, θ), etc., we consider minimax estimation of the parameter θ under the assumption it lies in a bounded interval of the form [0, m] and a LINEX loss function. Explicit conditions for the minimax estimator to be Bayes with respect to a boundary supported prior are given. Also for Bernoulli(θ)-distribution, which is not in the mentioned class of discrete distributions, we give conditions for which the Bayes estimator of θ ∈ [0, m], m < 1 with respect to a boundary supported prior is minimax under LINEX loss function. Numerical values are given for the largest values of m for which the corresponding Bayes estimators of θ are minimax.     

Quasi-universal bandwidth selection for kernel density estimators

Let f?_n, h denote the kernel density estimate based on a sample of size n drawn from an unknown density f. Using techniques from L₂ projection density estimators, the author shows how to construct a data-driven estimator f?_n, h which satisfies This paper is inspired by work of Stone (1984), Devroye and Lugosi (1996) and Birge and Massart (1997).     

MINIMUM MSE ESTIMATION BY LINEAR COMBINATIONS OF ORDER STATISTICS1

In this paper we assume that in a random sample of size ndrawn from a population having the pdf f(x; θ) the smallest r₁ observations and the largest r₂ observations are censored (r₁0, r₂0). We consider the problem of estimating θ on the basis of the middle n-r₁-r₂ observations when either f(x;θ)=θ^-1f(x/θ) or f(x;θ) = (aθ)¹f(x-θ)/aθ) where f(·) is a known pdf, a (<0) is known and θ (>0) is unknown. The minimum mean square error (MSE) linear estimator of θ proposed in this paper is a “shrinkage” of the minimum variance linear unbiased estimator of θ. We obtain explicit expressions of these estimators and their mean square errors when (i) f(·) is the uniform pdf defined on an interval of length one and (ii) f(·) is the standard exponential pdf, i.e., f(x) = exp(–x), x0. Various special cases of censoring from the left (right) and no censoring are considered.     

Robust location estimation with missing data

In a missing data setting, we have a sample in which a vector of explanatory variables ${\bf x}_i$ is observed for every subject i, while scalar responses $y_i$ are missing by happenstance on some individuals. In this work we propose robust estimators of the distribution of the responses assuming missing at random (MAR) data, under a semiparametric regression model. Our approach allows the consistent estimation of any weakly continuous functional of the response's distribution. In particular, strongly consistent estimators of any continuous location functional, such as the median, L‐functionals and M‐functionals, are proposed. A robust fit for the regression model combined with the robust properties of the location functional gives rise to a robust recipe for estimating the location parameter. Robustness is quantified through the breakdown point of the proposed procedure. The asymptotic distribution of the location estimators is also derived. The proofs of the theorems are presented in Supplementary Material available online. The Canadian Journal of Statistics 41: 111–132; 2013 © 2012 Statistical Society of Canada     

CERTAIN BOUNDS CONCERNING CHARACTERISTIC FUNCTIONS1

The largest value of the constant c for which holds over the class of random variables X with non-zero mean and finite second moment, is c=π. Let the random variable (r.v.) X with distribution function F(·) have non-zero mean and finite second moment. In studying a certain random walk problem (Daley, 1976) we sought a bound on the characteristic function of the form for some positive constant c. Of course the inequality is non-trivial only provided that . This note establishes that the best possible constant c =π. The wider relevance of the result is we believe that it underlines the use of trigonometric inequalities in bounding the (modulus of a) c.f. (see e.g. the truncation inequalities in §12.4 of Loève (1963)). In the present case the bound thus obtained is the best possible bound, and is better than the bound (2) |1-?(θ)| ≥ |θEX|-θ²EX²\2 obtained by applying the triangular inequality to the relation which follows from a two-fold integration by parts in the defining equation (*). The treatment of the counter-example furnished below may also be of interest. To prove (1) with c=π, recall that sin u > u(1-u/π) (all real u), so Since |E sinθX|-|E sin(-θX)|, the modulus sign required in (1) can be inserted into (4). Observe that since sin u > u for u < 0, it is possible to strengthen (4) to (denoting max(0,x) by x₊) To show that c=π is the best possible constant in (1), assume without loss of generality that EX > 0, and take θ > 0. Then (1) is equivalent to (6) c < θEX²/{EX-|1-?(θ)|/θ} for all θ > 0 and all r.v.s. X with EX > 0 and EX². Consider the r.v. where 0 < x < 1 and 0 < γ < ∞. Then EX=1, EX²=1+γx², From (4) it follows that |1-?(θ)| > 0 for 0 < |θ| <π|EX|/EX² but in fact this positivity holds for 0 < |θ| < 2π|EX|/EX² because by trigonometry and the Cauchy-Schwartz inequality, |1-?(θ)| > |Re(1-?(θ))| = |E(1-cosθX)| = 2|E sin²θX/2| (10) >2(E sinθX/2)² (11) >(|θEX|-θ²EX²/2π)²/2 > 0, the inequality at (11) holding provided that |θEX|-θ²EX²/2π > 0, i.e., that 0 < |θ| < 2π|EX|/EX². The random variable X at (7) with x= 1 shows that the range of positivity of |1-?(θ)| cannot in general be extended. If X is a non-negative r.v. with finite positive mean, then the identity shows that (1-?(θ))/iθEX is the c.f. of a non-negative random variable, and hence (13) |1-?(θ)| < |θEX| (all θ). This argument fans if pr{X < 0}pr{X> 0} > 0, but as a sharper alternative to (14) |1-?(θ)| < |θE|X||, we note (cf. (2) and (3)) first that (15) |1-?(θ)| < |θEX| +θ²EX²/2. For a bound that is more precise for |θ| close to 0, |1-?(θ)|²= (Re(1-?(θ)))²+ (Im?(θ))² <(θ²EX²/2)²+(|θEX| +θ²EX²_-/π)², so (16) |1-?(θ)| <(|θEX| +θ²EX²_-/π) + |θ|³(EX²)²/8|EX|.     

Common Correlated Effects Estimation of Dynamic Panels with Cross-Sectional Dependence

We derive inconsistency expressions for dynamic panel data estimators under error cross-sectional dependence generated by an unobserved common factor in both the fixed effect and the incidental trends case. We show that for a temporally dependent factor, the standard within groups (WG) estimator is inconsistent even as both N and T tend to infinity. Next we investigate the properties of the common correlated effects pooled (CCEP) estimator of Pesaran (2006) which eliminates the error cross-sectional dependence using cross-sectional averages of the data. In contrast to the static case, the CCEP estimator is only consistent when next to N also T tends to infinity. It is shown that for the most relevant parameter settings, the inconsistency of the CCEP estimator is larger than that of the infeasible WG estimator, which includes the common factors as regressors. Restricting the CCEP estimator results in a somewhat smaller inconsistency. The small sample properties of the various estimators are analyzed using Monte Carlo experiments. The simulation results suggest that the CCEP estimator can be used to estimate dynamic panel data models provided T is not too small. The size of N is of less importance.     

On the improved estimation of a function of the scale parameter of an exponential distribution based on doubly censored sample

In the present article, we have studied the estimation of entropy, that is, a function of scale parameter ln⁡σ of an exponential distribution based on doubly censored sample when the location parameter is restricted to positive real line. The estimation problem is studied under a general class of bowl-shaped non monotone location invariant loss functions. It is established that the best affine equivariant estimator (BAEE) is inadmissible by deriving an improved estimator. This estimator is non-smooth. Further, we have obtained a smooth improved estimator. A class of estimators is considered and sufficient conditions are derived under which these estimators improve upon the BAEE. In particular, using these results we have obtained the improved estimators for the squared error and the linex loss functions. Finally, we have compared the risk performance of the proposed estimators numerically. One data analysis has been performed for illustrative purposes.     

Bias reduction of the maximum-likelihood estimator for a conditional Gaussian MA(1) model

In this paper, we consider an estimation for the unknown parameters of a conditional Gaussian MA(1) model. In the majority of cases, a maximum-likelihood estimator is chosen because the estimator is consistent. However, for small sample sizes the error is large, because the estimator has a bias of O(n^{? 1}). Therefore, we provide a bias of O(n^{? 1}) for the maximum-likelihood estimator for the conditional Gaussian MA(1) model. Moreover, we propose new estimators for the unknown parameters of the conditional Gaussian MA(1) model based on the bias of O(n^{? 1}). We investigate the properties of the bias, as well as the asymptotical variance of the maximum-likelihood estimators for the unknown parameters, by performing some simulations. Finally, we demonstrate the validity of the new estimators through this simulation study.