Minimum variance unbiased estimation in a modified power series distribution and some of its applications

In this paper we study the minimum variance unbiased estimation in the modified power series distribution introduced by the author (1974a). Necessary and sufficient conditions for the existence of minimum variance unbiased estimate (MVUE) of the parameter based on sufficient statistics are obtained. These results are, then, applied to obtain MVUE of θ^r (r ≥ 1) for the generalized negative binomial and the decapitated generalized negative binomial distributions (Jain and Consul, 1971). Similar estimates are obtained for the generalized Poisson (Consul and Jain, 1973a) and the generalized logarithmic series distributions (Jain and Gupta, 1973). Several of the well-known results follow trivially from the results obtained here.     

Non-parametric estimation of an acceleration parameter

Let X₁,… X_m be a random sample of m failure times under normal conditions with the underlying distribution F(x) and Y₁,…,Y_n a random sample of n failure times under accelerated condititons with underlying distribution G(x);G(x)=1?[1?F(x)]^θ with θ being the unknown parameter under study.Define:U_ij=1 otherwise.The joint distribution of _ijdoes not involve the distribution F and thus can be used to estimate the acceleration parameter θ.The second approach for estimating θ is to use the ranks of the Y-observations in the combined X- and Y-samples.In this paper we establish that the rank of the Y-observations in the pooled sample form a sufficient statistic for the information contained in the U_ii 's about the parameter θ and that there does not exist an unbiassed estimator for the parameter θ.We also construct several estimators and confidence interavals for the parameter θ.     

Estimating the probability of winning (losing) in a gambler's ruin problem with applications

In a classical gambler's ruin problem, the distribution of the number of games lost till ruin is considered, which we call the lost game distribution (LGD). Some applications of LGD in the theory of queues, in the theory of epidemic and in certain clustering and branching models are mentioned. The maximum likelihood estimation of LGD in the framework of modified power series distribution (MPSD), introduced by the author (1974), is studied. The variance and bias of the MLE are given and the actual mean of the MLE is obtained by discussing the negative moments of the MPSD in general. The minimum variance unbiased estimator of θ^k (k≥1) is obtained employing the technique developed by the author (1977) for the class of MPSD.     

On the bias and variance of some proportion estimators

Providing certain parameters are known, almost any linear map from R^P to R¹ can be adjusted to yield a consistent and unbiased estimator in the context of estimating the mixing proportion θ on the basis of an unclassified sample of observations taken from a mixture of two p-dimensional distributions in proportions θ and 1-θ. Attention is focused on an estimator proposed recently, θ, which has minimum variance over all such linear maps. Unfortunately, the form of θ depends on the means of the component distributions and the covariance matrix of the mixture distribution. The effect of using appropriate sample estimates for these unknown parameters in forming θ is investigated by deriving the asymptotic mean and variance of the resulting estimator. The relative efficiency of this estimator under normality is derived. Also, a study is undertaken of the performance of a similar type of estimator appropriate in the context where an observed data vector is not an observation from either one or the other onent distributions, but is recorded as an integrated measurement over a surface area which is a mixture of two categories whose characteristics have different statistical distributions.The asymptotic bias in this case is compared with some available practical results.     

An information-theoretic approach to incorporating prior information in binomial sampling

The incorporation of prior information about θ, where θ is the success probability in a binomial sampling model, is an essential feature of Bayesian statistics. Methodology based on information-theoretic concepts is introduced which (a) quantifies the amount of information provided by the sample data relative to that provided by the prior distribution and (b) allows for a ranking of prior distributions with respect to conservativeness, where conservatism refers to restraint of extraneous information about θ which is embedded in any prior distribution. In effect, the most conservative prior distribution from a specified class (each member o f which carries the available prior information about θ) is that prior distribution within the class over which the likelihood function has the greatest average domination. The most conservative prior distributions from five different families of prior distributions over the interval (0,1) including the beta distribution are determined and compared for three situations: (1) no prior estimate of θ is available, (2) a prior point estimate or θ is available, and (3) a prior interval estimate of θ is available. The results of the comparisons not only advocate the use of the beta prior distribution in binomial sampling but also indicate which particular one to use in the three aforementioned situations.     

Distributions of certain variables in samples from two-parameter exponential distribution

Cumulative distribution function of the variable Y=(U+c)/(Z/2ν)) is given. Here U and Z are independent random variables, U has the exponential distribution (1.1) with θ=0, σ=1, Z has the distribution χ² (2ν) and c is a real quantity. The variable Y with U and Z given by (2.2) and (2.3) is used for inference about the parametric functions ?=θ?kσ of a two-parameter exponential distribution (1.1) with k or ? known. Special cases of ? or k are: the parameter θ, the Pth quantile Xp, the mean θ+σ and the value of the cumulative distribution function or of the reliability function at given point a. Also one-sided tolerance limits for a two-parameter exponential distribution can be derived from the distribution of the variable Y. The results are also applied to the Pareto distribution.     

Simultaneous selection of extreme populations:a bayesian approach

The problem of simultaneously selecting two non-empty subsets, S_Land S_U, of k populations which contain the lower extreme population (LEP) and the upper extreme population (UEP), respectively, is considered. Unknown parameters θ₁,…,θ_kcharacterize the populations π₁,…,π_kand the populations associated with θ_[1]=min θ_i. and θ_[k]= max θ_i. are called the LEP and the UEP, respectively. It is assumed that the underlying distributions possess the monotone likelihood ratio property and that the prior distribution of θ= (θ₁,…,θ_k) is exchangeable. The Bayes rule with respect to a general loss function is obtained. Bayes rule with respect to a semi-additive and non-negative loss function is also determined and it is shown that it is minimax and admissible. When the selected subsets are required to be disjoint, it shown that the Bayes rule with respect to a specific loss function can be obtained by comparing certain computable integrals, Application to normal distributions with unknown means θ₁,…,θ_kand a common known variance is also considered.     

A note on a modified double stage shrinkage estimator

A modified double stage shrinkage estimator has been proposed for the single parameter θ of a distribution function _Fθ. It is shown to be locally better in comparison to the usual double stage shrinkage estimator in the sense of smaller mean squared error in a certain neighbourhood of prior estimate θ_o of θ.     

Shewhart x-charts with estimated process variance

Properties of the Shewhart X-chart for controlling the mean of a process with a normal distribution are investigated for the situation where the process variance Ó²must be estimated from initial sample data. The control limits of the X-chart depend on the estimate of Ó²and thus, unlike the case when Ó²is known, the X-chart is not equivalent to a sequence of independent tests. When Ó²is estimated the distribution of the run length is not geometric and cannot be characterized simply in terms of the probability of a signal at a given point. The average run length (ARL) for the X-chart is expressed in terms of an integral involving the normal cdf, and it is shown that the chart signals with

probability one, but the ARL may not be finite if the size of the 2 sample used to estimate Ó²is sufficiently small. In addition, certain bounds for the ARL are also derived. Numerical integration is use to show that the effect of using small sample sizes in estimating Ó²is to increase the ARL and the variance of the run length distribution     

Correctings tests for trend in proportions for skewness

We develop the score test for the hypothesis that a parameter of a Markov sequence is constant over time, against the alternatives that it varies over time, i.e., θ_t = θ + U_t; t = 1,2,…, where {U_t; t = 1,2,...} is a sequence of independently and identically distributed random variables with mean zero and variance σ^z _u and θ is a fixed constant. The asymptotic null distribution of the test statistic is proved to be normal. We illustrate our procedure by examples and a real life data analysis.     

On the bounded regret of empirical bayes estimators

Let (θ₁,x₁),…,(θ_n,x_n) be independent and identically distributed random vectors with E(xθ) = θ and Var(x|θ) = a + bθ + cθ². Let t_i be the linear Bayes estimator of θ_i and θ~_i be the linear empirical Bayes estimator of θ_i as proposed in Robbins (1983). When Ex and Var x are unknown to the statistician. The regret of using θ~_i instead of t_i because of ignorance of the mean and the variance is r_i = E(θ_i ? θ_i)² ?E(t_i ?θ_i)². Under appropriate conditions cumulative regret R_n = r₁+…r_n is shown to have a finite limit even when n tends to infinity. The limit can be explicitly computed in terms of a,b,c and the first four moments of x.     

Convergence Rates of Empirical Bayes Estimation for the Parameter of the Uniform Distribution U(0, θ) Under Random Censorship

ABSTRACT

This article considers the empirical Bayes estimation problem in the uniform distribution U(0, θ) with censored data. For the parameter θ, using the empirical Bayes (EB) approach, we propose an EB estimation of θ which possesses a rate of convergence can be arbitrarily close to O(n ^?1/2) when the historical samples are randomly censored from the right, where n is the number of historical sample. A sample and some simulation results are also presented.     

A concentration approach to sensitivity studies in statistical estimation problems

It is shown that the concept of concentration is of potential interest in the sensitivity study of some parameters and related estimators. Basic ideas are introduced for a real parameter θ>0 together with graphical representations using Lorenz curves of concentration. Examples based on the mean, standard deviation and variance are provided for some classical distributions. This concentration approach is also discussed in relation with influence functions. Special emphasis is given to the average concentration of an estimator which provides a sensitivity measure allowing one to compare several estimators of the same parameter. Properties of this measure are investigated through simulation studies and its practical interest is illustrated by examples based on the trimmed mean and the Winsorized variance.     

On estimating uniform distribution via linear Bayes method

A linear Bayes procedure is suggested to simultaneously estimate the parameters of the uniform distribution U(θ₁, θ₂). The proposed linear Bayes estimator is simple and easy to use and its superiorities are established.     

Estimating population size with truncated sampling

Let X₁, X₂,…,X_n be independent, indentically distributed random variables with density f(x,θ) with respect to a σ-finite measure μ. Let R be a measurable set in the sample space X. The value of X is observable if X ? (X?R) and not otherwise. The number J of observable X’s is binomial, N, Q, Q = 1?P(X ? R). On the basis of J observations, it is desired to estimate N and θ. Estimators considered are conditional and unconditional maximum likelihood and modified maximum likelihood using a prior weight function to modify the likelihood before maximizing. Asymptotic expansions are developed for the [Ncirc]’s of the form [Ncirc] = N + α√N + β + o_p(1), where α and β are random variables. All estimators have the same α, which has mean 0, variance σ² (a function of θ) and is asymptotically normal. Hence all are asymptotically equivalent by the usual limit distributional theory. The β’s differ and Eβ can be considered an “asymptotic bias”. Formulas are developed to compare the asymptotic biases of the various estimators. For a scale parameter family of absolutely continuous distributions with X = (0,∞) and R = (T,∞), special formuli are developed and a best estimator is found.     

Analysing truncated data with semiparametric transformation models

Left-truncation often arises when patient information, such as time of diagnosis, is gathered retrospectively. In some cases, the distribution function, say G(x), of left-truncated variables can be parameterized as G(x; θ), where θ∈Θ?R^q and θ is a q-dimensional vector. Under semiparametric transformation models, we demonstrated that the approach of Chen et al. (Semiparametric analysis of transformation models with censored data. Biometrika. 2002;89:659–668) can be used to analyse this type of data. The asymptotic properties of the proposed estimators are derived. A simulation study is conducted to investigate the performance of the proposed estimators.     

Bayesian design of experiment for quantal responses: What is promised versus what is delivered

This article considers a design problem in quantal response analysis, where an experimenter must choose a set of dose levels and number of independent observations to take at these levels, subject to some total sample size, in order to minimize the expected or predicted posterior variance of some characteristics ø of the tolerance distribution F_θ, with unknown parameters θ. An exact solution to this problem is demonstrated when ø is the unknown LD50 of the one parameter logistic tolerance distribution, under the restriction that an equal number of observations are taken at each of a set of equally spaced levels. The solution is based on a combination of simulated outcomes and Monte Carlo integration to evaluate the predicted variance. The numerical results are compared to those obtained previously by asymptotic approximations in Tsutakawa (1972), (J. Amer. Statist. Assoc. 67 584–590). The wide variability in the simulated posterior variance suggests that the expected posterior variance alone is not a good criterion for design selection.     

ESTIMATING A PARAMETER WHEN IT IS KNOWN THAT THE PARAMETER EXCEEDS A GIVEN VALUE

In some statistical problems a degree of explicit, prior information is available about the value taken by the parameter of interest, θ say, although the information is much less than would be needed to place a prior density on the parameter's distribution. Often the prior information takes the form of a simple bound, ‘θ > θ₁ ’ or ‘θ < θ₁ ’, where θ₁ is determined by physical considerations or mathematical theory, such as positivity of a variance. A conventional approach to accommodating the requirement that θ > θ₁ is to replace an estimator, , of θ by the maximum of and θ₁. However, this technique is generally inadequate. For one thing, it does not respect the strictness of the inequality θ > θ₁ , which can be critical in interpreting results. For another, it produces an estimator that does not respond in a natural way to perturbations of the data. In this paper we suggest an alternative approach, in which bootstrap aggregation, or bagging, is used to overcome these difficulties. Bagging gives estimators that, when subjected to the constraint θ > θ₁ , strictly exceed θ₁ except in extreme settings in which the empirical evidence strongly contradicts the constraint. Bagging also reduces estimator variability in the important case for which is close to θ₁, and more generally produces estimators that respect the constraint in a smooth, realistic fashion.     

Multivariate normal mean–variance mixture distribution based on Birnbaum–Saunders distribution

A multivariate normal mean–variance mixture based on a Birnbaum–Saunders (NMVMBS) distribution is introduced and several properties of this new distribution are discussed. A new robust non-Gaussian ARCH-type model is proposed in which there exists a relation between the variance of the observations, and the marginal distributions are NMVMBS. A simple EM-based maximum likelihood estimation procedure to estimate the parameters of this normal mean–variance mixture distribution is given. A simulation study and some real data are used to demonstrate the modelling strength of this new model.     

The Performance of a Robust Multistage Estimator in Nonlinear Regression with Heteroscedastic Errors

In this article, a robust multistage parameter estimator is proposed for nonlinear regression with heteroscedastic variance, where the residual variances are considered as a general parametric function of predictors. The motivation is based on considering the chi-square distribution for the calculated sample variance of the data. It is shown that outliers that are influential in nonlinear regression parameter estimates are not necessarily influential in calculating the sample variance. This matter persuades us, not only to robustify the estimate of the parameters of the models for both the regression function and the variance, but also to replace the sample variance of the data by a robust scale estimate.