The global minimum variance unbiased estimator of the parameter for a truncated parameter family under the optimal ranked set sampling

The minimum variance unbiased estimators (MVUEs) of the parameters for various distributions are extensively studied under ranked set sampling (RSS). However, the results in existing literatures are only locally MVUEs, i.e. the MVUE in a class of some unbiased estimators is obtained. In this paper, the global MVUE of the parameter in a truncated parameter family is obtained, that is to say, it is the MVUE in the class of all unbiased estimators. Firstly we find the optimal RSS according to the character of a truncated parameter family, i.e. arrange RSS based on complete and sufficient statistics of independent and identically distributed samples. Then under this RSS, the global MVUE of the parameter in a truncated parameter family is found. Numerical simulations for some usual distributions in this family fully support the result from the above two-step optimizations. A real data set is used for illustration.     

Estimation of the location of a 0-type or ∞-type singularity by Poisson observations

We consider an inhomogeneous Poisson process X on [0, T]. The intensity function of X is supposed to be strictly positive and smooth on [0, T] except at the point θ, in which it has either a 0-type singularity (tends to 0 like |x| ^p , p∈(0, 1)), or an ∞-type singularity (tends to ∞ like |x| ^p , p∈(?1, 0)). We suppose that we know the shape of the intensity function, but not the location of the singularity. We consider the problem of estimation of this location (shift) parameter θ based on n observations of the process X. We study the Bayesian estimators and, in the case p>0, the maximum-likelihood estimator. We show that these estimators are consistent, their rate of convergence is n ^1/(p+1), they have different limit distributions, and the Bayesian estimators are asymptotically efficient.     

Multiparameter estimation in truncated power series distributions under the stein's loss

LetX ₁,…,X _p be p(≥2)independent random variables, where each X.has a distribution belonging to a one parameter truncated power series

distribution. The problem is to estimate simultaneously the unknown parameters under asymmetric loss developed by James and Stein (Proc. Fourth Berkeley Symp. Math. Statist. Prob. 1, 361-380). Several new classes of dominating estimators are obtained by solving a certain difference inequality.     

JAMES-STEIN RULE ESTIMATORS IN LINEAR REGRESSION MODELS WITH MULTIVARIATE-t DISTRIBUTED ERROR

This paper considers estimation of β in the regression model y =Xβ+μ, where the error components in μ have the jointly multivariate Student-t distribution. A family of James-Stein type estimators (characterised by nonstochastic scalars) is presented. Sufficient conditions involving only X are given, under which these estimators are better (with respect to the risk under a general quadratic loss function) than the usual minimum variance unbiased estimator (MVUE) of β. Approximate expressions for the bias, the risk, the mean square error matrix and the variance-covariance matrix for the estimators in this family are obtained. A necessary and sufficient condition for the dominance of this family over MVUE is also given.     

A New Family of Nonparametric Quantile Estimators

A new core methodology for creating nonparametric L-quantile estimators is introduced and three new quantile L-estimators (SV1 _p , SV2 _p , and SV3 _p ) are constructed using the new methodology. Monte Carlo simulation was used in order to investigate the performance of the new estimators for small and large samples under normal distribution and a variety of light and heavy-tailed symmetric and asymmetric distributions. The new estimators outperform, in most of the cases studied, the Harrell–Davis quantile estimator and the weighted average at X _([np]) quantile estimator.     

Minimum-Distance Estimator for Stable Exponent

Assume that X ₁, X ₂,…, X _n is a sequence of i.i.d. random variables with α-stable distribution (α ∈ (0,2], the stable exponent, is the unknown parameter). We construct minimum distance estimators for α by minimizing the Kolmogorov distance or the Cramér–von-Mises distance between the empirical distribution function G _n , and a class of distributions defined based on the sum-preserving property of stable random variables. The minimum distance estimators can also be obtained by minimizing a U-statistic estimate of an empirical distribution function involving the stable exponent. They share the same invariance property with the maximum likelihood estimates. In this article, we prove the strong consistency of the minimum distance estimators. We prove the asymptotic normality of our estimators. Simulation study shows that the new estimators are competitive to the existing ones and perform very closely even to the maximum likelihood estimator.     

Estimating a positive normal mean

Let X ₁, X ₂, ..., X _n be a random sample from a normal population with mean μ and variance σ ². In many real life situations, specially in lifetime or reliability estimation, the parameter μ is known a priori to lie in an interval [a, ∞). This makes the usual maximum likelihood estimator (MLE) ̄ an inadmissible estimator of μ with respect to the squared error loss. This is due to the fact that it may take values outside the parameter space. Katz (1961) and Gupta and Rohatgi (1980) proposed estimators which lie completely in the given interval. In this paper we derive some new estimators for μ and present a comparative study of the risk performance of these estimators. Both the known and unknown variance cases have been explored. The new estimators are shown to have superior risk performance over the existing ones over large portions of the parameter space.     

Bayes Estimation of Change Point in Non Standard Mixture of Left-Truncated Exponential With Unknown Proportions

A sequence of independent lifetimes X ₁, X ₂,…, X _m , X _m+1,…, X _n were observed from the mixture of a degenerate and left-truncated exponential (LTE) distribution, with reliability R _1τ at time τ and minimum life length η with unknown proportion p ₁ and θ₁ but later it was found that there was a change in the system at some point of time m and it is reflected in the sequence after X _m by change in reliability R _2τ at time τ and unknown proportion p ₂ and θ₂. This distribution occurs in many practical situations, for instance; life of a unit may have a LTE distribution but some of the units fail instantaneously. Apart from mixture distributions, the phenomenon of change point is also observed in several situations in life testing and reliability estimation problems. It may happen that at some point of time instability in the sequence of failure times is observed. The problem of study is: When and where this change has started occurring. This is called change point inference problem. The estimators of m, R ₁(t ₀), R ₂(t ₀), p ₁, and p ₂ are derived under asymmetric loss functions namely Linex loss & general entropy loss functions. Both the non informative and informative prior are considered. The effects of prior consideration on Bayes estimates of change point are also studied.     

Equivariant estimators of the covariance matrix

Given a Wishart matrix S [S ∽ W_p(n, Σ)] and an independent multinomial vector X [X ∽ N_p (μ, Σ)], equivariant estimators of Σ are proposed. These estimators dominate the best multiple of S and the Stein-type truncated estimators.     

Improved shrinkage estimators for the mean vector of a scale mixture of normals with unknown variance

The problem of estimating the mean θ of a not necessarily normal p-variate (p > 3) distribution with unknown covariance matrix of the form σ²A (A a known diagonal matrix) on the basis of n_i > 2 observations on each coordinate X_t (1 < i < p) is considered. It is argued that the class of scale (or variance) mixtures of normal distributions is a reasonable class to study. Assuming the loss function is quadratic, a large class of improved shrinkage estimators is developed in the case of a balanced design. We generalize results of Berger and Strawderman for one observation in the known-variance case. This methodology also permits the development of a new class of minimax shrinkage estimators of the mean of a p-variate normal distribution for an unbalanced design. Numerical calculations show that the improvements in risk can be substantial.     

Estimation After Selection Under Reflected Normal Loss Function

Let X ₁ and X ₂ be two independent random variables from normal populations Π₁, Π₂ with different unknown location parameters θ₁ and θ₂, respectively and common known scale parameter σ. Let X ₍₂₎ = max (X ₁, X ₂) and X ₍₁₎ = min (X ₁, X ₂). We consider the problem of estimating the location parameter θ _M (or θ _J ) of the selected population under the reflected normal loss function. We obtain minimax estimators of θ _M and θ _J . Also, we provide sufficient conditions for the inadmissibility of invariant estimators of θ _M and θ _J .     

Classical and Bayesian estimation of P(Y < X) for Kumaraswamy's distribution

The aim of this paper is to study the estimation of the reliability R=P(Y<X) when X and Y are independent random variables that follow Kumaraswamy's distribution with different parameters. If we assume that the first shape parameter is common and known, the maximum-likelihood estimator (MLE), the exact confidence interval and the uniformly minimum variance unbiased estimator of R are obtained. Moreover, when the first parameter is common but unknown, MLEs, Bayes estimators, asymptotic distributions and confidence intervals for R are derived. Furthermore, Bayes and empirical Bayes estimators for R are obtained when the first parameter is common and known. Finally, when all four parameters are different and unknown, the MLE of R is obtained. Monte Carlo simulations are performed to compare the different proposed methods and conclusions on the findings are given.     

Optimal Nonparametric Quantile Estimators. Towards a General Theory. A Survey

“Nonparametric” in the title is used to say that observations X ₁,…,X _n come from an unknown distribution F ∈ ? with ? being the class of all continuous and strictly increasing distribution functions. The problem is to estimate the quantile of a given order q ∈ (0,1) of the distribution F. The class ? of distributions is very large; it is so large that even X _nq:n , where nq is an integer, may be very poor estimator of the qth quantile. To assess the performance of estimators no properties based on moments may be used: expected values of estimators should be replaced by their medians, their variances—by some characteristics of concentration of distributions around the median. If an estimator is median-biased for one of distributions, the bias of the estimator may be infinitely large for other distributions. In the note optimal estimators with respect to various criteria of optimality are presented. The pivotal function F(T) of the estimator T is introduced which enables us to apply the classical statistical approach.     

BAYESIAN SMOOTHING WITH OCCASIONAL JUMPS

Consider a sequence of independent random variables X ₁, X ₂,…,X _n observed at n equally spaced time points where X _i has a probability distribution which is known apart from the values of a parameter θ _i ∈ R which may change from observation to observation. We consider the problem of estimating θ = (θ₁, θ₂,…,θ _n ) given the observed values of X ₁, X ₂,…,X _n . The paper proposes a prior distribution for the parameters θ for which sets of parameter values exhibiting no change, or no change apart from a few sudden large changes, or lots of small changes, all have positive prior probability. Markov chain sampling may be used to calculate Bayes estimates of the parameters. We report the results of a Monte Carlo study based on Poisson distributed data which compares the Bayes estimator with estimators obtained using cubic splines and with estimators derived from the Schwarz criterion. We conclude that the Bayes method is preferable in a minimax sense since it never produces the disastrously large errors of the other methods and pays only a modest price for this degree of safety. All three methods are used to smooth mortality rates for oesophageal cancer in Irish males aged 65–69 over the period 1955 through 1994.     

Maximum likelihood estimation in convex hull models

In this paper we consider models involving the convex hull operation of the parameter and the noise i.e. Y_i = CH(A, X_X). Then we generalize the basic models to ANOVA models; i.e. Y_ij=CH(A∪B_j,X_ij). In some cases the consistent estimators for the J U new parameters are derived. Assuming the existence of density forrandom convex sets, we derive the likelihood for the convex hull model. We then find the maximum Likelihood Estimators for the parameters. Examples for some random convex sets with finite dimensional distributions are derived to show how good these estimators are.     

Shrinkage estimation of P(Y < X) in the exponential distribution mixing with exponential distribution

ABSTRACT

The problem of estimation of R = P(Y < X) have been used in the paper. Let X has exponential distribution mixing with exponential distribution with parameters β and θ and Y independently of X has exponential distribution with parameter λ. By using a prior guess or estimate R₀, different shrinkage estimators of R are derived. Then the performance of the estimators are discussed. Finally, we compare these results with Baklizei and Dayyeh (2003) approaches.     

Maximum likelihood estimation of the parameters of the bivariate binomial distribution

We consider the problem of maximum likelihood estimation of the parameters of the bxvariate binomial distribution, In the statistical literature, this problem is solved when the observed sample is available in the form of a 2x2 contingency table, that is, with all four cell fre quencies given,, The present paper provides a solution for this problem when only the marginal totals of the 2x2 table are observed, which is the natural set-up in a bivariate sampling situation.. Thus, based on a sample [(X_i,Y_i:), i = 1, …, k] from a bivariate binomial population, we derive maximum likelihood (ML) estimators for the two marginal parameters p₁,p₂: and the covariance parameter p₁₁: It. turns out that the ML estimators for P₁: and P₂: are expressed explicitly in terms of the sample values, whereas the ML estimator for p₁₁: can only be obtained numerically by iterative methods Two nu merical illustrations are also presented     

Estimating parameters of a selected Pareto population

Let Π₁,…,Π_k be k populations with Π_i being Pareto with unknown scale parameter α_i and known shape parameter β_i;i=1,…,k. Suppose independent random samples (X_i1,…,X_in), i=1,…,k of equal size are drawn from each of k populations and let X_i denote the smallest observation of the ith sample. The population corresponding to the largest X_i is selected. We consider the problem of estimating the scale parameter of the selected population and obtain the uniformly minimum variance unbiased estimator (UMVUE) when the shape parameters are assumed to be equal. An admissible class of linear estimators is derived. Further, a general inadmissibility result for the scale equivariant estimators is proved.     

Another Proof of Borel's Strong Law of Large Numbers

Let X be a continuous nonnegative random variable with finite first and second moments and a continuous pdf that is positive on the interior of its support. A nonzero limiting density at the origin and a coefficient of variation (CV) greater than 1 are shown to be sufficient conditions for the distribution truncated below at t > 0 to have a variance greater than the variance of the full distribution. Distributions that satisfy these conditions include those with decreasing hazard rates (e.g., the gamma and Weibull distributions with shape parameters less than 1) and the beta distribution with parameter values p and q for which q > p(p + q + 1). The bound T for which truncation at 0 < t < T increases the variance relative to the full distribution is shown to be greater than the (1 — 1/CV)th percentile of the full distribution.     

Estimating population size with truncated sampling

Let X₁, X₂,…,X_n be independent, indentically distributed random variables with density f(x,θ) with respect to a σ-finite measure μ. Let R be a measurable set in the sample space X. The value of X is observable if X ? (X?R) and not otherwise. The number J of observable X’s is binomial, N, Q, Q = 1?P(X ? R). On the basis of J observations, it is desired to estimate N and θ. Estimators considered are conditional and unconditional maximum likelihood and modified maximum likelihood using a prior weight function to modify the likelihood before maximizing. Asymptotic expansions are developed for the [Ncirc]’s of the form [Ncirc] = N + α√N + β + o_p(1), where α and β are random variables. All estimators have the same α, which has mean 0, variance σ² (a function of θ) and is asymptotically normal. Hence all are asymptotically equivalent by the usual limit distributional theory. The β’s differ and Eβ can be considered an “asymptotic bias”. Formulas are developed to compare the asymptotic biases of the various estimators. For a scale parameter family of absolutely continuous distributions with X = (0,∞) and R = (T,∞), special formuli are developed and a best estimator is found.