Nonparametric Bayes estimation of gap-time distribution with recurrent event data

Nonparametric Bayes (NPB) estimation of the gap-time survivor function governing the time to occurrence of a recurrent event in the presence of censoring is considered. In our Bayesian approach, the gap-time distribution, denoted by F, has a Dirichlet process prior with parameter α. We derive NPB and nonparametric empirical Bayes (NPEB) estimators of the survivor function F?=1?F and construct point-wise credible intervals. The resulting Bayes estimator of F? extends that based on single-event right-censored data, and the PL-type estimator is a limiting case of this Bayes estimator. Through simulation studies, we demonstrate that the PL-type estimator has smaller biases but higher root-mean-squared errors (RMSEs) than those of the NPB and the NPEB estimators. Even in the case of a mis-specified prior measure parameter α, the NPB and the NPEB estimators have smaller RMSEs than the PL-type estimator, indicating robustness of the NPB and NPEB estimators. In addition, the NPB and NPEB estimators are smoother (in some sense) than the PL-type estimator.     

Regularized Posteriors in Linear Ill‐Posed Inverse Problems

Abstract. We study the Bayesian solution of a linear inverse problem in a separable Hilbert space setting with Gaussian prior and noise distribution. Our contribution is to propose a new Bayes estimator which is a linear and continuous estimator on the whole space and is stronger than the mean of the exact Gaussian posterior distribution which is only defined as a measurable linear transformation. Our estimator is the mean of a slightly modified posterior distribution called regularized posterior distribution. Frequentist consistency of our estimator and of the regularized posterior distribution is proved. A Monte Carlo study and an application to real data confirm good small‐sample properties of our procedure.     

Near Optimal Prediction from Relevant Components

Abstract. The random x regression model is approached through the group of rotations of the eigenvectors for the x ‐covariance matrix together with scale transformations for each of the corresponding regression coefficients. The partial least squares model can be constructed from the orbits of this group. A generalization of Pitman's Theorem says that the best equivariant estimator under a group is given by the Bayes estimator with the group's invariant measure as the prior. A straightforward application of this theorem turns out to be impossible since the relevant invariant prior leads to a non‐defined posterior. Nevertheless we can devise an approximate scale group with a proper invariant prior leading to a well‐defined posterior distribution with a finite mean. This Bayes estimator is explored using Markov chain Monte Carlo technique. The estimator seems to require heavy computations, but can be argued to have several nice properties. It is also a valid estimator when p>n.     

On asymptotic optimality of bayes empirical bayes estimators

In an empirical Bayes decision problem, a prior distribution ? is placed on a one-dimensfonal family G of priors G_w, wεΩ, to produce a Bayes empirical Bayes estimator, The asymptotic optimaiity of the Bayes estimator is established when the support of ? is Ω and the marginal distributions H_w have monotone likelihood ratio and continuous Kullback-Leibler information number.     

Learning from a lot: Empirical Bayes for high‐dimensional model‐based prediction

Empirical Bayes is a versatile approach to “learn from a lot” in two ways: first, from a large number of variables and, second, from a potentially large amount of prior information, for example, stored in public repositories. We review applications of a variety of empirical Bayes methods to several well‐known model‐based prediction methods, including penalized regression, linear discriminant analysis, and Bayesian models with sparse or dense priors. We discuss “formal” empirical Bayes methods that maximize the marginal likelihood but also more informal approaches based on other data summaries. We contrast empirical Bayes to cross‐validation and full Bayes and discuss hybrid approaches. To study the relation between the quality of an empirical Bayes estimator and p, the number of variables, we consider a simple empirical Bayes estimator in a linear model setting. We argue that empirical Bayes is particularly useful when the prior contains multiple parameters, which model a priori information on variables termed “co‐data”. In particular, we present two novel examples that allow for co‐data: first, a Bayesian spike‐and‐slab setting that facilitates inclusion of multiple co‐data sources and types and, second, a hybrid empirical Bayes–full Bayes ridge regression approach for estimation of the posterior predictive interval.     

Bayes minimax estimation of a bernoulli p in a restricted parameter space

In many estimation problems the parameter of interest is known,a priori, to belong to a proper subspace of the natural parameter space. Although useful in practice this type of additional information can lead to surprising theoretical difficulties. In this paper the problem of minimax estimation of a Bernoulli pwhen pis restricted to a symmetric subinterval of the natural parameter space is considered. For the sample sizes n = 1,2,3, and 4 least favorable priors with finite support are provided and the corresponding Bayes estimators are shown to be minimax. For n = 5 and 6 the usual constant risk minimax estimator is shown to be the Bayes minimax estimator corresponding to a least favorable prior with finite support, provided the restriction on the parameter space is not too tight.     

A note on james-stein and bayes empiricl bayes estimators

In an empirical Bayes decision problem, a simple class of estimators is constructed that dominate the James-Stein

estimator, A prior distribution A is placed on a restricted (normal) class G of priors to produce a Bayes empirical Bayes estimator, The Bayes empirical Bayes estimator is smooth, admissible, and asymptotically optimal. For certain A rate of convergence to minimum Bayes risk is 0(n^-1)uniformly on G. The results of a Monte Carlo study are presented to demonstrate the favorable risk bebhavior of the Bayes estimator In comparison with other competitors including the James-Stein estimator.     

Classical and Bayesian estimation of stress-strength reliability in type II censored Pareto distributions

ABSTRACT

In this paper, the stress-strength reliability, R, is estimated in type II censored samples from Pareto distributions. The classical inference includes obtaining the maximum likelihood estimator, an exact confidence interval, and the confidence intervals based on Wald and signed log-likelihood ratio statistics. Bayesian inference includes obtaining Bayes estimator, equi-tailed credible interval, and highest posterior density (HPD) interval given both informative and non-informative prior distributions. Bayes estimator of R is obtained using four methods: Lindley's approximation, Tierney-Kadane method, Monte Carlo integration, and MCMC. Also, we compare the proposed methods by simulation study and provide a real example to illustrate them.     

Minimax Estimation of the Bounded Parameter of Some Discrete Distributions Under LINEX Loss Function

For a class of discrete distributions, including Poisson(θ), Generalized Poisson(θ), Borel(m, θ), etc., we consider minimax estimation of the parameter θ under the assumption it lies in a bounded interval of the form [0, m] and a LINEX loss function. Explicit conditions for the minimax estimator to be Bayes with respect to a boundary supported prior are given. Also for Bernoulli(θ)-distribution, which is not in the mentioned class of discrete distributions, we give conditions for which the Bayes estimator of θ ∈ [0, m], m < 1 with respect to a boundary supported prior is minimax under LINEX loss function. Numerical values are given for the largest values of m for which the corresponding Bayes estimators of θ are minimax.     

Mean likelihood estimators

The use of Mathematica in deriving mean likelihood estimators is discussed. Comparisons are made between the mean likelihood estimator, the maximum likelihood estimator, and the Bayes estimator based on a Jeffrey's noninformative prior. These estimators are compared using the mean-square error criterion and Pitman measure of closeness. In some cases it is possible, using Mathematica, to derive exact results for these criteria. Using Mathematica, simulation comparisons among the criteria can be made for any model for which we can readily obtain estimators.In the binomial and exponential distribution cases, these criteria are evaluated exactly. In the first-order moving-average model, analytical comparisons are possible only for n = 2. In general, we find that for the binomial distribution and the first-order moving-average time series model the mean likelihood estimator outperforms the maximum likelihood estimator and the Bayes estimator with a Jeffrey's noninformative prior. Mathematica was used for symbolic and numeric computations as well as for the graphical display of results. A Mathematica notebook which provides the Mathematica code used in this article is available: http://www.stats.uwo.ca/mcleod/epubs/mele. Our article concludes with our opinions and criticisms of the relative merits of some of the popular computing environments for statistics researchers.     

Nonparametric hierarchical Bayes analysis of binomial data via Bernstein polynomial priors

For binomial data analysis, many methods based on empirical Bayes interpretations have been developed, in which a variance‐stabilizing transformation and a normality assumption are usually required. To achieve the greatest model flexibility, we conduct nonparametric Bayesian inference for binomial data and employ a special nonparametric Bayesian prior—the Bernstein–Dirichlet process (BDP)—in the hierarchical Bayes model for the data. The BDP is a special Dirichlet process (DP) mixture based on beta distributions, and the posterior distribution resulting from it has a smooth density defined on [0, 1]. We examine two Markov chain Monte Carlo procedures for simulating from the resulting posterior distribution, and compare their convergence rates and computational efficiency. In contrast to existing results for posterior consistency based on direct observations, the posterior consistency of the BDP, given indirect binomial data, is established. We study shrinkage effects and the robustness of the BDP‐based posterior estimators in comparison with several other empirical and hierarchical Bayes estimators, and we illustrate through examples that the BDP‐based nonparametric Bayesian estimate is more robust to the sample variation and tends to have a smaller estimation error than those based on the DP prior. In certain settings, the new estimator can also beat Stein's estimator, Efron and Morris's limited‐translation estimator, and many other existing empirical Bayes estimators. The Canadian Journal of Statistics 40: 328–344; 2012 © 2012 Statistical Society of Canada     

Empirical Bayes sequential estimation of a finite population mean

In this article, we consider the Bayes and empirical Bayes problem of the current population mean of a finite population when the sample data is available from other similar (m-1) finite populations. We investigate a general class of linear estimators and obtain the optimal linear Bayes estimator of the finite population mean under a squared error loss function that considered the cost of sampling. The optimal linear Bayes estimator and the sample size are obtained as a function of the parameters of the prior distribution. The corresponding empirical Bayes estimates are obtained by replacing the unknown hyperparameters with their respective consistent estimates. A Monte Carlo study is conducted to evaluate the performance of the proposed empirical Bayes procedure.     

Empirical Bayes estimation for the mean of the selected normal population when there are additional data

ABSTRACT

This paper is concerned with the problem of estimation for the mean of the selected population from two normal populations with unknown means and common known variance in a Bayesian framework. The empirical Bayes estimator, when there are available additional observations, is derived and its bias and risk function are computed. The expected bias and risk of the empirical Bayes estimator and the intuitive estimator are compared. It is shown that the empirical Bayes estimator is asymptotically optimal and especially dominates the intuitive estimator in terms of Bayes risk, with respect to any normal prior. Also, the Bayesian correlation between the mean of the selected population (random parameter) and some interested estimators are obtained and compared.     

Bayesian Estimation of the Change Point Using X¯ Control Chart

The process personnel always seek the opportunity to improve the processes. One of the essential steps for process improvement is to quickly recognize the starting time or the change point of a process disturbance. The proposed approach combines the X¯ control chart with the Bayesian estimation technique. We show that the control chart has some information about the change point and this information can be used to make an informative prior. Then two Bayes estimators corresponding to the informative and a non informative prior along with MLE are considered. Their efficiencies are compared through a series of simulations. The results show that the Bayes estimator with the informative prior is more accurate and more precise when the means of the process before and after the change point time are not too closed. In addition, the efficiency of the Bayes estimator with the informative prior increases as the change point goes away from the origin.     

Inference of stress-strength for the Type-II generalized logistic distribution under progressively Type-II censored samples

This article studies the estimation of the reliability R = P[Y < X] when X and Y come from two independent generalized logistic distributions of Type-II with different parameters, based on progressively Type-II censored samples. When the common scale parameter is unknown, the maximum likelihood estimator and its asymptotic distribution are proposed. The asymptotic distribution is used to construct an asymptotic confidence interval of R. Bayes estimator of R and the corresponding credible interval using the Gibbs sampling technique have been proposed too. Assuming that the common scale parameter is known, the maximum likelihood estimator, uniformly minimum variance unbiased estimator, Bayes estimation, and confidence interval of R are extracted. Monte Carlo simulations are performed to compare the different proposed methods. Analysis of a real dataset is given for illustrative purposes. Finally, methods are extended for proportional hazard rate models.     

Nonparametric Bayesian estimation of survival function under random left truncation

Several observational studies give rise to randomly left truncated data. In a nonparametric model for such data X denotes a variable of interest, T denotes the truncation variable and the distributions of both X and T are left unspecified. For this model, the product-limit estimator, which is also the maximum likelihood estimator of the survival curve, has been widely discussed. In this article, a nonparametric Bayes estimator of the survival function based on randomly left truncated data and Dirichlet process prior is presented. Some new results on the mixtures of Dirichlet processes in the context of truncated data are obtained. These results are then used to derive the Bayes estimator of the survival function under squared error loss. The weak convergence of the Bayes estimator is studied. An example using transfusion related AIDS data quoted in Kalbfleisch and Lawless (1989) is considered.     

A Bayesian nonparametric estimator based on left censored data

Summary This paper introduces a Bayesian nonparametric estimator for an unknown distribution function based on left censored observations. Hjort (1990)/Lo (1993) introduced Bayesian nonparametric estimators derived from beta/beta-neutral processes which allow for right censoring. These processes are taken as priors from the class ofneutral to the right processes (Doksum, 1974). The Kaplan-Meier nonparametric product limit estimator can be obtained from these Bayesian nonparametric estimators in the limiting case of a vague prior. The present paper introduces what can be seen as the correspondingleft beta/beta-neutral process prior which allow for left censoring. The Bayesian nonparametyric estimator is obtained as in the corresponding product limit estimator based on left censored data.     

On estimating uniform distribution via linear Bayes method

A linear Bayes procedure is suggested to simultaneously estimate the parameters of the uniform distribution U(θ₁, θ₂). The proposed linear Bayes estimator is simple and easy to use and its superiorities are established.     

Some Applications of the Rao Distance to Shrinkage Estimators

Bayesian statistics is concerned with how prior information influence inferences. This article studies this problem by comparing the value of the Rao distance between prior and posterior normal distributions. Particular cases include the linear Bayes estimator, the mixed estimator, and ridge-type estimators.     

Uniformly best estimation in linear regression when prior information is fuzzy

Modeling prior information as a fuzzy set and using Zadeh’s extension principle, a general approach is presented how to rate linear affine estimators in linear regression. This general approach is applied to fuzzy prior information sets given by ellipsoidal α-cuts. Here, in an important and meaningful subclass, a uniformly best linear affine estimator can be determined explicitly. Surprisingly, such a uniformly best linear affine estimator is optimal with respect to a corresponding relative squared error approach. Two illustrative special cases are discussed, where a generalized least squares estimator on the one hand and a general ridge or Kuks–Olman estimator on the other hand turn out to be uniformly best.