A Universal Prior Distribution for Bayesian Consistency of Non parametric Procedures

The introduction of the Hausdorff α-entropy in Xing (2008a Xing, Y. (2008a). Convergence rates of posterior distributions for observations without the iid structure, 38 pages. Available at: www.arxiv.org:0811.4677v1. Google Scholar]), Xing (2008b Xing, Y. (2008b). On adaptive Bayesian inference. Electron. J. Stat. 2:848–862.Crossref] , Google Scholar]), Xing (2010 Xing, Y. (2010). Rates of posterior convergence for iid Observations. Commun. Stat. Theory Methods. 39(19):3389–3398.Taylor & Francis Online] , Google Scholar]), Xing (2011 Xing, Y. (2011). Convergence rates of nonparametric posterior distributions. J. Stat. Plann. Inference 141:3382–3390.Crossref], Web of Science ®] , Google Scholar]), and Xing and Ranneby (2009 Xing, Y., Ranneby, B. (2009). Sufficient conditions for Bayesian consistency. J. Stat. Plann. Inference. 139:2479–2489.Crossref], Web of Science ®] , Google Scholar]) has lead a series of improvements of well-known results on posterior consistency. In this paper we discuss an application of the Hausdorff α-entropy. We construct a universal prior distribution such that the corresponding posterior distribution is almost surely consistent. The approach of the construction of this type of prior distribution is natural, but it works very well for all separable models. We illustrate such prior distributions by examples. In particular, we obtain that if the true density function is known to be some normal probability density function with unknown mean and unknown variance then without any additional assumption one can construct a prior distribution which leads to posterior consistency.