Bayesian confidence estimation: an alternative approach

From a Bayesian point of wiew, the estimation of an unknown parameter can be interpreted (in many situations) as the problem of fixing a partition of the parameter space (by means of small intervals I₁,…I_k and choosing an interval I_j, from this partition, provided that sufficient information has been obtained. This idea is developed in a decision theory setting. If the Kolmogorov-Smirnov loss is used, it is proved that I_j is the best interval estimation if and only if its posterior probability is greater than or equal to 1/2     

Hierarchical bayes estimation of normal variances with application to a random effect model

The problem of simultaneously estimating p normal variances is investigated when the parameters are believed a priori to be similar in size. A hierarchical Bayes approach is employed and the resulting estimator is compared to common estimators used including one proposed by Box and Tiao (1973) using a Bayesian approach with a noninformative prior. The technique is then applied to estimate components of variance in the one way layout random effect model of the analysis of variance.     

The Bayes rule of the variance parameter of the hierarchical normal and inverse gamma model under Stein's loss

For the variance parameter of the hierarchical normal and inverse gamma model, we analytically calculate the Bayes rule (estimator) with respect to a prior distribution IG (alpha, beta) under Stein's loss function. This estimator minimizes the posterior expected Stein's loss (PESL). We also analytically calculate the Bayes rule and the PESL under the squared error loss. Finally, the numerical simulations exemplify that the PESLs depend only on alpha and the number of observations. The Bayes rules and PESLs under Stein's loss are unanimously smaller than those under the squared error loss.     

Bayesian estimation of sensitivity level and population proportion of a sensitive characteristic in a binary optional unrelated question RRT model

Sihm et al. (2016 Sihm, J. S., A. Chhabra, and S. N. Gupta. 2016. An optional unrelated question RRT model. Involve: A Journal of Mathematics 9 (2):195–209.[Crossref] , [Google Scholar]) proposed an unrelated question binary optional randomized response technique (RRT) model for estimating the proportion of population that possess a sensitive characteristic and the sensitivity level of the question. In our work, decision theoretic approach has been followed to obtain Bayes estimates of the two parameters along with their corresponding minimal Bayes posterior expected losses (BPEL) using beta prior and squared error loss function (SELF). Relative losses are also examined to compare the performances of the Bayes estimates with those of the classical estimates obtained by Sihm et al. (2016 Sihm, J. S., A. Chhabra, and S. N. Gupta. 2016. An optional unrelated question RRT model. Involve: A Journal of Mathematics 9 (2):195–209.[Crossref] , [Google Scholar]). The results obtained are illustrated with the help of real survey data using non informative prior.     

Loss functions for estimation of extrema with an application to disease mapping

It is often of interest to find the maximum or near maxima among a set of vector‐valued parameters in a statistical model; in the case of disease mapping, for example, these correspond to relative‐risk “hotspots” where public‐health intervention may be needed. The general problem is one of estimating nonlinear functions of the ensemble of relative risks, but biased estimates result if posterior means are simply substituted into these nonlinear functions. The authors obtain better estimates of extrema from a new, weighted ranks squared error loss function. The derivation of these Bayes estimators assumes a hidden‐Markov random‐field model for relative risks, and their behaviour is illustrated with real and simulated data.     

The Bayes rule of the parameter in (0,1) under Zhang’s loss function with an application to the beta-binomial model

Abstract

For the restricted parameter space (0,1), we propose Zhang’s loss function which satisfies all the 7 properties for a good loss function on (0,1). We then calculate the Bayes rule (estimator), the posterior expectation, the integrated risk, and the Bayes risk of the parameter in (0,1) under Zhang’s loss function. We also calculate the usual Bayes estimator under the squared error loss function, and the Bayes estimator has been proved to underestimate the Bayes estimator under Zhang’s loss function. Finally, the numerical simulations and a real data example of some monthly magazine exposure data exemplify our theoretical studies of two size relationships about the Bayes estimators and the Posterior Expected Zhang’s Losses (PEZLs).     

Three strings of inequalities among six Bayes estimators

We discover three interesting strings of inequalities among six Bayes estimators, where for the parameter space (0, 1), (0, ∞), and ( ? ∞, ∞), each case has a string of inequalities. The three strings of inequalities only depend on the loss functions, and the inequalities are independent of the chosen models and the used priors provided the Bayes estimators exist. Therefore, they exist in a general setting which makes them quite interesting. Finally, the numerical simulations exemplify the two strings of inequalities defined on (0, 1) and (0, ∞), and that there does not exist a string of inequalities among the six smallest posterior expected losses.     

Data skeletons: simultaneous estimation of multiple quantiles for massive streaming datasets with applications to density estimation

We consider the problem of density estimation when the data is in the form of a continuous stream with no fixed length. In this setting, implementations of the usual methods of density estimation such as kernel density estimation are problematic. We propose a method of density estimation for massive datasets that is based upon taking the derivative of a smooth curve that has been fit through a set of quantile estimates. To achieve this, a low-storage, single-pass, sequential method is proposed for simultaneous estimation of multiple quantiles for massive datasets that form the basis of this method of density estimation. For comparison, we also consider a sequential kernel density estimator. The proposed methods are shown through simulation study to perform well and to have several distinct advantages over existing methods.     

An inclusion-consistent solution to the problem of absurd confidence statements: 2. Consistent nonexact-confidence-interval estimation

Two consistent nonexact-confidence-interval estimation methods, both derived from the consistency-equivalence theorem in Plante (1991), are suggested for estimation of problematic parametric functions with no consistent exact solution and for which standard optimal confidence procedures are inadequate or even absurd, i.e., can provide confidence statements with a 95% empty or all-inclusive confidence set. A belt C(·) from a consistent nonexact-belt family, used with two confidence coefficients (γ = inf_θ P_θ [ θ ? C(X)] and γ⁺ = sup_θ P_θ[θ ? C(X)], is shown to provide a consistent nonexact-belt solution for estimating μ₂ -μ₁ in the Behrens-Fisher problem. A rule for consistent behaviour enables any confidence belt to be used consistently by providing each sample point with best upper and lower confidence levels [δ⁺(x) ≥ γ⁺, δ(x) ≤ γ], which give least-conservative consistent confidence statements ranging from practically exact through informative to noninformative. The rule also provides a consistency correction L(x) = δ⁺(x)-δ(X) enabling alternative confidence solutions to be compared on grounds of adequacy; this is demonstrated by comparing consistent conservative sample-point-wise solutions with inconsistent standard solutions for estimating μ₂/μ₁ (Creasy-Fieller-Neyman problem) and $\sqrt {\mu _1^2 + \mu _2^2 }$, a distance-estimation problem closely related to Stein's 1959 example     

An application of a minimax Bayes rule and shrinkage estimators to the portofolio selection problem under the Bayesian approach

This paper shows that a minimax Bayes rule and shrinkage estimators can be effectively applied to portfolio selection under the Bayesian approach. Specifically, it is shown that the portfolio selection problem can result in a statistical decision problem in some situations. Following that, we present a method for solving a problem involved in portfolio selection under the Bayesian approach.     

Using generalized doubly robust estimator to estimate average treatment effects of multiple treatments in observational studies

The generalized doubly robust estimator is proposed for estimating the average treatment effect (ATE) of multiple treatments based on the generalized propensity score (GPS). In medical researches where observational studies are conducted, estimations of ATEs are usually biased since the covariate distributions could be unbalanced among treatments. To overcome this problem, Imbens [The role of the propensity score in estimating dose-response functions, Biometrika 87 (2000), pp. 706–710] and Feng et al. [Generalized propensity score for estimating the average treatment effect of multiple treatments, Stat. Med. (2011), in press. Available at: http://onlinelibrary.wiley.com/doi/10.1002/sim.4168/abstract] proposed weighted estimators that are extensions of a ratio estimator based on GPS to estimate ATEs with multiple treatments. However, the ratio estimator always produces a larger empirical sample variance than the doubly robust estimator, which estimates an ATE between two treatments based on the estimated propensity score (PS). We conduct a simulation study to compare the performance of our proposed estimator with Imbens’ and Feng et al.’s estimators, and simulation results show that our proposed estimator outperforms their estimators in terms of bias, empirical sample variance and mean-squared error of the estimated ATEs.     

A martingale approach to the problem of dimensionality and performance of bayesian classifiers: asymptotic results

A martingale approach to the problem of performance of Bayesian classifiers with increasing feature dimensionality is applied here . Martingale limit theorems are also used to demonstrate that the expected probability of correct classification tends monotonically to unity for two general classification problems.     

GMM estimation of a realized stochastic volatility model: A Monte Carlo study

This article investigates alternative generalized method of moments (GMM) estimation procedures of a stochastic volatility model with realized volatility measures. The extended model can accommodate a more general correlation structure. General closed form moment conditions are derived to examine the model properties and to evaluate the performance of various GMM estimation procedures under Monte Carlo environment, including standard GMM, principal component GMM, robust GMM and regularized GMM. An application to five company stocks and one stock index is also provided for an empirical demonstration.     

Semiparametric estimation of plane similarities: application to fast computation of aeronautic loads

In the big data era, it is often needed to resolve the problem of parsimonious data representation. In this paper, the data under study are curves and the sparse representation is based on a semiparametric model. Indeed, we propose an original registration model for noisy curves. The model is built transforming an unknown function by plane similarities. We develop a statistical method that allows to estimate the parameters characterizing the plane similarities. The properties of the statistical procedure are studied. We show the convergence and the asymptotic normality of the estimators. Numerical simulations and a real-life aeronautic example illustrate and demonstrate the strength of our methodology.