Constrained Bayes and Empirical Bayes Estimation with Balanced Loss Functions

This article develops constrained Bayes and empirical Bayes estimators under balanced loss functions. In the normal-normal example, estimators of the mean squared errors of the EB and constrained EB estimators are provided which are correct asymptotically up to O(m ^?1), m denoting the number of strata.     

Empirical Bayes Estimation of Small Area Means under a Nested Error Linear Regression Model with Measurement Errors in the Covariates

Abstract.  Previously, small area estimation under a nested error linear regression model was studied with area level covariates subject to measurement error. However, the information on observed covariates was not used in finding the Bayes predictor of a small area mean. In this paper, we first derive the fully efficient Bayes predictor by utilizing all the available data. We then estimate the regression and variance component parameters in the model to get an empirical Bayes (EB) predictor and show that the EB predictor is asymptotically optimal. In addition, we employ the jackknife method to obtain an estimator of mean squared prediction error (MSPE) of the EB predictor. Finally, we report the results of a simulation study on the performance of our EB predictor and associated jackknife MSPE estimators. Our results show that the proposed EB predictor can lead to significant gain in efficiency over the previously proposed EB predictor.     

指数族分布中参数的经验贝叶斯估计

指数族分布是一类应用广泛的分布类,包括了泊松分布、Gamma分布、Beta分布、二项分布等常见分布.在非寿险中,索赔额或索赔次数过程常常被假定服从指数族分布,由于风险的非齐次性,指数族分布中的参数θ也为随机变量,假定服从指数族共轭先验分布.此时风险参数的估计落入了Bayes框架,风险参数θ的Bayes估计被表达“信度”形式.然而,在实际运用中,由于先验分布与样本分布中仍然含有结构参数,根据样本的边际分布的似然函数估计结构参数,从而获得风险参数的经验Bayes估计,最后证明了该经验Bayes估计是渐近最优的.     

Minimax Empirical Bayes Estimators in Multivariate Mixed Linear Models with Unequal Replications

Predictive influence of explanatory variables has been studied in both univariate and multivariate distributions. In the Bayesian approach, the same problem is considered in absence of multicollinearity in the dataset. The aim of this article is to study the same in the presence of perfect multicollinearity. To do this, we first derived the predictive distributions for full model and reduced model using vague prior density. Then the discrepancies between these predictive distributions are measured by the Kullback–Leibler (K–L) directed measure of divergence to assess the influence of deleted explanatory variables. Finally, distribution of the discrepancies is derived and the test procedure is performed.     

Empirical Likelihood for Nonparametric Models Under Linear Process Errors

In this paper, we study the construction of confidence intervals for a nonparametric regression function under linear process errors by using the blockwise technique. It is shown that the blockwise empirical likelihood (EL) ratio statistic is asymptotically distributed. The result is used to obtain EL based confidence intervals for the nonparametric regression function. The finite‐sample performance of the method is evaluated through a simulation study.     

The Consistency of Estimators in Finite Mixture Models

The parameters of a finite mixture model cannot be consistently estimated when the data come from an embedded distribution with fewer components than that being fitted, because the distribution is represented by a subset in the parameter space, and not by a single point. Feng & McCulloch (1996) give conditions, not easily verified, under which the maximum likelihood (ML) estimator will converge to an arbitrary point in this subset. We show that the conditions can be considerably weakened. Even though embedded distributions may not be uniquely represented in the parameter space, estimators of quantities of interest, like the mean or variance of the distribution, may nevertheless actually be consistent in the conventional sense. We give an example of some practical interest where the ML estimators are root of n -consistent.
Similarly consistent statistics can usually be found to test for a simpler model vs a full model. We suggest a test statistic suitable for a general class of model and propose a parameter-based bootstrap test, based on this statistic, for when the simpler model is correct.     

A parametric empirical Bayes approach to the analysis of capture-recapture experiments

Empirical Bayes methods and a bootstrap bias adjustment procedure are used to estimate the size of a closed population when the individual capture probabilities are independently and identically distributed with a Beta distribution. The method is examined in simulations and applied to several well-known datasets. The simulations show the estimator performs as well as several other proposed parametric and non-parametric estimators.     

Empirical Bayes Small-Area Estimation Using Logistic Regression Models and Summary Statistics

Many of the available methods for estimating small-area parameters are model-based approaches in which auxiliary variables are used to predict the variable of interest. For models that are nonlinear, prediction is not straightforward. MacGibbon and Tomberlin and Farrell, MacGibbon, and Tomberlin have proposed approaches that require microdata for all individuals in a small area. In this article, we develop a method, based on a second-order Taylor-series expansion to obtain model-based predictions, that requires only local-area summary statistics for both continuous and categorical auxiliary variables. The methodology is evaluated using data based on a U.S. Census.     

Estimation in Second-Order Models with Errors in the Factor Levels

The impact of errors in the factor levels is examined on the estimation of parameters in second-order response models. Errors can occur in setting the factor levels for response surface and robust parameter design models. These errors can lead to heterogeneity of variances in model errors that make ordinary least squares estimation inappropriate. Weighted least squares and maximum likelihood estimation approaches are developed as viable alternatives where it is assumed the variances and covariances of the errors are known. Performance of these estimation techniques are examined in simulation studies for two examples. Another example is given that applies these results.     

Estimation in multi-path change-point problems

The current literature deals with the change-point problem only in the context of the obser¬vation of a single sequence. In this paper, inference will be based on the observation of TV sequences of random variables, each sequence containing one change-point. This extension allows the effective use of bootstrap and empirical Bayes methods, both of which are not feasible in the single-path context. Two classes of these “multi-path” change-point problems are considered. If the change-point is assumed to occur at the the same position in each sequence, then the terminology “fixed-tau multi-path change-point” will be used. In other cases, one may expect the change-point to occur at random positions in each sequence, according to some distribution, a “random-tau multi-path change-point” problem. Examples and simulations are given.     

Empirical Uncertain Bayes Methods in Area‐level Models

Random effects model can account for the lack of fitting a regression model and increase precision of estimating area‐level means. However, in case that the synthetic mean provides accurate estimates, the prior distribution may inflate an estimation error. Thus, it is desirable to consider the uncertain prior distribution, which is expressed as the mixture of a one‐point distribution and a proper prior distribution. In this paper, we develop an empirical Bayes approach for estimating area‐level means, using the uncertain prior distribution in the context of a natural exponential family, which we call the empirical uncertain Bayes (EUB) method. The regression model considered in this paper includes the Poisson‐gamma and the binomial‐beta, and the normal‐normal (Fay–Herriot) model, which are typically used in small area estimation. We obtain the estimators of hyperparameters based on the marginal likelihood by using a well‐known expectation‐maximization algorithm and propose the EUB estimators of area means. For risk evaluation of the EUB estimator, we derive a second‐order unbiased estimator of a conditional mean squared error by using some techniques of numerical calculation. Through simulation studies and real data applications, we evaluate a performance of the EUB estimator and compare it with the usual empirical Bayes estimator.     

Monte Carlo Simulation Study of Biased Estimators in the Linear Regression Models with Correlated or Heteroscedastic Errors

In this study, the performance of the estimators proposed in the presence of multicollinearity in the linear regression model with heteroscedastic or correlated or both error terms is investigated under the matrix mean square error criterion. Structures of the autocorrelated error terms are given and a Monte Carlo simulation study is conducted to examine the relative efficiency of the estimators against each other.     

Relative Errors of Difference-Based Variance Estimators in Nonparametric Regression

Difference-based estimators for the error variance are popular since they do not require the estimation of the mean function. Unlike most existing difference-based estimators, new estimators proposed by Müller et al. (2003 Müller , U. , Schick , A. , Wefelmeyer , W. ( 2003 ). Estimating the error variance in nonparametric regression by a covariate-matched U-statistic . Statistics 37 : 179 – 188 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and Tong and Wang (2005 Tong , T. , Wang , Y. ( 2005 ). Estimating residual variance in nonparametric regression using least squares . Biometrika 92 : 821 – 830 .[Crossref], [Web of Science ®] , [Google Scholar]) achieved the asymptotic optimal rate as residual-based estimators. In this article, we study the relative errors of these difference-based estimators which lead to better understanding of the differences between them and residual-based estimators. To compute the relative error of the covariate-matched U-statistic estimator proposed by Müller et al. (2003 Müller , U. , Schick , A. , Wefelmeyer , W. ( 2003 ). Estimating the error variance in nonparametric regression by a covariate-matched U-statistic . Statistics 37 : 179 – 188 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), we develop a modified version by using simpler weights. We further investigate its asymptotic property for both equidistant and random designs and show that our modified estimator is asymptotically efficient.     

Linear Models with Doubly Exchangeable Distributed Errors

We study the general linear model (GLM) with doubly exchangeable distributed error for m observed random variables. The doubly exchangeable general linear model (DEGLM) arises when the m-dimensional error vectors are “doubly exchangeable,” jointly normally distributed, which is a much weaker assumption than the independent and identically distributed error vectors as in the case of GLM or classical GLM (CGLM). We estimate the parameters in the model and also find their distributions. We show that the tests of intercept and slope are possible in DEGLM as a particular case using parametric bootstrap as well as multivariate Satterthwaite approximation.     

Bayes and Empirical Bayes Estimation of the Parameter n in a Binomial Distribution

The problem of estimating the total number of trials n in a binomial distribution is reconsidered in this article for both cases of known and unknown probability of success p from the Bayesian viewpoint. Bayes and empirical Bayes point estimates for n are proposed under the assumption of a left-truncated prior distribution for n and a beta prior distribution for p. Simulation studies are provided in this article in order to compare the proposed estimate with the most familiar n estimates.     

Local Likelihood Estimation in Generalized Additive Models

ABSTRACT.  Generalized additive models are a popular class of multivariate non-parametric regression models, due in large part to the ease of use of the local scoring estimation algorithm. However, the theoretical properties of the local scoring estimator are poorly understood. In this article, we propose a local likelihood estimator for generalized additive models that is closely related to the local scoring estimator fitted by local polynomial regression. We derive the statistical properties of the estimator and show that it achieves the same asymptotic convergence rate as a one-dimensional local polynomial regression estimator. We also propose a wild bootstrap estimator for calculating point-wise confidence intervals for the additive component functions. The practical behaviour of the proposed estimator is illustrated through a simulation experiment.     

Some Classes of Estimators for Median Estimation in Survey Sampling

In this article, we have suggested some classes of estimators for estimating finite population median using information on an auxiliary variable. To study the properties of suggested classes of estimators under large sample approximation, a generalized class of estimators has been suggested with its properties. It has been shown that the suggested classes of estimators are more efficient than other existing estimators. The results have been illustrated through an empirical study.     

Models with Errors due to Misreported Measurements

Measurement error and misclassification models feature prominently in the literature. This paper describes misreporting error, which can be considered to fall somewhere between these two broad types of model. Misreporting is concerned with situations where a continuous random variable X is measured with error and only reported as the discrete random variable Z. Data grouping or rounding are the simplest examples of this, but more generally X may be reported as a value z of Z which refers to a different interval from the one in which X lies. The paper discusses a method for handling misreported data and draws links with measurement error and misclassification models. A motivating example is considered from a prenatal Down's syndrome screening, where the gestational age at which mothers present for screening is a true continuous variable but is misreported because it is only ever observed as a discrete whole number of weeks which may in fact be in error. The implications this misreporting might have for the screening are investigated.