Bayesian estimation methods for contingency tables

Summary A method of inputting prior opinion in contingency tables is described. The method can be used to incorporate beliefs of independence or symmetry but extensions are straightforward. Logistic normal distributions that express such beliefs are used as priors of the cell probabilities and posterior estimates are derived. Empirical Bayes methods are also discussed and approximate posterior variances are provided. The methods are illustrated by a numerical example.     

Empirical bayes shrinkage estimation of reliability in the exponential distribution

In this paper we propose two empirical Bayes shrinkage estimators for the reliability of the exponential distribution and study their properties. Under the uniform prior distribution and the inverted gamma prior distribution these estimators are developed and compared with a preliminary test estimator and with a shrinkage testimator in terms of mean squared error. The proposed empirical Bayes shrinkage estimator under the inverted gamma prior distribution is shown to be preferable to the preliminary test estimator and the shrinkage testimator when the prior value of mean life is clsoe to the true mean life.     

Whittemore's notion of collapsibility in multidimensional contingency tables

We develop simple necessary and sufficient conditions for a hierarchical log linear model to be strictly collapsible in the sense defined by Whittemore (1978). We then show that collapsibility as defined by Asmussen & Edwards (1983) can be viewed as equivalent to collapsibility as defined by Whittemore (1978) and illustrate why Bishop, Fienberg, & Holland's (1975, p.47) conditions for collapsibility are sufficient but not necessary. Finally, we discuss how collapsibility facilitates interpretation of certain hierarchical log linear models and formulation of hypotheses concerning marginal distributions associated with multidimensional contingency tables.     

Collapsibility of contingency tables based on conditional models

Strict collapsibility and model collapsibility are two important concepts associated with the dimension reduction of a multidimensional contingency table, without losing the relevant information. In this paper, we obtain some necessary and sufficient conditions for the strict collapsibility of the full model, with respect to an interaction factor or a set of interaction factors, based on the interaction parameters of the conditional/layer log-linear models. For hierarchical log-linear models, we present also necessary and sufficient conditions for the full model to be model collapsible, based on the conditional interaction parameters. We discuss both the cases where one variable or a set of variables is conditioned. The connections between the strict collapsibility and the model collapsibility are also pointed out. Our results are illustrated through suitable examples, including a real life application.     

Protection against outliers in empirical bayes estimation

The proven optimality properties of empirical Bayes estimators and their documented successful performance in practice have made them popular. Although many statisticians have used these estimators since the landmark paper of James and Stein (1961), relatively few have proposed techniques for protecting them from the effects of outlying observations or outlying parameters. One notable series of studies in protection against outlying parameters was conducted by Efron and Morris (1971, 1972, 1975). In the fully Bayesian case, a general discussion on robust procedures can be found in Berger (1984, 1985). Here we implement and evaluate a different approach for outlier protection in a random-effects model which is based on appropriate specification of the prior distribution. When unusual parameters are present, we estimate the prior as a step function, as suggested by Laird and Louis (1987). This procedure is evaluated empirically, using a number of simulated data sets to compare the effects of the step-function prior with those of the normal and Laplace priors on the prediction of small-area proportions.     

Empirical bayes estimation of binomial parameter with symmetric priors

This paper deals with the problem of estimating the binomial parameter via the nonparametric empirical Bayes approach. This estimation problem has the feature that estimators which are asymptotically optimal in the usual empirical Bayes sense do not exist (Robbins (1958, 1964)), However, as pointed out by Liang (1934) and Gupta and Liang (1988), it is possible to construct asymptotically optimal empirical Bayes estimators if the unknown prior is symmetric about the point 1/2, In this paper, assuming symmetric priors a monotone empirical Bayes estimator is constructed by using the isotonic regression method. This estimator is asymptotically optimal in the usual empirical Bayes sense. The corresponding rate of convergence is investigated and shown to be of order n^-1, where n is the number of past observations at hand.     

Empirical Bayes estimators in hierarchical models with mixture priors

We consider subgroup analyses within the framework of hierarchical modeling and empirical Bayes (EB) methodology for general priors, thereby generalizing the normal–normal model. By doing this one obtains greater flexibility in modeling. We focus on mixture priors, that is, on the situation where group effects are exchangeable within clusters of subgroups only. We establish theoretical results on accuracy, precision, shrinkage and selection bias of EB estimators under the general priors. The impact of model misspecification is investigated and the applicability of the methodology is illustrated with datasets from the (medical) literature.     

Empirical bayes approach to bayes sequential estimation: the poisson and bernoulli cases

The problem considered is the Bayes sequential estimation of the mean with quadratic loss and fixed cost per observation. Assume the prior distribution is not completely known. Some empirical Bayes procedures are proposed in the Poisson and Bernoulli cases, and they are shown to be asymptotically non-deficient in the sense of Woodroofe (1981).     

Empirical bayes estimation of a distribution function with a gamma process prior

A sequence of empirical Bayes estimators is given for estimating a distribution function. It is shown that ‘i’ this sequence is asymptotically optimum relative to a Gamma process prior, ‘ii’ the overall expected loss approaches the minimum Bayes risk at a rate of n , and ‘iii’ the estimators form a sequence of proper distribution functions. Finally, the numerical example presented by Susarla and Van Ryzin ‘Ann. Statist., 6, 1978’ reworked by Phadia ‘Ann. Statist., 1, 1980, to appear’ has been analyzed and the results are compared to the numerical results by Phadia     

Hierarchical bayes estimation of normal variances with application to a random effect model

The problem of simultaneously estimating p normal variances is investigated when the parameters are believed a priori to be similar in size. A hierarchical Bayes approach is employed and the resulting estimator is compared to common estimators used including one proposed by Box and Tiao (1973) using a Bayesian approach with a noninformative prior. The technique is then applied to estimate components of variance in the one way layout random effect model of the analysis of variance.     

Extended linear empirical bayes estimation

In this paper, the linear empirical Bayes estimation method, which is based on approximation of the Bayes estimator by a linear function, is generalized to an extended linear empirical Bayes estimation technique which represents the Bayes estimator by a series of algebraic polynomials. The extended linear empirical Bayes estimators are elaborated in the case of a location or a scale parameter. The theory is illustrated by examples of its application to the normal distribution with a location parameter and the gamma distribution with a scale parameter. The linear and the extended linear empirical Bayes estimators are constructed in these two cases and, then, studied numerically via Monte Carlo simulations. The simulations show that the extended linear empirical Bayes estimators have better convergence rates than the traditional linear empirical Bayes estimators.     

Statistical evidence in contingency tables analysis

The likelihood ratio is used for measuring the strength of statistical evidence. The probability of observing strong misleading evidence along with that of observing weak evidence evaluate the performance of this measure. When the corresponding likelihood function is expressed in terms of a parametric statistical model that fails, the likelihood ratio retains its evidential value if the likelihood function is robust [Royall, R., Tsou, T.S., 2003. Interpreting statistical evidence by using imperfect models: robust adjusted likelihood functions. J. Roy. Statist. Soc. Ser. B 65, 391–404]. In this paper, we extend the theory of Royall and Tsou [2003. Interpreting statistical evidence by using imperfect models: robust adjusted likelihood functions. J. Roy. Statist. Soc., Ser. B 65, 391–404] to the case when the assumed working model is a characteristic model for two-way contingency tables (the model of independence, association and correlation models). We observe that association and correlation models are not equivalent in terms of statistical evidence. The association models are bounded by the maximum of the bump function while the correlation models are not.     

Empirical bayes interval estimates involving uniform distributions

Bayesian and empirical Bayesian decision rules are exhibited for the interval estimation of the parameter 0 of a Uniform (0,θ) distribution. The estimate ?,δ>resulting in the interval [?,?+δ]suffers loss given by L(?,δ>,θ)=1-[?≦e≦?+δ]+c₁((?-θ)²+(?+δ?θ)²))+c₂δ. The solution is presented for prior distributions G which have bounded support, no point masses,∫θ^?mdG(θ)<∞ and for some integer m. An example is presented involving a particular parametric form for G and rates of risk convergence in the empirical Bayes problem for this example are calculated.     

Empiric bayes estimation of binomial probability

An empirical Bayes estimator of a binomial parameter, based on orthogonal polynomials on (0,1), is introduced. The resulting estimator of the prior density is asymptotically optimal. The method allows one to combine Bayes and empiric Bayes methods with smoothing in a natural way.     

On collapsing categories in two-way contingency tables

In this paper, we examine the relationships between log odds rate and various reliability measures such as hazard rate and reversed hazard rate in the context of repairable systems. We also prove characterization theorems for some families of distributions viz. Burr, Pearson and log exponential models. We discuss the properties and applications of log odds rate in weighted models. Further we extend the concept to the bivariate set up and study its properties.     

Nonparametrio bayes and empirical bayes estimation of the residual survival function at age t

Nonparametric Bayes and empirical Bayes estimations of the

survival function of a unit of age t (> 0) using Dirichlet

process prior are presented. The proposed empirical Bayes

estimators are found to be “asymptotically optimal” in the sense of Robbins (1955). The performances of the proposed

empirical Bayes estimators are compared with those of certain

rival estimators in terms of relative savings loss, The exact

expressions for Bayes risks are also provided in certain cases.     

Multidimensional contingency tables with missing data

This paper is concerned wim ine maximum likelihood estimation and the likelihood ratio test for hierarchical loglinear models of multidimensional contingency tables with missing data. The problems of estimation and test for a high dimensional contingency table can be reduced into those for a class of low dimensional tables. In some cases, the incomplete data in the high dimensional table can become complete in the low dimensional tables through the reduction can indicate how much the incomplete data contribute to the estimation and the test.     

Bayesian estimation of log odds ratios over two-way contingency tables with intraclass correlated cells

In this article, a Bayesian approach is proposed for the estimation of log odds ratios and intraclass correlations over a two-way contingency table, including intraclass correlated cells. Required likelihood functions of log odds ratios are obtained, and determination of prior structures is discussed. Hypothesis testing for log odds ratios and intraclass correlations by using the posterior simulations is outlined. Because the proposed approach includes no asymptotic theory, it is useful for the estimation and hypothesis testing of log odds ratios in the presence of certain intraclass correlation patterns. A family health status and limitations data set is analyzed by using the proposed approach in order to figure out the impact of intraclass correlations on the estimates and hypothesis tests of log odds ratios. Although intraclass correlations are small in the data set, we obtain that even small intraclass correlations can significantly affect the estimates and test results, and our approach is useful for the estimation and testing of log odds ratios in the presence of intraclass correlations.     

Empirical bayes estimation of the binomial parameter n

Estimation of the prior distribution of the binomial parameter nbased on a system of orthogonal polynomials, the Poisson-Charlier polynomials, is studied. It is shown that the resulting estimator is mean squared consistent with rate O(N ^ε-1), where Nis the sample size and ε> 0 is arbitrarily small.     

Modeling symmetry models in square contingency tables with ordered categories

This paper provides alternative methods for fitting symmetry and diagonal-parameters symmetry models to square tables having ordered categories. We demonstrate here the implementation of the class of models discussed in Goodman (1979c) using GEN-MOD in SAS. We also provide procedures for testing hypotheses involving model parameters. The methodology provided here can readily be used to fit the class of models discussed in Lawal and Upton (1995). If desired, composite models can be fitted. Two data sets, the 4 × 4 unaided distance vision of 4746 Japanese students Tomizawa (1985) and the 5 × 5 British social mobility data Glass (1954) are employed to demonstrate the fitting of these models. Results obtained are consistent with those from Goodman (1972, 1979c, 1986) and Tomizawa (1985, 1987).