A random weighting approach for posterior distributions

ABSTRACT

In Bayesian theory, calculating a posterior probability distribution is highly important but typically difficult. Therefore, some methods have been proposed to deal with such problem, among which, the most popular one is the asymptotic expansions of posterior distributions. In this paper, we propose an alternative approach, named a random weighting method, for scaled posterior distributions, and give an ideal convergence rate, o(n^{( ? 1/2)}), which serves as the theoretical guarantee for methods of numerical simulations.     

Laplace approximations to means and variances with asymptotic modes

The moment-generating function method, which is proposed by Tierney et al. [1989a. Fully exponential Laplace approximations to expectations and variances of nonpositive functions. J. Amer. Statist. Assoc. 84, 710–716], is an asymptotic technique of approximating a posterior mean of a general function by approximating the moment-generating function (MGF), and then differentiating it. In this article, we give approximations to the posterior means and variances by combining the MGF method and the Laplace approximations with asymptotic modes. We prove that asymptotic errors of the approximate means and variances are of order n^-2$n^{-2}$ and of order n^-3$n^{-3}$, respectively. Our approximation is closely related to a standard-form approximation, and is given without evaluating the exact posterior mode and third derivatives of the log-likelihood function. The MGF method also improves numerical instability of the fully exponential Laplace approximation for a predictive mean in logistic regression.     

A Note on Asymptotic Behavior of the Nonparametric Density Estimators in Multivariate Mixtures

The asymptotic behavior of the nonparametric density estimator has been given for a multivariate mixture model. It has been observed that the estimator is asymptotically normally distributed with bias of size h ² and variance of size (nh)^?1.     

Asymptotic Expansion of the Non Null Distribution of the Two-Sample t-Statistic Under Non Normality with Application in Power Comparison

This article studies the non null distribution of the two-sample t-statistic, or Welch statistic, under non normality. The asymptotic expansion of the non null distribution is derived up to n ^?1, where n is the pooled sample size, under general conditions. It is used to compare the power with that obtained by normal theory method. A simple technique is recommended to achieve more power through a monotone transformation in practice.     

Distributional Studies and the Computer: An Analysis of Durbin's Rank Test

A study of the distribution of a statistic involves two major steps: (a) working out its asymptotic, large n, distribution, and (b) making the connection between the asymptotic results and the distribution of the statistic for the sample sizes used in practice. This crucial second step is not included in many studies. In this article, the second step is applied to Durbin's (1951) well-known rank test of treatment effects in balanced incomplete block designs (BIB's). We found that asymptotic, χ², distributions do not provide adequate approximations in most BIB's. Consequently, we feel that several of Durbin's recommendations should be altered.     

Approximate Bayesianity of Frequentist Confidence Intervals for a Binomial Proportion

The well-known Wilson and Agresti–Coull confidence intervals for a binomial proportion p are centered around a Bayesian estimator. Using this as a starting point, similarities between frequentist confidence intervals for proportions and Bayesian credible intervals based on low-informative priors are studied using asymptotic expansions. A Bayesian motivation for a large class of frequentist confidence intervals is provided. It is shown that the likelihood ratio interval for p approximates a Bayesian credible interval based on Kerman’s neutral noninformative conjugate prior up to O(n^{? 1}) in the confidence bounds. For the significance level α ? 0.317, the Bayesian interval based on the Jeffreys’ prior is then shown to be a compromise between the likelihood ratio and Wilson intervals. Supplementary materials for this article are available online.     

A class of small deviation theorems for the random variables associated with mth-order asymptotic circular Markov chains

ABSTRACT

In this article, we study a class of small deviation theorems for the random variables associated with mth-order asymptotic circular Markov chains. First, the definition of mth-order asymptotic circular Markov chain is introduced, then by applying the known results of the limit theorem for mth-order non homogeneous Markov chain, the small deviation theorem on the frequencies of occurrence of states for mth-order asymptotic circular Markov chains is established. Next, the strong law of large numbers and asymptotic equipartition property for this Markov chains are obtained. Finally, some results of mth-order nonhomogeneous Markov chains are given.     

SKEWNESS FOR PARAMETERS IN GENERALIZED LINEAR MODELS

In this paper we give an asymptotic formula of order n ^?1/2, where n is the sample size, for the skewness of the distribution of the maximum likelihood estimates of the linear parameters in generalized linear models. The formula is given in matrix notation and is very suitable for computer implementation. Several special cases are discussed. We also give asymptotic formulae for the skewness of the distribution of the maximum likelihood estimates of the dispersion and precision parameters.     

Empirical Bayes Testing for the Mean Lifetime of Exponential Distributions: Unequal Sample Sizes Case

This paper deals with an empirical Bayes testing problem for the mean lifetimes of exponential distributions with unequal sample sizes. We study a method to construct empirical Bayes tests {δ* _nl + 1,n }^∞ _n = 1 for the sequence of the testing problems. The asymptotic optimality of {δ* _nl + 1,n }^∞ _n = 1 is studied. It is shown that the sequence of empirical Bayes tests {δ* _nl + 1,n }^∞ _n = 1 is asymptotically optimal, and its associated sequence of regrets converges to zero at a rate (ln n)^4M?1/n, where M is an upper bound of sample sizes.     

Asymptotic Expansion and Conditional Robustness for the Sample Multiple Correlation Coefficient Under Nonnormality

ABSTRACT

Asymptotic distributions of the standardized estimators of the squared and non squared multiple correlation coefficients under nonnormality were obtained using Edgeworth expansion up to O(1/n). Conditions for the normal-theory asymptotic biases and variances to hold under nonnormality were derived with respect to the parameter values and the weighted sum of the cumulants of associated variables. The condition for the cumulants indicates a compensatory effect to yield the robust normal-theory lower-order cumulants. Simulations were performed to see the usefulness of the formulas of the asymptotic expansions using the model with the asymptotic robustness under nonnormality, which showed that the approximations by Edgeworth expansions were satisfactory.     

Some asymptotic distribution results in time-sequential estimation of the mean exponential survival time

The asymptotic distribution of the stopping time N in a time-sequential procedure for the estimation of the mean exponential survival time given by Gardiner, Susarla, and van Ryzin (1986) is obtained. The same techniques used to obtain this asymptotic distribution of N are used to obtain the asymptotic distribution of the statistic representing the time-on-test expended per unit item in the study.     

The Recursive Kernel Distribution Function Estimator Based on Negatively and Positively Associated Sequences

Let {X _j , j ≥ 1} be a strictly stationary negatively or positively associated sequence of real valued random variables with unknown distribution function F(x). On the basis of the random variables {X _j , j ≥ 1}, we propose a smooth recursive kernel-type estimate of F(x), and study asymptotic bias, quadratic-mean consistency and asymptotic normality of the recursive kernel-type estimator under suitable conditions.     

On Tests of Uniformity for Randomly Distributed Arcs on a Circle

Let n points be independently distributed on a circle. Moving in a counter-clockwise direction, place arcs of length a on the circle with the i^th are starting at the i^th point. We describe three simple tests of the hypothesis of uniformity based on vacancy, on number of spacings and on the length of the maximal spacing. The tests do not require knowledge of the random points. The asymptotic power of these tests is investigated, and it is shown that vacancy-based tests perform best of the three.     

An Adaptive Test for the Two-Sample Location Problem Based on U-Statistics

For the two-sample location problem with continuous data we consider a general class of tests, all members of it are based on U-statistics. The asymptotic efficacies are investigated in detail. We construct an adaptive test where all statistics involved are suitably chosen U-statistics. It is shown that the proposed adaptive test has good asymptotic and finite sample power properties.     

High dimensional asymptotics for the naive Hotelling T2 statistic in pattern recognition

Abstract

This paper examines the high dimensional asymptotics of the naive Hotelling T² statistic. Naive Bayes has been utilized in high dimensional pattern recognition as a method to avoid singularities in the estimated covariance matrix. The naive Hotelling T² statistic, which is equivalent to the estimator of the naive canonical correlation, is a statistically important quantity in naive Bayes and its high dimensional behavior has been studied under several conditions. In this paper, asymptotic normality of the naive Hotelling T² statistic under a high dimension low sample size setting is developed using the central limit theorem of a martingale difference sequence.     

Empirical Bayes testing for guarantee lifetime: Non identical components case

This article considers an empirical Bayes testing problem for the guarantee lifetime in the two-parameter exponential distributions with non identical components. We study a method of constructing empirical Bayes tests under a class of unknown prior distributions for the sequence of the component testing problems. The asymptotic optimality of the sequence of empirical Bayes tests is studied. Under certain regularity conditions on the prior distributions, it is shown that the sequence of the constructed empirical Bayes tests is asymptotically optimal, and the associated sequence of regrets converges to zero at a rate O(n^{? 1 + 1/[2(r + α) + 1]}) for some integer r ? 0 and 0 ? α ? 1 depending on the unknown prior distributions, where n is the number of past data available when the (n + 1)st component testing problem is considered.     

On Non-Normal Invariance Principles for Multi-Response Permutation Procedures

A non-normal invariance principle is established for a restricted class of univariate multi-response permutation procedures whose distance measure is the square of Euclidean distance. For observations from a distribution with finite second moment, the test statistic is found asymptotically to have a centered chi-squared distribution. Spectral expansions are used to determine the asymptotic distribution for more general distance measures d, and it is shown that if d(x, y) = |x — y|^u, u? 2, the asymptotic distribution is not invariant (i.e. it is dependent on the distribution of the observations).     

Small -sample comparison of the exact and symptotic upper tail probabilitiesof chi-squared goodness -of-fit statistics: pearson's x 2,likelihood ratio,and power-divergence statistic(λ = 2/3)

The exact and asymptotic upper tail probabilities ( α= .l0, .05, .01, .001) of the three chi-squared goodness-of-fit statistics Pearson's X ², likelihood ratioG ², and power-divergence statisticD ² (λ ) , with λ = 2/3, are compared numerically for simple null hypotheses not involving parameter estimation. Three types of such hypotheses were investigated (equal cell probabilities, proportional cell probabilities, some fixed small expectations together with some increasing large expectations) for the number of cells being between 3 and 15, and for sample sizes from 10 to 40, increasing by steps of one. Rating the relative accuracy of the chi-squared approximation in terms of ±10% and ±20% intervals around α led to the following conclusions: 1. Using G ² is not recommended. 2 . At the more relevant significance levels α = .10 and α = .05X ² should be preferred over D ². Solely in case of unequal cell probabilitiesD ² is the better choice at α = .O1 and α = .001. 3 . Yarnold's (1970; Journal of the Amerin Statistical Association, 65, 864-886) rule for the minimum expectation when using X ² ("If the number of cells k is 3 or more, and if r denotes the number of expectations less than 5, then the minimum expectation may be as small as 5r/k.") generalizes to D ²; it gives a good lower limit for the expected cell frequencies, however, when the number of cells is greater than 3. For k = 3 , even sample sizes over 15 may be insufficient.     

Two-stage generalized moment method approach for bidimensional random coefficient autoregressive models

ABSTRACT

A two-dimensionally indexed random coefficients autoregressive models (2D ? RCAR) and the corresponding statistical inference are important tools for the analysis of spatial lattice data. The study of such models is motivated by their second-order properties that are similar to those of 2D ? (G)ARCH which play an important role in spatial econometrics. In this article, we study the asymptotic properties of two-stage generalized moment method (2S ? GMM) under general asymptotic framework for 2D ? RCA models. So, the efficiency, strong consistency, the asymptotic normality, and hypothesis tests of 2S ? GMM estimation are derived. A simulation experiment is presented to highlight the theoretical results.     

Stepanov-like almost automorphic solutions for stochastic differential equations with Lévy noise

In this paper, we introduce a new concept of Poisson Stepanov-like almost automorphy (or Poisson S²-almost automorphy). Under some suitable conditions on the coefficients, we establish the existence and uniqueness of Stepanov-like almost automorphic mild solution to a class of semilinear stochastic differential equations with infinite dimensional Lévy noise. We further discuss the global asymptotic stability of these solution. Finally, we give an example to illustrate the theoretical results obtained in this paper.