A Bayesian analysis of frequency count data

The zero truncated inverse Gaussian–Poisson model, obtained by first mixing the Poisson model assuming its expected value has an inverse Gaussian distribution and then truncating the model at zero, is very useful when modelling frequency count data. A Bayesian analysis based on this statistical model is implemented on the word frequency counts of various texts, and its validity is checked by exploring the posterior distribution of the Pearson errors and by implementing posterior predictive consistency checks. The analysis based on this model is useful because it allows one to use the posterior distribution of the model mixing density as an approximation of the posterior distribution of the density of the word frequencies of the vocabulary of the author, which is useful to characterize the style of that author. The posterior distribution of the expectation and of measures of the variability of that mixing distribution can be used to assess the size and diversity of his vocabulary. An alternative analysis is proposed based on the inverse Gaussian-zero truncated Poisson mixture model, which is obtained by switching the order of the mixing and the truncation stages. Even though this second model fits some of the word frequency data sets more accurately than the first model, in practice the analysis based on it is not as useful because it does not allow one to estimate the word frequency distribution of the vocabulary.     

Matrix variate Cauchy distribution

In this article we introduce the matrix variate Cauchy distribution. Its density function has been derived using independent random matrices having dependent normal entries. Some properties of this distribution are also studied.     

Applied Nonparametric Instrumental Variables Estimation

Instrumental variables are widely used in applied econometrics to achieve identification and carry out estimation and inference in models that contain endogenous explanatory variables. In most applications, the function of interest (e.g., an Engel curve or demand function) is assumed to be known up to finitely many parameters (e.g., a linear model), and instrumental variables are used to identify and estimate these parameters. However, linear and other finite‐dimensional parametric models make strong assumptions about the population being modeled that are rarely if ever justified by economic theory or other a priori reasoning and can lead to seriously erroneous conclusions if they are incorrect. This paper explores what can be learned when the function of interest is identified through an instrumental variable but is not assumed to be known up to finitely many parameters. The paper explains the differences between parametric and nonparametric estimators that are important for applied research, describes an easily implemented nonparametric instrumental variables estimator, and presents empirical examples in which nonparametric methods lead to substantive conclusions that are quite different from those obtained using standard, parametric estimators.     

Goodness-of-fit tests via ϕ-measures of divergence for censored data

Measures of divergence or discrepancy are used extensively in statistics in various fields. In this article, we are focusing on divergence measures that are based on a class of measures known as Csiszar's divergence measures. In particular, we propose a class of goodness-of-fit tests based on Csiszar's class of measures designed for censored survival or reliability data. Further, we derive the asymptotic distribution of the test statistic under simple and composite null hypotheses as well as under contiguous alternative hypotheses. Simulations are furnished and real data are analysed to show the performance of the proposed tests for different ?-divergence measures.     

An efficient Monte Carlo EM algorithm for Bayesian lasso

The lasso is a popular technique of simultaneous estimation and variable selection in many research areas. The marginal posterior mode of the regression coefficients is equivalent to estimates given by the non-Bayesian lasso when the regression coefficients have independent Laplace priors. Because of its flexibility of statistical inferences, the Bayesian approach is attracting a growing body of research in recent years. Current approaches are primarily to either do a fully Bayesian analysis using Markov chain Monte Carlo (MCMC) algorithm or use Monte Carlo expectation maximization (MCEM) methods with an MCMC algorithm in each E-step. However, MCMC-based Bayesian method has much computational burden and slow convergence. Tan et al. [An efficient MCEM algorithm for fitting generalized linear mixed models for correlated binary data. J Stat Comput Simul. 2007;77:929–943] proposed a non-iterative sampling approach, the inverse Bayes formula (IBF) sampler, for computing posteriors of a hierarchical model in the structure of MCEM. Motivated by their paper, we develop this IBF sampler in the structure of MCEM to give the marginal posterior mode of the regression coefficients for the Bayesian lasso, by adjusting the weights of importance sampling, when the full conditional distribution is not explicit. Simulation experiments show that the computational time is much reduced with our method based on the expectation maximization algorithm and our algorithms and our methods behave comparably with other Bayesian lasso methods not only in prediction accuracy but also in variable selection accuracy and even better especially when the sample size is relatively large.     

Entropy estimation and goodness-of-fit tests for the inverse Gaussian and Laplace distributions using paired ranked set sampling

ABSTRACT

In this paper, Vasicek [A test for normality based on sample entropy. J R Stat Soc Ser B. 1976;38:54–59] entropy estimator is modified using paired ranked set sampling (PRSS) method. Also, two goodness-of-fit tests using PRSS are suggested for the inverse Gaussian and Laplace distributions. The new suggested entropy estimator and goodness-of-fit tests using PRSS are compared with their counterparts using simple random sampling (SRS) via Monte Carlo simulations. The critical values of the suggested tests are obtained, and the powers of the tests based on several alternatives hypotheses using SRS and PRSS are calculated. It turns out that the proposed PRSS entropy estimator is more efficient than the SRS counterpart in terms of root mean square error. Also, the proposed PRSS goodness-of-fit tests have higher powers than their counterparts using SRS for all alternative considered in this study.     

Properties and applications of the Poisson-reciprocal inverse Gaussian distribution

The barely known continuous reciprocal inverse Gaussian distribution is used in this paper to introduce the Poisson-reciprocal inverse Gaussian discrete distribution. Several of its most relevant statistical properties are examined, some of them directly inherited from the reciprocal of the inverse Gaussian distribution. Furthermore, a mixed Poisson regression model that uses the reciprocal inverse Gaussian as mixing distribution is presented. Parameters estimation in this regression model is performed via an EM type algorithm. In light of the numerical results displayed in the paper, the distributions introduced in this work are competitive with the classical negative binomial and Poisson-inverse Gaussian distributions.     

Moments of nonparametric probability density functions of entropy estimators applied to testing the inverse Gaussian distribution

The inverse Gaussian (IG) distribution is widely used to model data and then it is important to develop efficient goodness of fit tests for this distribution. In this article, we introduce some new test statistics for examining the IG goodness of fit based on correcting moments of nonparametric probability density functions of entropy estimators. These tests are consistent against all alternatives. Critical points and power of the tests are explored by simulation. We show that the proposed tests are more powerful than competitor tests. Finally, the proposed tests are illustrated by real data examples.     

Bayesian inference using product of spacings function for Progressive hybrid Type-I censoring scheme

This article is devoted to the development of product of spacings estimator for a Progressive hybrid Type-I censoring scheme with binomial removals. The experimental units are assumed to follow inverse Lindley distribution. We propose a Bayes estimator of associated scale parameter based on the product of spacings function and simultaneously compare it with that obtained under a usual Bayesian estimation procedure. The estimators are obtained under the squared error loss function along with corresponding HP intervals evaluated by using the Markov chain Monte-Carlo technique. The classical product of spacings estimator has also been derived and compared with the maximum likelihood estimator in addition to 95% average asymptotic confidence intervals. The applicability of the proposed methods is demonstrated by analysing a real data of guinea pigs affected with tuberculosis for the considered censoring scheme.     

Extropy estimators with applications in testing uniformity

Two estimators for estimating the extropy of an absolutely continuous random variable with known support were introduced by using spacing. It is shown that the proposed estimators are consistent and their mean square errors are shift invariant. Their behaviours were also studied by means of real data and Monte Carlo simulation. The winner estimator of extropy in the Monte Carlo experiment was used to develop goodness-of-fit test for standard uniform distribution. It is shown that the extropy-based test that we proposed performs well by comparing its powers with that of other tests for uniformity.