Score tests for heterogeneity and overdispersion in zero‐inflated Poisson and binomial regression models

Hall (2000) has described zero‐inflated Poisson and binomial regression models that include random effects to account for excess zeros and additional sources of heterogeneity in the data. The authors of the present paper propose a general score test for the null hypothesis that variance components associated with these random effects are zero. For a zero‐inflated Poisson model with random intercept, the new test reduces to an alternative to the overdispersion test of Ridout, Demério & Hinde (2001). The authors also examine their general test in the special case of the zero‐inflated binomial model with random intercept and propose an overdispersion test in that context which is based on a beta‐binomial alternative.     

EXPONENTIAL SMOOTHING AND NON‐NEGATIVE DATA

The most common forecasting methods in business are based on exponential smoothing, and the most common time series in business are inherently non‐negative. Therefore it is of interest to consider the properties of the potential stochastic models underlying exponential smoothing when applied to non‐negative data. We explore exponential smoothing state space models for non‐negative data under various assumptions about the innovations, or error, process. We first demonstrate that prediction distributions from some commonly used state space models may have an infinite variance beyond a certain forecasting horizon. For multiplicative error models that do not have this flaw, we show that sample paths will converge almost surely to zero even when the error distribution is non‐Gaussian. We propose a new model with similar properties to exponential smoothing, but which does not have these problems, and we develop some distributional properties for our new model. We then explore the implications of our results for inference, and compare the short‐term forecasting performance of the various models using data on the weekly sales of over 300 items of costume jewelry. The main findings of the research are that the Gaussian approximation is adequate for estimation and one‐step‐ahead forecasting. However, as the forecasting horizon increases, the approximate prediction intervals become increasingly problematic. When the model is to be used for simulation purposes, a suitably specified scheme must be employed.     

Transmuted generalized exponential distribution: A generalization of the exponential distribution with applications to survival data

In this article, we investigate the potential usefulness of the three-parameter transmuted generalized exponential distribution for analyzing lifetime data. We compare it with various generalizations of the two-parameter exponential distribution using maximum likelihood estimation. Some mathematical properties of the new extended model including expressions for the quantile and moments are investigated. We propose a location-scale regression model, based on the log-transmuted generalized exponential distribution. Two applications with real data are given to illustrate the proposed family of lifetime distributions.     

Modeling data with a truncated and inflated Poisson distribution

Zero inflated Poisson regression is a model commonly used to analyze data with excessive zeros. Although many models have been developed to fit zero-inflated data, most of them strongly depend on the special features of the individual data. For example, there is a need for new models when dealing with truncated and inflated data. In this paper, we propose a new model that is sufficiently flexible to model inflation and truncation simultaneously, and which is a mixture of a multinomial logistic and a truncated Poisson regression, in which the multinomial logistic component models the occurrence of excessive counts. The truncated Poisson regression models the counts that are assumed to follow a truncated Poisson distribution. The performance of our proposed model is evaluated through simulation studies, and our model is found to have the smallest mean absolute error and best model fit. In the empirical example, the data are truncated with inflated values of zero and fourteen, and the results show that our model has a better fit than the other competing models.     

A generalized Bayesian nonlinear mixed‐effects regression model for zero‐inflated longitudinal count data in tuberculosis trials

In this paper, we investigate Bayesian generalized nonlinear mixed‐effects (NLME) regression models for zero‐inflated longitudinal count data. The methodology is motivated by and applied to colony forming unit (CFU) counts in extended bactericidal activity tuberculosis (TB) trials. Furthermore, for model comparisons, we present a generalized method for calculating the marginal likelihoods required to determine Bayes factors. A simulation study shows that the proposed zero‐inflated negative binomial regression model has good accuracy, precision, and credibility interval coverage. In contrast, conventional normal NLME regression models applied to log‐transformed count data, which handle zero counts as left censored values, may yield credibility intervals that undercover the true bactericidal activity of anti‐TB drugs. We therefore recommend that zero‐inflated NLME regression models should be fitted to CFU count on the original scale, as an alternative to conventional normal NLME regression models on the logarithmic scale.     

Objective Bayes Factors for Gaussian Directed Acyclic Graphical Models

Abstract. We propose an objective Bayesian method for the comparison of all Gaussian directed acyclic graphical models defined on a given set of variables. The method, which is based on the notion of fractional Bayes factor (BF), requires a single default (typically improper) prior on the space of unconstrained covariance matrices, together with a prior sample size hyper‐parameter, which can be set to its minimal value. We show that our approach produces genuine BFs. The implied prior on the concentration matrix of any complete graph is a data‐dependent Wishart distribution, and this in turn guarantees that Markov equivalent graphs are scored with the same marginal likelihood. We specialize our results to the smaller class of Gaussian decomposable undirected graphical models and show that in this case they coincide with those recently obtained using limiting versions of hyper‐inverse Wishart distributions as priors on the graph‐constrained covariance matrices.     

Absolute continuous bivariate generalized exponential distribution

Generalized exponential distribution has been used quite effectively to model positively skewed lifetime data as an alternative to the well known Weibull or gamma distributions. In this paper we introduce an absolute continuous bivariate generalized exponential distribution by using a simple transformation from a well known bivariate exchangeable distribution. The marginal distributions of the proposed bivariate generalized exponential distributions are generalized exponential distributions. The joint probability density function and the joint cumulative distribution function can be expressed in closed forms. It is observed that the proposed bivariate distribution can be obtained using Clayton copula with generalized exponential distribution as marginals. We derive different properties of this new distribution. It is a five-parameter distribution, and the maximum likelihood estimators of the unknown parameters cannot be obtained in closed forms. We propose some alternative estimators, which can be obtained quite easily, and they can be used as initial guesses to compute the maximum likelihood estimates. One data set has been analyzed for illustrative purposes. Finally we propose some generalization of the proposed model.     

The exponentiated power exponential regression model with different regression structures: application in nursing data

We define the exponentiated power exponential distribution and propose a regression model with different systematic structures based on the new distribution. We show that the new regression model can be applied to dispersion data since it represents a parametric family of models that includes as sub-models some widely-known regression models. It then can be used more effectively in the analysis of real data. We use maximum likelihood estimation and derive the appropriate matrices for assessing local influence on the parameter estimates under different perturbation schemes. Some global-influence measurements are also investigated and simulation studies are performed to evaluate the accuracy of the estimates. We provide an application of the regression model with four systematic structures to nursing activities score data in the Unit of the Medical Clinic of University of São Paulo (USP) Hospital.     

Independence Structure of Natural Conjugate Densities to Exponential Families and the Gibbs' Sampler

In this paper the independence between a block of natural parameters and the complementary block of mean value parameters holding for densities which are natural conjugate to some regular exponential families is used to design in a convenient way a Gibbs' sampler with block updates. Even when the densities of interest are obtained by conditioning to zero a block of natural parameters in a density conjugate to a larger "saturated" model, the updates require only the computation of marginal distributions under the "unconditional" density. For exponential families which are closed under marginalization, including both the zero mean Gaussian family and the cross-classified Bernoulli family such an implementation of the Gibbs' sampler can be seen as an Iterative Proportional Fitting algorithm with random inputs.     

Empirical Uncertain Bayes Methods in Area‐level Models

Random effects model can account for the lack of fitting a regression model and increase precision of estimating area‐level means. However, in case that the synthetic mean provides accurate estimates, the prior distribution may inflate an estimation error. Thus, it is desirable to consider the uncertain prior distribution, which is expressed as the mixture of a one‐point distribution and a proper prior distribution. In this paper, we develop an empirical Bayes approach for estimating area‐level means, using the uncertain prior distribution in the context of a natural exponential family, which we call the empirical uncertain Bayes (EUB) method. The regression model considered in this paper includes the Poisson‐gamma and the binomial‐beta, and the normal‐normal (Fay–Herriot) model, which are typically used in small area estimation. We obtain the estimators of hyperparameters based on the marginal likelihood by using a well‐known expectation‐maximization algorithm and propose the EUB estimators of area means. For risk evaluation of the EUB estimator, we derive a second‐order unbiased estimator of a conditional mean squared error by using some techniques of numerical calculation. Through simulation studies and real data applications, we evaluate a performance of the EUB estimator and compare it with the usual empirical Bayes estimator.     

A new bivariate distribution with weighted exponential marginals and its multivariate generalization

Gupta and Kundu (Statistics 43:621–643, 2009) recently introduced a new class of weighted exponential distribution. It is observed that the proposed weighted exponential distribution is very flexible and can be used quite effectively to analyze skewed data. In this paper we propose a new bivariate distribution with the weighted exponential marginals. Different properties of this new bivariate distribution have been investigated. This new family has three unknown parameters, and it is observed that the maximum likelihood estimators of the unknown parameters can be obtained by solving a one-dimensional optimization procedure. We obtain the asymptotic distribution of the maximum likelihood estimators. Small simulation experiments have been performed to see the behavior of the maximum likelihood estimators, and one data analysis has been presented for illustrative purposes. Finally we discuss the multivariate generalization of the proposed model.     

An F-type test for detecting departure from monotonicity in a functional linear model

When studying associations between a functional covariate and scalar response using a functional linear model (FLM), scientific knowledge may indicate possible monotonicity of the unknown parameter curve. In this context, we propose an F-type test of monotonicity, based on a full versus reduced nested model structure, where the reduced model with monotonically constrained parameter curve is nested within an unconstrained FLM. For estimation under the unconstrained FLM, we consider two approaches: penalised least-squares and linear mixed model effects estimation. We use a smooth then monotonise approach to estimate the reduced model, within the null space of monotone parameter curves. A bootstrap procedure is used to simulate the null distribution of the test statistic. We present a simulation study of the power of the proposed test, and illustrate the test using data from a head and neck cancer study.     

A Quasi‐Score Statistic for Homogeneity Testing against Covariate‐Varying Heterogeneity

In statistical modelling, it is often of interest to evaluate non‐negative quantities that capture heterogeneity in the population such as variances, mixing proportions and dispersion parameters. In instances of covariate‐dependent heterogeneity, the implied homogeneity hypotheses are nonstandard and existing inferential techniques are not applicable. In this paper, we develop a quasi‐score test statistic to evaluate homogeneity against heterogeneity that varies with a covariate profile through a regression model. We establish the limiting null distribution of the proposed test as a functional of mixtures of chi‐square processes. The methodology does not require the full distribution of the data to be entirely specified. Instead, a general estimating function for a finite dimensional component of the model, that is, of interest is assumed but other characteristics of the population are left completely unspecified. We apply the methodology to evaluate the excess zero proportion in zero‐inflated models for count data. Our numerical simulations show that the proposed test can greatly improve efficiency over tests of homogeneity that neglect covariate information under the alternative hypothesis. An empirical application to dental caries indices demonstrates the importance and practical utility of the methodology in detecting excess zeros in the data.     

An alternative skew exponential power distribution formulation

In this note we propose a newly formulated skew exponential power distribution that behaves substantially better than previously defined versions. This new model performs very well in terms of the large sample behavior of the maximum likelihood estimation procedure when compared to the classically defined four parameter model defined by Azzalini. More recently, approaches to defining a skew exponential power distribution have used five or more parameters. Our approach improves upon previous attempts to extend the symmetric power exponential family to include skew alternatives by maintaining a minimum set of four parameters corresponding directly to location, scale, skewness and kurtosis. We illustrate the utility of our proposed model using translational and clinical data sets.     

Bivariate discrete generalized exponential distribution

In this paper, we develop a bivariate discrete generalized exponential distribution, whose marginals are discrete generalized exponential distribution as proposed by Nekoukhou, Alamatsaz and Bidram [Discrete generalized exponential distribution of a second type. Statistics. 2013;47:876–887]. It is observed that the proposed bivariate distribution is a very flexible distribution and the bivariate geometric distribution can be obtained as a special case of this distribution. The proposed distribution can be seen as a natural discrete analogue of the bivariate generalized exponential distribution proposed by Kundu and Gupta [Bivariate generalized exponential distribution. J Multivariate Anal. 2009;100:581–593]. We study different properties of this distribution and explore its dependence structures. We propose a new EM algorithm to compute the maximum-likelihood estimators of the unknown parameters which can be implemented very efficiently, and discuss some inferential issues also. The analysis of one data set has been performed to show the effectiveness of the proposed model. Finally, we propose some open problems and conclude the paper.     

The VGAM package for negative binomial regression

Negative binomial (NB) regression is the most common full‐likelihood method for analysing count data exhibiting overdispersion with respect to the Poisson distribution. Usually most practitioners are content to fit one of two NB variants, however other important variants exist. It is demonstrated here that the VGAM R package can fit them all under a common statistical framework founded upon a generalised linear and additive model approach. Additionally, other modifications such as zero‐altered (hurdle), zero‐truncated and zero‐inflated NB distributions are naturally handled. Rootograms are also available for graphically checking the goodness of fit. Two data sets and some recently added features of the VGAM package are used here for illustration.     

Multimodal exponential families of circular distributions with application to daily peak hours of PM2.5 level in a large city

In this paper, we propose two multimodal circular distributions which are suitable for modeling circular data sets with two or more modes. Both distributions belong to the regular exponential family of distributions and are considered as extensions of the von Mises distribution. Hence, they possess the highly desirable properties, such as the existence of non-trivial sufficient statistics and optimal inferences for their parameters. Fine particulates (PM2.5) are generally emitted from activities such as industrial and residential combustion and from vehicle exhaust. We illustrate the utility of our proposed models using a real data set consisting of fine particulates (PM2.5) pollutant levels in Houston region during Fall season in 2019. Our results provide a strong evidence that its diurnal pattern exhibits four modes; two peaks during morning and evening rush hours and two peaks in between.     

Dealing with excess of zeros in the statistical analysis of magnetic resonance imaging lesion count in multiple sclerosis

Lesion count observed on brain magnetic resonance imaging scan is a common end point in phase 2 clinical trials evaluating therapeutic treatment in relapsing remitting multiple sclerosis (MS). This paper compares the performances of Poisson, zero‐inflated poisson (ZIP), negative binomial (NB), and zero‐inflated NB (ZINB) mixed‐effects regression models in fitting lesion count data in a clinical trial evaluating the efficacy and safety of fingolimod in comparison with placebo, in MS. The NB and ZINB models prove to be superior to the Poisson and ZIP models. We discuss the advantages and limitations of zero‐inflated models in the context of MS treatment. Copyright © 2012 John Wiley & Sons, Ltd.     

A generalization of discrete Weibull distribution

In this paper, we introduce a new family of discrete distributions and study its properties. It is shown that the new family is a generalization of discrete Marshall-Olkin family of distributions. In particular, we study generalized discrete Weibull distribution in detail. Discrete Marshall-Olkin Weibull distribution, exponentiated discrete Weibull distribution, discrete Weibull distribution, discrete Marshall-Olkin generalized exponential distribution, exponentiated geometric distribution, generalized discrete exponential distribution, discrete Marshall-Olkin Rayleigh distribution and exponentiated discrete Rayleigh distribution are sub-models of generalized discrete Weibull distribution. We derive some basic distributional properties such as probability generating function, moments, hazard rate and quantiles of the generalized discrete Weibull distribution. We can see that the hazard rate function can be decreasing, increasing, bathtub and upside-down bathtub shape. Estimation of the parameters are done using maximum likelihood method. A real data set is analyzed to illustrate the suitability of the proposed model.     

Forecasting Equity Premium: Global Historical Average Versus Local Historical Average and Constraints

The equity premium, return on equity minus return on risk-free asset, is expected to be positive. We consider imposing such positivity constraint in local historical average (LHA) in nonparametric kernel regression framework. It is also extended to the semiparametric single index model when multiple predictors are used. We construct the constrained LHA estimator via an indicator function which operates as “model-selection” between the unconstrained LHA and the bound of the constraint (zero for the positivity constraint). We smooth the indicator function by bagging, which operates as “model-averaging” and yields a combined forecast of unconstrained LHA forecasts and the bound of the constraint. The local combining weights are determined by the probability that the constraint is binding. Asymptotic properties of the constrained LHA estimators without and with bagging are established, which show how the positive constraint and bagging can help reduce the asymptotic variance and mean squared errors. Monte Carlo simulations are conducted to show the finite sample behavior of the asymptotic properties. In predicting U.S. equity premium, we show that substantial nonlinearity can be captured by LHA and that the local positivity constraint can improve out-of-sample prediction of the equity premium.