Generalized Kerridge’s inaccuracy measure for conditionally specified models

Recently, conditional Renyi’s divergence of order α and Kerridge’s inaccuracy measures are studied by Navarro et al. (2014 Navarro, J., Sunoj, S.M., Linu, M.N. (2014). Characterizations of bivariate models using some dynamic conditional information divergence measures. Commun. Stat. Theory Methods 43:1939–1948.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). In the present article, a generalized dynamic conditional Kerridge’s inaccuracy measure is introduced, which can be represented as the sum of conditional Renyi’s divergence and Renyi’s entropy. Some useful bounds are obtained using the concept of likelihood ratio order. The results are extended to weighted distributions. Sufficient conditions are obtained for the monotonicity of the proposed measure. Characterizations for bivariate exponential conditional distribution are presented based on the proposed measure.     

Influence Measures Based on Cressie-Read Divergence Measures in Multivariate Linear Model

We define a new family of influence measures based on the divergence measures, in the multivariate general linear model. Influence measures are obtained by quantifying the divergence between the sample distribution of an estimate obtained with all the observations and the sample distribution of the same estimate obtained without any observation. This approach is applied to best linear unbiased estimates of estimable functions. Therefore, these diagnostics can be applied to every statistical multivariate technique that can be formulated like this kind of model. Some examples are considered to clarify the applicability of the introduced diagnostics.     

Bayesian analysis of outlier problems using divergence measures

A Bayesian approach is presented for detecting influential observations using general divergence measures on the posterior distributions. A sampling-based approach using a Gibbs or Metropolis-within-Gibbs method is used to compute the posterior divergence measures. Four specific measures are proposed, which convey the effects of a single observation or covariate on the posterior. The technique is applied to a generalized linear model with binary response data, an overdispersed model and a nonlinear model. An asymptotic approximation using Laplace method to obtain the posterior divergence is also briefly discussed.     

A NEW FAMILY OF DIVERGENCE MEASURES FOR TESTS OF FIT

The aim of this work is to investigate a new family of divergence measures based on the recently introduced Basu, Harris, Hjort and Jones (BHHJ) measure of divergence (Biometrika 85 , 549–559). The new family is investigated in connection with hypothesis testing problems, and new test statistics are proposed. Simulations are performed to check the appropriateness of the proposed test statistics.     

Robust estimation for zero-inflated poisson autoregressive models based on density power divergence

In this study, we consider a robust estimation for zero-inflated Poisson autoregressive models using the minimum density power divergence estimator designed by Basu et al. [Robust and efficient estimation by minimising a density power divergence. Biometrika. 1998;85:549–559]. We show that under some regularity conditions, the proposed estimator is strongly consistent and asymptotically normal. The performance of the estimator is evaluated through Monte Carlo simulations. A real data analysis using New South Wales crime data is also provided for illustration.     

Testing hypotheses in truncated samples by means of divergence statistics

In this paper we consider the problem of testing hypotheses in parametric models, when only the first r (of n) ordered observations are known.Using divergence measures, a procedure to test statistical hypotheses is proposed, Replacing the parameters by suitable estimators in the expresion of the divergence measure, the test statistics are obtained.Asymptotic distributions for these statistics are given in several cases when maximum likelihood estimators for truncated samples are considered.Applications of these results in testing statistical hypotheses, on the basis of truncated data, are presented.The small sample behavior of the proposed test statistics is analyzed in particular cases.A comparative study of power values is carried out by computer simulation.     

A model selection criterion based on the BHHJ measure of divergence

The aim of this work is the discussion and investigation of measures of divergence and model selection criteria. A recently introduced measure of divergence, the so-called BHHJ measure (Basu, A., Harris, I.R., Hjort, N.L., Jones, M.C., 1998. Robust and efficient estimation by minimising a density power divergence. Biometrika 85, 549–559) is investigated and a new model selection criterion the divergence information criterion (DIC) based on this measure is proposed. Simulations are performed to check the appropriateness of the proposed criterion.     

Criteria for Linear Model Selection Based on Kullback's Symmetric Divergence

Model selection criteria are frequently developed by constructing estimators of discrepancy measures that assess the disparity between the 'true' model and a fitted approximating model. The Akaike information criterion (AIC) and its variants result from utilizing Kullback's directed divergence as the targeted discrepancy. The directed divergence is an asymmetric measure of separation between two statistical models, meaning that an alternative directed divergence can be obtained by reversing the roles of the two models in the definition of the measure. The sum of the two directed divergences is Kullback's symmetric divergence. In the framework of linear models, a comparison of the two directed divergences reveals an important distinction between the measures. When used to evaluate fitted approximating models that are improperly specified, the directed divergence which serves as the basis for AIC is more sensitive towards detecting overfitted models, whereas its counterpart is more sensitive towards detecting underfitted models. Since the symmetric divergence combines the information in both measures, it functions as a gauge of model disparity which is arguably more balanced than either of its individual components. With this motivation, the paper proposes a new class of criteria for linear model selection based on targeting the symmetric divergence. The criteria can be regarded as analogues of AIC and two of its variants: 'corrected' AIC or AICc and 'modified' AIC or MAIC. The paper examines the selection tendencies of the new criteria in a simulation study and the results indicate that they perform favourably when compared to their AIC analogues.     

Tail-weighted measures of dependence

Multivariate copula models are commonly used in place of Gaussian dependence models when plots of the data suggest tail dependence and tail asymmetry. In these cases, it is useful to have simple statistics to summarize the strength of dependence in different joint tails. Measures of monotone association such as Kendall's tau and Spearman's rho are insufficient to distinguish commonly used parametric bivariate families with different tail properties. We propose lower and upper tail-weighted bivariate measures of dependence as additional scalar measures to distinguish bivariate copulas with roughly the same overall monotone dependence. These measures allow the efficient estimation of strength of dependence in the joint tails and can be used as a guide for selection of bivariate linking copulas in vine and factor models as well as for assessing the adequacy of fit of multivariate copula models. We apply the tail-weighted measures of dependence to a financial data set and show that the measures better discriminate models with different tail properties compared to commonly used risk measures – the portfolio value-at-risk and conditional tail expectation.     

On generalized variance of product of powered components and multiple stable Tweedie models

A flexible family of multivariate models, named multiple stable Tweedie (MST) models, is introduced and produces generalized variance functions which are products of powered components of the mean. These MST models are built from a fixed univariate stable Tweedie variable having a positive value domain, and the remaining random variables given the fixed one are also real independent Tweedie variables, with the same dispersion parameter equal to the fixed component. In this huge family of MST models, generalized variance estimators are explicitly pointed out by maximum likelihood method and, moreover, computably presented for the uniform minimum variance and unbiased approach. The second estimator is brought from modified Lévy measures of MST which lead to some solutions of particular Monge–Ampère equations.     

Uncertainty,information, and disagreement of economic forecasters

ABSTRACT

An information framework is proposed for studying uncertainty and disagreement of economic forecasters. This framework builds upon the mixture model of combining density forecasts through a systematic application of the information theory. The framework encompasses the measures used in the literature and leads to their generalizations. The focal measure is the Jensen–Shannon divergence of the mixture which admits Kullback–Leibler and mutual information representations. Illustrations include exploring the dynamics of the individual and aggregate uncertainty about the US inflation rate using the survey of professional forecasters (SPF). We show that the normalized entropy index corrects some of the distortions caused by changes of the design of the SPF over time. Bayesian hierarchical models are used to examine the association of the inflation uncertainty with the anticipated inflation and the dispersion of point forecasts. Implementation of the information framework based on the variance and Dirichlet model for capturing uncertainty about the probability distribution of the economic variable are briefly discussed.     

Bayesian inference and diagnostics in zero-inflated generalized power series regression model

ABSTRACT

The paper provides a Bayesian analysis for the zero-inflated regression models based on the generalized power series distribution. The approach is based on Markov chain Monte Carlo methods. The residual analysis is discussed and case-deletion influence diagnostics are developed for the joint posterior distribution, based on the ψ-divergence, which includes several divergence measures such as the Kullback–Leibler, J-distance, L₁ norm, and χ²-square in zero-inflated general power series models. The methodology is reflected in a data set collected by wildlife biologists in a state park in California.     

Tests for Bivariate Symmetry Against Ordered Alternatives in Square Contingency Tables

Let X and Y denote two ordinal response variables, each having I levels. When subjects are classified on both variables, there are I 2 possible combinations of classifications. Let pij = Pr (X = i, Y = j) . This paper introduces a family of tests based on φ –divergence measures for testing H₀: pij = pji against H1: pij ≥ pji (I≥ j) ; and for testing H1 against H2: pij unrestricted. A simulation study assesses some of the family of tests introduced in this paper in comparison to the likelihood ratio test.     

Selecting and checking a binomial response generalized linear model using phi-divergences

This work introduces specific tools based on phi-divergences to select and check generalized linear models with binary data. A backward selection criterion that helps to reduce the number of explanatory variables is considered. Diagnostic methods based on divergence measures such as a new measure to detect leverage points and two indicators to detect influential points are introduced. As an illustration, the diagnostics are applied to human psychology data.     

A general long-term aging model with different underlying activation mechanisms: Modeling,Bayesian estimation,and case influence diagnostics

In this paper we propose a general cure rate aging model. Our approach enables different underlying activation mechanisms which lead to the event of interest. The number of competing causes of the event of interest is assumed to follow a logarithmic distribution. The model is parameterized in terms of the cured fraction which is then linked to covariates. We explore the use of Markov chain Monte Carlo methods to develop a Bayesian analysis for the proposed model. Moreover, some discussions on the model selection to compare the fitted models are given, as well as case deletion influence diagnostics are developed for the joint posterior distribution based on the ψ-divergence, which has several divergence measures as particular cases, such as the Kullback–Leibler (K-L), J-distance, L₁ norm, and χ²-square divergence measures. Simulation studies are performed and experimental results are illustrated based on a real malignant melanoma data.     

On estimation and influence diagnostics for log-Birnbaum–Saunders Student-t regression models: Full Bayesian analysis

The purpose of this paper is to develop a Bayesian approach for log-Birnbaum–Saunders Student-t regression models under right-censored survival data. Markov chain Monte Carlo (MCMC) methods are used to develop a Bayesian procedure for the considered model. In order to attenuate the influence of the outlying observations on the parameter estimates, we present in this paper Birnbaum–Saunders models in which a Student-t distribution is assumed to explain the cumulative damage. Also, some discussions on the model selection to compare the fitted models are given and case deletion influence diagnostics are developed for the joint posterior distribution based on the Kullback–Leibler divergence. The developed procedures are illustrated with a real data set.     

Decomposable pseudodistances and applications in statistical estimation

The aim of this paper is to introduce new statistical criteria for estimation, suitable for inference in models with common continuous support. This proposal is in the direct line of a renewed interest for divergence based inference tools imbedding the most classical ones, such as maximum likelihood, Chi-square or Kullback–Leibler. General pseudodistances with decomposable structure are considered, they allowing defining minimum pseudodistance estimators, without using nonparametric density estimators. A special class of pseudodistances indexed by α>0$\alpha >0$, leading for α↓0$\alpha \downarrow 0$ to the Kullback–Leibler divergence, is presented in detail. Corresponding estimation criteria are developed and asymptotic properties are studied. The estimation method is then extended to regression models. Finally, some examples based on Monte Carlo simulations are discussed.     

On estimating extremal dependence structures by parametric spectral measures

Estimation of extreme value copulas is often required in situations where available data are sparse. Parametric methods may then be the preferred approach. A possible way of defining parametric families that are simple and, at the same time, cover a large variety of multivariate extremal dependence structures is to build models based on spectral measures. This approach is considered here. Parametric families of spectral measures are defined as convex hulls of suitable basis elements, and parameters are estimated by projecting an initial nonparametric estimator on these finite-dimensional spaces. Asymptotic distributions are derived for the estimated parameters and the resulting estimates of the spectral measure and the extreme value copula. Finite sample properties are illustrated by a simulation study.     

Quantile-based cumulative Kullback–Leibler divergence

The paper introduces a quantile-based cumulative Kullback–Leibler divergence and study its various properties. Unlike the distribution function approach, the quantile-based measure possesses some unique properties. The quantile functions used in many applied works do not have any tractable distribution functions where the proposed measure is a useful tool to compute the distance between two random variables. Some useful bounds are obtained for quantile-based residual cumulative Kullback–Leibler divergence and quantile-based reliability measures. Characterization results based on the functional forms of quantile-based residual Kullback–Leibler divergence are obtained for some well-known life distributions, namely exponential, Pareto II and beta.