Goodness-of-fit tests via ϕ-measures of divergence for censored data

Measures of divergence or discrepancy are used extensively in statistics in various fields. In this article, we are focusing on divergence measures that are based on a class of measures known as Csiszar's divergence measures. In particular, we propose a class of goodness-of-fit tests based on Csiszar's class of measures designed for censored survival or reliability data. Further, we derive the asymptotic distribution of the test statistic under simple and composite null hypotheses as well as under contiguous alternative hypotheses. Simulations are furnished and real data are analysed to show the performance of the proposed tests for different ?-divergence measures.     

Exponentiality test based on alpha-divergence and gamma-divergence

In the present paper, we use the already defined alpha-divergence and gamma-divergence for constructing some goodness of fit tests for exponentiality. These divergence measures are very robust with respect to outliers. Since the existence of outliers among statistical data can be lead to misleading results, therefore utilizing these divergence measures can be of importance. In order to construct test statistics, two estimators are used for alpha-divergence and gamma-divergence. In the first one, we consider the alpha-divergence and gamma-divergence of the equilibrium distribution function, which is well defined on the empirical distribution function (EDF) and is proposed as an EDF-based goodness of fit test statistic. The second one is an estimator in manner of Vasicek entropy estimator. Simulation results indicate that in comparison with the other tests statistics, our mentioned test statistics almost in most of the cases have higher power. Finally, two examples containing outliers illustrate the importance and use of the proposed tests.     

Testing hypotheses in truncated samples by means of divergence statistics

In this paper we consider the problem of testing hypotheses in parametric models, when only the first r (of n) ordered observations are known.Using divergence measures, a procedure to test statistical hypotheses is proposed, Replacing the parameters by suitable estimators in the expresion of the divergence measure, the test statistics are obtained.Asymptotic distributions for these statistics are given in several cases when maximum likelihood estimators for truncated samples are considered.Applications of these results in testing statistical hypotheses, on the basis of truncated data, are presented.The small sample behavior of the proposed test statistics is analyzed in particular cases.A comparative study of power values is carried out by computer simulation.     

Tests of Symmetry in Three-dimensional Contingency Tables Based on Phi-divergence Statistics

In this paper we introduce a family of test statistics for testing complete symmetry in three-dimensional contingency tables based on phi- divergence families. These test statistics yield the likelihood ratio test and the Pearson test statistics as special cases. Asymptotic distribution for the new test statistics are derived under both the null and the alternative hypotheses. A simulation study is presented to show that some new statistics offer an attractive alternative to the classical Pearson and likelihood ratio test statistics for this problem of complete symmetry.     

Divergence-based tests of homogeneity for spatial data

The problem of testing homogeneity in contingency tables when the data are spatially correlated is considered. We derive statistics defined as divergences between unrestricted and restricted estimated joint cell probabilities and we show that they are asymptotically distributed as linear combinations of chi-square random variables under the null hypothesis of homogeneity. Monte Carlo simulation experiments are carried out to investigate the behavior of the new divergence test statistics and to make comparisons with the statistics that do not take into account the spatial correlation. We show that some of the introduced divergence test statistics have a significantly better behavior than the classical chi-square test for the problem under consideration when we compare them on the basis of the simulated sizes and powers.     

CSISZAR DIVERGENCE FROM CONSTANT FAILURE RATE MODEL FOR GROUPED DATA

We propose a measure of divergence in failure rates of a system from the constant failure rate model for a grouped data situation. We use this measure to compare the divergences of several systems from the constant failure rate model and find the asymptotic distributions of the test statistics. Several applications are discussed to illustrate the procedure. In the context of testing the goodness-of-fit with the constant failure rate model, we conduct a simulation study which shows that this procedure compares favorably with the Pearson chi-square test and the likelihood ratio test procedures.     

A Bayesian panel data framework for examining the economic growth convergence hypothesis: do the G7 countries converge?

In this paper, we suggest a Bayesian panel (longitudinal) data approach to test for the economic growth convergence hypothesis. This approach can control for possible effects of initial income conditions, observed covariates and cross-sectional correlation of unobserved common error terms on inference procedures about the unit root hypothesis based on panel data dynamic models. Ignoring these effects can lead to spurious evidence supporting economic growth divergence. The application of our suggested approach to real gross domestic product panel data of the G7 countries indicates that the economic growth convergence hypothesis is supported by the data. Our empirical analysis shows that evidence of economic growth divergence for the G7 countries can be attributed to not accounting for the presence of exogenous covariates in the model.     

Order-restricted Dose-related Trend Phi-divergence Tests for Generalized Linear Models

In this paper a new family of test statistics is presented for testing the independence between the binary response Y and an ordered categorical explanatory variable X (doses) against the alternative hypothesis of an increase dose-response relationship between a response variable Y and X (doses). The properties of these test statistics are studied. This new family of test statistics is based on the family of φ-divergence measures and contains as a particular case the likelihood ratio test. We pay special attention to the family of test statistics associated with the power divergence family. A simulation study is included in order to analyze the behavior of the power divergence family of test statistics.     

A Necessary Power Divergence Type Family Tests of Multivariate Normality

In a recent article, Cardoso de Oliveira and Ferreira have proposed a multivariate extension of the univariate chi-squared normality test, using a known result for the distribution of quadratic forms in normal variables. In this article, we propose a family of power divergence type test statistics for testing the hypothesis of multinormality. The proposed family of test statistics includes as a particular case the test proposed by Cardoso de Oliveira and Ferreira. We assess the performance of the new family of test statistics by using Monte Carlo simulation. In this context, the type I error rates and the power of the tests are studied, for important family members. Moreover, the performance of significant members of the proposed test statistics are compared with the respective performance of a multivariate normality test, proposed recently by Batsidis and Zografos. Finally, two well-known data sets are used to illustrate the method developed in this article as well as the specialized test of multivariate normality proposed by Batsidis and Zografos.     

An adjusted cumulative Kullback-Leibler information with application to test of exponentiality

Abstract

In order to discriminate between two probability distributions extensions of Kullback–Leibler (KL) information have been proposed in the literature. In recent years, an extension called cumulative Kullback–Leibler (CKL) information is considered by authors which is closely related to equilibrium distributions. In this paper, we propose an adjusted version of CKL based on equilibrium distributions. Some properties of the proposed measure of divergence are investigated. A test of exponentiality based on the adjusted measure, is proposed. The empirical power of the presented test is calculated and compared with some existing standard tests of exponentiality. The results show that our proposed test, for some important alternative distributions, has better performance than some of the existing tests.     

On testing hypotheses with divergence statistics

Using divergence measures based on entropy functions, a procedure to test statistical hypotheses is proposed. Replacing the parameters by suitable estimators in the expresion of the divergence measure, the test statistics are obtained. Asymptotic distributions for these statistics are given in several cases when maximum likelihood estimators are considered, so they can be used to construct confidence intervals and to test statistical hypotheses based on one or more samples. These results can also be applied to multinomial populations. Tests of goodness of fit and tests of homogeneity can be constructed.     

Characterizations of Bivariate Models Using Some Dynamic Conditional Information Divergence Measures

In this article, we study some relevant information divergence measures viz. Renyi divergence and Kerridge’s inaccuracy measures. These measures are extended to conditionally specified models and they are used to characterize some bivariate distributions using the concepts of weighted and proportional hazard rate models. Moreover, some bounds are obtained for these measures using the likelihood ratio order.     

Minimax Empirical Bayes Estimators in Multivariate Mixed Linear Models with Unequal Replications

Predictive influence of explanatory variables has been studied in both univariate and multivariate distributions. In the Bayesian approach, the same problem is considered in absence of multicollinearity in the dataset. The aim of this article is to study the same in the presence of perfect multicollinearity. To do this, we first derived the predictive distributions for full model and reduced model using vague prior density. Then the discrepancies between these predictive distributions are measured by the Kullback–Leibler (K–L) directed measure of divergence to assess the influence of deleted explanatory variables. Finally, distribution of the discrepancies is derived and the test procedure is performed.     

Probability Generating Function Based Jeffrey's Divergence for Statistical Inference

Statistical inference procedures based on transforms such as characteristic function and probability generating function have been examined by many researchers because they are much simpler than probability density functions. Here, a probability generating function based Jeffrey's divergence measure is proposed for parameter estimation and goodness-of-fit test. Being a member of the M-estimators, the proposed estimator is consistent. Also, the proposed goodness-of-fit test has good statistical power. The proposed divergence measure shows improved performance over existing probability generating function based measures. Real data examples are given to illustrate the proposed parameter estimation method and goodness-of-fit test.     

Generalized Wald-type tests based on minimum density power divergence estimators

In testing of hypothesis, the robustness of the tests is an important concern. Generally, the maximum likelihood-based tests are most efficient under standard regularity conditions, but they are highly non-robust even under small deviations from the assumed conditions. In this paper, we have proposed generalized Wald-type tests based on minimum density power divergence estimators for parametric hypotheses. This method avoids the use of nonparametric density estimation and the bandwidth selection. The trade-off between efficiency and robustness is controlled by a tuning parameter β. The asymptotic distributions of the test statistics are chi-square with appropriate degrees of freedom. The performance of the proposed tests is explored through simulations and real data analysis.     

Asymptotic behaviour and statistical applications of divergence measures in multinomial populations: a unified study

Divergence measures play an important role in statistical theory, especially in large sample theories of estimation and testing. The underlying reason is that they are indices of statistical distance between probability distributions P and Q; the smaller these indices are the harder it is to discriminate between P and Q. Many divergence measures have been proposed since the publication of the paper of Kullback and Leibler (1951). Renyi (1961) gave the first generalization of Kullback-Leibler divergence, Jeffreys (1946) defined the J-divergences, Burbea and Rao (1982) introduced the R-divergences, Sharma and Mittal (1977) the (r,s)-divergences, Csiszar (1967) the ϕ-divergences, Taneja (1989) the generalized J-divergences and the generalized R-divergences and so on. In order to do a unified study of their statistical properties, here we propose a generalized divergence, called (h,ϕ)-divergence, which include as particular cases the above mentioned divergence measures. Under different assumptions, it is shown that the asymptotic distributions of the (h,ϕ)-divergence statistics are either normal or chi square. The chi square and the likelihood ratio test statistics are particular cases of the (h,ϕ)-divergence test statistics considered. From the previous results, asymptotic distributions of entropy statistics are derived too. Applications to testing statistical hypothesis in multinomial populations are given. The Pitman and Bahadur efficiencies of tests of goodness of fit and independence based on these statistics are obtained. To finish, apendices with the asymptotic variances of many well known divergence and entropy statistics are presented. The research in this paper was supported in part by DGICYT Grants N. PB91-0387 and N. PB91-0155. Their financial support is gratefully acknowledged.     

A NEW FAMILY OF DIVERGENCE MEASURES FOR TESTS OF FIT

The aim of this work is to investigate a new family of divergence measures based on the recently introduced Basu, Harris, Hjort and Jones (BHHJ) measure of divergence (Biometrika 85 , 549–559). The new family is investigated in connection with hypothesis testing problems, and new test statistics are proposed. Simulations are performed to check the appropriateness of the proposed test statistics.     

Robust estimation for zero-inflated poisson autoregressive models based on density power divergence

In this study, we consider a robust estimation for zero-inflated Poisson autoregressive models using the minimum density power divergence estimator designed by Basu et al. [Robust and efficient estimation by minimising a density power divergence. Biometrika. 1998;85:549–559]. We show that under some regularity conditions, the proposed estimator is strongly consistent and asymptotically normal. The performance of the estimator is evaluated through Monte Carlo simulations. A real data analysis using New South Wales crime data is also provided for illustration.     

The Minimum Density Power Divergence Estimation for the Lognormal Density

In this article, we implement the minimum density power divergence estimation for estimating the parameters of the lognormal density. We compare the minimum density power divergence estimator (MDPDE) and the maximum likelihood estimator (MLE) in terms of robustness and asymptotic distribution. The simulations and an example indicate that the MDPDE is less biased than MLE and is as good as MLE in terms of the mean square error under various distributional situations.     

A Generalized Bayes Rule for Prediction

In the case of prior knowledge about the unknown parameter, the Bayesian predictive density coincides with the Bayes estimator for the true density in the sense of the Kullback-Leibler divergence, but this is no longer true if we consider another loss function. In this paper we present a generalized Bayes rule to obtain Bayes density estimators with respect to any α-divergence, including the Kullback-Leibler divergence and the Hellinger distance. For curved exponential models, we study the asymptotic behaviour of these predictive densities. We show that, whatever prior we use, the generalized Bayes rule improves (in a non-Bayesian sense) the estimative density corresponding to a bias modification of the maximum likelihood estimator. It gives rise to a correspondence between choosing a prior density for the generalized Bayes rule and fixing a bias for the maximum likelihood estimator in the classical setting. A criterion for comparing and selecting prior densities is also given.