On tests of symmetry,marginal homogeneity and quasi-symmetry in two-way contingency tables based on minimum φ-divergence estimator with constraints

The restricted minimum φ-divergence estimator, [Pardo, J.A., Pardo, L. and Zografos, K., 2002, Minimum φ-divergence estimators with constraints in multinomial populations. Journal of Statistical Planning and Inference, 104, 221–237], is employed to obtain estimates of the cell frequencies of an I×I contingency table under hypotheses of symmetry, marginal homogeneity or quasi-symmetry. The associated φ-divergence statistics are distributed asymptotically as chi-squared distributions under the null hypothesis. The new estimators and test statistics contain, as particular cases, the classical estimators and test statistics previously presented in the literature for the cited problems. A simulation study is presented, for the symmetry problem, to choose the best function φ₂ for estimation and the best function φ₁ for testing.     

Preliminary phi-divergence test estimators for linear restrictions in a logistic regression model

The problem of estimation of the parameters in a logistic regression model is considered under multicollinearity situation when it is suspected that the parameter of the logistic regression model may be restricted to a subspace. We study the properties of the preliminary test based on the minimum ϕ -divergence estimator as well as in the ϕ -divergence test statistic. The minimum ϕ -divergence estimator is a natural extension of the maximum likelihood estimator and the ϕ -divergence test statistics is a family of the test statistics for testing the hypothesis that the regression coefficients may be restricted to a subspace.     

On some pre-test and Stein-rule phi-divergence test estimators in the independence model of categorical data

For the model of independence in a two way contingency table, shrinkage estimators based on minimum φ$\phi$-divergence estimators and φ$\phi$-divergence statistics are considered. These estimators are based on the James–Stein-type rule and incorporate the idea of preliminary test estimator. The asymptotic bias and risk are obtained under contiguous alternative hypotheses, and on the basis of them a comparison study is carried out.     

Minimum power-divergence estimator in three-way contingency tables

Cressie et al. (2000; 2003) introduced and studied a new family of statistics, based on the φ-divergence measure, for solving the problem of testing a nested sequence of loglinear models. In that family of test statistics the parameters are estimated using the minimum φ-divergence estimator which is a generalization of the maximum likelihood estimator. In this paper we study the minimum power-divergence estimator (the most important family of minimum φ-divergence estimator) for a nested sequence of loglinear models in three-way contingency tables under assumptions of multinomial sampling. A simulation study illustrates that the minimum chi-squared estimator is simultaneously the most robust and efficient estimator among the family of the minimum power-divergence estimator.     

Improvements in the small sample efficiency of the minimum S-divergence estimators under discrete models

This paper considers the problem of inliers and empty cells and the resulting issue of relative inefficiency in estimation under pure samples from a discrete population when the sample size is small. Many minimum divergence estimators in the S-divergence family, although possessing very strong outlier stability properties, often have very poor small sample efficiency in the presence of inliers and some are not even defined in the presence of a single empty cell; this limits the practical applicability of these estimators, in spite of their otherwise sound robustness properties and high asymptotic efficiency. Here, we study a penalized version of the S-divergences such that the resulting minimum divergence estimators are free from these issues, without altering their robustness properties and asymptotic efficiencies. We present a general proof for the asymptotic properties of these minimum penalized S-divergence estimators. This provides a significant addition to the literature, as the asymptotics of penalized divergences which are not finitely defined are currently unavailable in the literature. The small sample advantages of the minimum penalized S-divergence estimators are examined through an extensive simulation study and some empirical suggestions regarding the choice of the relevant underlying tuning parameters are also provided.     

Divergence-based confidence intervals in false-positive misclassification model

In this article, we introduce minimum divergence estimators of parameters of a binary response model when data are subject to false-positive misclassification and obtained using a double-sampling plan. Under this set up, the problem of goodness-of-fit is considered and divergence-based confidence intervals (CIs) for a population proportion parameter are derived. A simulation experiment is carried out to compare the coverage probabilities of the new CIs. An application to real data is also given.     

On testing hypotheses with divergence statistics

Using divergence measures based on entropy functions, a procedure to test statistical hypotheses is proposed. Replacing the parameters by suitable estimators in the expresion of the divergence measure, the test statistics are obtained. Asymptotic distributions for these statistics are given in several cases when maximum likelihood estimators are considered, so they can be used to construct confidence intervals and to test statistical hypotheses based on one or more samples. These results can also be applied to multinomial populations. Tests of goodness of fit and tests of homogeneity can be constructed.     

Phi-Divergence Statistics for Testing Linear Hypotheses in Logistic Regression Models

In this paper we introduce and study two new families of statistics for the problem of testing linear combinations of the parameters in logistic regression models. These families are based on the phi-divergence measures. One of them includes the classical likelihood ratio statistic and the other the classical Pearson's statistic for this problem. It is interesting to note that the vector of unknown parameters, in the two new families of phi-divergence statistics considered in this paper, is estimated using the minimum phi-divergence estimator instead of the maximum likelihood estimator. Minimum phi-divergence estimators are a natural extension of the maximum likelihood estimator.     

A generalization of the log-series distribution

A new generalized logarithmic series distribution (GLSD) with two parameters is proposed.The proposed model is flexible enough to describe short-tailed as well as long-tailed data.Some recurence relations for its probabilities and the factorial moments are presente.These recurrence relations are utilized to obtain the minimum chi-square estimators for the parmaters.Maximum likelihood estimators and some other estimators based on first few moments and probabilities are also suggested.Asymptotic relative efficiency of some of these estimators is also obtained and compared.Two test statistics based on the minimum chi-square estimators fo testing some hypotheses regarding the GLSD are proposed.The fit of the model and the application of the test statistics are exemplified by some data sets.Finally, a graphical method is suggested for differentiating between the ordinary logarithmic series distribution and the GLSD.     

Testing hypotheses in truncated samples by means of divergence statistics

In this paper we consider the problem of testing hypotheses in parametric models, when only the first r (of n) ordered observations are known.Using divergence measures, a procedure to test statistical hypotheses is proposed, Replacing the parameters by suitable estimators in the expresion of the divergence measure, the test statistics are obtained.Asymptotic distributions for these statistics are given in several cases when maximum likelihood estimators for truncated samples are considered.Applications of these results in testing statistical hypotheses, on the basis of truncated data, are presented.The small sample behavior of the proposed test statistics is analyzed in particular cases.A comparative study of power values is carried out by computer simulation.     

Goodness-of-fit testing for Weibull-type behavior

In the process of analyzing data, testing the fit of a model under consideration is a prerequisite for performing inference about the model parameters. In this paper we examine the goodness-of-fit testing problem for assessing whether a sample is consistent with the Weibull-type model. Inspired by the Jackson and the Lewis test statistics, originally proposed as goodness-of-fit tests for the exponential distribution, we introduce two new statistics for testing Weibull-type behavior, and study their asymptotic properties. Moreover, given that the statistics are ratios of estimators for the Weibull-tail coefficient, we obtain new estimators for the latter, and establish their consistency and asymptotic normality. The small sample behavior of our statistics and estimators is evaluated on the basis of a simulation study.     

Nonadditivity in loglinear models using φ-divergences and MLEs

In this paper three families of test statistics for testing nonadditivity in loglinear models are presented under the assumption of either Poisson, multinomial, or product-multinomial sampling. These new families are based on the φ-divergence measures. The standard method for testing nonadditivity is used, i.e., the two-stage tests procedure. In this procedure the parameters are first estimated using an additive model and then the estimates are treated as known constants for the second stage of the procedure. These test statistics, which are asymptotically chi-squared, generalize the likelihood ratio test for this problem given by Christensen and Utts (J. Statist. Plann. Inference 33 (1992) 333). An example and a simulation study are included.     

Minimum Φ-divergence estimator in logistic regression models

A general class of minimum distance estimators for logistic regression models based on the ϕ-divergence measures is introduced: The minimum ϕ-divergence estimator, which is seen to be a generalization of the maximum likelihood estimator. Its asymptotic properties are studied as well as its behaviour in small samples throught a simulation study. This work was supported partially by Grant DGI (BMF2003-00892).     

Second-order asymptotic comparison of estimators under φ-divergence loss

Our main concern is on the second-order asymptotic optimality problem of estimators. The φ-divergence loss is used as a criterion for evaluating the performance of estimators. In the comparison problem of any two estimators, the condition that one estimator dominates another estimator under the φ-divergence risk is given by evaluating the second-order term in the difference between the risks. As a result, it is proved that the condition is characterized by a peculiar value of the φ-divergence loss, which is called the divergence-loss coefficient. Furthermore, it is shown that the comparison based on the φ-divergence loss does not correspond with that based on any standard loss functions including the mean squared error, the absolute loss and the 0-1 loss. In addition, a necessary and sufficient condition for an estimator to be second-order admissible is derived.     

ROBUST ESTIMATION AND HYPOTHESIS TESTS FOR FIRST-ORDER THRESHOLD AUTOREGRESSIVE MODELS

Results of Petrucelli & Woolford (1984) for a first-order threshold autoregressive model are considered from a robust point of view. Robust estimators of the threshold parameters of the model are obtained and their asymptotic normality is proved. Testing the equality of the threshold parameters is considered using the robust analogues of Wald and score test statistics. Limiting distributions of these statistics are given under both null and alternative hypotheses.     

Comparison of two weibull distributions under random censoring

The two-sample problem for comparing Weibull scale parameters is studied for randomly censored data. Three different test statistics are considered and their asymptotic properties are established under a sequence of local alternatives, It is shown that both the test statistic based on the mlefs (maximum likelihood estimators) and the likelihood ratio test are asymptotically optimum. The third statistic based only on the number of failures is not, Asymptotic relative efficiency of this statistic is obtained and its numerical values are computed for uniform and Weibull censoring, Effects of uniform random censoring on the censoring level of the experiment are illus¬trated, A direct proof for the joint asymptotic normality of the mlefs of the shape and the scale parameters is also given     

Asymptotic approximations for the distributions of the <Emphasis Type="Italic">K</Emphasis>ø-divergence goodness-of-fit statistics

Kø-divergence’s statistic family for goodness-of-fit, under the null hypothesis, has an asymptotic chi-squared distribution; however, for small samples, the chi-squared approximation in some cases does not well agree with the exact distribution. In this paper, a closer approximation to the exact distribution is obtained by extracting the ø-dependent second order component from the distribution. Moreover, numerical results are presented for moderate sample sizes with moderate number of cells.     

Estimating the proportion of true null hypotheses, with application to DNA microarray data

Summary.  We consider the problem of estimating the proportion of true null hypotheses, π ₀, in a multiple-hypothesis set-up. The tests are based on observed p -values. We first review published estimators based on the estimator that was suggested by Schweder and Spjøtvoll. Then we derive new estimators based on nonparametric maximum likelihood estimation of the p -value density, restricting to decreasing and convex decreasing densities. The estimators of π ₀ are all derived under the assumption of independent test statistics. Their performance under dependence is investigated in a simulation study. We find that the estimators are relatively robust with respect to the assumption of independence and work well also for test statistics with moderate dependence.     

Comparing two treatments in terms of the likelihood ratio order

In this paper new families of test-statistics are introduced and studied for the problem of comparing two treatments in terms of the likelihood ratio order. The considered families are based on φ-divergence measures and arise as natural extensions of the classical likelihood ratio test and Pearson test-statistics. It is proven that their asymptotic distribution is a common chi-bar random variable. An illustrative example is presented and the performance of these statistics is analysed through a simulation study. Through a simulation study it is shown that, for most of the proposed scenarios adjusted to be small or moderate, some members of this new family of test-statistic display clearly better performance with respect to the power in comparison to the classical likelihood ratio and the Pearson's chi-square test while the exact size remains closed to the nominal size. In view of the exact powers and significance levels, the study also shows that the Wilcoxon test-statistic is not as good as the two classical test-statistics.