Preliminary phi-divergence test estimators for linear restrictions in a logistic regression model

The problem of estimation of the parameters in a logistic regression model is considered under multicollinearity situation when it is suspected that the parameter of the logistic regression model may be restricted to a subspace. We study the properties of the preliminary test based on the minimum ϕ -divergence estimator as well as in the ϕ -divergence test statistic. The minimum ϕ -divergence estimator is a natural extension of the maximum likelihood estimator and the ϕ -divergence test statistics is a family of the test statistics for testing the hypothesis that the regression coefficients may be restricted to a subspace.     

Comparison of Ordinary and Penalized Power-Divergence Test Statistics for Small and Moderate Samples in Three-Way Contingency Tables via Simulation

In this article, size and power properties of the ordinary and penalized power-divergence test statistics have been compared to test a nested sequence of log-linear models for various penalization and λ values. 2 × 2 × 2 contingency tables distributed according to a multinomial distribution are considered. The simulation study results reveal that the penalized power-divergence test statistics with penalization value of one and λ = ?1.5, ?2 are the best choices for small and moderate samples, respectively.     

Minimum phi-divergence estimators for loglinear models with linear constraints and multinomial sampling

In this paper the family ofφ-divergence estimators for loglinear models with linear constraints and multinomial sampling is studied. This family is an extension of the maximum likelihood estimator studied by Haber and Brown (1986). A simulation study is presented and some alternative estimators to the maximum likelihood are obtained. This work was parcially supported by Grant DGES PB2003-892     

On tests of symmetry,marginal homogeneity and quasi-symmetry in two-way contingency tables based on minimum φ-divergence estimator with constraints

The restricted minimum φ-divergence estimator, [Pardo, J.A., Pardo, L. and Zografos, K., 2002, Minimum φ-divergence estimators with constraints in multinomial populations. Journal of Statistical Planning and Inference, 104, 221–237], is employed to obtain estimates of the cell frequencies of an I×I contingency table under hypotheses of symmetry, marginal homogeneity or quasi-symmetry. The associated φ-divergence statistics are distributed asymptotically as chi-squared distributions under the null hypothesis. The new estimators and test statistics contain, as particular cases, the classical estimators and test statistics previously presented in the literature for the cited problems. A simulation study is presented, for the symmetry problem, to choose the best function φ₂ for estimation and the best function φ₁ for testing.     

On some pre-test and Stein-rule phi-divergence test estimators in the independence model of categorical data

For the model of independence in a two way contingency table, shrinkage estimators based on minimum φ$\phi$-divergence estimators and φ$\phi$-divergence statistics are considered. These estimators are based on the James–Stein-type rule and incorporate the idea of preliminary test estimator. The asymptotic bias and risk are obtained under contiguous alternative hypotheses, and on the basis of them a comparison study is carried out.     

Nonadditivity in loglinear models using φ-divergences and MLEs

In this paper three families of test statistics for testing nonadditivity in loglinear models are presented under the assumption of either Poisson, multinomial, or product-multinomial sampling. These new families are based on the φ-divergence measures. The standard method for testing nonadditivity is used, i.e., the two-stage tests procedure. In this procedure the parameters are first estimated using an additive model and then the estimates are treated as known constants for the second stage of the procedure. These test statistics, which are asymptotically chi-squared, generalize the likelihood ratio test for this problem given by Christensen and Utts (J. Statist. Plann. Inference 33 (1992) 333). An example and a simulation study are included.     

A New Family of BAN Estimators for Polytomous Logistic Regression Models based on ϕ- Divergence Measures

In this paper we study polytomous logistic regression model and the asymptotic properties of the minimum ϕ-divergence estimators for this model. A simulation study is conducted to analyze the behavior of these estimators as function of the power-divergence measure ϕ_(λ) Research partially done when was visiting the Bowling Green State University as the Distinguished Lukacs Professor     

A comparison of estimators for the mean in the inverse gaussian distribution with a known coefficient of variation

In this paper, we discuss an estimation problem of the mean in the inverse Gaussian distribution with a known coefficient of variation. Two types of linear estimators for the mean, the linear minimum variance unbiased estimator and the linear minimum mean squared error estimator, are constructed by using the squared error loss function and their properties are examined. It is observed that, for small samples the performance of the proposed estimators is better than that of the maximum likelihood estimator, when the coefficient of variation is large.     

Minimum Φ-divergence estimator in logistic regression models

A general class of minimum distance estimators for logistic regression models based on the ϕ-divergence measures is introduced: The minimum ϕ-divergence estimator, which is seen to be a generalization of the maximum likelihood estimator. Its asymptotic properties are studied as well as its behaviour in small samples throught a simulation study. This work was supported partially by Grant DGI (BMF2003-00892).     

Residual analysis and outliers in loglinear models based on phi-divergence statistics

In this paper we consider new families of residuals and influential measures, under the assumption of multinomial sampling, for loglinear models. These new families are based on φ$\phi$-divergence test statistic. The asymptotic normality of the standardized residuals is obtained as well as the relation of the new family of influential measures with the appropriate Cook's distance in this context. The expression of the new family of residuals is obtained in two important problems: independence and symmetry in two-dimensional contingence tables. A numerical example illustrates the results obtained.     

Accuracy of Power-Divergence Statistics for Testing Independence and Homogeneity in Two-Way Contingency Tables

The small-sample accuracy of seven members of the family of power-divergence statistics for testing independence or homogeneity in contingency tables was studied via simulation. The likelihood ratio statistic G ² and Pearson's X ² statistic are among these seven members, whose behavior was studied at nominal test sizes of.01 and.05 with marginal distributions that could be uniform or skewed and with a set of sample sizes that included sparseness conditions as measured through table density (i.e., the ratio of sample size to number of cells). The likelihood ratio statistic G ² rejected the null hypothesis too often even with large table density, whereas Pearson's X ² was sufficiently accurate and only presented a minor misbehavior when table density was less than two observations/cell. None of the other five statistics outperformed Pearson's X ². A nonasymptotic variant of X ² solved the minor inaccuracies of Pearson's X ² and turned out to be the most accurate statistic for testing independence or homogeneity, even with table densities of one observation/cell. These results clearly advise against the use of the likelihood ratio statistic G ².     

Choosing a robustness tuning parameter

A novel method is proposed for choosing the tuning parameter associated with a family of robust estimators. It consists of minimising estimated mean squared error, an approach that requires pilot estimation of model parameters. The method is explored for the family of minimum distance estimators proposed by [Basu, A., Harris, I.R., Hjort, N.L. and Jones, M.C., 1998, Robust and efficient estimation by minimising a density power divergence. Biometrika, 85, 549–559.] Our preference in that context is for a version of the method using the L ₂ distance estimator [Scott, D.W., 2001, Parametric statistical modeling by minimum integrated squared error. Technometrics, 43, 274–285.] as pilot estimator.     

Bayesian estimation and influence diagnostics of generalized partially linear mixed-effects models for longitudinal data

This paper develops a Bayesian approach to obtain the joint estimates of unknown parameters, nonparametric functions and random effects in generalized partially linear mixed models (GPLMMs), and presents three case deletion influence measures to identify influential observations based on the φ-divergence, Cook's posterior mean distance and Cook's posterior mode distance of parameters. Fisher's iterative scoring algorithm is developed to evaluate the posterior modes of parameters in GPLMMs. The first-order approximation to Cook's posterior mode distance is presented. The computationally feasible formulae for the φ-divergence diagnostic and Cook's posterior mean distance are given. Several simulation studies and an example are presented to illustrate our proposed methodologies.     

异质性数据下广义线性模型的Maximin似然比估计及应用

针对具有多个来源的异质性数据,文献中通常提出复杂程度较高的模型用于描述每个数据子总体的特征,而本文着眼于刻画不同数据子总体的共性进而建立一个简单的模型。在参数估计方面,本文借鉴了普通线性模型的Maximin估计思想,提出了适用于广义线性模型的Maximin似然比估计方法及稀疏结构下的惩罚估计。该方法通过最大化所有子总体中似然比统计量的最小值,构建成一个简单而保守的模型,以减少数据来源较多而呈现的复杂性。所提方法适用于因变量服从正态分布、两点分布、泊松分布等指数族分布的情形,丰富了前人的研究成果,具有更好的实践意义。模拟分析显示,相比于经典的估计方法,Maximin似然比估计方法不仅能够有效地探寻子总体的共性,而且具有较高的样本外预测精度。本文提出的方法也适用于政府统计和经济统计中具有异质性的大型数据集。     

Comparing two treatments in terms of the likelihood ratio order

In this paper new families of test-statistics are introduced and studied for the problem of comparing two treatments in terms of the likelihood ratio order. The considered families are based on φ-divergence measures and arise as natural extensions of the classical likelihood ratio test and Pearson test-statistics. It is proven that their asymptotic distribution is a common chi-bar random variable. An illustrative example is presented and the performance of these statistics is analysed through a simulation study. Through a simulation study it is shown that, for most of the proposed scenarios adjusted to be small or moderate, some members of this new family of test-statistic display clearly better performance with respect to the power in comparison to the classical likelihood ratio and the Pearson's chi-square test while the exact size remains closed to the nominal size. In view of the exact powers and significance levels, the study also shows that the Wilcoxon test-statistic is not as good as the two classical test-statistics.     

Asymptotics for an Adaptive Trimmed Likelihood Location Estimator

An asymptotic normality result is given for an adaptive trimmed likelihood estimator of location, which parallels the asymptotic normality result for the adaptive trimmed mean. The new result comes out of studying the adaptive trimmed likelihood estimator modelled parametrically by a normal family but then examining the behavior when the underlying distribution is in fact some F different from normal. The asymptotic variance of the adaptive estimator is equal to the asymptotic variance of the trimmed likelihood estimator at the optimal trimming proportion for the distribution F, subject to that trimming proportion being positive and F being suitably smooth.     

Improvements in the small sample efficiency of the minimum S-divergence estimators under discrete models

This paper considers the problem of inliers and empty cells and the resulting issue of relative inefficiency in estimation under pure samples from a discrete population when the sample size is small. Many minimum divergence estimators in the S-divergence family, although possessing very strong outlier stability properties, often have very poor small sample efficiency in the presence of inliers and some are not even defined in the presence of a single empty cell; this limits the practical applicability of these estimators, in spite of their otherwise sound robustness properties and high asymptotic efficiency. Here, we study a penalized version of the S-divergences such that the resulting minimum divergence estimators are free from these issues, without altering their robustness properties and asymptotic efficiencies. We present a general proof for the asymptotic properties of these minimum penalized S-divergence estimators. This provides a significant addition to the literature, as the asymptotics of penalized divergences which are not finitely defined are currently unavailable in the literature. The small sample advantages of the minimum penalized S-divergence estimators are examined through an extensive simulation study and some empirical suggestions regarding the choice of the relevant underlying tuning parameters are also provided.     

Robust confidence regions for multinomial probabilities

Generally, confidence regions for the probabilities of a multinomial population are constructed based on the Pearson χ² statistic. Morales et al. (Bootstrap confidence regions in multinomial sampling. Appl Math Comput. 2004;155:295–315) considered the bootstrap and asymptotic confidence regions based on a broader family of test statistics known as power-divergence test statistics. In this study, we extend their work and propose penalized power-divergence test statistics-based confidence regions. We only consider small sample sizes where asymptotic properties fail and alternative methods are needed. Both bootstrap and asymptotic confidence regions are constructed. We consider the percentile and the bias corrected and accelerated bootstrap confidence regions. The latter confidence region has not been studied previously for the power-divergence statistics much less for the penalized ones. Designed simulation studies are carried out to calculate average coverage probabilities. Mean absolute deviation between actual and nominal coverage probabilities is used to compare the proposed confidence regions.     

A note on penalized minimum distance estimation in nonparametric regression

The authors introduce a penalized minimum distance regression estimator. They show the estimator to balance, among a sequence of nested models of increasing complexity, the L¹ ‐approximation error of each model class and a penalty term which reflects the richness of each model and serves as a upper bound for the estimation error.