On principal points for location mixtures of spherically symmetric distributions

In this paper, we investigate some properties of 2-principal points for location mixtures of spherically symmetric distributions with focus on a linear subspace in which a set of 2-principal points must lie. Our results can be viewed as an extension of those of Yamamoto and Shinozaki [2000. Two principal points for multivariate location mixtures of spherically symmetric distributions. J. Japan Statist. Soc. 30, 53–63], where a finite location mixture of spherically symmetric distributions is treated. As an extension of their paper, this paper defines a wider class of distributions, and derives a linear subspace in which a set of 2-principal points must exist. A theorem useful for comparing the mean squared distances is also established.     

Multivariate Matsumoto–Yor property is rather restrictive

Matsumoto and Yor [2001. An analogue of Pitman's 2M-X$2M-X$ theorem for exponential Wiener functionals. Part II: the role of the GIG laws. Nagoya Math. J. 162, 65–86] discovered an interesting invariance property of a product of the generalized inverse Gaussian (GIG) and the gamma distributions. For univariate random variables or symmetric positive definite random matrices it is a characteristic property for this pair of distributions. It appears that for random vectors the Matsumoto–Yor property characterizes only very special families of multivariate GIG and gamma distributions: components of the respective random vectors are grouped into independent subvectors, each subvector having linearly dependent components. This complements the version of the multivariate Matsumoto–Yor property on trees and related characterization obtained in Massam and Weso?owski [2004. The Matsumoto–Yor property on trees. Bernoulli 10, 685–700].     

Likelihood ratio test against simple stochastic ordering among several multinomial populations

Stochastic ordering between probability distributions has been widely studied in the past 50 years. Because it is often easy to make valuable judgments when such orderings exist, it is desirable to recognize their existence and to model distributional structures under them. Likelihood ratio test is the most commonly used method to test hypotheses involving stochastic orderings. Among the various formally defined notions of stochastic ordering, the least stringent is simple stochastic ordering. In this paper, we consider testing the hypothesis that all multinomial populations are identically distributed against the alternative that they are in simple stochastic ordering. We construct likelihood ratio test statistic for this hypothesis test problem, provide limit form of the objective function corresponding to the test statistic and show that the test statistic is asymptotically distributed as a mixture of chi-squared distributions, i.e., a chi-bar-squared distribution.     

Cross-cumulants measure for independence

We propose a measure for independence of group of random variables, given by a sum of cross-cumulants of a given order n  . A similar measure was known for the case of fourth-order cross-cumulants from the JADE algorithm for ICA (independent component analysis). We derive a formula for its calculation using cumulant tensors. In the case n=4$n=4$ our formula allows efficient calculation of this measure, using cumulant matrices. Much attention is devoted to the case of six-order cross-cumulants, aiming to show that this measure can be calculated using again cumulant matrices.     

On Christensen's conjecture

In this paper we give solution to a conjecture appearing in Christensen (1997, p. 360) in relation to the definitions of standardized residuals in loglinear models. Work done when he was visiting as the Distinguished Lukacs Professor on leave from the Complutense University of Madrid. An erratum to this article is available at .     

A generalization of an identity of hoeffding and some applications

Summary We generalize a well-known identity due to Hoeffding and use this generalization to prove a result of Cambanis, Simons and Stout under somewhat different hypotheses and to extend some results of Lehmann concerning bivariate distributions with quadrant dependence.     

On the comparison of the pre-test and shrinkage estimators for the univariate normal mean

The estimation of the mean of an univariate normal population with unknown variance is considered when uncertain non-sample prior information is available. Alternative estimators are defined to incorporate both the sample as well as the non-sample information in the estimation process. Some of the important statistical properties of the restricted, preliminary test, and shrinkage estimators are investigated. The performances of the estimators are compared based on the criteria of unbiasedness and mean square error in order to search for a ‘best’ estimator. Both analytical and graphical methods are explored. There is no superior estimator that uniformly dominates the others. However, if the non-sample information regarding the value of the mean is close to its true value, the shrinkage estimator over performs the rest of the estimators. Received: June 19, 1999; revised version: March 23, 2000     

An alternative form of the Watson efficiency

Watson [1951. Serial correlation in regression analysis. Ph.D. Thesis, Department of Experimental Statistics, North Carolina State College, Raleigh] introduced a relative efficiency, which is often called the Watson efficiency in literatures, to measure the inefficiency of the least squares in linear regression models. The Watson efficiency is defined by determinant, but we shall show by two examples that such a criterion does not always work well in some cases. In this paper, an alternative form based on Euclidean norm of the Watson efficiency is proposed and some examples are given to illustrate superiority of the new relative efficiency.     

Log-linear models for mutations in the HIV genome

We discuss a general application of categorical data analysis to mutations along the HIV genome. We consider a multidimensional table for several positions at the same time. Due to the complexity of the multidimensional table, we may collapse it by pooling some categories. However, the association between the remaining variables may not be the same as before collapsing. We discuss the collapsibility of tables and the change in the meaning of parameters after collapsing categories. We also address this problem with a log-linear model. We present a parameterization with the consensus output as the reference cell as is appropriate to explain genomic mutations in HIV. We also consider five null hypotheses and some classical methods to address them. We illustrate methods for six positions along the HIV genome, through consideration of all triples of positions.     

Use of non-normality in structural equation modeling: Application to direction of causation

Structural equation modeling (SEM) typically utilizes first- and second-order moment structures. This limits its applicability since many unidentified models and many equivalent models that researchers would like to distinguish are created. In this paper, we relax this restriction and assume non-normal distributions on exogenous variables. We shall provide a solution to the problems of underidentifiability and equivalence of SEM models by making use of non-normality (higher-order moment structures). The non-normal SEM is applied to finding the possible direction of a path in simple regression models. The method of (generalized) least squares is employed to estimate model parameters. A test statistic for examining a fit of a model is proposed. A simulation result and a real data example are reported to study how the non-normal SEM approach works empirically.     

Minimum phi-divergence estimators for loglinear models with linear constraints and multinomial sampling

In this paper the family ofφ-divergence estimators for loglinear models with linear constraints and multinomial sampling is studied. This family is an extension of the maximum likelihood estimator studied by Haber and Brown (1986). A simulation study is presented and some alternative estimators to the maximum likelihood are obtained. This work was parcially supported by Grant DGES PB2003-892     

A generalization of the multivariate slash distribution

In this paper, we propose a generalization of the multivariate slash distribution and investigate some of its properties. We show that the new distribution belongs to the elliptically contoured distributions family, and can have heavier tails than the multivariate slash distribution. Therefore, this generalization of the multivariate slash distribution can be considered as an alternative heavy-tailed distribution for modeling data sets in a variety of settings. We apply the generalized multivariate slash distribution to two real data sets to provide some illustrative examples.     

SVM-like decision theoretical classification of high-dimensional vectors

In this paper, we consider the classification of high-dimensional vectors based on a small number of training samples from each class. The proposed method follows the Bayesian paradigm, and it is based on a small vector which can be viewed as the regression of the new observation on the space spanned by the training samples. The classification method provides posterior probabilities that the new vector belongs to each of the classes, hence it adapts naturally to any number of classes. Furthermore, we show a direct similarity between the proposed method and the multicategory linear support vector machine introduced in Lee et al. [2004. Multicategory support vector machines: theory and applications to the classification of microarray data and satellite radiance data. Journal of the American Statistical Association 99 (465), 67–81]. We compare the performance of the technique proposed in this paper with the SVM classifier using real-life military and microarray datasets. The study shows that the misclassification errors of both methods are very similar, and that the posterior probabilities assigned to each class are fairly accurate.     

Two-stage Huber estimation

In this paper we propose a new robust estimator in the context of two-stage estimation methods directed towards the correction of endogeneity problems in linear models. Our estimator is a combination of Huber estimators for each of the two stages, with scale corrections implemented using preliminary median absolute deviation estimators. In this way we obtain a two-stage estimation procedure that is an interesting compromise between concerns of simplicity of calculation, robustness and efficiency. This method compares well with other possible estimators such as two-stage least-squares (2SLS) and two-stage least-absolute-deviations (2SLAD), asymptotically and in finite samples. It is notably interesting to deal with contamination affecting more heavily the distribution tails than a few outliers and not losing as much efficiency as other popular estimators in that case, e.g. under normality. An additional originality resides in the fact that we deal with random regressors and asymmetric errors, which is not often the case in the literature on robust estimators.     

Generalized Least Squares Estimation in Contingency Tables Analysis: Asymptotic Properties and Applications

Different sorts of bilinear models (models with bilinear interaction terms) are currently used when analyzing contingency tables: association models, correlation models... All these can be included in a general family of bilinear models: power models. In this framework, Maximum Likelihood (ML) estimation is not always possible, as explained in an introductory example. Thus, Generalized Least Squares (GLS) estimation is sometimes needed in order to estimate parameters. A subclass of power models is then considered in this paper: separable reduced-rank (SRR) models. They allow an optimal choice of weights for GLS estimation and simplifications in asymptotic studies concerning GLS estimators. Power 2 models belong to the subclass of SRR models and the asymptotic properties of GLS estimators are established. Similar results are also established for association models which are not SRR models. However, these results are more difficult to prove. Finally, 2 examples are considered to illustrate our results.     

Independence in multi-way contingency tables: S.N. Roy's breakthroughs and later developments

In the mid-1950s S.N. Roy and his students contributed two landmark articles to the contingency table literature [Roy, S.N., Kastenbaum, M.A., 1956. On the hypothesis of no “interaction” in a multiway contingency table. Ann. Math. Statist. 27, 749–757; Roy, S.N., Mitra, S.K., 1956. An introduction to some nonparametric generalizations of analysis of variance and multivariate analysis. Biometrika 43, 361–376]. The first article generalized concepts of interaction from 2×2×2$2\times 2\times 2$ contingency tables to three-way tables of arbitrary size and to larger tables. In the second article, which is the source of our primary focus, various notions of independence were clarified for three-way contingency tables, Roy's union–intersection test was applied to construct chi-squared tests of hypotheses about the structure of such tables, and the chi-squared statistics were shown not to depend on the distinction between response and explanatory variables. This work pre-dates by many years later developments that expressed such results in the context of loglinear models. It pre-dates by a quarter century the development of graphical models. We summarize the main results in these key articles and discuss the connection between them and the later developments of loglinear modeling and of graphical modeling. We also mention ways in which these later developments have themselves been further generalized.     

Residual analysis and outliers in loglinear models based on phi-divergence statistics

In this paper we consider new families of residuals and influential measures, under the assumption of multinomial sampling, for loglinear models. These new families are based on φ$\phi$-divergence test statistic. The asymptotic normality of the standardized residuals is obtained as well as the relation of the new family of influential measures with the appropriate Cook's distance in this context. The expression of the new family of residuals is obtained in two important problems: independence and symmetry in two-dimensional contingence tables. A numerical example illustrates the results obtained.