Linear signed rank tests for hultivariate location

Previously proposed linear signed rank tests for multivariate location are not invariant under linear transformations of the observations, The asymptotic relative efficiencies of the tests 2 with respect to Hotelling's T²test depend on the direction of shift and the covariance matrix of the alternative distributions. For distributions with highly correlated components, the efficiencies of some of these tests can be arbitrarily low; they approach zero for certain multivariate normal alternatives, This article proposes a transformation of the data to be performed prior to standard linear signed rank tests, The resulting procedures have attractive power and efficiency properties compared to the original tests, In particular, for elliptically symmetric contiguous alternafives, the efficiencies of the new tests equal those of corresponding univariate linear signed rank tests with respect to the t test.     

Power of One-Sample Location Tests Under Distributions with Equal Lévy Distance

In this article, we study the power of one-sample location tests under classical distributions and two supermodels which include the normal distribution as a special case. The distributions of the supermodels are chosen in such a way that they have equal distance to the normal as the logistic, uniform, double exponential, and the Cauchy, respectively. As a measure of distance we use the Lévy metric. The tests considered are two parametric tests, the t-test and a trimmed t-test, and two nonparametric tests, the sign test and the Wilcoxon signed-rank tests. It turns out that the power of the tests, first of all, does not depend on the Lévy distance but on the special chosen supermodel.     

Tests of symmetry derived as components of pearson's phi-squared distance measure

Rank statistics which arise as estimates of the first and third components of a frequency decomposition of Pearson's phi-squared distance measure, introduced by Eubank, LaRiccia, and Rosenstein (1987), are examined for their usefulness as tests of symmetry about a known median against various asymmetric alternatives, Pitman asymptotic relative efficiencies are used to compare the efficacies of the new statistics with classical test procedures, and empirical powers of the new tests are compared via simulation for a variety of asymmetric distributions. Statistics which arise from components based on Legendre polynomials are of particular interest. The first component is the familiar Wilcoxon signed rank statistic. The third component, which is a new statistic for this problem, exhibits a high level of sensitivity to a variety of asymmetric alternatives both asymptotically and in small sample studies.     

Optimal detection of Fechner-asymmetry

We consider a general class of skewed univariate densities introduced by Fechner [1897. Kollectivmasslehre. Engleman, Leipzig], and derive optimal testing procedures for the null hypothesis of symmetry within that class. Locally and asymptotically optimal (in the Le Cam sense) tests are obtained, both for the case of symmetry with respect to a specified location as for the case of symmetry with respect to some unspecified location. Signed-rank based versions of these tests are also provided. The efficiency properties of the proposed procedures are investigated by a derivation of their asymptotic relative efficiencies with respect to the corresponding Gaussian parametric tests based on the traditional Pearson–Fisher coefficient of skewness. Small-sample performances under several types of asymmetry are investigated via simulations.     

Combining Univariate Tests for Multivariate Location Problem

In this article, three methods of combining dependent univariate tests are studied. The Bahadur approximate efficiencies are derived under the asymptotic normal assumption. These procedures are applied to the multivariate location problem and compared with two Hotelling-type tests. A Monte Carlo study indicates that in certain cases the powers of the combination methods are much better than Hotelling's T ² and other multivariate nonparametric tests.     

A continuous general multivariate distribution and its properties

Starting from two known continuous univariate distributions, a bivariate distribution is constructed depending on a parameter which measures the degree of stochastic dependence between the two random variables. From the foregoing construction we then pass to a multivariate-type distribution, constructed using only univariate distributions and an association matrix. Some properties of the multivariate and bivariate case are studied.     

On influence diagnostic in univariate elliptical linear regression models

We discuss in this paper the assessment of local influence in univariate elliptical linear regression models. This class includes all symmetric continuous distributions, such as normal, Student-t, Pearson VII, exponential power and logistic, among others. We derive the appropriate matrices for assessing the local influence on the parameter estimates and on predictions by considering as influence measures the likelihood displacement and a distance based on the Pearson residual. Two examples with real data are given for illustration.     

Simple nonparametric tests for a known standard survival based on censored data

It is often of interest in survival analysis to test whether the distribution of lifetimes from which the sample under study was derived is the same as a reference distribution. The latter can be specified on the basis of previous studies or on subject matter considerations. In this paper several tests are developed for the above hypothesis, suitable for right-censored observations. The tests are based on modifications of Moses' one-sample limits of some classical two-sample rank tests. The asymptotic distributions of the test statistics are derived, consistency is established for alternatives which are stochastically ordered with respect to the null, and Pitman asymptotic efficiencies are calculated relative to competing tests. Simulated power comparisons are reported. An example is given with data on the survival times of lung cancer patients.     

Characteristic function-based inference for GARCH models with heavy-tailed innovations

We consider estimation and goodness-of-fit tests in GARCH models with innovations following a heavy-tailed and possibly asymmetric distribution. Although the method is fairly general and applies to GARCH models with arbitrary innovation distribution, we consider as special instances the stable Paretian, the variance gamma, and the normal inverse Gaussian distribution. Exploiting the simple structure of the characteristic function of these distributions, we propose minimum distance estimation based on the empirical characteristic function of properly standardized GARCH-residuals. The finite-sample results presented facilitate comparison with existing methods, while the new procedures are also applied to real data from the financial market.     

Simultaneous equivariant estimation of the parameters of linear models

Consider a family of distributions which is invariant under a group of transformations. In this paper, we define an optimality criterion with respect to an arbitrary convex loss function and we prove a characterization theorem for an equivariant estimator to be optimal. Then we consider a linear model Y=Xβ+ε, in which ε has a multivariate distribution with mean vector zero and has a density belonging to a scale family with scale parameter σ. Also we assume that the underlying family of distributions is invariant with respect to a certain group of transformations. First, we find the class of all equivariant estimators of regression parameters and the powers of σ. By using the characterization theorem we discuss the simultaneous equivariant estimation of the parameters of the linear model.     

Asymptotic efficiencies of estiamtors of location a comutational study

Asymptotic efficiencies of four classes of estimators of location are evaluated for a family of distributions consisting of t, lambda and contaminated normal densities. For the class of estimators derived from signed rank tests, maximin efficiencies between pairs of distributions in the family are computed using a formula of Gastwirth ( 1966 ). Asymptotic efficiencies are also evaluated for the scale dependent estimators of the form proposed by Hubcr ( 1964 ) and the efficiencies of procedures utilizing interquantiie ranges.are evaluated. Efficiencies of linear estimators such as trimmed means, BLUE's for the lambda family are computed for each density considered. Efficiencies of linear, polynomial and trigonometric approximations to BLUE weight functions are determined. Using the method of Birnbaum and Laska ( 1967 ) maximin efficiencies are computed using four linear or polynomial terms. On the basis of comparisons of these numerical results, suggestions for robust estimators are given     

Asymptotic behaviour and statistical applications of divergence measures in multinomial populations: a unified study

Divergence measures play an important role in statistical theory, especially in large sample theories of estimation and testing. The underlying reason is that they are indices of statistical distance between probability distributions P and Q; the smaller these indices are the harder it is to discriminate between P and Q. Many divergence measures have been proposed since the publication of the paper of Kullback and Leibler (1951). Renyi (1961) gave the first generalization of Kullback-Leibler divergence, Jeffreys (1946) defined the J-divergences, Burbea and Rao (1982) introduced the R-divergences, Sharma and Mittal (1977) the (r,s)-divergences, Csiszar (1967) the ϕ-divergences, Taneja (1989) the generalized J-divergences and the generalized R-divergences and so on. In order to do a unified study of their statistical properties, here we propose a generalized divergence, called (h,ϕ)-divergence, which include as particular cases the above mentioned divergence measures. Under different assumptions, it is shown that the asymptotic distributions of the (h,ϕ)-divergence statistics are either normal or chi square. The chi square and the likelihood ratio test statistics are particular cases of the (h,ϕ)-divergence test statistics considered. From the previous results, asymptotic distributions of entropy statistics are derived too. Applications to testing statistical hypothesis in multinomial populations are given. The Pitman and Bahadur efficiencies of tests of goodness of fit and independence based on these statistics are obtained. To finish, apendices with the asymptotic variances of many well known divergence and entropy statistics are presented. The research in this paper was supported in part by DGICYT Grants N. PB91-0387 and N. PB91-0155. Their financial support is gratefully acknowledged.     

Bootstrapping analogs of the one way MANOVA test

Abstract

Analogs of the classical one way MANOVA model have recently been suggested that do not assume that population covariance matrices are equal or that the error vector distribution is known. These tests are based on the sample mean and sample covariance matrix corresponding to each of the p populations. We show how to extend these tests using other measures of location such as the trimmed mean or coordinatewise median. These new bootstrap tests can have some outlier resistance, and can perform better than the tests based on the sample mean if the error vector distribution is heavy tailed.     

Statistical mining of interesting association rules

This article utilizes stochastic ideas for reasoning about association rule mining, and provides a formal statistical view of this discipline. A simple stochastic model is proposed, based on which support and confidence are reasonable estimates for certain probabilities of the model. Statistical properties of the corresponding estimators, like moments and confidence intervals, are derived, and items and itemsets are observed for correlations. After a brief review of measures of interest of association rules, with the main focus on interestingness measures motivated by statistical principles, two new measures are described. These measures, called α- and σ-precision, respectively, rely on statistical properties of the estimators discussed before. Experimental results demonstrate the effectivity of both measures.     

Sampling Some Truncated Distributions Via Rejection Algorithms

In this article, we develop rejection sampling algorithms to sample from some truncated and tail distributions. Such samplers are needed in many Markov chain Monte Carlo methods, often in connection with Bayesian inference. In addition to univariate normal, gamma, and beta distributions, we consider multivariate normal distributions truncated to certain sets.     

On several estimates to the precision parameter of Dirichlet process prior

The article presents careful comparisons among several empirical Bayes estimates to the precision parameter of Dirichlet process prior, with the setup of univariate observations and multigroup data. Specifically, the data are equipped with a two-stage compound sampling model, where the prior is assumed as a Dirichlet process that follows within a Bayesian nonparametric framework. The precision parameter α measures the strength of the prior belief and kinds of estimates are generated on the basis of observations, including the naive estimate, two calibrated naive estimates, and two different types of maximum likelihood estimates stemming from distinct distributions. We explore some theoretical properties and provide explicitly detailed comparisons among these estimates, in the perspectives of bias, variance, and mean squared error. Besides, we further present the corresponding calculation algorithms and numerical simulations to illustrate our theoretical achievements.     

Methods to test for equality of two normal distributions

Statistical tests for two independent samples under the assumption of normality are applied routinely by most practitioners of statistics. Likewise, presumably each introductory course in statistics treats some statistical procedures for two independent normal samples. Often, the classical two-sample model with equal variances is introduced, emphasizing that a test for equality of the expected values is a test for equality of both distributions as well, which is the actual goal. In a second step, usually the assumption of equal variances is discarded. The two-sample t test with Welch correction and the F test for equality of variances are introduced. The first test is solely treated as a test for the equality of central location, as well as the second as a test for the equality of scatter. Typically, there is no discussion if and to which extent testing for equality of the underlying normal distributions is possible, which is quite unsatisfactorily regarding the motivation and treatment of the situation with equal variances. It is the aim of this article to investigate the problem of testing for equality of two normal distributions, and to do so using knowledge and methods adequate to statistical practitioners as well as to students in an introductory statistics course. The power of the different tests discussed in the article is examined empirically. Finally, we apply the tests to several real data sets to illustrate their performance. In particular, we consider several data sets arising from intelligence tests since there is a large body of research supporting the existence of sex differences in mean scores or in variability in specific cognitive abilities.     

Location‐invariant Multi‐sample U‐tests for Covariance Matrices with Large Dimension

For two or more multivariate distributions with common covariance matrix, test statistics for certain special structures of the common covariance matrix are presented when the dimension of the multivariate vectors may exceed the number of such vectors. The test statistics are constructed as functions of location‐invariant estimators defined as U‐statistics, and the corresponding asymptotic theory is used to derive the limiting distributions of the proposed tests. The properties of the test statistics are established under mild and practical assumptions, and the same are numerically demonstrated using simulation results with small or moderate sample sizes and large dimensions.     

Testing for departures from nominal dispersion in generalized nonlinear models with varying dispersion and/or additive random effects

This paper discusses the tests for departures from nominal dispersion in the framework of generalized nonlinear models with varying dispersion and/or additive random effects. We consider two classes of exponential family distributions. The first is discrete exponential family distributions, such as Poisson, binomial, and negative binomial distributions. The second is continuous exponential family distributions, such as normal, gamma, and inverse Gaussian distributions. Correspondingly, we develop a unifying approach and propose several tests for testing for departures from nominal dispersion in two classes of generalized nonlinear models. The score test statistics are constructed and expressed in simple, easy to use, matrix formulas, so that the tests can easily be implemented using existing statistical software. The properties of test statistics are investigated through Monte Carlo simulations.     

The skew generalized t distribution as the scale mixture of a skew exponential power distribution and its applications in robust estimation

In this paper, we consider the family of skew generalized t (SGT) distributions originally introduced by Theodossiou [P. Theodossiou, Financial data and the skewed generalized t distribution, Manage. Sci. Part 1 44 (12) ( 1998), pp. 1650–1661] as a skew extension of the generalized t (GT) distribution. The SGT distribution family warrants special attention, because it encompasses distributions having both heavy tails and skewness, and many of the widely used distributions such as Student's t, normal, Hansen's skew t, exponential power, and skew exponential power (SEP) distributions are included as limiting or special cases in the SGT family. We show that the SGT distribution can be obtained as the scale mixture of the SEP and generalized gamma distributions. We investigate several properties of the SGT distribution and consider the maximum likelihood estimation of the location, scale, and skewness parameters under the assumption that the shape parameters are known. We show that if the shape parameters are estimated along with the location, scale, and skewness parameters, the influence function for the maximum likelihood estimators becomes unbounded. We obtain the necessary conditions to ensure the uniqueness of the maximum likelihood estimators for the location, scale, and skewness parameters, with known shape parameters. We provide a simple iterative re-weighting algorithm to compute the maximum likelihood estimates for the location, scale, and skewness parameters and show that this simple algorithm can be identified as an EM-type algorithm. We finally present two applications of the SGT distributions in robust estimation.