On the validity of the perturbation method in asymptotic theory

The perturbation methods and the Taylor expansions are very often used to obtain test statistics approximations in multivariate analysis (Specially in Principal Component and Canonical Analyses). These approximations are then used to obtain formal Edgeworth expransions of the distribution functions of the statistics. BHATTACHARYA and GHOSH 1978 have justified these practices under suitable assumptions. In this paper a non classical perturbation problem is solved in order to obtain almost surely expansions of test statistics     

Hypothesis Testing of Hazard Ratio Parameters in Marginal Models for Multivariate Failure Time Data

Marginal hazard models for multivariate failure time data have been studied extensively in recent literature. However, standard hypothesis test statistics based on the likelihood method are not exactly appropriate for this kind of model. In this paper, extensions of the three commonly used likelihood hypothesis test statistics are discussed. Generalized Wald, generalized score and generalized likelihood ratio tests for hazard ratio parameters in a marginal hazard model for multivariate failure time data are proposed and their asymptotic distributions examined. The finite sample properties of these statistics are studied through simulations. The proposed method is applied to data from Busselton Population Health Surveys.     

Dependence structure of generalized order statistics

In this article, simple expressions for marginal density functions of multiply censored generalized order statistics based on continuous distribution functions are obtained. Moreover, it is shown that generalized order statistics are multivariate totally positive and, thus, associated. This property is applied to show that regressions of generalized order statistics are nondecreasing under weak conditions.     

Rényi statistics for testing equality of autocorrelation coefficients

The problem of testing for equality of autocorrelation coefficients of two populations in multivariate data when errors are autocorrelated is considered. We derive Rényi statistics defined as divergences between unrestricted and restricted estimated joint probability density functions and we show that they are asymptotically chi-square distributed under the null hypothesis of interest. Monte Carlo simulation experiments are carried out to investigate the behavior of Rényi statistics and to make comparisons with test statistics based on the approach of Bhandary [M. Bhandary, Test for equality of autocorrelation coefficients for two populations in multivariate data when the errors are autocorrelated, Statistics & Probability Letters 73 (2005) 333–342] for the problem under consideration. Rényi statistics showed to have significantly better behavior.     

Nonparametric Comparison for Multivariate Panel Count Data

Multivariate panel count data often occur when there exist several related recurrent events or response variables defined by occurrences of related events. For univariate panel count data, several nonparametric treatment comparison procedures have been developed. However, it does not seem to exist a nonparametric procedure for multivariate cases. Based on differences between estimated mean functions, this article proposes a class of nonparametric test procedures for multivariate panel count data. The asymptotic distribution of the new test statistics is established and a simulation study is conducted. Moreover, the new procedures are applied to a skin cancer problem that motivated this study.     

Neural networks and flexible regression and discrimination

Feed-forward neural networks—also known as multi-layer perceptrons—are now widely used for regression and classification. In parallel but slightly earlier, a family of methods for flexible regression and discrimination were developed in multivariate statistics, and tree-induction methods have been developed in both machine learning and statistics. We expound and compare these approaches in the context of a number of examples.     

Neural networks and flexible regression and discrimination

Feed-forward neural networks—also known as multi-layer perceptrons—are now widely used for regression and classification. In parallel but slightly earlier, a family of methods for flexible regression and discrimination were developed in multivariate statistics, and tree-induction methods have been developed in both machine learning and statistics. We expound and compare these approaches in the context of a number of examples.     

Asymptotic Properties of Generalized Multivariate Rank Statistics

This article discusses generalization of the well-known multivariate rank statistics under right-censored data case. Empirical process representation used to get the generalization. The marginal distribution functions are estimated by Kaplan–Meier estimators. Sufficient conditions for asymptotic normality of the generalized multivariate rank statistics under independently right censored data are specified. Several auxiliary results on sup-norm convergence of Kaplan–Meier estimators in randomly exhausting regions are given too.     

Approximation of power in multivariate analysis

We consider the calculation of power functions in classical multivariate analysis. In this context, power can be expressed in terms of tail probabilities of certain noncentral distributions. The necessary noncentral distribution theory was developed between the 1940s and 1970s by a number of authors. However, tractable methods for calculating the relevant probabilities have been lacking. In this paper we present simple yet extremely accurate saddlepoint approximations to power functions associated with the following classical test statistics: the likelihood ratio statistic for testing the general linear hypothesis in MANOVA; the likelihood ratio statistic for testing block independence; and Bartlett's modified likelihood ratio statistic for testing equality of covariance matrices.     

Power Comparison of Multivariate Wilcoxon-type Tests Based on the Jurečková–Kalina’s Ranks of Distances

A multivariate two-sample testing problem is one of the most important topics in nonparametric statistics. One of the multivariate two-sample testing problems based on the Jure?ková–Kalina ranks of distance is discussed in this article. Further, a multivariate Wilcoxon-type test is proposed for testing the equality of two continuous distribution functions. Simulations are used to investigate the power of this test for the two-sided alternative with various population distributions. The results show that the proposed test statistic is more suitable than various existing statistics for testing a shift in the locationt and location-scale parameters.     

A Smooth Nonparametric,Multivariate, Mixed-Data Location-Scale Test

Abstract

A number of tests have been proposed for assessing the location-scale assumption that is often invoked by practitioners. Existing approaches include Kolmogorov–Smirnov and Cramer–von Mises statistics that each involve measures of divergence between unknown joint distribution functions and products of marginal distributions. In practice, the unknown distribution functions embedded in these statistics are typically approximated using nonsmooth empirical distribution functions (EDFs). In a recent article, Li, Li, and Racine establish the benefits of smoothing the EDF for inference, though their theoretical results are limited to the case where the covariates are observed and the distributions unobserved, while in the current setting some covariates and their distributions are unobserved (i.e., the test relies on population error terms from a location-scale model) which necessarily involves a separate theoretical approach. We demonstrate how replacing the nonsmooth distributions of unobservables with their kernel-smoothed sample counterparts can lead to substantial power improvements, and extend existing approaches to the smooth multivariate and mixed continuous and discrete data setting in the presence of unobservables. Theoretical underpinnings are provided, Monte Carlo simulations are undertaken to assess finite-sample performance, and illustrative applications are provided.     

Location‐invariant Multi‐sample U‐tests for Covariance Matrices with Large Dimension

For two or more multivariate distributions with common covariance matrix, test statistics for certain special structures of the common covariance matrix are presented when the dimension of the multivariate vectors may exceed the number of such vectors. The test statistics are constructed as functions of location‐invariant estimators defined as U‐statistics, and the corresponding asymptotic theory is used to derive the limiting distributions of the proposed tests. The properties of the test statistics are established under mild and practical assumptions, and the same are numerically demonstrated using simulation results with small or moderate sample sizes and large dimensions.     

Some principles for surveillance adopted for multivariate processes with a common change point

The surveillance of multivariate processes has received growing attention during the last decade. Several generalizations of well-known methods such as Shewhart, CUSUM and EWMA charts have been proposed. Many of these multivariate procedures are based on a univariate summarized statistic of the multivariate observations, usually the likelihood ratio statistic. In this paper we consider the surveillance of multivariate observation processes for a shift between two fully specified alternatives. The effect of the dimension reduction using likelihood ratio statistics are discussed in the context of sufficiency properties. Also, an example of the loss of efficiency when not using the univariate sufficient statistic is given. Furthermore, a likelihood ratio method, the LR method, for constructing surveillance procedures is suggested for multivariate surveillance situations. It is shown to produce univariate surveillance procedures based on the sufficient likelihood ratios. As the LR procedure has several optimality properties in the univariate, it is also used here as a benchmark for comparisons between multivariate surveillance procedures     

CASE-DELETION DIAGNOSTICS FOR TEST STATISTICS IN MULTIVARIATE REGRESSION

Influence measures in multivariate regression analysis have been widely developed, especially through use of the case-deletion approach. However, there seem to be few accounts of the influence of observations on test statistics in hypothesis testing. This paper examines four common multivariate tests, namely the Wilks' ratio, Lawley-Hotelling trace, Pillai's trace and Roy's greatest root for testing a general linear hypothesis of the regression coefficients in multivariate regression. The influence of observations is measured using the case-deletion approach. The proposed diagnostic measures, except that of Roy's greatest root, can be expressed in terms of statistics without involving the actual deletion of observations. An illustrative example is given with satisfactory results.     

Generalized discriminant analysis based on distances

This paper describes a method of generalized discriminant analysis based on a dissimilarity matrix to test for differences in a priori groups of multivariate observations. Use of classical multidimensional scaling produces a low‐dimensional representation of the data for which Euclidean distances approximate the original dissimilarities. The resulting scores are then analysed using discriminant analysis, giving tests based on the canonical correlations. The asymptotic distributions of these statistics under permutations of the observations are shown to be invariant to changes in the distributions of the original variables, unlike the distributions of the multi‐response permutation test statistics which have been considered by other workers for testing differences among groups. This canonical method is applied to multivariate fish assemblage data, with Monte Carlo simulations to make power comparisons and to compare theoretical results and empirical distributions. The paper proposes classification based on distances. Error rates are estimated using cross‐validation.     

Wald,LM and LR test statistics of linear hypothese in a strutural equation model

For the linear hypothesis in a strucural equation model, the properties of test statistics based on the two stage least squares estimator (2SLSE) have been examined since these test statistics are easily derived in the instrumental variable estimation framework. Savin (1976) has shown that inequalities exist among the test statistics for the linear hypothesis, but it is well known that there is no systematic inequality among these statistics based on 2SLSE for the linear hypothesis in a structural equation model. Morimune and Oya (1994) derived the constrained limited information maximum likelihood estimator (LIMLE) subject to general linear constraints on the coefficients of the structural equation, as well as Wald, LM and Lr Test statistics for the adequacy of the linear constraints.

In this paper, we derive the inequalities among these three test statistics based on LIMLE and the local power functions based on Limle and 2SLSE to show that there is no test statistic which is uniformly most powerful, and the LR test statistic based on LIMLE is locally unbised and the other test statistics are not. Monte Carlo simulations are used to examine the actual sizes of these test statistics and some numerical examples of the power differences among these test statistics are given. It is found that the actual sizes of these test statistics are greater than the nominal sizes, the differences between the actual and nominal sizes of Wald test statistics are generally the greatest, those of LM test statistics are the smallest, and the power functions depend on the correlations between the endogenous explanatory variables and the error term of the structural equation, the asymptotic variance of estimator of coefficients of the structural equation and the number of restrictions imposed on the coefficients.     

Wald,LM and LR test statistics of linear hypothese in a strutural equation model

For the linear hypothesis in a strucural equation model, the properties of test statistics based on the two stage least squares estimator (2SLSE) have been examined since these test statistics are easily derived in the instrumental variable estimation framework. Savin (1976) has shown that inequalities exist among the test statistics for the linear hypothesis, but it is well known that there is no systematic inequality among these statistics based on 2SLSE for the linear hypothesis in a structural equation model. Morimune and Oya (1994) derived the constrained limited information maximum likelihood estimator (LIMLE) subject to general linear constraints on the coefficients of the structural equation, as well as Wald, LM and Lr Test statistics for the adequacy of the linear constraints.

In this paper, we derive the inequalities among these three test statistics based on LIMLE and the local power functions based on Limle and 2SLSE to show that there is no test statistic which is uniformly most powerful, and the LR test statistic based on LIMLE is locally unbised and the other test statistics are not. Monte Carlo simulations are used to examine the actual sizes of these test statistics and some numerical examples of the power differences among these test statistics are given. It is found that the actual sizes of these test statistics are greater than the nominal sizes, the differences between the actual and nominal sizes of Wald test statistics are generally the greatest, those of LM test statistics are the smallest, and the power functions depend on the correlations between the endogenous explanatory variables and the error term of the structural equation, the asymptotic variance of estimator of coefficients of the structural equation and the number of restrictions imposed on the coefficients.     

The influence of a single observation on some standard test statistics

The ideas of influence are now well known, and influence functions have been investigated widely, especially in the contexts of regression analysis and multivariate analysis. However, there seems to be no published account of the influence of single observations on simple one-sample tests for means and variance. The usual test statistics, based on normality assumptions, for a mean when the variance is known, and for the variance, display an obvious behaviour when an extra observation is added to a data set. However, the t-test for a single mean has a more interesting, and less predictable, pattern of behaviour. The t-statistic also demonstrates how the theoretical influence function can sometimes be misleading when used to estimate the effect of inserting or deleting a single observation.     

New multivariate aging notions based on the corrected orthant and the standard construction

ABSTRACT

Recently, some well-known univariate aging classes of lifetime distributions have been characterized by means of properties of their quantile functions and excess-wealth functions. The generalization of the univariate aging notions to the multivariate case involve, among other factors, appropriate definitions of multivariate quantiles or regression representation and related notions, which are able to correctly describe the intrinsic characteristic of the concepts of aging that should be generalized. The multivariate versions of these notions, which are characterized by using the multivariate u-quantiles and the multivariate excess-wealth function, are considered in this paper. Relationships between such multivariate aging classes are studied, and examples are provided.     

A Class of Permutation Tests for the Equality of Two Marginal Survival Functions Using Paired Censored Data

We studied several test statistics for testing the equality of marginal survival functions of paired censored data. The null distribution of the test statistics was approximated by permutation. These tests do not require explicit modeling or estimation of the within-pair correlation, accommodate both paired data and singletons, and the computation is straightforward with most statistical software. Numerical studies showed that these tests have competitive size and power performance. One test statistic has higher power than previously published test statistics when the two survival functions under comparison cross. We illustrate use of these tests in a propensity score matched dataset.