Testing independence based on Bernstein empirical copula and copula density

In this paper we provide three nonparametric tests of independence between continuous random variables based on the Bernstein copula distribution function and the Bernstein copula density function. The first test is constructed based on a Cramér-von Mises divergence-type functional based on the empirical Bernstein copula process. The two other tests are based on the Bernstein copula density and use Cramér-von Mises and Kullback–Leibler divergence-type functionals, respectively. Furthermore, we study the asymptotic null distribution of each of these test statistics. Finally, we consider a Monte Carlo experiment to investigate the performance of our tests. In particular we examine their size and power which we compare with those of the classical nonparametric tests that are based on the empirical distribution function.     

Universal codes as a basis for time series testing

We suggest a new approach to hypothesis testing for ergodic and stationary processes. In contrast to standard methods, the suggested approach gives a possibility to make tests, based on any lossless data compression method even if the distribution law of the codeword lengths is not known. We apply this approach to the following four problems: goodness-of-fit testing (or identity testing), testing for independence, testing of serial independence and homogeneity testing and suggest nonparametric statistical tests for these problems. It is important to note that practically used so-called archivers can be used for suggested testing.     

Powerful Trend Function Tests That Are Robust to Strong Serial Correlation,With an Application to the Prebisch–Singer Hypothesis

We propose tests for hypotheses on the parameters of the deterministic trend function of a univariate time series. The tests do not require knowledge of the form of serial correlation in the data, and they are robust to strong serial correlation. The data can contain a unit root and still have the correct size asymptotically. The tests that we analyze are standard heteroscedasticity autocorrelation robust tests based on nonparametric kernel variance estimators. We analyze these tests using the fixed-b asymptotic framework recently proposed by Kiefer and Vogelsang. This analysis allows us to analyze the power properties of the tests with regard to bandwidth and kernel choices. Our analysis shows that among popular kernels, specific kernel and bandwidth choices deliver tests with maximal power within a specific class of tests. Based on the theoretical results, we propose a data-dependent bandwidth rule that maximizes integrated power. Our recommended test is shown to have power that dominates a related test proposed by Vogelsang. We apply the recommended test to the logarithm of a net barter terms of trade series and we find that this series has a statistically significant negative slope. This finding is consistent with the well-known Prebisch–Singer hypothesis.     

Kendall's tau for serial dependence

The authors show how Kendall's tau can be adapted to test against serial dependence in a univariate time series context. They provide formulas for the mean and variance of circular and noncircular versions of this statistic, and they prove its asymptotic normality under the hypothesis of independence. They present also a Monte Carlo study comparing the power and size of a test based on Kendall's tau with the power and size of competing procedures based on alternative parametric and nonparametric measures of serial dependence. In particular, their simulations indicate that Kendall's tau outperforms Spearman's rho in detecting first‐order autoregressive dependence, despite the fact that these two statistics are asymptotically equivalent under the null hypothesis, as well as under local alternatives.     

The difference-sign runs length distribution in testing for serial independence

We investigate the sequence of difference-sign runs length of a time series in the context of non-parametric tests for serial independence. This sequence is, under suitable conditioning, a stationary sequence and we prove that the normalized correlation of two consecutive runs length is small (≈0.0427). We use this result in a test based on the relative entropy of the empirical distribution of the runs length. We investigate the performance of the test in simulated series and test serial independence of cardiac data series in atrial fibrillation.     

Measures of Dependence and Tests of Independence

Measures of dependence and resulting tests of independence are surveyed. Measures arising both from linear and nonlinear modeling are examined. Tests based on chaos theory are briefly discussed. The main emphasis, however, is on some recently developed nonparametric tests using estimated distribution and density functions. Most of the paper is phrased in terms of serial dependence for a univariate stationary time series, but it is indicated how more general situations can be analysed. The bootstrap is an essential tool for determining the critical value of the new tests.     

Generalized spectral tests for serial dependence

Two tests for serial dependence are proposed using a generalized spectral theory in combination with the empirical distribution function. The tests are generalizations of the Cramér-von Mises and Kolmogorov-Smirnov tests based on the standardized spectral distribution function. They do not involve the choice of a lag order, and they are consistent against all types of pairwise serial dependence, including those with zero autocorrelation. They also require no moment condition and are distribution free under serial independence. A simulation study compares the finite sample performances of the new tests and some closely related tests. The asymptotic distribution theory works well in finite samples. The generalized Cramér-von Mises test has good power against a variety of dependent alternatives and dominates the generalized Kolmogorov-Smirnov test. A local power analysis explains some important stylized facts on the power of the tests based on the empirical distribution function.     

Testing for Serial Independence: Beyond the Portmanteau Approach

Portmanteau tests are typically used to test serial independence even if, by construction, they are generally powerful only in presence of pairwise dependence between lagged variables. In this article, we present a simple statistic defining a new serial independence test, which is able to detect more general forms of dependence. In particular, differently from the Portmanteau tests, the resulting test is powerful also under a dependent process characterized by pairwise independence. A diagram, based on p-values from the proposed test, is introduced to investigate serial dependence. Finally, the effectiveness of the proposal is evaluated in a simulation study and with an application on financial data. Both show that the new test, used in synergy with the existing ones, helps in the identification of the true data-generating process. Supplementary materials for this article are available online.     

Power comparison of data depth-based nonparametric tests for testing equality of locations

In the recent years, the notion of data depth has been used in nonparametric multivariate data analysis since it gives natural ‘centre-outward’ ordering of multivariate data points with respect to the given data cloud. In the literature, various nonparametric tests are developed for testing equality of location of two multivariate distributions based on data depth. Here, we define two nonparametric tests based on two different test statistic for testing equality of locations of two multivariate distributions. In the present work, we compare the performance of these tests with the tests developed by Li and Liu [New nonparametric tests of multivariate locations and scales using data depth. Statist Sci. 2004;(1):686–696] for testing equality of locations of two multivariate distributions. Comparison in terms of power is done for multivariate symmetric and skewed distributions using simulation for three popular depth functions. Application of tests to real life data is provided. Conclusion and recommendations are also provided.     

Kernel partial correlation: a novel approach to capturing conditional independence in graphical models for noisy data

Graphical models capture the conditional independence structure among random variables via existence of edges among vertices. One way of inferring a graph is to identify zero partial correlation coefficients, which is an effective way of finding conditional independence under a multivariate Gaussian setting. For more general settings, we propose kernel partial correlation which extends partial correlation with a combination of two kernel methods. First, a nonparametric function estimation is employed to remove effects from other variables, and then the dependence between remaining random components is assessed through a nonparametric association measure. The proposed approach is not only flexible but also robust under high levels of noise owing to the robustness of the nonparametric approaches.     

NONPARAMETRIC ESTIMATION OF GENEWISE VARIANCE FOR MICROARRAY DATA

Estimation of genewise variance arises from two important applications in microarray data analysis: selecting significantly differentially expressed genes and validation tests for normalization of microarray data. We approach the problem by introducing a two-way nonparametric model, which is an extension of the famous Neyman-Scott model and is applicable beyond microarray data. The problem itself poses interesting challenges because the number of nuisance parameters is proportional to the sample size and it is not obvious how the variance function can be estimated when measurements are correlated. In such a high-dimensional nonparametric problem, we proposed two novel nonparametric estimators for genewise variance function and semiparametric estimators for measurement correlation, via solving a system of nonlinear equations. Their asymptotic normality is established. The finite sample property is demonstrated by simulation studies. The estimators also improve the power of the tests for detecting statistically differentially expressed genes. The methodology is illustrated by the data from MicroArray Quality Control (MAQC) project.     

Tests for Serial Dependence and Other Specification Analysis in Models of Markets in Disequilibrium

The assumption of serial independence of disturbances is the starting point of most of the work done on analyzing market disequilibrium models. We derive tests for serial dependence given normality and homoscedasticity using the Lagrange multiplier (LM) test principle. Although the likelihood function under serial dependence is very complicated and involves multiple integrals of dimensions equal to the sample size, the test statistic we obtain through the LM principle is very simple. We apply the test to the housing-start data of Fair and Jaffee (1972) and study its finite sample properties through simulation. The test seems to perform quite well in finite samples in terms of size and power. We present an analysis of disequilibrium models that assumes that the disturbances are logistic rather than normal. The relative performances of these distributions are investigated by simulation.     

Testing for the Equality of Two Nonparametric Regression Curves with Long Memory Errors

This article discusses the problem of testing the equality of two nonparametric regression functions against two-sided alternatives for uniform design on [0,1] with long memory moving average errors. The standard deviations and the long memory parameters are possibly different for the two errors. The article adapts the partial sum process idea used in the independent observations settings to construct the tests and derives their asymptotic null distributions. The article also shows that these tests are consistent for general alternatives and obtains their limiting distributions under a sequence of local alternatives. Since the limiting null distributions of these tests are unknown, we first conducted a Monte Carlo simulation study to obtain a few selected critical values of the proposed tests. Then based on these critical values, another Monte Carlo simulation is conducted to study the finite sample level and power behavior of these tests at some alternatives. The article also contains a simulation study that assesses the effect of estimating the nonparametric regression function on an estimate of the long memory parameter of the errors. It is observed that the estimate based on direct observations is generally preferable over the one based on the estimated nonparametric residuals.     

Nonparametric tests for strictly increasing virtual valuations

This paper shows that for absolutely continuous valuation distributions the increasing virtual valuations is equivalent to the increasing odds rate. Based on this new characterization we develop two nonparametric tests for the strictly increasing virtual valuations by using the generalized total time on test transform. The empirical type I error rate and power performance of the two tests are examined through Monte Carlo simulations. As illustrations the two tests are also applied to two real data sets collected from eBay.     

An Empirical Analysis of Some Nonparametric Goodness-of-Fit Tests for Censored Data

In this article, we consider some nonparametric goodness-of-fit tests for right censored samples, viz., the modified Kolmogorov, Cramer–von Mises–Smirnov, Anderson–Darling, and Nikulin–Rao–Robson χ² tests. We also consider an approach based on a transformation of the original censored sample to a complete one and the subsequent application of classical goodness-of-fit tests to the pseudo-complete sample. We then compare these tests in terms of power in the case of Type II censored data along with the power of the Neyman–Pearson test, and draw some conclusions. Finally, we present an illustrative example.     

Nonlinear measures of association with kernel canonical correlation analysis and applications

Measures of association between two sets of random variables have long been of interest to statisticians. The classical canonical correlation analysis (LCCA) can characterize, but also is limited to, linear association. This article introduces a nonlinear and nonparametric kernel method for association study and proposes a new independence test for two sets of variables. This nonlinear kernel canonical correlation analysis (KCCA) can also be applied to the nonlinear discriminant analysis. Implementation issues are discussed. We place the implementation of KCCA in the framework of classical LCCA via a sequence of independent systems in the kernel associated Hilbert spaces. Such a placement provides an easy way to carry out the KCCA. Numerical experiments and comparison with other nonparametric methods are presented.     

A Projection-Based Nonparametric Test of Conditional Quantile Independence

Abstract

This paper proposes a nonparametric procedure for testing conditional quantile independence using projections. Relative to existing smoothed nonparametric tests, the resulting test statistic: (i) detects the high frequency local alternatives that converge to the null hypothesis in probability at faster rate and, (ii) yields improvements in the finite sample power when a large number of variables are included under the alternative. In addition, it allows the researcher to include qualitative information and, if desired, direct the test against specific subsets of alternatives without imposing any functional form on them. We use the weighted Nadaraya-Watson (WNW) estimator of the conditional quantile function avoiding the boundary problems in estimation and testing and prove weak uniform consistency (with rate) of the WNW estimator for absolutely regular processes. The procedure is applied to a study of risk spillovers among the banks. We show that the methodology generalizes some of the recently proposed measures of systemic risk and we use the quantile framework to assess the intensity of risk spillovers among individual financial institutions.     

Nonparametric Independence Screening in Sparse Ultra-High Dimensional Additive Models

A variable screening procedure via correlation learning was proposed in Fan and Lv (2008) to reduce dimensionality in sparse ultra-high dimensional models. Even when the true model is linear, the marginal regression can be highly nonlinear. To address this issue, we further extend the correlation learning to marginal nonparametric learning. Our nonparametric independence screening is called NIS, a specific member of the sure independence screening. Several closely related variable screening procedures are proposed. Under general nonparametric models, it is shown that under some mild technical conditions, the proposed independence screening methods enjoy a sure screening property. The extent to which the dimensionality can be reduced by independence screening is also explicitly quantified. As a methodological extension, a data-driven thresholding and an iterative nonparametric independence screening (INIS) are also proposed to enhance the finite sample performance for fitting sparse additive models. The simulation results and a real data analysis demonstrate that the proposed procedure works well with moderate sample size and large dimension and performs better than competing methods.     

Goodness-of-fit tests for one-shot device accelerated life testing data

In this article, we develop a formal goodness-of-fit testing procedure for one-shot device testing data, in which each observation in the sample is either left censored or right censored. Such data are also called current status data. We provide an algorithm for calculating the nonparametric maximum likelihood estimate (NPMLE) of the unknown lifetime distribution based on such data. Then, we consider four different test statistics that can be used for testing the goodness-of-fit of accelerated failure time (AFT) model by the use of samples of residuals: a chi-square-type statistic based on the difference between the empirical and expected numbers of failures at each inspection time; two other statistics based on the difference between the NPMLE of the lifetime distribution obtained from one-shot device testing data and the distribution specified under the null hypothesis; as a final statistic, we use White's idea of comparing two estimators of the Fisher Information (FI) to propose a test statistic. We then compare these tests in terms of power, and draw some conclusions. Finally, we present an example to illustrate the proposed tests.     

An empirical study of the type I error rate and power for some selected normal-theory and nonparametric tests of the independence of two sets of variables

Normal-theory tests of the hypothesis of no relationship among two sets of variables require assumptions of independence, hamoscedasticity, and normality. If, however, the assumption of normality is not tenable, there are few guidelines for properly using these tests. Historically, the lack of a comprehensive hypothesis-testing framework in the nonparametric case has provided few alternatives to normal-theory procedures. Fortunately, this situation has changed with the introduction of nonparametric, general linear model-based tests that can be used with existing computing packages. Multivariate-nonparametric tests due to Puri and Sen (1969, 1971, 1985) and Conover and Iman (1981) are outlined, and the results of a simulation study of the performance of three nonparametric and one normal-theory test of the hypothesis of no relationship among two sets of variables are presented. These results suggest that multivariate-nonparametric tests should be considered for a variety of data conditions. especially heavy-tailed and badly skewed data for small samples and a large number of variates.