A nonparametric approach to detecting the difference of survival medians

Some nonparametric methods have been proposed to compare survival medians. Most of them are based on the asymptotic null distribution to estimate the p-value. However, for small to moderate sample sizes, those tests may have inflated Type I error rate, which makes their application limited. In this article, we proposed a new nonparametric test that uses bootstrap to estimate the sample mean and variance of the median. Through comprehensive simulation, we show that the proposed approach can control Type I error rates well. A real data application is used to illustrate the use of the new test.     

Remember the curse of dimensionality: the case of goodness-of-fit testing in arbitrary dimension

Despite a substantial literature on nonparametric two-sample goodness-of-fit testing in arbitrary dimensions, there is no mention there of any curse of dimensionality. In fact, in some publications, a parametric rate is derived. As we discuss below, this is because a directional alternative is considered. Indeed, even in dimension one, Ingster, Y. I. [(1987). Minimax testing of nonparametric hypotheses on a distribution density in the l_p metrics. Theory of Probability & Its Applications, 31(2), 333–337] has shown that the minimax rate is not parametric. In this paper, we extend his results to arbitrary dimension and confirm that the minimax rate is not only nonparametric, exhibits but also a prototypical curse of dimensionality. We further extend Ingster's work to show that the chi-squared test achieves the minimax rate. Moreover, we show that the test adapts to the intrinsic dimensionality of the data. Finally, in the spirit of Ingster, Y. I. [(2000). Adaptive chi-square tests. Journal of Mathematical Sciences, 99(2), 1110–1119], we consider a multiscale version of the chi-square test, showing that one can adapt to unknown smoothness without much loss in power.     

Smoothed bootstrap bandwidth selection for nonparametric hazard rate estimation

A smoothed bootstrap method is presented for the purpose of bandwidth selection in nonparametric hazard rate estimation for iid data. In this context, two new bootstrap bandwidth selectors are established based on the exact expression of the bootstrap version of the mean integrated squared error of some approximations of the kernel hazard rate estimator. This is very useful since Monte Carlo approximation is no longer needed for the implementation of the two bootstrap selectors. A simulation study is carried out in order to show the empirical performance of the new bootstrap bandwidths and to compare them with other existing selectors. The methods are illustrated by applying them to a diabetes data set.     

Nonparametric tests for conditional independence using conditional distributions

The concept of causality is naturally defined in terms of conditional distribution, however almost all the empirical works focus on causality in mean. This paper aims to propose a nonparametric statistic to test the conditional independence and Granger non-causality between two variables conditionally on another one. The test statistic is based on the comparison of conditional distribution functions using an L₂ metric. We use Nadaraya–Watson method to estimate the conditional distribution functions. We establish the asymptotic size and power properties of the test statistic and we motivate the validity of the local bootstrap. We ran a simulation experiment to investigate the finite sample properties of the test and we illustrate its practical relevance by examining the Granger non-causality between S&P 500 Index returns and VIX volatility index. Contrary to the conventional t-test which is based on a linear mean-regression, we find that VIX index predicts excess returns both at short and long horizons.     

A REVIEW OF SYSTEMS COINTEGRATION TESTS

The literature on systems cointegration tests is reviewed and the various sets of assumptions for the asymptotic validity of the tests are compared within a general unifying framework. The comparison includes likelihood ratio tests, Lagrange multiplier and Wald type tests, lag augmentation tests, tests based on canonical correlations, the Stock-Watson tests and Bierens' nonparametric tests. Asymptotic results regarding the power of these tests and previous small sample simulation studies are discussed. Further issues and proposals in the context of systems cointegration tests are also considered briefly. New simulations are presented to compare the tests under uniform conditions. Special emphasis is given to the sensitivity of the test performance with respect to the trending properties of the DGP.     

An adaptive two-sample location-scale test of lepage type for symmetric distributions

For the two-sample location and scale problem we propose an adaptive test which is based on so called Lepage type tests. The well known test of Lepage (1971) is a combination of the Wilcoxon test for location alternatives and the Ansari-Bradley test for scale alternatives and it behaves well for symmetric and medium-tailed distributions. For the cae of short-, medium- and long-tailed distributions we replace the Wilcoxon test and the .Ansari-Bradley test by suitable other two-sample tests for location and scale, respectively, in oder to get higher power than the classical Lepage test for such distribotions. These tests here are called Lepage type tests. in practice, however, we generally have no clear idea about the distribution having generated our data. Thus, an adaptive test should be applied which takes the the given data set inio consideration. The proposed adaptive test is based on the concept of Hogg (1974), i.e., first, to classify the unknown symmetric distribution function with respect to a measure for tailweight and second, to apply an appropriate Lepage type test for this classified type of distribution. We compare the adaptive test with the three Lepage type tests in the adaptive scheme and with the classical Lepage test as well as with other parametric and nonparametric tests. The power comparison is carried out via Monte Carlo simulation. It is shown that the adaptive test is the best one for the broad class of distributions considered.     

The Size and Power of Bootstrap and Bartlett-Corrected Tests of Hypotheses on the Cointegrating Vectors

In this paper we compare Bartlett-corrected, bootstrap, and fast double bootstrap tests on maximum likelihood estimates of cointegration parameters. The key result is that both the bootstrap and the Bartlett-corrected tests must be based on the unrestricted estimates of the cointegrating vectors: procedures based on the restricted estimates have almost no power. The small sample size bias of the asymptotic test appears so severe as to advise strongly against its use with the sample sizes commonly available; the fast double bootstrap test minimizes size bias, while the Bartlett-corrected test is somehow more powerful.     

Measuring Nonlinear Granger Causality in Mean

We propose model-free measures for Granger causality in mean between random variables. Unlike the existing measures, ours are able to detect and quantify nonlinear causal effects. The new measures are based on nonparametric regressions and defined as logarithmic functions of restricted and unrestricted mean square forecast errors. They are easily and consistently estimated by replacing the unknown mean square forecast errors by their nonparametric kernel estimates. We derive the asymptotic normality of nonparametric estimator of causality measures, which we use to build tests for their statistical significance. We establish the validity of smoothed local bootstrap that one can use in finite sample settings to perform statistical tests. Monte Carlo simulations reveal that the proposed test has good finite sample size and power properties for a variety of data-generating processes and different sample sizes. Finally, the empirical importance of measuring nonlinear causality in mean is also illustrated. We quantify the degree of nonlinear predictability of equity risk premium using variance risk premium. Our empirical results show that the variance risk premium is a very good predictor of risk premium at horizons less than 6 months. We also find that there is a high degree of predictability at the 1-month horizon, that can be attributed to a nonlinear causal effect. Supplementary materials for this article are available online.     

Testing independence based on Bernstein empirical copula and copula density

In this paper we provide three nonparametric tests of independence between continuous random variables based on the Bernstein copula distribution function and the Bernstein copula density function. The first test is constructed based on a Cramér-von Mises divergence-type functional based on the empirical Bernstein copula process. The two other tests are based on the Bernstein copula density and use Cramér-von Mises and Kullback–Leibler divergence-type functionals, respectively. Furthermore, we study the asymptotic null distribution of each of these test statistics. Finally, we consider a Monte Carlo experiment to investigate the performance of our tests. In particular we examine their size and power which we compare with those of the classical nonparametric tests that are based on the empirical distribution function.     

Nonparametric tests for multivariate multi-sample locations based on data depth

Several nonparametric tests for multivariate multi-sample location problem are proposed in this paper. These tests are based on the notion of data depth, which is used to measure the centrality/outlyingness of a given point with respect to a given distribution or a data cloud. Proposed tests are completely nonparametric and implemented through the idea of permutation tests. Performance of the proposed tests is compared with existing parametric test and nonparametric test based on data depth. An extensive simulation study reveals that proposed tests are superior to the existing tests based on data depth with regard to power. Illustrations with real data are provided.     

Comments

In this paper we compare Bartlett-corrected, bootstrap, and fast double bootstrap tests on maximum likelihood estimates of cointegration parameters. The key result is that both the bootstrap and the Bartlett-corrected tests must be based on the unrestricted estimates of the cointegrating vectors: procedures based on the restricted estimates have almost no power. The small sample size bias of the asymptotic test appears so severe as to advise strongly against its use with the sample sizes commonly available; the fast double bootstrap test minimizes size bias, while the Bartlett-corrected test is somehow more powerful.     

Bootstrap hypothesis testing in generalized additive models for comparing curves of treatments in longitudinal studies

The study of the effect of a treatment may involve the evaluation of a variable at a number of moments. When assuming a smooth curve for the mean response along time, estimation can be afforded by spline regression, in the context of generalized additive models. The novelty of our work lies in the construction of hypothesis tests to compare two curves of treatments in any interval of time for several types of response variables. The within-subject correlation is not modeled but is considered to obtain valid inferences by the use of bootstrap. We propose both semiparametric and nonparametric bootstrap approaches, based on resampling vectors of residuals or responses, respectively. Simulation studies revealed a good performance of the tests, considering, for the outcome, different distribution functions in the exponential family and varying the correlation between observations along time. We show that the sizes of bootstrap tests are close to the nominal value, with tests based on a standardized statistic having slightly better size properties. The power increases as the distance between curves increases and decreases when correlation gets higher. The usefulness of these statistical tools was confirmed using real data, thus allowing to detect changes in fish behavior when exposed to the toxin microcystin-RR.     

On Robustness of Model-Based Bootstrap Schemes in Nonparametric Time Series Analysis

Theory in time series analysis is often developed under the assumption of finite-dimensional models for the data generating process. Whereas corresponding estimators such as those of a conditional mean function are reasonable even if the true dependence mechanism is more complex, it is usually necessary to capture the whole dependence structure asymptotically for the bootstrap to be valid. In contrast, we show that certain simplified bootstrap schemes which imitate only some aspects of the time series are consistent for quantities arising in nonparametric statistics. To this end, we generalize the well-known "whitening by windowing" principle to joint distributions of nonparametric estimators of the autoregression function. Consequently, we obtain that model-based nonparametric bootstrap schemes remain valid for supremum-type functionals as long as they mimic those finite-dimensional joint distributions consistently which determine the quantity of interest. As an application, we show that simple regression-type bootstrap schemes can be applied for the determination of critical values for nonparametric tests of parametric or semiparametric hypotheses on the autoregression function in the context of a general process.     

A Discussion of Permutation Tests Conditional to Observed Responses in Unreplicated 2 M Full Factorial Designs

ABSTRACT

In this article we present a new solution to test for effects in unreplicated two-level factorial designs. The proposed test statistic, in case the error components are normally distributed, follows an F random variable, though our attention is on its nonparametric permutation version. The proposed procedure does not require any transformation of data such as residualization and it is exact for each effect and distribution-free. Our main aim is to discuss a permutation solution conditional to the original vector of responses. We give two versions of the same nonparametric testing procedure in order to control both the individual error rate and the experiment-wise error rate. A power comparison with Loughin and Noble's test is provided in the case of a unreplicated 2⁴ full factorial design.     

Simple and Exact Empirical Likelihood Ratio Tests for Normality Based on Moment Relations

The empirical likelihood (EL) technique is a powerful nonparametric method with wide theoretical and practical applications. In this article, we use the EL methodology in order to develop simple and efficient goodness-of-fit tests for normality based on the dependence between moments that characterizes normal distributions. The new empirical likelihood ratio (ELR) tests are exact and are shown to be very powerful decision rules based on small to moderate sample sizes. Asymptotic results related to the Type I error rates of the proposed tests are presented. We present a broad Monte Carlo comparison between different tests for normality, confirming the preference of the proposed method from a power perspective. A real data example is provided.     

THE POWER OF STUDENT'S t TEST: CAN A NON-SIMILAR TEST DO BETTER?

Lehmann & Stein (1948) proved the existence of non-similar tests which can be more powerful than best similar tests. They used Student's problem of testing for a non-zero mean given a random sample from the normal distribution with unknown variance as an example. This raises the question: should we use a non-similar test instead of Student's t test? Questions like this can be answered by comparing the power of the test with the power envelope. This paper discusses the difficulties involved in computing power envelopes. It reports an empirical comparison of the power of the t test and the power envelope and finds that the two are almost identical especially for sample sizes greater than 20. These findings suggest that, as well as being uniformly most powerful (UMP) within the class of similar tests, Student's t test is approximately UMP within the class of all tests. For practical purposes it might also be regarded as UMP when moderate or large sample sizes are involved.     

Controlling Type-I Error Rate in Monitoring Structural Changes Using Partially Sequential Procedures

In the present article, we develop some asymptotically power on partially sequential nonparametric tests for monitoring structural changes. Our test procedures are based on Wilcoxon score. We use the idea of curved stopping boundaries. We derive some exact results and perform simulation studies to provide various properties of the tests. We see that one of the proposed procedures significantly controls the Type I error rate. This procedure may be very effective for fluctuation monitoring. We illustrate the procedures by using real life data from the stock market.     

A non-parametric statistic for testing conditional heteroscedasticity for unobserved component models

When prediction intervals are constructed using unobserved component models (UCM), problems can arise due to the possible existence of components that may or may not be conditionally heteroscedastic. Accurate coverage depends on correctly identifying the source of the heteroscedasticity. Different proposals for testing heteroscedasticity have been applied to UCM; however, in most cases, these procedures are unable to identify the heteroscedastic component correctly. The main issue is that test statistics are affected by the presence of serial correlation, causing the distribution of the statistic under conditional homoscedasticity to remain unknown. We propose a nonparametric statistic for testing heteroscedasticity based on the well-known Wilcoxon''s rank statistic. We study the asymptotic validation of the statistic and examine bootstrap procedures for approximating its finite sample distribution. Simulation results show an improvement in the size of the homoscedasticity tests and a power that is clearly comparable with the best alternative in the literature. We also apply the test on real inflation data. Looking for the presence of a conditionally heteroscedastic effect on the error terms, we arrive at conclusions that almost all cases are different than those given by the alternative test statistics presented in the literature.     

Shapiro–Wilk test for skew normal distributions based on data transformations

A probability property that connects the skew normal (SN) distribution with the normal distribution is used for proposing a goodness-of-fit test for the composite null hypothesis that a random sample follows an SN distribution with unknown parameters. The random sample is transformed to approximately normal random variables, and then the Shapiro–Wilk test is used for testing normality. The implementation of this test does not require neither parametric bootstrap nor the use of tables for different values of the slant parameter. An additional test for the same problem, based on a property that relates the gamma and SN distributions, is also introduced. The results of a power study conducted by the Monte Carlo simulation show some good properties of the proposed tests in comparison to existing tests for the same problem.     

On the Relationship between Directional and Omnibus Statistical Tests

Abstract.  A common statistical problem involves the testing of a K -dimensional parameter vector. In both parametric and semiparametric settings, two types of directional tests – linear combination and constrained tests – are frequently used instead of omnibus tests in hopes of achieving greater power for specific alternatives. In this paper, we consider the relationship between these directional tests, as well as their relationship to omnibus tests. Every constrained directional test is shown to be asymptotically equivalent to a specific linear combination test under a sequence of contiguous alternatives and vice versa. Even when the direction of the alternative is known, the constrained test in general will not be optimal unless the objective function used to derive it is efficient. For an arbitrary alternative, insight into the power characteristics of directional tests in comparison to omnibus tests can be gained by a chi-square partition of the omnibus test.