Independence test in high-dimension using distance correlation and power enhancement technique

Abstract

This paper is concerned with independence test in high-dimension. A new test statistic is proposed with two terms: one is based on the modified distance correlation statistic, the other is constructed to enhance the power under sparse alternatives. Asymptotic properties of the test statistic are discussed under some regular conditions. The finite-sample simulations exhibit its superiority over some existing procedures. Finally, a real data example illustrates the proposed test.     

Optimal record-based statistical procedures for the two-parameter exponential distribution

There are a number of situations in which the experimental data observed are record statistics. In this paper, optimal confidence intervals as well as uniformly most powerful (MP) tests for one-sided alternatives are developed. Since a uniformly MP test for a two-sided alternative does not exist, generalized likelihood ratio and uniformly unbiased and invariant tests are derived for the two parameters of the exponential distribution based on record data. For illustrative purposes, a data set on the times between consecutive telephone calls to a company's switchboard is analysed using the proposed procedures. Finally, some open problems in this direction are pointed out.     

A nonparametric test for detecting changes in location

Procedure for the changepoint problem based on Mann-Whitney-Wilcoxon statistics is studied in Schechtman and Wolfe (1981). In this paper we give tables for the null distributions of the statistics for the one-sided and two-sided alternatives. We also report on some Monte Carlo power comparisons involving another nonparametric competitor, proposed by Pettitt (1979).     

A Nonparametric Test Procedure Based on a Group of Quantile Tests

In this article, we consider nonparametric test procedures based on a group of quantile test statistics. We consider the quadratic form for the two-sided test and the maximal and summing types of statistics for the one-sided alternatives. Then we derive the null limiting distributions of the proposed test statistics using the large sample approximation theory. Also, we consider applying the permutation principle to obtain the null distribution. In this vein, we may consider the supremum type, which should use the permutation principle for obtaining the null distribution. Then we illustrate our procedure with an example and compare the proposed tests with other existing tests including the individual quantile tests by obtaining empirical powers through simulation study. Also, we comment on the related discussions to this testing procedure as concluding remarks. Finally we prove the lemmas and theorems in the appendices.     

Testing for Persistence in the Error Component Model: A One-Sided Approach

This article proposes new simple testing procedures for the joint null hypothesis of absence of persistent effects, in the form of random effects and first-order serial correlation in the error component model. The fact that the presence of random effects is clearly of a one-sided nature, together with the fact that in many empirical applications researchers worry about positive serial correlation leaves room for a power gain that arises from restricting the parameter space under the alternative hypothesis, compared to existing procedures that allow for two-sided alternatives. A Monte Carlo experiment shows that the proposed statistics have good size and power performance in very small samples like those typically used in applied work in panel data. An empirical example illustrates the usefulness of the proposed statistics.     

The two-sample problem with multivariate censored data: a new rank test family

A new rank test family is proposed to test the equality of two multivariate failure times distributions with censored observations. The tests are very simple: they are based on a transformation of the multivariate rank vectors to a univariate rank score and the resulting statistics belong to the familiar class of the weighted logrank test statistics. The new procedure is also applicable to multivariate observations in general, such as repeated measures, some of which may be missing. To investigate the performance of the proposed tests, a simulation study was conducted with bivariate exponential models for various censoring rates. The size and power of these tests against Lehmann alternatives were compared to the size and power of two other tests (Wei and Lachin, 1984 and Wei and Knuiman, 1987). In all simulations the new procedures provide a relatively good power and an accurate control over the size of the test. A real example from the National Cooperative Gallstone Study is given     

Estimation of two ordered normal means when a covariance matrix is known

Estimation of two normal means with an order restriction is considered when a covariance matrix is known. It is shown that restricted maximum likelihood estimator (MLE) stochastically dominates both estimators proposed by Hwang and Peddada [Confidence interval estimation subject to order restrictions. Ann Statist. 1994;22(1):67–93] and Peddada et al. [Estimation of order-restricted means from correlated data. Biometrika. 2005;92:703–715]. The estimators are also compared under the Pitman nearness criterion and it is shown that the MLE is closer to ordered means than the other two estimators. Estimation of linear functions of ordered means is also considered and a necessary and sufficient condition on the coefficients is given for the MLE to dominate the other estimators in terms of mean squared error.     

Adaptive Neyman's smooth tests of homogeneity of two samples of survival data

The problem of testing whether two samples of possibly right-censored survival data come from the same distribution is considered. The aim is to develop a test which is capable of detection of a wide spectrum of alternatives. A new class of tests based on Neyman's embedding idea is proposed. The null hypothesis is tested against a model where the hazard ratio of the two survival distributions is expressed by several smooth functions. A data-driven approach to the selection of these functions is studied. Asymptotic properties of the proposed procedures are investigated under fixed and local alternatives. Small-sample performance is explored via simulations which show that the power of the proposed tests appears to be more robust than the power of some versatile tests previously proposed in the literature (such as combinations of weighted logrank tests, or Kolmogorov–Smirnov tests).     

On the power of goodness-of-fit tests for the exponential distribution under progressive Type-II censoring

The aim of this article is to review existing goodness-of-fit tests for the exponential distribution under progressive Type-II censoring and to provide some new ideas and adjustments. In particular, we consider two-parameter exponentially distributed random variables and adapt the proposed test procedures to our scenario if necessary. Then, we compare their power by an extensive simulation study. Furthermore, we propose five new test procedures that provide reasonable alternatives to those already known.     

Distribution-free test in Tobit mean regression model

This paper discusses the problem of fitting a parametric model in Tobit mean regression models. The proposed test is based on the supremum of the Khamaladze-type transformation of a partial sum process of calibrated residuals. The asymptotic null distribution of this transformed process is shown to be the same as that of a time-transformed standard Brownian motion. Consistency of this sequence of tests against some fixed alternatives and asymptotic power under some local nonparametric alternatives are also discussed. Simulation studies are conducted to assess the finite sample performance of the proposed test. The power comparison with some existing tests shows some superiority of the proposed test at the chosen alternatives.     

Closed testing procedures for all pairwise comparisons in a randomized block design

We consider multiple comparison test procedures among treatment effects in a randomized block design. We propose closed testing procedures based on maximum values of some two-sample t test statistics and based on F test statistics. It is shown that the proposed procedures are more powerful than single-step procedures and the REGW (Ryan/Einot–Gabriel/Welsch)-type tests. Next, we consider the randomized block design under simple ordered restrictions of treatment effects. We propose closed testing procedures based on maximum values of two-sample one-sided t test statistics and based on Batholomew’s statistics for all pairwise comparisons of treatment effects. Although single-step multiple comparison procedures are utilized in general, the power of these procedures is low for a large number of groups. The closed testing procedures stated in the present article are more powerful than the single-step procedures. Simulation studies are performed under the null hypothesis and some alternative hypotheses. In this studies, the proposed procedures show a good performance.     

Graphical comparison of means with a standard in the one-way layout

Some simple test procedures are considered for comparing several group means with a standard value when the data are in a one-way layout. The underlying distributions are assumed to be normal with possibly unequal variances. The tests are based on a union-intersection formulation and can be applied in a form similar to a Shewhart control chart. Both two-sided and one-sided alternatives are considered. The power of the tests can be obtained from tables of a non-central t distribution. Implementation of the tests is illustrated with a numerical example. The tests help identify any group means different from the standard and might lead to a decision about rejecting the null hypothesis before all the group means are observed. The resulting savings in time and resources might be valuable in applications where the number of groups is large and the cost of acquiring data is high. For situations where the normality assumption is untenable, a non-parametric procedure, based on one-sample sign tests is considered.     

Hypotheses testing for generalized order statistics with simple order restrictions on model parameters under the alternative

In applications of generalized order statistics as, for instance, reliability analysis of engineering systems, prior knowledge about the order of the underlying model parameters is often available and may therefore be incorporated in inferential procedures. Taking this information into account, we establish the likelihood ratio test, Rao's score test, and Wald's test for test problems arising from the question of appropriate model selection for ordered data, where simple order restrictions are put on the parameters under the alternative hypothesis. For simple and composite null hypothesis, explicit representations of the corresponding test statistics are obtained along with some properties and their asymptotic distributions. A simulation study is carried out to compare the order restricted tests in terms of their power. In the set-up considered, the adapted tests significantly improve the power of the associated omnibus versions for small sample sizes, especially when testing a composite null hypothesis.     

Power Comparison of Multivariate Wilcoxon-type Tests Based on the Jurečková–Kalina’s Ranks of Distances

A multivariate two-sample testing problem is one of the most important topics in nonparametric statistics. One of the multivariate two-sample testing problems based on the Jure?ková–Kalina ranks of distance is discussed in this article. Further, a multivariate Wilcoxon-type test is proposed for testing the equality of two continuous distribution functions. Simulations are used to investigate the power of this test for the two-sided alternative with various population distributions. The results show that the proposed test statistic is more suitable than various existing statistics for testing a shift in the locationt and location-scale parameters.     

A two-sample distribution-free scale test of the smirnov type

The two-sample, distribution-free statistics of Smirnov (1939) are used to define a new statistic. While the Smirnov statistics are used as a general goodness-of-fit test, a distribution-free scale test based on this new statistic is developed. It is shown that this new test has higher power than the two-sided Smirnov statistic in detecting differences in scale for some symmetric distributions with equal means/medians. The critical values of the proposed test statistic and its limiting distribution are given     

A CONTINUOUSLY ADAPTIVE RANK TEST FOR SHIFT IN LOCATION

This paper considers the problem of testing for shift in location when the symmetry of the underlying distribution is in doubt. Various adaptive test procedures have been suggested in the literature; they are mainly based on a preliminary test or measure of asymmetry, and then choosing between the sign or the Wilcoxon tests accordingly. However, as this paper demonstrates, there are some disadvantages with such procedures. This paper develops a test that does not suffer from such disadvantages. The proposed test is based on modifying the Wilcoxon scores according to the evidence of asymmetry of the distribution present in the data as indicated by the magnitude of the P‐value from a preliminary test of symmetry. A simulation study investigates and compares the performance of the proposed test and other known adaptive procedures in terms of power and attainment of the nominal size. The performance of a suitable bootstrap procedure for the situation under consideration is also studied. In most cases under consideration, the proposed test is found to be superior to the other tests.     

Extension of two-sided test to multiple treatment trials

In a two-treatment trial, a two-sided test is often used to reach a conclusion, Usually we are interested in doing a two-sided test because of no prior preference between the two treatments and we want a three-decision framework. When a standard control is just as good as the new experimental treatment (which has the same toxicity and cost), then we will accept both treatments. Only when the standard control is clearly worse or better than the new experimental treatment, then we choose only one treatment. In this paper, we extend the concept of a two-sided test to the multiple treatment trial where three or more treatments are involved. The procedure turns out to be a subset selection procedure; however, the theoretical framework and performance requirement are different from the existing subset selection procedures. Two procedures (exclusion or inclusion) are developed here for the case of normal data with equal known variance. If the sample size is large, they can be applied with unknown variance and with the binomial data or survival data with random censoring.     

Schwarz information criterion based tests for a change-point in regression models

Standard Schwarz information criterion for testing a change-point in regression models is considered and two new test procedures are evolved. The case of small sample size is investigated. Numerical approximations to the power against various alternatives are given and compared with powers of tests based on r-ahead recursive residuals and of the CUSUM of squares test. Application of these procedures to some real data is also provided.     

Precedence tests for equality of two distributions based on early failures of ranked set samples

In this article, two different types of precedence tests, each with two different test statistics, based on ranked set samples for testing the equality of two distributions are discussed. The exact null distributions of proposed test statistics are derived, critical values are tabulated for both set size and number of cycles up to 8, and the exact power functions of these two types of precedence tests under the Lehmann alternative are derived. Then, the power values of these two test procedures and their competitors based on simple random samples and based on ranked set samples are compared under the Lehmann alternative exactly and also under a location-shift alternative by means of Monte Carlo simulations. Finally, the impact of imperfect ranking is discussed and some concluding remarks are presented.     

Empirical smoothing lack-of-fit tests for variance function

This paper discusses a nonparametric empirical smoothing lack-of-fit test for the functional form of the variance in regression models. The proposed test can be treated as a nontrivial modification of Zheng's nonparametric smoothing test, Koul and Ni's minimum distance test for the mean function in the classic regression models. The paper establishes the asymptotic normality of the proposed test under the null hypothesis. Consistency at some fixed alternatives and asymptotic power under some local alternatives are also discussed. A simulation study is conducted to assess the finite sample performance of the proposed test. Simulation study also shows that the proposed test is more powerful and computationally more efficient than some existing tests.