Robust Inference for Near-Unit Root Processes with Time-Varying Error Variances

The autoregressive Cauchy estimator uses the sign of the first lag as instrumental variable (IV); under independent and identically distributed (i.i.d.) errors, the resulting IV t-type statistic is known to have a standard normal limiting distribution in the unit root case. With unconditional heteroskedasticity, the ordinary least squares (OLS) t statistic is affected in the unit root case; but the paper shows that, by using some nonlinear transformation behaving asymptotically like the sign as instrument, limiting normality of the IV t-type statistic is maintained when the series to be tested has no deterministic trends. Neither estimation of the so-called variance profile nor bootstrap procedures are required to this end. The Cauchy unit root test has power in the same 1/T neighborhoods as the usual unit root tests, also for a wide range of magnitudes for the initial value. It is furthermore shown to be competitive with other, bootstrap-based, robust tests. When the series exhibit a linear trend, however, the null distribution of the Cauchy test for a unit root becomes nonstandard, reminiscent of the Dickey-Fuller distribution. In this case, inference robust to nonstationary volatility is obtained via the wild bootstrap.     

On the use of priors in goodness‐of‐fit tests

Priors are introduced into goodness‐of‐fit tests, both for unknown parameters in the tested distribution and on the alternative density. Neyman–Pearson theory leads to the test with the highest expected power. To make the test practical, we seek priors that make it likely a priori that the power will be larger than the level of the test but not too close to one. As a result, priors are sample size dependent. We explore this procedure in particular for priors that are defined via a Gaussian process approximation for the logarithm of the alternative density. In the case of testing for the uniform distribution, we show that the optimal test is of the U‐statistic type and establish limiting distributions for the optimal test statistic, both under the null hypothesis and averaged over the alternative hypotheses. The optimal test statistic is shown to be of the Cramér–von Mises type for specific choices of the Gaussian process involved. The methodology when parameters in the tested distribution are unknown is discussed and illustrated in the case of testing for the von Mises distribution. The Canadian Journal of Statistics 47: 560–579; 2019 © 2019 Statistical Society of Canada     

Outlier detection in contingency tables using decomposable graphical models

For high-dimensional data, it is a tedious task to determine anomalies such as outliers. We present a novel outlier detection method for high-dimensional contingency tables. We use the class of decomposable graphical models to model the relationship among the variables of interest, which can be depicted by an undirected graph called the interaction graph. Given an interaction graph, we derive a closed-form expression of the likelihood ratio test (LRT) statistic and an exact distribution for efficient simulation of the test statistic. An observation is declared an outlier if it deviates significantly from the approximated distribution of the test statistic under the null hypothesis. We demonstrate the use of the LRT outlier detection framework on genetic data modeled by Chow–Liu trees.     

A Nonrandomized,Nonconservative Version of the Fisher Exact Test

The Fisher exact test has been unjustly dismissed by some as ‘only conditional,’ whereas it is unconditionally the uniform most powerful test among all unbiased tests, tests of size α and with power greater than its nominal level of significance α. The problem with this truly optimal test is that it requires randomization at the critical value(s) to be of size α. Obviously, in practice, one does not want to conclude that ‘with probability x the we have a statistical significant result.’ Usually, the hypothesis is rejected only if the test statistic's outcome is more extreme than the critical value, reducing the actual size considerably.

The randomized unconditional Fisher exact is constructed (using Neyman–structure arguments) by deriving a conditional randomized test randomizing at critical values c(t) by probabilities γ(t), that both depend on the total number of successes T (the complete-sufficient statistic for the nuisance parameter—the common success probability) conditioned upon.

In this paper, the Fisher exact is approximated by deriving nonrandomized conditional tests with critical region including the critical value only if γ (t) > γ₀, for a fixed threshold value γ₀, such that the size of the unconditional modified test is for all value of the nuisance parameter—the common success probability—smaller, but as close as possible to α. It will be seen that this greatly improves the size of the test as compared with the conservative nonrandomized Fisher exact test.

Size, power, and p value comparison with the (virtual) randomized Fisher exact test, and the conservative nonrandomized Fisher exact, Pearson's chi-square test, with the more competitive mid-p value, the McDonald's modification, and Boschloo's modifications are performed under the assumption of two binomial samples.     

Calibrating the excess mass and dip tests of modality

Nonparametric tests of modality are a distribution-free way of assessing evidence about inhomogeneity in a population, provided that the potential sub populations are sufficiently well separated. They include the excess mass and dip tests, which are equivalent in univariate settings and are alternatives to the bandwidth test. Only very conservative forms of the excess mass and dip tests are available at presently, however, and for that reason they are generally not competitive with the bandwidth test. In the present paper we develop a practical approach to calibrating the excess mass and dip tests to improve their level accuracy and power substantially. Our method exploits the fact that the limiting distribution of the excess mass statistic under the null hypothesis depends on unknowns only through a constant, which may be estimated. Our calibrated test exploits this fact and is shown to have greater power and level accuracy than the bandwidth test has. The latter tends to be quite conservative, even in an asymptotic sense. Moreover, the calibrated test avoids difficulties that the bandwidth test has with spurious modes in the tails, which often must be discounted through subjective intervention of the experimenter.     

Multivariate outlier tests with structured co variance matrices

Outlier tests are developed for multivariate data where there is a structure to the covariance or correlation matrix. Particular structures considered are the block diagonal structure where there are reasons to assume that one set of variables is independent of another, and the equicorrelation structure where it may be assumed that all pairs of variables have the same correlation. Likelihood ratio tests for an outlier are derived for these situations and critical values, under the null hypothesis of no outliers present, are determined for selected sample sizes and dimensions, using Bonferroni bounds or simulation. The powers of the tests are compared with those of the Wilks′ statistic for a variety of situations. It is shown that the test procedures which incorporate knowledge of the correlation structure have considerably greater power than the usual tests particularly in relatively small samples with several dimensions.     

Testing for the Null Hypothesis of Cointegration with a Structural Break

In this paper we propose residual-based tests for the null hypothesis of cointegration with a structural break against the alternative of no cointegration. The Lagrange Multiplier (LM) test is proposed and its limiting distribution is obtained for the case in which the timing of a structural break is known. Then the test statistic is extended to deal with a structural break of unknown timing. The test statistic, a plug-in version of the test statistic for known timing, replaces the true break point by the estimated one. We show the limiting properties of the test statistic under the null as well as the alternative. Critical values are calculated for the tests by simulation methods. Finite-sample simulations show that the empirical size of the test is close to the nominal one unless the regression error is very persistent and that the test rejects the null when no cointegrating relationship with a structural break is present. We provide empirical examples based on the present-value model, the term structure model, and the money-output relationship model.     

A semiparametric maximum likelihood ratio test for the change point in copula models

In the present paper, a semiparametric maximum-likelihood-type test statistic is proposed and proved to have the same limit null distribution as the classical parametric likelihood one. Under some mild conditions, the limiting law of the proposed test statistic, suitably normalized and centralized, is shown to be double exponential, under the null hypothesis of no change in the parameter of copula models. We also discuss the Gaussian-type approximations for the semiparametric likelihood ratio. The asymptotic distribution of the proposed statistic under specified alternatives is shown to be normal, and an approximation to the power function is given. Simulation results are provided to illustrate the finite sample performance of the proposed statistical tests based on the double exponential and Gaussian-type approximations.     

Testing for the Null Hypothesis of Cointegration with a Structural Break

In this paper we propose residual-based tests for the null hypothesis of cointegration with a structural break against the alternative of no cointegration. The Lagrange Multiplier (LM) test is proposed and its limiting distribution is obtained for the case in which the timing of a structural break is known. Then the test statistic is extended to deal with a structural break of unknown timing. The test statistic, a plug-in version of the test statistic for known timing, replaces the true break point by the estimated one. We show the limiting properties of the test statistic under the null as well as the alternative. Critical values are calculated for the tests by simulation methods. Finite-sample simulations show that the empirical size of the test is close to the nominal one unless the regression error is very persistent and that the test rejects the null when no cointegrating relationship with a structural break is present. We provide empirical examples based on the present-value model, the term structure model, and the money-output relationship model.     

Some pitfalls of tests of separate families of hypotheses: normality vs. lognormality

It is often desirable to test non-nested hypotheses. Cox (1961, 1962) proposed forming a log-likelihood ratio from their maxima and then comparing this value to its expected value under the null hypothesis. Pitfalls exists when we apply Cox's test to the special case of testing normality versus lognormality. Pesaran (1981) and Kotz (1973) pointed out the slow convergence rate of the Cox's test. In this paper, this fact has been reemphasized; moreover, we propose an alternative likelihood ratio test which remedies problems arising from negative estimates of the asymptotic variance of Cox's test statistic and is uniformly more powerful than most commonly used tests.     

A test of normality using nonparametrlic residuals

In this paper, we develop a test of the normality assumption of the errors using the residuals from a nonparametric kernel regression. Contrary to the existing tests based on the residuals from a parametric regression, our test is thus robust to misspecification of the regression function. The test statistic proposed here is a Bera-Jarque type test of skewness and kurtosis. We show that the test statistic has the usual x ²(2) limit distribution under the null hypothesis. In contrast to the results of Rilstone (1992), we provide a set of primitive assumptions that allow weakly dependent observations and data dependent bandwidth parameters. We also establish consistency property of the test. Monte Carlo experiments show that our test has reasonably good size and power performance in small samples and perfornu better than some of the alternative tests in various situations.     

A class of multivariate distribution-free tests of independence based on graphs

A class of distribution-free tests is proposed for the independence of two subsets of response coordinates. The tests are based on the pairwise distances across subjects within each subset of the response. A complete graph is induced by each subset of response coordinates, with the sample points as nodes and the pairwise distances as the edge weights. The proposed test statistic depends only on the rank order of edges in these complete graphs. The response vector may be of any dimensions. In particular, the number of samples may be smaller than the dimensions of the response. The test statistic is shown to have a normal limiting distribution with known expectation and variance under the null hypothesis of independence. The exact distribution free null distribution of the test statistic is given for a sample of size 14, and its Monte-Carlo approximation is considered for larger sample sizes. We demonstrate in simulations that this new class of tests has good power properties for very general alternatives.     

Testing for monotonic trend in time series based on resampling methods

In this paper, we propose several tests for monotonic trend based on the Brillinger's test statistic (1989, Biometrika, 76, 23–30). When there are highly correlated residuals or short record lengths, Brillinger's test procedure tends to have significance level much higher than the nominal level. It is found that this could be related to the discrepancy between the empirical distribution of the test statistic and the asymptotic normal distribution. Hence, in this paper, we propose three bootstrap-based procedures based on the Brillinger's test statistic to test for monotonic trend. The performance of the proposed test procedures is evaluated through an extensive Monte Carlo simulation study, and is compared to other trend test procedures in the literature. It is shown that the proposed bootstrap-based Brillinger test procedures can well control the significance levels and provide satisfactory power performance in testing the monotonic trend under different scenarios.     

Goodness-of-fit test using residuals in infinite-order autoregressive models

In this paper we study the asymptotic behavior of the Bickel–Rosenblatt test in infinite-order autoregressive models. Under some mild conditions, the test statistic based on residuals is shown to have the same limiting distribution as that based on true iid errors. It is also proved that this result remains the same when the nuisance parameters in the model are to be estimated, which means that the Bickel–Rosenblatt test is easily applicable in composite hypothesis goodness-of-fit testing unlike the Kolmogorov–Smirnov type tests. The result of a simulation study is supplemented to verify the result of this paper.     

The X2-goodness-of-fit tests with moment type estimators

In the x²-goodness-of-fit test the underlying null hypothesis usually involves unknown parameters. In this article we study the asymptotic distribution of the Pearson statistic when the unknown parameters are estimated by a moment type estimator based on the ungrouped data. As is expected the usual Pearson statistic is no longer asymptotically x²-distributed in this situation. We propose a statistic [Qcirc] which under certain regularity conditions is asymptotically x²-distributed. We also propose a statistic Q? for the goodness-of-fit test when the class boundaries are random. The asymptotic powers of [Qcirc] and [Qcirc]? tests are discussed.     

A class of k-sample distribution-free tests for location against ordered alternatives

This paper introduces a new class of distribution-free tests for testing the homogeneity of several location parameters against ordered alternatives. The proposed class of test statistics is based on a linear combination of two-sample U-statistics based on subsample extremes. The mean and variance of the test statistic are obtained under the null hypothesis as well as under the sequence of local alternatives. The optimal weights are also determined. It is shown via Pitman ARE comparisons that the proposed class of test statistics performs better than its competitor tests in case of heavy-tailed and long-tailed distributions     

A generalization of the Wilcoxon signed-rank test and its applications

This paper extends the Wilcoxon signed-rank test to the case where the available observations are imprecise quantities, rather than crisp. To do this, the associated test statistic is extended, using the α-cuts approach. In addition, the concept of critical value is generalized to the case when the significance level is given by a fuzzy number. Finally, to accept or reject the null hypothesis of interest, a preference degree between two fuzzy sets is employed for comparing the observed fuzzy test statistic and fuzzy critical value.     

Robust inference from multiple test statistics via permutations: a better alternative to the single test statistic approach for randomized trials

Formal inference in randomized clinical trials is based on controlling the type I error rate associated with a single pre‐specified statistic. The deficiency of using just one method of analysis is that it depends on assumptions that may not be met. For robust inference, we propose pre‐specifying multiple test statistics and relying on the minimum p‐value for testing the null hypothesis of no treatment effect. The null hypothesis associated with the various test statistics is that the treatment groups are indistinguishable. The critical value for hypothesis testing comes from permutation distributions. Rejection of the null hypothesis when the smallest p‐value is less than the critical value controls the type I error rate at its designated value. Even if one of the candidate test statistics has low power, the adverse effect on the power of the minimum p‐value statistic is not much. Its use is illustrated with examples. We conclude that it is better to rely on the minimum p‐value rather than a single statistic particularly when that single statistic is the logrank test, because of the cost and complexity of many survival trials. Copyright © 2013 John Wiley & Sons, Ltd.     

Rényi statistics for testing composite hypotheses in general exponential models

We introduce a family of Rényi statistics of orders r?∈?R for testing composite hypotheses in general exponential models, as alternatives to the previously considered generalized likelihood ratio (GLR) statistic and generalized Wald statistic. If appropriately normalized exponential models converge in a specific sense when the sample size (observation window) tends to infinity, and if the hypothesis is regular, then these statistics are shown to be χ²-distributed under the hypothesis. The corresponding Rényi tests are shown to be consistent. The exact sizes and powers of asymptotically α-size Rényi, GLR and generalized Wald tests are evaluated for a concrete hypothesis about a bivariate Lévy process and moderate observation windows. In this concrete situation the exact sizes of the Rényi test of the order r?=?2 practically coincide with those of the GLR and generalized Wald tests but the exact powers of the Rényi test are on average somewhat better.     

An Approximation for the Test of the Equality of the Smallest Eigenvalues of a Covariance Matrix

A limiting distribution of the likelihood ratio statistic for the test of the equality of the q smallest eigenvalues of a covariance matrix is obtained. This distribution can be used as an alternative to the chi-squared distribution which is usually used with this test. It is shown that this new method yields reasonable significance levels for those situations in which the chi-squared approximation is inadequate.