On the Relationship between Directional and Omnibus Statistical Tests

Abstract.  A common statistical problem involves the testing of a K -dimensional parameter vector. In both parametric and semiparametric settings, two types of directional tests – linear combination and constrained tests – are frequently used instead of omnibus tests in hopes of achieving greater power for specific alternatives. In this paper, we consider the relationship between these directional tests, as well as their relationship to omnibus tests. Every constrained directional test is shown to be asymptotically equivalent to a specific linear combination test under a sequence of contiguous alternatives and vice versa. Even when the direction of the alternative is known, the constrained test in general will not be optimal unless the objective function used to derive it is efficient. For an arbitrary alternative, insight into the power characteristics of directional tests in comparison to omnibus tests can be gained by a chi-square partition of the omnibus test.     

THE CONSTRUCTION OF EQUILEVERAGE DESIGNS FOR MULTIPLE LINEAR REGRESSION

The hat matrix is widely used as a diagnostic tool in linear regression because it contains the leverages which the independent variables exert on the fitted values. In some experiments, cases with high leverage may be avoided by judicious choice of design for the independent variables. A variety of methods for constructing equileverage designs for linear regression are discussed. Such designs remove one of the factors, namely large leverage points, which can lead to nonrobust estimators and tests. In addition, a method is given for combining equileverage designs to test for lack of fit of the linear model.     

Testing parallelism of regression lines against ordered alternatives

For the problem of testing the equality of slopes of several regression lines against the alternative that the slopes are in increasing (decreasing) order of magnitude, two types of tests are proposed. These are the likelihood ratio test and a test that depends on suitable linear combination of one group statistics. Rank analogues of the two tests are also examined.     

Combined multiple testing by censored empirical likelihood

We propose a new procedure for combining multiple tests in samples of right-censored observations. The new method is based on multiple constrained censored empirical likelihood where the constraints are formulated as linear functionals of the cumulative hazard functions. We prove a version of Wilks’ theorem for the multiple constrained censored empirical likelihood ratio, which provides a simple reference distribution for the test statistic of our proposed method. A useful application of the proposed method is, for example, examining the survival experience of different populations by combining different weighted log-rank tests. Real data examples are given using the log-rank and Gehan-Wilcoxon tests. In a simulation study of two sample survival data, we compare the proposed method of combining tests to previously developed procedures. The results demonstrate that, in addition to its computational simplicity, the combined test performs comparably to, and in some situations more reliably than previously developed procedures. Statistical software is available in the R package ‘emplik’.     

On a fisherian detour of the step-down procedure for manova

The well known step-down procedure for MANOVA given by J. Roy (1958) can be modified by combining the step-down tests using a B-optimal combination method such as Fisher's. The Fisherian detour of the stepwise MANOVA is shown to be asymptotically equivalent to the likelihood ratio test.     

Quasi-likelihood ratio tests for cointegration,cobreaking, and cotrending

We consider a set of variables with two types of nonstationary features, stochastic trends and broken linear trends. We develop tests that can determine whether there is a linear combination of these variables under which the nonstationary features can be canceled out. The first test can determine whether stochastic trends can be eliminated and thus whether cointegration holds, regardless of whether structural breaks in linear trends are eliminated. The second test can determine whether both stochastic trends and breaks in linear trends are simultaneously removed and thus whether cointegration and cobreaking simultaneously hold. The third test can determine whether not only breaks in linear trends but also linear trends themselves are eliminated along with stochastic trends and thus whether both cointegration and cotrending hold.     

A modified harmonic mean test procedure for variance components

A complete class of tests of variance components is characterized within the class of tests statistics of the form of a ratio of a linear combination of chi-squared random variables to an independent chi-squared random variable. This result is used in the context of general unbalanced mixed models to show that the harmonic mean method results in an inadmissible test of the random treatment effects. The harmonic mean procedure is then modified in such a way that the modified test uniformly dominates the original test. Two competitive tests are the LMP (locally most powerful) and Wald's tests, which have optimal power properties against small and large alternatives, respectively. A Monte Carlo simulation study reveals that the modified test outperforms both the LMP and Wald's tests in badly unbalanced designs and that it is a viable alternative in less unbalanced designs.     

A class of k-sample distribution-free tests for location against ordered alternatives

This paper introduces a new class of distribution-free tests for testing the homogeneity of several location parameters against ordered alternatives. The proposed class of test statistics is based on a linear combination of two-sample U-statistics based on subsample extremes. The mean and variance of the test statistic are obtained under the null hypothesis as well as under the sequence of local alternatives. The optimal weights are also determined. It is shown via Pitman ARE comparisons that the proposed class of test statistics performs better than its competitor tests in case of heavy-tailed and long-tailed distributions     

Some weighted mixed portmanteau tests for diagnostic checking in linear time series models

The popular diagnostic checking methods in linear time series models are portmanteau tests based on either residual autocorrelation functions (acf) or partial autocorrelation functions (pacf). In this paper, we device some new weighted mixed portmanteau tests by appropriately combining individual tests based on both acf and pacf. We derive the asymptotic distribution of such weighted mixed portmanteau statistics and study their size and power. It is found that the weighted mixed tests outperform when higher order ARMA models are fitted and diagnostic checks are performed via testing lack of residual autocorrelations. Simulation results suggest to use the proposed tests as complementary to those classical tests found in literature. An illustrative application is given to demonstrate the usefulness of the mixed test.     

On the Distribution of the Inverted Linear Compound of Dependent F-Variates and its Application to the Combination of Forecasts

This paper establishes a sampling theory for an inverted linear combination of two dependent F-variates. It is found that the random variable is approximately expressible in terms of a mixture of weighted beta distributions. Operational results, including rth-order raw moments and critical values of the density are subsequently obtained by using the Pearson Type I approximation technique. As a contribution to the probability theory, our findings extend Lee & Hu's (1996) recent investigation on the distribution of the linear compound of two independent F-variates. In terms of relevant applied works, our results refine Dickinson's (1973) inquiry on the distribution of the optimal combining weights estimates based on combining two independent rival forecasts, and provide a further advancement to the general case of combining three independent competing forecasts. Accordingly, our conclusions give a new perception of constructing the confidence intervals for the optimal combining weights estimates studied in the literature of the linear combination of forecasts.     

Using -splines to test the linearity of partially linear models

The nonparametric component in a partially linear model is estimated by a linear combination of fixed-knot cubic B-splines with a second-order difference penalty on the adjacent B-spline coefficients. The resulting penalized least-squares estimator is used to construct two Wald-type spline-based test statistics for the null hypothesis of the linearity of the nonparametric function. When the number of knots is fixed, the first test statistic asymptotically has the distribution of a linear combination of independent chi-squared random variables, each with one degree of freedom, under the null hypothesis. The smoothing parameter is determined by specifying a value for the asymptotically expected value of the test statistic under the null hypothesis. When the number of knots is fixed and under the null hypothesis, the second test statistic asymptotically has a chi-squared distribution with K=q+2 degrees of freedom, where q is the number of knots used for estimation. The power performances of the two proposed tests are investigated via simulation experiments, and the practicality of the proposed methodology is illustrated using a real-life data set.     

Data Driven Rank Test for Two-Sample Problem

Traditional linear rank tests are known to possess low power for large spectrum of alternatives. In this paper we introduce a new rank test possessing a considerably larger range of sensitivity than linear rank tests. The new test statistic is a sum of squares of some linear rank statistics while the number of summands is chosen via a data-based selection rule. Simulations show that the new test possesses high and stable power in situations when linear rank tests completely break down, while simultaneously it has almost the same power under alternatives which can be detected by standard linear rank tests. Our approach is illustrated by some practical examples. Theoretical support is given by deriving asymptotic null distribution of the test statistic and proving consistency of the new test under essentially any alternative.     

Performance of unit-root tests for non linear unit-root and partial unit-root processes

ABSTRACT

This paper investigates the finite-sample performance of the augmented Dickey–Fuller (ADF), Phillips–Perron (PP), momentum threshold autoregressive (M-TAR), Kapetanios–Shin–Snell (KSS), and the inf-t unit-root tests. Simulation results show that the ADF and KSS tests have better size, whereas other tests generate severe size distortions when the date-generating processes are non linear unit-root processes. In general, with regard to the combination of test powers with test sizes, the ADF and KSS tests are comparatively better than the PP, M-TAR, and inf-t tests; moreover, the inf-t test exhibits the poorest performance even for larger sample sizes.     

A Hybrid Approximation Bayesian Test of Variance Components for Longitudinal Data

The test of variance components of possibly correlated random effects in generalized linear mixed models (GLMMs) can be used to examine if there exists heterogeneous effects. The Bayesian test with Bayes factors offers a flexible method. In this article, we focus on the performance of Bayesian tests under three reference priors and a conjugate prior: an approximate uniform shrinkage prior, modified approximate Jeffreys' prior, half-normal unit information prior and Wishart prior. To compute Bayes factors, we propose a hybrid approximation approach combining a simulated version of Laplace's method and importance sampling techniques to test the variance components in GLMMs.     

Comparison of Nonparametric Regression Curves by Spline Smoothing

In this article, procedures are proposed to test the hypothesis of equality of two or more regression functions. Tests are proposed by p-values, first under homoscedastic regression model, which are derived using fiducial method based on cubic spline interpolation. Then, we construct a test in the heteroscedastic case based on Fisher's method of combining independent tests. We study the behaviors of the tests by simulation experiments, in which comparisons with other tests are also given. The proposed tests have good performances. Finally, an application to a data set are given to illustrate the usefulness of the proposed test in practice.     

SMOOTH TESTS FOR THE BIVARIATE POISSON DISTRIBUTION

A theorem of Rayner & Best (1989) is generalised to permit the construction of smooth tests of goodness of fit without requiring a set of orthonormal functions on the hypothesised distribution. This result is used to construct smooth tests for the bivariate Poisson distribution. The test due to Crockett (1979) is similar to a smooth test that assesses the variance structure under the bivariate Poisson model; the test due to Loukas & Kemp (1986) is related to a smooth test that seeks to detect a particular linear relationship between the variances and covariance under the bivariate Poisson model. Using focused smooth tests may be more informative than using previously suggested tests. The distribution of the Loukas & Kemp (1986) statistic is not well approximated by the x²distribution for larger correlations, and a revised statistic is suggested.     

Asymptotic power efficiency for a location and scale problem

The asymptotic power efficiency of the class of linear rank tests relative to the asymptotically most powerful rank test is derived for a two sample location and scale problem and numerical evaluations are presented for two special tests.     

Testing Equality of Order Constrained Inverse Gaussian Means

The inverse Gaussian family of non negative, skewed random variables is analytically simple, and its inference theory is well known to be analogous to the normal theory in numerous ways. Hence, it is widely used for modeling non negative positively skewed data. In this note, we consider the problem of testing homogeneity of order restricted means of several inverse Gaussian populations with a common unknown scale parameter using an approach based on the classical methods, such as Fisher's, for combining independent tests. Unlike the likelihood approach which can only be readily applied to a limited number of restrictions and the settings of equal sample sizes, this approach is applicable to problems involving a broad variety of order restrictions and arbitrary sample size settings, and most importantly, no new null distributions are needed. An empirical power study shows that, in case of the simple order, the test based on Fisher's combination method compares reasonably with the corresponding likelihood ratio procedure.     

Exact testing in multivariate regression

An F statistic due to Rao (1951,1973) tests uniform mixed linear restrictions in the multivariateregression model. In combination with a generalization of the Bera-Evans-Savin exact functional relationship between the W, LR, and LM statistics, Rao's F serves to unify a number of exact test procedures commonly applied in disparate empirical literatures. Examples in demand analysis and asset pricing are provided. The availability of exact tests of restrictions in certain nonlinear models when the model is linear under the null, originally explored by Milliken-Graybill (1970), is extended to multivariate regression. Generalized RESET, J-, and Hausman-Wu tests are resented. As an extension of Dufour (1989), bounds tests exist for nonlinear and inequality restrictions. Applications include conservative bound tests for symmetry or negativity of the substitution matrix in demand systems.     

Combining Univariate Tests for Multivariate Location Problem

In this article, three methods of combining dependent univariate tests are studied. The Bahadur approximate efficiencies are derived under the asymptotic normal assumption. These procedures are applied to the multivariate location problem and compared with two Hotelling-type tests. A Monte Carlo study indicates that in certain cases the powers of the combination methods are much better than Hotelling's T ² and other multivariate nonparametric tests.