Union-Intersection testing for outliers in multivariate normal data

The union-intersection approach to multivariate test construction is used to develop an alternative to Wilks' likelihood ratio test statistic for testing for two or more outliers in multivariate normal data. It is shown that critical values of both statistics are poorly approximated by Bonferroni bounds. Simulated critical values are presented for both statistics for significance levels 1% and 5%, for sample sizes 10(5)30, 40, 50, 75 and 100 for 2, 3, 4 and 5 dimensions. A power comparison of the two tests in the slippage of the mean model for generating outliers indicates that the union-intersection test is the more powerful when the slippages are close to collinear. Although Wilks' test remains the preference for general use, the union-intersection test could be valuable when such special structure in the data is suspected.     

Testing for Zero Intercept in Multivariate Normal Regression Using the Univariate Multiple-Regression F Test

A likelihood ratio test is derived for comparing the performance potential of a subset of a population of financial assets to the performance potential of the entire population. The test is shown to be equivalent to a test for zero intercept in a multivariate normal regression model. Rao's F approximation to Wilks' Lamda is shown to be equivalent in this case to the conventional F test used to test the significance of a subset of regressors in a univariate multiple-regression model. The test is illustrated using a sample of returns from ten stocks from the New York Stock Exchange.     

Direction and collinearity factors of wilks‘s a - a review

Wilks's A was factorized by Bartlett (1951) for testing the hypothesis of goodness of fit of a hypothetical discriminant function in the case of several groups. This test has applications in various areas such as Econometrics, contingency tables, growth curves, principal components analysis, design of experiments and so on. This paper gives a consolidated account of the research done in these areas on the application of factors of Wilks's A     

Elliptically contoured model and factorization of wllks1 A

In a series of papers, Kshirsagar (1964, 1971) and McHenry and Kshirsagar (1977), factorize Wilks' A into a number of factors and find the independent null multivariate beta densities of these factors. These factors are the likelihood ratio test criteria for testing the goodness of fit of certain assigned discriminant functions or canonical variables either in the space of independent or dependent variables. Essentially the factors of Wilks' A are the factors of certain multivariate beta distributed matrix or its determinant. The Bartlett decomposition of the underlying multivariate beta distribution into independent factors determines the distribution of these factors. The present paper generalizes Kshirsagar's (1971) normal theory to the elliptically contoured model, and shows that his results are null robust for the elliptically contoured model.     

A NOTE ON MULTIVARIATE LINEAR MODELS WITH NON-ADDITIVITY

Tukey's non-additivity test in an analysis of variance model is extended to a multivariate linear model with covariates. If non-additivity is found to exist, a Wilks's Lambda test for the dimensionality of the matrix of the non-additivity parameters is derived and the Lambda criterion is then factorized into two independent test criteria to test meaningful hypotheses concerning the multivariate model.     

CASE-DELETION DIAGNOSTICS FOR TEST STATISTICS IN MULTIVARIATE REGRESSION

Influence measures in multivariate regression analysis have been widely developed, especially through use of the case-deletion approach. However, there seem to be few accounts of the influence of observations on test statistics in hypothesis testing. This paper examines four common multivariate tests, namely the Wilks' ratio, Lawley-Hotelling trace, Pillai's trace and Roy's greatest root for testing a general linear hypothesis of the regression coefficients in multivariate regression. The influence of observations is measured using the case-deletion approach. The proposed diagnostic measures, except that of Roy's greatest root, can be expressed in terms of statistics without involving the actual deletion of observations. An illustrative example is given with satisfactory results.     

Empirical likelihood and Wilks phenomenon for data with nonignorable missing values

Wilks's theorem is useful for constructing confidence regions. When applying the popular empirical likelihood to data with nonignorable nonresponses, Wilks's phenomenon does not hold. This paper unveils that this is caused by the extra estimation of the nuisance parameter in the nonignorable nonresponse propensity. Motivated by this result, we propose an adjusted empirical likelihood for which Wilks's theorem holds. Asymptotic results are presented and supplemented by simulation results for finite sample performance of the point estimators and confidence regions. An analysis of a data set is included for illustration.     

Testing independence of several groups of variables

The null distribution of Wilks' likelihood-ratio criterion for testing independence of several groups of variables in a multivariate normal population is derived. Percentage points are tabulated for various values of the sample sizeN and partitions of p, the number of variables. This paper extends Mathai and Katiya's (1979) “sphericity” results and tables.     

Multivariate analysis with an autoregressive covariance model

This paper addresses the problem of testing the multivariate linear hypothesis when the errors follow an antedependence model (Gabriel, 1961, 1962). Antedependence can be formulated as a nonstationary autoregressive model of general order. Three test statistics are derived that provide analogs to three commonly used MANOVA statistics: Wilks' Lambda, the Lawley-Hotelling Trace, and Pillai's Trace. Formulas are given for each of these statistics that show how they can be obtained From any statistical computing package that calculates the usual MANOVA statistics. These antedependent statistics would be appropriate in analyzing certain multivariate data sets in which repeated measurements are taken on the same subjects over a period of time.     

Nonnull distribution of Wilks' statistic for Manova in the complex case

In this paper, the exact distribution of Wilks' likelihood ratio criterion, A, for MANOVA, in the complex case when the alternate hypothesis is of unit rank (i.e. the linear case) has been derived and the explicit expressions for the same for p = 2 and 3 (where p is the number of variates) and general f₁ (the error degrees of freedom) and f₂ (the hypothesis degrees of freedom), are given. For an unrestricted number of variables, a general form of the density and the distribution of A in this case, is also given. It has been shown that the total integral of the series obtained by taking a few terms only, rapidly approaches the theoretical value one as more terms are taken into account, and some percentage points have also been computed.     

A more powerful unconditional exact test of homogeneity for 2 × c contingency table analysis

The classical unconditional exact p-value test can be used to compare two multinomial distributions with small samples. This general hypothesis requires parameter estimation under the null which makes the test severely conservative. Similar property has been observed for Fisher's exact test with Barnard and Boschloo providing distinct adjustments that produce more powerful testing approaches. In this study, we develop a novel adjustment for the conservativeness of the unconditional multinomial exact p-value test that produces nominal type I error rate and increased power in comparison to all alternative approaches. We used a large simulation study to empirically estimate the 5th percentiles of the distributions of the p-values of the exact test over a range of scenarios and implemented a regression model to predict the values for two-sample multinomial settings. Our results show that the new test is uniformly more powerful than Fisher's, Barnard's, and Boschloo's tests with gains in power as large as several hundred percent in certain scenarios. Lastly, we provide a real-life data example where the unadjusted unconditional exact test wrongly fails to reject the null hypothesis and the corrected unconditional exact test rejects the null appropriately.     

Testing equality of scale parameters against restricted alternatives for m≥3 gamma distributions with unknown common shape parameter

Shiue and Bain (1983) proposed an approximate F-test for the equality of the scale parameters of two gamma distributions with equal but unknown shape parameters. In this article, we propose a simple procedure to test equality of scale parameters of m≥3 gamma distributions against nonincreasing order. The test is based on Fisher's method of combining p-values. The actual size of the resulting test is investigated through Monte Carlo studies. Also asymptotic results are derived for the nominal test size. These can be used to obtain a test which achieves the desired size. The case of more general partial orders is discussed.     

Exact distributions of two non-central generalized Wilks's statistics

We derive the exact expressions of the probability density function (pdf) and the cumulative distribution function (cdf) of Wilks's likelihood ratio criterion Λ and Wilks-Lawley's statistic U in the non-central linear and the non-central planar cases. Those expressions are given in rapidly converging infinite series and can be used for numerical computation. For applications, we compute the exact power of these statistics in a multivariate analysis of variance exercise, and show by simulation the precision of our analytic formulae.     

A remark on testing covariance structure in a mixed model

Khuri (1989) tests for the intraclass covariance structure implied by the balanced two-way mixed analysis of variance model by computing wilks' likelihood ratio test statistic using the sample covariance matrix of the vectors of treatment means. In the unbalanced case he uses a linear transformation to augment the treatment-mean vectors to vectors which are expected to satisfy the intraclass structure, and then computes Wilks' statistic using these augmented vectors. We point out that the augmentation process is in fact equivalent to deleting observations until the design is balanced, so that the augmented test actually uses less information than that contained in the original sample means.     

Testing for normality in linear regression models

The importance of the normal distribution for fitting continuous data is well known. However, in many practical situations data distribution departs from normality. For example, the sample skewness and the sample kurtosis are far away from 0 and 3, respectively, which are nice properties of normal distributions. So, it is important to have formal tests of normality against any alternative. D'Agostino et al. [A suggestion for using powerful and informative tests of normality, Am. Statist. 44 (1990), pp. 316–321] review four procedures Z ²(g ₁), Z ²(g ₂), D and K ² for testing departure from normality. The first two of these procedures are tests of normality against departure due to skewness and kurtosis, respectively. The other two tests are omnibus tests. An alternative to the normal distribution is a class of skew-normal distributions (see [A. Azzalini, A class of distributions which includes the normal ones, Scand. J. Statist. 12 (1985), pp. 171–178]). In this paper, we obtain a score test (W) and a likelihood ratio test (LR) of goodness of fit of the normal regression model against the skew-normal family of regression models. It turns out that the score test is based on the sample skewness and is of very simple form. The performance of these six procedures, in terms of size and power, are compared using simulations. The level properties of the three statistics LR, W and Z ²(g ₁) are similar and close to the nominal level for moderate to large sample sizes. Also, their power properties are similar for small departure from normality due to skewness (γ₁≤0.4). Of these, the score test statistic has a very simple form and computationally much simpler than the other two statistics. The LR statistic, in general, has highest power, although it is computationally much complex as it requires estimates of the parameters under the normal model as well as those under the skew-normal model. So, the score test may be used to test for normality against small departure from normality due to skewness. Otherwise, the likelihood ratio statistic LR should be used as it detects general departure from normality (due to both skewness and kurtosis) with, in general, largest power.     

Testing Variability in the Two-Sample Case

A number of robust methods for testing variability have been reported in previous literature. An examination of these procedures for a wide variety of populations confirms their general robustness. Shoemaker's improvement of the F test extends that test use to a realistic variety of population shapes. However, a combination of the Brown–Forsythe and O'Brien methods based on testing kurtosis is shown to be conservative for a wide range of sample sizes and population distributions. The composite test is also shown to be more powerful in most conditions than other conservative procedures.     

A comparison of several adaptive tests for paired data

In the last few years, two adaptive tests for paired data have been proposed. One test proposed by Freidlin et al. [On the use of the Shapiro–Wilk test in two-stage adaptive inference for paired data from moderate to very heavy tailed distributions, Biom. J. 45 (2003), pp. 887–900] is a two-stage procedure that uses a selection statistic to determine which of three rank scores to use in the computation of the test statistic. Another statistic, proposed by O'Gorman [Applied Adaptive Statistical Methods: Tests of Significance and Confidence Intervals, Society for Industrial and Applied Mathematics, Philadelphia, 2004], uses a weighted t-test with the weights determined by the data. These two methods, and an earlier rank-based adaptive test proposed by Randles and Hogg [Adaptive Distribution-free Tests, Commun. Stat. 2 (1973), pp. 337–356], are compared with the t-test and to Wilcoxon's signed-rank test. For sample sizes between 15 and 50, the results show that the adaptive test proposed by Freidlin et al. and the adaptive test proposed by O'Gorman have higher power than the other tests over a range of moderate to long-tailed symmetric distributions. The results also show that the test proposed by O'Gorman has greater power than the other tests for short-tailed distributions. For sample sizes greater than 50 and for small sample sizes the adaptive test proposed by O'Gorman has the highest power for most distributions.     

A Single Form for t-Distributions and Symmetric Beta Distributions

A single parametric form is given for the symmetric distributions in the Pearson system with finite variance. In effect, these are Student's t-distributions with ν > 2 and all centered symmetric beta distributions. A different parametrization allows the inclusion of the t-distributions with ν ≤2 at the expense of symmetric beta distributions with a low shape parameter.     

Confidence interval of the jump activity index based on empirical likelihood using high frequency data

It is widely accepted that jumps exist in the asset price process. The jump activity index is a natural measure of how frequent the jumps are. Statistical inference of the jump activity index is of importance in determining the type of process that underlies the dynamics of the log price process. In this paper, we implement the empirical likelihood approach to construct the confidence interval of the jump activity index of a pure jump model using high frequency data. Wilks' theorem is established. We also extend the result on Zhao and Wu (2009)'s estimator to the more general framework in this paper. Simulation studies demonstrate the good performance of the empirical likelihood approach. Compared with the existing non-parametric estimator proposed by Zhao and Wu (2009), the empirical likelihood approach gives more accurate coverage probabilities in the simulation studies.     

Smoothed empirical likelihood confidence intervals for the relative distribution with left‐truncated and right‐censored data

The study of differences among groups is an interesting statistical topic in many applied fields. It is very common in this context to have data that are subject to mechanisms of loss of information, such as censoring and truncation. In the setting of a two‐sample problem with data subject to left truncation and right censoring, we develop an empirical likelihood method to do inference for the relative distribution. We obtain a nonparametric generalization of Wilks' theorem and construct nonparametric pointwise confidence intervals for the relative distribution. Finally, we analyse the coverage probability and length of these confidence intervals through a simulation study and illustrate their use with a real data set on gastric cancer. The Canadian Journal of Statistics 38: 453–473; 2010 © 2010 Statistical Society of Canada