Adjusted Supremum Score‐Type Statistics for Evaluating Non‐Standard Hypotheses

Supremum score test statistics are often used to evaluate hypotheses with unidentifiable nuisance parameters under the null hypothesis. Although these statistics provide an attractive framework to address non‐identifiability under the null hypothesis, little attention has been paid to their distributional properties in small to moderate sample size settings. In situations where there are identifiable nuisance parameters under the null hypothesis, these statistics may behave erratically in realistic samples as a result of a non‐negligible bias induced by substituting these nuisance parameters by their estimates under the null hypothesis. In this paper, we propose an adjustment to the supremum score statistics by subtracting the expected bias from the score processes and show that this adjustment does not alter the limiting null distribution of the supremum score statistics. Using a simple example from the class of zero‐inflated regression models for count data, we show empirically and theoretically that the adjusted tests are superior in terms of size and power. The practical utility of this methodology is illustrated using count data in HIV research.     

OPTIMAL TESTS OF SIGNIFICANCE

To perform a test of significance of a null hypothesis, a test statistic is chosen which is expected to be small if the hypothesis is false. Then the significance level of the test for an observed sample is the probability that the test statistic, under the assumptions of the hypothesis, is as small, or smaller than, its observed value. A "good" test statistic is taken to be one which is stochastically small when the null hypothesis is false. Optimal test statistics are defined using this criterion and the relationship of these methods to the Neyman-Pearson theory of hypothesis testing is considered.     

Empirical phi-divergence test statistics for testing simple and composite null hypotheses

The main purpose of this paper is to introduce first a new family of empirical test statistics for testing a simple null hypothesis when the vector of parameters of interest is defined through a specific set of unbiased estimating functions. This family of test statistics is based on a distance between two probability vectors, with the first probability vector obtained by maximizing the empirical likelihood (EL) on the vector of parameters, and the second vector defined from the fixed vector of parameters under the simple null hypothesis. The distance considered for this purpose is the phi-divergence measure. The asymptotic distribution is then derived for this family of test statistics. The proposed methodology is illustrated through the well-known data of Newcomb's measurements on the passage time for light. A simulation study is carried out to compare its performance with that of the EL ratio test when confidence intervals are constructed based on the respective statistics for small sample sizes. The results suggest that the ‘empirical modified likelihood ratio test statistic’ provides a competitive alternative to the EL ratio test statistic, and is also more robust than the EL ratio test statistic in the presence of contamination in the data. Finally, we propose empirical phi-divergence test statistics for testing a composite null hypothesis and present some asymptotic as well as simulation results for evaluating the performance of these test procedures.     

On similarity and independence properties of composite edf goodness-of-fit tests

Many test statistics for classical simple goodness-of-fit hypothesis testing problems are distancemeasures between the distribution function of the null hypothesis distributipn and the empirical distribution function sometimes called EDF tests. If a composite parametric null hypothesis is considered in place of the simple null hypothesis, then a test statistic can be obtained from each EDF test by replacing the known distribution function of the simple problem by the Rao-Blackwell estimating distribution function. In this note we use known results to show that these Rao-Blackwell-EDF test statistics have distributions that do not depend upon parameter values, and hence that these tests are independent of a complete sufficient statistic for the parameters.     

Hypotheses testing for generalized order statistics with simple order restrictions on model parameters under the alternative

In applications of generalized order statistics as, for instance, reliability analysis of engineering systems, prior knowledge about the order of the underlying model parameters is often available and may therefore be incorporated in inferential procedures. Taking this information into account, we establish the likelihood ratio test, Rao's score test, and Wald's test for test problems arising from the question of appropriate model selection for ordered data, where simple order restrictions are put on the parameters under the alternative hypothesis. For simple and composite null hypothesis, explicit representations of the corresponding test statistics are obtained along with some properties and their asymptotic distributions. A simulation study is carried out to compare the order restricted tests in terms of their power. In the set-up considered, the adapted tests significantly improve the power of the associated omnibus versions for small sample sizes, especially when testing a composite null hypothesis.     

Bayesian testing of an exponential point null hypothesis

The problem of testing a point null hypothesis involving an exponential mean is The problem of testing a point null hypothesis involving an exponential mean is usual interpretation of P-values as evidence against precise hypotheses is faulty. As in Berger and Delampady (1986) and Berger and Sellke (1987), lower bounds on Bayesian measures of evidence over wide classes of priors are found emphasizing the conflict between posterior probabilities and P-values. A hierarchical Bayes approach is also considered as an alternative to computing lower bounds and “automatic” Bayesian significance tests which further illustrates the point that P-values are highly misleading measures of evidence for tests of point null hypotheses.     

Decisions on Seasonal Unit Roots

Decisions on the presence of seasonal unit roots in economic time series are commonly taken on the basis of statistical hypothesis tests. Some of these tests have absence of unit roots as the null hypothesis, while others use unit roots as their null. Following a suggestion by Hylleberg (1995) to combine such tests in order to reach a clearer conclusion, we evaluate the merits of such test combinations on the basis of a Bayesian decision setup. We find that the potential gains over a pure application of the most common test due to Hylleberg et al. (1990) can be small.     

协整参数的自举推断

 针对完全修正最小二乘(full-modified ordinary least square,简称FMOLS）估计方法,给出一种协整参数的自举推断程序,证明零假设下自举统计量与检验统计量具有相同的渐近分布。关于检验功效的研究表明,虽然有约束自举的实际检验水平表现良好,但如果零假设不成立,自举统计量的分布是不确定的,因而其经验分布不能作为检验统计量精确分布的有效估计。实际应用中建议使用无约束自举,因为无论观测数据是否满足零假设,其自举统计量与零假设下检验统计量都具有相同的渐近分布。最后,利用蒙特卡洛模拟对自举推断和渐近推断的有限样本表现进行比较研究。     

On the detection of changes in autoregressive time series I. Asymptotics

Various test statistics are discussed which can be used for detecting changes in the parameters of an autoregressive time series. In this first part of our study, the limiting behavior of the test statistics is derived under the null hypothesis of no change as well as under alternatives. In a forthcoming second part of our investigation, these asymptotic results will be compared to some corresponding bootstrap procedures, and a small simulation study will be conducted.     

On Small Sample Properties of the Wald,LR and LM Tests in a Linear Model with AR(1) Errors

When the error terms are autocorrelated, the conventional t-tests for individual regression coefficients mislead us to over-rejection of the null hypothesis. We examine, by Monte Carlo experiments, the small sample properties of the unrestricted estimator of ρ and of the estimator of ρ restricted by the null hypothesis. We compare the small sample properties of the Wald, likelihood ratio and Lagrange multiplier test statistics for individual regression coefficients. It is shown that when the null hypothesis is true, the unrestricted estimator of ρ is biased. It is also shown that the Lagrange multiplier test using the maximum likelihood estimator of ρ performs better than the Wald and likelihood ratio tests.     

A New Goodness-of-Fit Test for Censored Data with an Application in Monitoring Processes

In this article, we propose a new goodness-of-fit test for Type I or Type II censored samples from a completely specified distribution. This test is a generalization of Michael's test for censored data, which is based on the empirical distribution and a variance stabilizing transformation. Using Monte Carlo methods, the distributions of the test statistics are analyzed under the null hypothesis. Tables of quantiles of these statistics are also provided. The power of the proposed test is studied and compared to that of other well-known tests also using simulation. The proposed test is more powerful in most of the considered cases. Acceptance regions for the PP, QQ, and Michael's stabilized probability plots are derived, which enable one to visualize which data contribute to the decision of rejecting the null hypothesis. Finally, an application in quality control is presented as illustration.     

Testing the Normality Assumption in the Tobit Model

This paper examines a number of statistics that have been proposed to test the normality assumption in the tobit (censored regression) model. It argues that a number of commonly proposed statistics can be interpreted as different versions of the Lagrange multiplier, or score, test for a common null hypothesis. This observation is useful in examining the Monte Carlo results presented in the paper. The Monte Carlo results suggest that the computational convenience of a number of statistics is obtained at the cost of poor finite sample performance under the null hypothesis.     

Entropy-based goodness-of-fit tests for the Pareto I distribution

In this article, having observed the generalized order statistics in a sample, we construct a test for the hypothesis that the underlying distribution is the Pareto I distribution. The Shannon entropy of generalized order statistics is used to test the null hypothesis.     

Durbin–Watson and Generalized Durbin–Watson Tests for Autocorrelations and Randomness

The Durbin–Watson (DW) test for lag 1 autocorrelation has been generalized (DWG) to test for autocorrelations at higher lags. This includes the Wallis test for lag 4 autocorrelation. These tests are also applicable to test for the important hypothesis of randomness. It is found that for small sample sizes a normal distribution or a scaled beta distribution by matching the first two moments approximates well the null distribution of the DW and DWG statistics. The approximations seem to be adequate even when the samples are from nonnormal distributions. These approximations require the first two moments of these statistics. The expressions of these moments are derived.     

A general theory of hypothesis testing based on rankings

In nonparametric statistics, a hypothesis testing problem based on the ranks of the data gives rise to two separate permutation sets corresponding to the null and to the alternative hypothesis, respectively. A modification of Critchlow's unified approach to hypothesis testing is proposed. By defining the distance between permutation sets to be the average distance between pairs of permutations, one from each set, various test statistics are derived for the multi-sample location problem and the two-way layout. The asymptotic distributions of the test statistics are computed under both the null and alternative hypotheses. Some comparisons are made on the basis of the asymptotic relative efficiency.     

Testing variance components in balanced linear growth curve models

It is well known that the testing of zero variance components is a non-standard problem since the null hypothesis is on the boundary of the parameter space. The usual asymptotic chi-square distribution of the likelihood ratio and score statistics under the null does not necessarily hold because of this null hypothesis. To circumvent this difficulty in balanced linear growth curve models, we introduce an appropriate test statistic and suggest a permutation procedure to approximate its finite-sample distribution. The proposed test alleviates the necessity of any distributional assumptions for the random effects and errors and can easily be applied for testing multiple variance components. Our simulation studies show that the proposed test has Type I error rate close to the nominal level. The power of the proposed test is also compared with the likelihood ratio test in the simulations. An application on data from an orthodontic study is presented and discussed.     

Testing stationarity and trend stationarity against the unit root hypothesis

In this paper we propose a family of relativel simple nonparametrics tests for a unit root in a univariate time series. Almost all the tests proposed in the literature test the unit root hypothesis against the alternative that the time series involved is stationarity or trend stationary. In this paper we take the (trend) stationarity hypothesis as the null and the unit root hypothesis as the alternative. The order differnce with most of the tests proposed in the literature is that in all four cases the asymptotic null distribution is of a well-known type, namely standard Cauchy. In the first instance we propose four Cauchy tests of the stationarity hypothesis against the unit root hypothesis. Under H1 these four test statistics involved, divided by the sample size n, converge weakly to a non-central Cauchy distribution, to one, and to the product of two normal variates, respectively. Hence, the absolute values of these test statistics converge in probability to infinity 9at order n). The tests involved are therefore consistent against the unit root hypothesis. Moreover, the small sample performance of these test are compared by Monte Carlo simulations. Furthermore, we propose two additional Cauchy tests of the trend stationarity hypothesis against the alternative of a unit root with drift.     

Asymptotic distributions of some test statistics for a linear functional relationship

We consider the testing problems of the structural parameters for the multivariate linear functional relationship model. We treat the likelihood ratio test statistics and the test statistics based on the asymptotic distributions of the maximum likelihood estimators. We derive their asymptotic distributions under each null hypothesis respectively. A simulation study is made to evaluate how we can trust our asymptotic results when the sample size is rather small.     

On the joint distribution of the random variables ‘number of inversions’ and ‘number of outstanding variables’ in a randomly arranged sequence

The bivariate probability distribution of the random variables [number of inversions] and [number of outstanding variables] in a sequence of n i.i.d. random variables is derived. As an application, the null covariance between the test statistics proposed by Mann and Brunk, respectively, for the ‘trend in location’ problem is obtained. It is shown that these test statistics are asymptotically uncorrelated under the null hypothesis.