Book Review: New Introduction to Multiple Time Series Analysis

ABSTRACT

This paper proposes a test for the null hypothesis of periodic stationarity against the alternative hypothesis of periodic integration. We derive the limiting distribution of the test statistic and its characteristic function, which are the same as those of the test developed in Kwiatkowski, Phillips, Schmidt and Shin.[15] Kwiatkowski, D., Phillips, P.C. B., Schmidt, P. and Shin, Y. 1992. Testing the Null Hypothesis of Stationarity against the Alternative of a Unit Root.. Journal of Econometrics, 54: 159–178. [Crossref], [Web of Science ®] , [Google Scholar] We find that some parameters, which we must assume under the alternative, have an important effect on the limiting power, so we should choose such parameters carefully. A Monte Carlo simulation reveals that the test has reasonable power but may be affected by the lag truncation parameter that is used for the correction of nuisance parameters.     

On the use of priors in goodness‐of‐fit tests

Priors are introduced into goodness‐of‐fit tests, both for unknown parameters in the tested distribution and on the alternative density. Neyman–Pearson theory leads to the test with the highest expected power. To make the test practical, we seek priors that make it likely a priori that the power will be larger than the level of the test but not too close to one. As a result, priors are sample size dependent. We explore this procedure in particular for priors that are defined via a Gaussian process approximation for the logarithm of the alternative density. In the case of testing for the uniform distribution, we show that the optimal test is of the U‐statistic type and establish limiting distributions for the optimal test statistic, both under the null hypothesis and averaged over the alternative hypotheses. The optimal test statistic is shown to be of the Cramér–von Mises type for specific choices of the Gaussian process involved. The methodology when parameters in the tested distribution are unknown is discussed and illustrated in the case of testing for the von Mises distribution. The Canadian Journal of Statistics 47: 560–579; 2019 © 2019 Statistical Society of Canada     

Theoretical analysis of power in a two-component normal mixture model

In a likelihood-ratio test for a two-component Normal location mixture, the natural parametrisation degenerates to non-uniqueness under the null hypothesis. One consequence of this ambiguity is that the limiting distribution of the likelihood-ratio statistic is quite irregular, being of extreme-value type rather than chi-squared. Another irregular feature is that the likelihood-ratio statistic diverges to infinity, and so limit theory is nonstandard in this respect as well. These results, in a form applying directly to the likelihood-ratio statistic rather than to an approximating stochastic process, have recently been established by Liu and Shao (2004). While they address only properties under the null hypothesis, they hint that the power of the likelihood-ratio test may be less than in more conventional settings. In this paper we show that this is indeed the case. Using a system of local alternative hypotheses we quantify the extent to which power is reduced. We show that, in a large class of circumstances, the reduction in power can be appreciated in terms of inflation (by a log–log factor) of the displacement of the closest local alternative that can just be distinguished from the null hypothesis. However, in important respects the properties of power under local alternatives are significantly more complex than this, and exhibit two types of singularity. In particular, in two quite different respects, small changes in the local alternative, in the neighbourhood of a threshold, can dramatically alter power.     

On the one-sample location hypothesis for mixed bivariate data

We study a hypothesis testing problem involving the location model suggested by Olkin and Tate (1961). Specifically, we derive a likelihood ratio lest of the associated location hypothesis as an alternative to the conventional method of carrying out separate tests for each of the parameters. A small sample Monte Carlo comparison indicates the general superiority of the former in terms of statistical power. We also comment briefly on the properties of the test.     

Testing for the Null Hypothesis of Cointegration with a Structural Break

In this paper we propose residual-based tests for the null hypothesis of cointegration with a structural break against the alternative of no cointegration. The Lagrange Multiplier (LM) test is proposed and its limiting distribution is obtained for the case in which the timing of a structural break is known. Then the test statistic is extended to deal with a structural break of unknown timing. The test statistic, a plug-in version of the test statistic for known timing, replaces the true break point by the estimated one. We show the limiting properties of the test statistic under the null as well as the alternative. Critical values are calculated for the tests by simulation methods. Finite-sample simulations show that the empirical size of the test is close to the nominal one unless the regression error is very persistent and that the test rejects the null when no cointegrating relationship with a structural break is present. We provide empirical examples based on the present-value model, the term structure model, and the money-output relationship model.     

Testing for the Null Hypothesis of Cointegration with a Structural Break

In this paper we propose residual-based tests for the null hypothesis of cointegration with a structural break against the alternative of no cointegration. The Lagrange Multiplier (LM) test is proposed and its limiting distribution is obtained for the case in which the timing of a structural break is known. Then the test statistic is extended to deal with a structural break of unknown timing. The test statistic, a plug-in version of the test statistic for known timing, replaces the true break point by the estimated one. We show the limiting properties of the test statistic under the null as well as the alternative. Critical values are calculated for the tests by simulation methods. Finite-sample simulations show that the empirical size of the test is close to the nominal one unless the regression error is very persistent and that the test rejects the null when no cointegrating relationship with a structural break is present. We provide empirical examples based on the present-value model, the term structure model, and the money-output relationship model.     

Precedence-type test based on Kaplan–Meier estimator of cumulative distribution function

In this paper, we introduce a precedence-type test based on Kaplan–Meier estimator of cumulative distribution function (CDF) for testing the hypothesis that two distribution functions are equal against a stochastically ordered hypothesis. This test is an alternative to the precedence life-test proposed first by Nelson (1963). After deriving the null distribution of the test statistic, we present its exact power function under the Lehmann alternative, and compare the exact power as well as simulated power (under location-shift) of the proposed test with other precedence-type tests. Next, we extend this test to the case of progressively Type-II censored data. Critical values for some combination of sample sizes and progressive censoring schemes are presented. We then examine the power properties of this test procedure and compare them to those of the weighted precedence and weighted maximal precedence tests under a location-shift alternative by means of Monte Carlo simulations. Finally, we present two examples to illustrate all the test procedures discussed here, and then make some concluding remarks.     

An ANOVA-type test for multiple change points

We consider the problem of testing the null hypothesis of no change against the alternative of multiple change points in a series of independent observations. We propose an ANOVA-type test statistic and obtain its asymptotic null distribution. We also give approximations of its limiting critical values. We report the results of Monte Carlo studies conducted to compare the power of the proposed test against a number of its competitors. As illustrations we analyzed three real data sets.     

Hypotheses testing for a multidimensional parameter of inhomogeneous Poisson processes

We observe a realization of an inhomogeneous Poisson process whose intensity function depends on an unknown multidimensional parameter. We consider the asymptotic behaviour of the Rao score test for a simple null hypothesis against the multilateral alternative. By using the Edgeworth type expansion (under the null hypothesis) for a vector of stochastic integrals with respect to the Poisson process, we refine the (classic) threshold of the test (obtained by the central limit theorem), which improves the first type probability of error. The expansion allows us to describe the power of the test under the local alternative, i.e. a sequence of alternatives, which converge to the null hypothesis with a certain rate. The rates can be different for components of the parameter.     

Hypotheses testing for generalized order statistics with simple order restrictions on model parameters under the alternative

In applications of generalized order statistics as, for instance, reliability analysis of engineering systems, prior knowledge about the order of the underlying model parameters is often available and may therefore be incorporated in inferential procedures. Taking this information into account, we establish the likelihood ratio test, Rao's score test, and Wald's test for test problems arising from the question of appropriate model selection for ordered data, where simple order restrictions are put on the parameters under the alternative hypothesis. For simple and composite null hypothesis, explicit representations of the corresponding test statistics are obtained along with some properties and their asymptotic distributions. A simulation study is carried out to compare the order restricted tests in terms of their power. In the set-up considered, the adapted tests significantly improve the power of the associated omnibus versions for small sample sizes, especially when testing a composite null hypothesis.     

Testing Parameter Constancy in Stationary Vector Autoregressive Models Against Continuous Change

In this article we derive a parameter constancy test of a stationary vector autoregressive model against the hypothesis that the parameters of the model change smoothly over time. A single structural break is contained in this alternative hypothesis as a special case. The test is a generalization of a single-equation test of a similar hypothesis proposed in the literature. An advantage here is that the asymptotic distribution theory is standard. The performance of the tests is compared to that of generalized Chow-tests and found satisfactory in terms of both size and power.     

Use of an empirical probability generating function for testing a Poisson model

We present a test of the fit to a Poisson model based on the empirical probability generating function (epgf). We derive the limiting distribution of the test under the Poisson hypothesis and show that a rescaling of it is approximately independent of the mean parameter in the Poisson distribution. When inspected under a simulation study over a range of alternative distributions, we find that this test shows reasonable behaviour compared to other goodness-of-fit tests like the Poisson index of dispersion and smooth test applied to the Poisson model. These results illustrate that epgf-based methods for anlyzing count data are promising.     

Which Wald statistic? Choosing a parameterization of the Wald statistic to maximize power in k-sample generalized estimating equations

The Wald statistic is known to vary under reparameterization. This raises the question: which parameterization should be chosen, in order to optimize power of the Wald statistic? We specifically consider k-sample tests of generalized linear models (GLMs) and generalized estimating equations (GEEs) in which the alternative hypothesis contains only two parameters. An example is presented in which such an alternative hypothesis is of interest. Amongst a general class of parameterizations, we find the parameterization that maximizes power via analysis of the non-centrality parameter, and show how the effect on power of reparameterization depends on sampling design and the differences in variance across samples. There is no single parameterization with optimal power across all alternatives. The Wald statistic commonly used under the canonical parameterization is optimal in some instances but it performs very poorly in others. We demonstrate results by example and by simulation, and describe their implications for likelihood ratio statistics and score statistics. We conclude that due to poor power properties, the routine use of score statistics and Wald statistics under the canonical parameterization for GEEs is a questionable practice.     

Power of largest root on canonical correlation

We consider the testing hypothesis that two random vectors of p and q components are independent in canonical correlation analysis. In this paper we investigate the powers of the test based on the largest root criterion. As the exact distribution are expressed by the zonal polynomials, the computation is possible only for p=2, and also it is necessary to calculate using quadruplex precision because we lose the significance by subtraction. So in Table I we obtain the percentage points of the largest root criterion for the computation of the quadruplex precision. Then we calculate the power when p=2 and q = 3 to 11 (2). The results show that for the fixed n–q the power becomes smaller when q increases, and for the fixed p1 of the alternative hypothesis (p1, P2) the power does not become significantly large when P2 increases. We can also find the sample size required for the power agnist some alternative hypothesis to be about 0.9. the numerical results may be useful to find the quality of approximation by using formula of the asyptotic distribution.     

Bootstrapping Periodic State-Space Models

This article is concerned with how the bootstrap can be applied to study conditional forecast error distributions and construct prediction regions for future observations in periodic time-varying state-space models. We derive, first, an algorithm for assessing the precision of quasi-maximum likelihood estimates of the parameters. As a result, the derived algorithm is exploited for numerically evaluating the conditional forecast accuracy of a periodic time series model expressed in state space form. We propose a method which requires the backward, or reverse-time, representation of the model for assessing conditional forecast errors. Finally, the small sample properties of the proposed procedures will be investigated by some simulation studies. Furthermore, we illustrate the results by applying the proposed method to a real time series.     

A test of normality using nonparametrlic residuals

In this paper, we develop a test of the normality assumption of the errors using the residuals from a nonparametric kernel regression. Contrary to the existing tests based on the residuals from a parametric regression, our test is thus robust to misspecification of the regression function. The test statistic proposed here is a Bera-Jarque type test of skewness and kurtosis. We show that the test statistic has the usual x²(2) limit distribution under the null hypothesis. In contrast to the results of Rilstone (1992), we provide a set of primitive assumptions that allow weakly dependent observations and data dependent bandwidth parameters. We also establish consistency property of the test. Monte Carlo experiments show that our test has reasonably good size and power performance in small samples and perfornu better than some of the alternative tests in various situations.     

Adjusted Supremum Score‐Type Statistics for Evaluating Non‐Standard Hypotheses

Supremum score test statistics are often used to evaluate hypotheses with unidentifiable nuisance parameters under the null hypothesis. Although these statistics provide an attractive framework to address non‐identifiability under the null hypothesis, little attention has been paid to their distributional properties in small to moderate sample size settings. In situations where there are identifiable nuisance parameters under the null hypothesis, these statistics may behave erratically in realistic samples as a result of a non‐negligible bias induced by substituting these nuisance parameters by their estimates under the null hypothesis. In this paper, we propose an adjustment to the supremum score statistics by subtracting the expected bias from the score processes and show that this adjustment does not alter the limiting null distribution of the supremum score statistics. Using a simple example from the class of zero‐inflated regression models for count data, we show empirically and theoretically that the adjusted tests are superior in terms of size and power. The practical utility of this methodology is illustrated using count data in HIV research.     

Power Loss for Inhomogeneous Poisson Processes

In this work, based on a realization of an inhomogeneous Poisson process whose intensity function depends on a real parameter, we consider a simple null hypothesis against the composite one sided alternative. Under certain regularity conditions we will obtain the power loss of the score test which measures its performance with respect to the Neyman-Pearson test. We present the second-order approximation of the power of the score test under the close alternatives by specifying the explicit form of the next term after the Gaussian term.     

Homogeneity testing under finite location-scale mixtures

The testing problem for the order of finite mixture models has a long history and remains an active research topic. Since Ghosh & Sen (1985) revealed the hard-to-manage asymptotic properties of the likelihood ratio test, many successful alternative approaches have been developed. The most successful attempts include the modified likelihood ratio test and the EM-test, which lead to neat solutions for finite mixtures of univariate normal distributions, finite mixtures of single-parameter distributions, and several mixture-like models. The problem remains challenging, and there is still no generic solution for location-scale mixtures. In this article, we provide an EM-test solution for homogeneity for finite mixtures of location-scale family distributions. This EM-test has nonstandard limiting distributions, but we are able to find the critical values numerically. We use computer experiments to obtain appropriate values for the tuning parameters. A simulation study shows that the fine-tuned EM-test has close to nominal type I errors and very good power properties. Two application examples are included to demonstrate the performance of the EM-test.     

A test of normality using nonparametrlic residuals

In this paper, we develop a test of the normality assumption of the errors using the residuals from a nonparametric kernel regression. Contrary to the existing tests based on the residuals from a parametric regression, our test is thus robust to misspecification of the regression function. The test statistic proposed here is a Bera-Jarque type test of skewness and kurtosis. We show that the test statistic has the usual x ²(2) limit distribution under the null hypothesis. In contrast to the results of Rilstone (1992), we provide a set of primitive assumptions that allow weakly dependent observations and data dependent bandwidth parameters. We also establish consistency property of the test. Monte Carlo experiments show that our test has reasonably good size and power performance in small samples and perfornu better than some of the alternative tests in various situations.