Multiple hypothesis test for parameter constancy based on recursive residuals

This article presents a multiple hypothesis test procedure that combines two well known tests for structural change in the linear regression model, the CUSUM test and the recursive t test. The CUSUM test is run through the sequence of recursive residuals as usual; if the CUSUM plot does not violate the critical lines, one more step is taken to perform the t test for hypothesis of zero mean based on all recursive residuals. The asymptotic size of this multiple hypothesis test is derived; power simulation results suggest that it outperforms the traditional CUSUM test and complements other tests that are currently stressed in econometrics.     

Local Fourier tests for structural change based on residuals

We propose a structural change test based on the recursive residuals with the local Fourier series estimators. The statistical properties of the proposed test are derived and the empirical properties are shown via simulation. We also consider other structural change tests based on CUSUM, MOSUM, moving estimates (ME), and empirical distribution functions with the recursive residuals and the ordinary residuals. Empirical powers are calculated in various structural change models for the comparison of those tests. These structural change tests are applied to South Korea's gross domestic product (GDP), South Korean Won to US Dollar currency exchange rates, and South Korea's Okun's law.     

Schwarz information criterion based tests for a change-point in regression models

Standard Schwarz information criterion for testing a change-point in regression models is considered and two new test procedures are evolved. The case of small sample size is investigated. Numerical approximations to the power against various alternatives are given and compared with powers of tests based on r-ahead recursive residuals and of the CUSUM of squares test. Application of these procedures to some real data is also provided.     

Residual-based CUSUM of squares test for Poisson integer-valued GARCH models

This study considers the problem of testing for a parameter change in integer-valued time series models in which the conditional density of current observations is assumed to follow a Poisson distribution. As a test, we consider the CUSUM of the squares test based on the residuals from INGARCH models and find that the test converges weakly to the supremum of a Brownian bridge. A simulation study demonstrates its superiority to the residual and standardized residual-based CUSUM tests of Kang and Lee [Parameter change test for Poisson autoregressive models. Scand J Statist. 2014;41:1136–1152] and Lee and Lee [CUSUM tests for general nonlinear inter-valued GARCH models: comparison study. Ann Inst Stat Math. 2019;71:1033–1057.] as well as the CUSUM of squares test based on standardized residuals.     

Change-Point Detection in Two-Phase Regression with Inequality Constraints on the Regression Parameters

Two-phase regression models with inequality constraints on the regression coefficients and with a small number of measurements is considered. A new test based on the likelihood ratio in linear model with inequality constraints for the presence of a change-point is proposed. Numerical approximations to the powers against various alternatives are given and compared with the powers of the likelihood ratio test in the two-phase regression models without inequality constraints, the backwards CUSUM test, and the k-linear-r-ahead recursive residuals tests. Performance of related likelihood based estimators of the change-point is briefly studied in a Monte Carlo experiment.     

Change-point detection in a shape-restricted regression model

A regression model with a possible structural change and with a small number of measurements is considered. A priori information about the shape of the regression function is used to formulate the model as a linear regression model with inequality constraints and a likelihood ratio test for the presence of a change-point is constructed. The exact null distribution of the test statistic is given. Consistency of the test is proved when the noise level goes to zero. Numerical approximations to the powers against various alternatives are given and compared with the powers of the k-linear-r-ahead recursive residuals tests and CUSUM tests. Performance of four different estimators of the change-point is studied in a Monte Carlo experiment. An application of the procedures to some real data is also presented.     

Two tests for sequential detection of a change-point in a nonlinear model

In this paper, two tests, based on weighted CUSUM of the least squares residuals, are studied to detect in real time a change-point in a nonlinear model. A first test statistic is proposed by extension of a method already used in the literature but for the linear models. It is tested under the null hypothesis, at each sequential observation, that there is no change in the model against a change presence. The asymptotic distribution of the test statistic under the null hypothesis is given and its convergence in probability to infinity is proved when a change occurs. These results will allow to build an asymptotic critical region. Next, in order to decrease the type I error probability, a bootstrapped critical value is proposed and a modified test is studied in a similar way. A generalization of the Hájek–Rényi inequality is established.     

Parameter Change Test for Poisson Autoregressive Models

In this paper, we consider the problem of testing for a parameter change in Poisson autoregressive models. We suggest two types of cumulative sum (CUSUM) tests, namely, those based on estimates and residuals. We first demonstrate that the conditional maximum likelihood estimator (CMLE) is strongly consistent and asymptotically normal and then construct the CMLE‐based CUSUM test. It is shown that under regularity conditions, its limiting null distribution is a function of independent Brownian bridges. Next, we construct the residual‐based CUSUM test and derive its limiting null distribution. Simulation results are provided for illustration. A real‐data analysis is performed on data for polio incidence and campylobacteriosis infections.     

Testing for random individual effects using recursive residuals

This paper derives a simple ANOVA-F-statistic which tests for random individual effects in a one-way error component model, using recursive residuals. Power comparisons are performed for this F-test when it is computed using true disturbances and recursive residuals from a panel data regression. Under the null, both statistics have an exact F distribution. The standardized version of the Breusch and Pagan (1980) Lagrange Multiplier test (SLM) as well as a fixed effects F-statistic (FE) recommended by Moulton and Randolph (1989), are also included in this comparison. The exact power function can be computed in all cases using Imhof's (1961) procedure. Our results suggest that the F-test based on recursive residuals is inferior to the popular SLM and FE tests based on computational simplicity, power comparisons and its sensitivity to the K observations starting the recursion.     

Monitoring Structural Changes in Generalized Linear Models

In this article, we introduce two monitoring schemes to (sequentially) detect structural changes in generalized linear models and develop asymptotic theories for them. The first method is based on cumulative sums (CUSUM) of weighted residuals, in which the unknown in-control parameters have been replaced by its maximum likelihood (ML) estimate from the training sample, whereas the second scheme makes use of moving sums (MOSUM) of weighted residuals. We characterize the limit distribution of the test statistic and show that these tests are consistent. Moreover, we also obtain and tabulate the asymptotic critical values of the tests. Finally, we study the speed of detection under different conditions. The methods are illustrated and compared in several simulations.     

Testing for structural changes in linear regressions with time-varying variance

Abstract

This article proposes a nonparametric test for structural changes in linear regression models that allows for serial correlation, autoregressive conditional heteroskedasticity and time-varying variance in error terms. The test requires no trimming of the boundary region near the end points of the sample period, and requires no prior information on the alternative, what it requires is the transformed OLS residuals under the null hypothesis. We show that the test has a limiting standard normal distribution under the null hypothesis, and is powerful against single break, multiple breaks and smooth structural changes. The Monte Carlo experiment is conducted to highlight the merits of the proposed test relative to other popular tests for structural changes.     

Estimation Mean Change-Point in ARCH Models with Heavy-Tailed Innovations

The quest of the mean change-point in ARCH models with innovations in the domain of attraction of a κ-stable law appears to still be ongoing. We derive the asymptotic distribution of the residuals CUSUM of squares test (RCUSQ) statistic and find it depends on the stable index κ which is often typically unknown and difficult to estimate. Therefore, the subsampling method is proposed to detect changes without estimating κ. The tests are easy to use and are found to perform well in a Monte Carlo experiment.     

A Weighted Least Squares Approach to Levene's Test of Homogeneity of Variance

In 1960 Levene suggested a potentially robust test of homogeneity of variance based on an ordinary least squares analysis of variance of the absolute values of mean-based residuals. Levene's test has since been shown to have inflated levels of significance when based on the F-distribution, and tests a hypothesis other than homogeneity of variance when treatments are unequally replicated, but the incorrect formulation is now standard output in several statistical packages. This paper develops a weighted least squares analysis of variance of the absolute values of both mean-based and median-based residuals. It shows how to adjust the residuals so that tests using the F -statistic focus on homogeneity of variance for both balanced and unbalanced designs. It shows how to modify the F -statistics currently produced by statistical packages so that the distribution of the resultant test statistic is closer to an F-distribution than is currently the case. The weighted least squares approach also produces component mean squares that are unbiased irrespective of which variable is used in Levene's test. To complete this aspect of the investigation the paper derives exact second-order moments of the component sums of squares used in the calculation of the mean-based test statistic. It shows that, for large samples, both ordinary and weighted least squares test statistics are equivalent; however they are over-dispersed compared to an F variable.     

Power properties of the modified CUSUM tests

The CUSUM test has played an important role in theory and applications related to structural change, but its drawback is that it loses power when the break is orthogonal to the mean of the regressors. In this study, we consider two modified CUSUM tests that have been proposed, implicitly or explicitly, in the literature to detect such structural changes and investigate the limiting power properties of these tests under a fixed alternative. We demonstrate that the modified tests are superior to the classic tests in terms of both asymptotic theory and in finite samples when detecting an orthogonal structural shift.     

Average run lengths for cusum control charts applied to residuals

A common approach to building control charts for autocorrelated data is to apply classical SPC to the residuals from a time series model of the process. However, Shewhart charts and even CUSUM charts are less sensitive to small shifts in the process mean when applied to residuals than when applied to independent data. Using an approximate analytical model, we show that the average run length of a CUSUM chart for residuals can be reduced substantially by modifying traditional chart design guidelines to account for the degree of autocorrelation in the data.     

STAR模型中的递归退势单位根检验研究

在STAR模型框架下,考虑时间序列具有线性确定性趋势成分,本文建立了一个递归退势单位根检验统计量,推导了其渐近分布;并在考虑初始条件情形下,对递归退势、OLS和GLS退势单位根检验统计量的有限样本性质进行了细致的比较研究。若忽略初始条件的影响,GLS退势和递归退势单位根检验统计量的检验势都显著高于OLS退势。随着初始条件的增大,GLS退势单位根检验统计量的检验势下降得比较厉害,递归退势单位根检验统计量的检验势较为稳定,且在样本量较大情形下更具优势。     

A power study of k-linear-r-ahead recursive residuals test for change-point in finite sequences

A change-point problem in finite sequences is considered along with, so-called, k-linear-r-ahead recursive residuals and a test procedure proposed by ?o?a¸d? et al. [?o?a¸d?, J.A., Szkutnik, Z., Majerczak, J. and Duda, K. 1998, Detection of change point in oxygen uptake during an incremental exercise test using recursive residuals: relationship to the plasma lactate accumulation and blood acid base balance. European Journal of Applied Physiology, 78, 369–377.]. Theoretical significance levels of that (conservative) test are compared with its simulated sizes. Numerical approximations to the powers against various alternatives are given. Properties of the k-linear-r-ahead recursive residuals are described and the consistency of the test is proved, when the noise level goes to zero.     

Influence Diagnostics on Testing Linear Hypothesis in Linear Models with Correlated Errors

To assess the influence of observations on the parameter estimates, case deletion diagnostics are commonly used in linear regression models. For linear models with correlated errors we study the influence of observations on testing a linear hypothesis using single and multiple case deletions. The change in likelihood ratio test and F test theoretically is derived and it is shown these tests to be completely determined by two proposed generalized externally studentized residuals. An illustrative example of a real data set is also reported.     

On the power of some tests for examining the stability of regression coefficients

The main objective of the study is to compare four different procedures to test for the stability of regression coefficients. The comparisons are based on a numerical study and are with respect to their abilities to detect various simple forms of parameter instabilities. Besides the power comparisons a special interest is directed towards the choice of “window length” in the tests based on moving sums of squared recursive and ordinary least-squares residuals.     

Alternative boundaries for CUSUM tests

Alternative boundaries for the common Recursive (or Standard) CUSUM test and the OLS-based CUSUM test for structural change are suggested and their properties are examined by simulation of expectedp values. The poor power of the tests for early and late structural changes can be improved for the OLS-based version, whereas this weakness of the Recursive CUSUM test cannot be overcome by the new boundaries. Research supported by the Austrian Science Foundation (FWF) under grant SFB#010 (‘Adaptive Information Systems and Modeling in Economics and Management Science’).