Likelihood Based Inference in Non-linear Regression Models Using the p* and R* Approach

We develop second order asymptotic results for likelihood-based inference in Gaussian non-linear regression models. We provide an approximation to the conditional density of the maximum likelihood estimator given an approximate ancillary statistic (the affine ancillary). From this approximation, we derive a statistic to test an hypothesis on one component of the parameter. This test statistic is an adjustment of the signed log-likelihood ratio statistic. The distributional approximations (for the maximum likelihood estimator and for the test statistic) are of second order in large deviation regions.     

A Projection-Based Nonparametric Test of Conditional Quantile Independence

Abstract

This paper proposes a nonparametric procedure for testing conditional quantile independence using projections. Relative to existing smoothed nonparametric tests, the resulting test statistic: (i) detects the high frequency local alternatives that converge to the null hypothesis in probability at faster rate and, (ii) yields improvements in the finite sample power when a large number of variables are included under the alternative. In addition, it allows the researcher to include qualitative information and, if desired, direct the test against specific subsets of alternatives without imposing any functional form on them. We use the weighted Nadaraya-Watson (WNW) estimator of the conditional quantile function avoiding the boundary problems in estimation and testing and prove weak uniform consistency (with rate) of the WNW estimator for absolutely regular processes. The procedure is applied to a study of risk spillovers among the banks. We show that the methodology generalizes some of the recently proposed measures of systemic risk and we use the quantile framework to assess the intensity of risk spillovers among individual financial institutions.     

Testing for Granger-causality in quantiles

This paper proposes a consistent parametric test of Granger-causality in quantiles. Although the concept of Granger-causality is defined in terms of the conditional distribution, most articles have tested Granger-causality using conditional mean regression models in which the causal relations are linear. Rather than focusing on a single part of the conditional distribution, we develop a test that evaluates nonlinear causalities and possible causal relations in all conditional quantiles, which provides a sufficient condition for Granger-causality when all quantiles are considered. The proposed test statistic has correct asymptotic size, is consistent against fixed alternatives, and has power against Pitman deviations from the null hypothesis. As the proposed test statistic is asymptotically nonpivotal, we tabulate critical values via a subsampling approach. We present Monte Carlo evidence and an application considering the causal relation between the gold price, the USD/GBP exchange rate, and the oil price.     

An omnibus test of goodness-of-fit for conditional distributions with applications to regression models

We introduce an omnibus goodness-of-fit test for statistical models for the conditional distribution of a random variable. In particular, this test is useful for assessing whether a regression model fits a data set on all its assumptions. The test is based on a generalization of the Cramér–von Mises statistic and involves a local polynomial estimator of the conditional distribution function. First, the uniform almost sure consistency of this estimator is established. Then, the asymptotic distribution of the test statistic is derived under the null hypothesis and under contiguous alternatives. The extension to the case where unknown parameters appear in the model is developed. A simulation study shows that the test has good power against some common departures encountered in regression models. Moreover, its power is comparable to that of other nonparametric tests designed to examine only specific departures.     

Testing transition probability matrix of a multi-state model with censored data

In this paper, we develop procedures to test hypotheses concerning transition probability matrices arising from certain nonhomogeneous Markov processes. It is assumed that the data consist of sample paths, some of which are observed until a certain terminal state, and the other paths are censored. Problems of this type arise in the context of multi-state models relevant to Health Related Quality of Life (HRQoL) and Competing Risks. The test statistic is based on the estimator for the associated intensity matrix. We show that the asymptotic null distribution of the proposed statistic is Gaussian, and demonstrate how the procedure can be adopted for HRQoL studies and competing risks model using real data sets. Finally, we establish that the test statistic for the HRQoL has greatest local asymptotic power against a sequence of proportional hazards alternatives converging to the null hypothesis.     

MOSUM monitoring for variance change in nonparametric regression models

ABSTRACT

This article considers the monitoring for variance change in nonparametric regression models. First, the local linear estimator of the regression function is given. A moving square cumulative sum procedure is proposed based on residuals of the estimator. And the asymptotic results of the statistic under the null hypothesis and the alternative hypothesis are obtained. Simulations and Application support our procedure.     

Spectral Density Based Goodness-of-Fit Tests for Time Series Models

A new goodness-of-fit test for time series models is proposed. The test statistic is based on the distance between a kernel estimator of the ratio between the true and the hypothesized spectral density and the expected value of the estimator under the null. It provides a quantification of how well a parametric spectral density model fits the sample spectral density (periodogram). The asymptotic distribution of the statistic proposed is derived and its power properties are discussed. To improve upon the large sample (Gaussian) approximation of the distribution of the test statistic under the null, a bootstrap procedure is presented and justified theoretically. The finite sample performance of the test is investigated through a simulation experiment and applications to real data sets are given.     

Order test for high-dimensional two-sample means

We propose a new method to test the order between two high-dimensional mean curves. The new statistic extends the approach of Follmann (1996) to high-dimensional data by adapting the strategy of Bai and Saranadasa (1996). The proposed procedure is an alternative to the non-negative basis matrix factorization (NBMF) based test of Lee et al. (2008) for the same hypothesis, but it is much easier to implement. We derive the asymptotic mean and variance of the proposed test statistic under the null hypothesis of equal mean curves. Based on theoretical results, we put forward a permutation procedure to approximate the null distribution of the new test statistic. We compare the power of the proposed test with that of the NBMF-based test via simulations. We illustrate the approach by an application to tidal volume traces.     

Precedence-type test based on Kaplan–Meier estimator of cumulative distribution function

In this paper, we introduce a precedence-type test based on Kaplan–Meier estimator of cumulative distribution function (CDF) for testing the hypothesis that two distribution functions are equal against a stochastically ordered hypothesis. This test is an alternative to the precedence life-test proposed first by Nelson (1963). After deriving the null distribution of the test statistic, we present its exact power function under the Lehmann alternative, and compare the exact power as well as simulated power (under location-shift) of the proposed test with other precedence-type tests. Next, we extend this test to the case of progressively Type-II censored data. Critical values for some combination of sample sizes and progressive censoring schemes are presented. We then examine the power properties of this test procedure and compare them to those of the weighted precedence and weighted maximal precedence tests under a location-shift alternative by means of Monte Carlo simulations. Finally, we present two examples to illustrate all the test procedures discussed here, and then make some concluding remarks.     

A test of the mean square error criterion for shrinkage estimators

A test for choosing between a shrinkage estimator and the least squares estimator is described and a central-F approximation to the test statistic is considered. An example from the literature was analysed using the test procedure proposed here. The power of the test was studied by means of simulation.     

The Empirical Likelihood for First-Order Random Coefficient Integer-Valued Autoregressive Processes

This article studies the empirical likelihood method for the first-order random coefficient integer-valued autoregressive process. The limiting distribution of the log empirical likelihood ratio statistic is established. Confidence region for the parameter of interest and its coverage probabilities are given, and hypothesis testing is considered. The maximum empirical likelihood estimator for the parameter is derived and its asymptotic properties are established. The performances of the estimator are compared with the conditional least squares estimator via simulation.     

Statistic inference for a single-index ARCH-M model

For a single-index autoregressive conditional heteroscedastic (ARCH-M) model, estimators of the parametric and non parametric components are proposed by the profile likelihood method. The research results had shown that all the estimators have consistency and the parametric estimators have asymptotic normality. We extend this line of research by deriving the asymptotic normality of the non parametric estimator. Based on the asymptotic properties, we propose Wald statistic and generalized likelihood ratio statistic to investigate the testing problems for ARCH effect and goodness of fit, respectively. A simulation study is conducted to evaluate the finite-sample performance of the proposed estimation methodology and testing procedure.     

Bootstrap estimation of actual significance levels for tests based on estimated nuisance parameters

Often for a non-regular parametric hypothesis, a tractable test statistic involves a nuisance parameter. A common practice is to replace the unknown nuisance parameter by its estimator. The validality of such a replacement can only be justified for an infinite sample in the sense that under appropriate conditions the asymptotic distribution of the statistic under the null hypothesis is unchanged when the nuisance parameter is replaced by its estimator (Crowder M.J. 1990. Biometrika 77: 499–506). We propose a bootstrap method to calibrate the error incurred in the significance level, for finite samples, due to the replacement. Further, we have proved that the bootstrap method provides a more accurate estimator for the unknown actual significance level than the nominal level. Simulations demonstrate the proposed methodology.     

A test for correlation based on Kendall's tau

A consistent estimator for the variance of Kendall's tau is proposed which allows for testing the hypothesis of no correlation in a bivariate distribution. The null distribution of the test statistic is tabulated under independence, and the properties of the test are discussed.     

Testing parametric models in linear‐directional regression

This paper presents a goodness‐of‐fit test for parametric regression models with scalar response and directional predictor, that is, a vector on a sphere of arbitrary dimension. The testing procedure is based on the weighted squared distance between a smooth and a parametric regression estimator, where the smooth regression estimator is obtained by a projected local approach. Asymptotic behaviour of the test statistic under the null hypothesis and local alternatives is provided, jointly with a consistent bootstrap algorithm for application in practice. A simulation study illustrates the performance of the test in finite samples. The procedure is applied to test a linear model in text mining.     

Changepoint Estimation in a Segmented Linear Regression via Empirical Likelihood

For a segmented regression system with an unknown changepoint over two domains of a predictor, a new empirical likelihood ratio statistic is proposed to test the null hypothesis of no change. Under the null hypothesis of no change, the proposed test statistic is shown empirically to be Gumbel distributed with robust location and scale estimators against various parameter settings and error distributions. A power analysis is conducted to illustrate the performance of the test. Under the alternative hypothesis with a changepoint, the test statistic is utilized to estimate the changepoint between the two domains. A comparison of the frequency distributions between the proposed estimator and two parametric methods indicates that the proposed method is effective in capturing the true changepoint.     

Computing Wald criteria for nested hypotheses

We present a numerically convenient procedure for computing Wald criteria for nested hypotheses. Similar to Szroeter’s (1983) generalized Wald test, the suggested procedure does not require explicit derivation of the restrictions implied by the null hypothesis and hence its use might eliminate an intricate step in testing linear and nonlinear hypotheses. We show that the traditional Wald test, Szroeter’s (1983) generalized Wald test and our procedure are asymptotically equivalent under H₀. A class of nonlinear transformations of the restrictions for which the Wald statistic is asymptotically invariant is discussed. Finally, we illustrate the use of our procedure for testing the common factor restrictions in a dynamic regression model.     

一类基于非参数回归的条件异方差检验

现有基于参数模型构造的条件异方差检验往往存在模型设定偏误问题。为了避免模型误设对检验结果的影响,并且同时捕获多种条件异方差现象,本文基于非参数回归构造了不依赖于特定模型形式的条件异方差检验统计量。该统计量可视作条件方差和无条件方差之间差异的加权平均,在原假设成立时渐近服从标准正态分布。数值模拟结果一方面表明本文统计量具有良好的有限样本性质,另一方面也说明条件均值模型误设会导致错误地拒绝条件同方差的原假设,凸显了本文引入非参数方法构造条件异方差检验的必要性。实证分析采用本文统计量探讨了国际主要股指收益率的条件异方差现象,得到了与Engle (1982)不同的检验结果,可能意味着股指收益率呈现出非线性动态特征。     

Semiparametric ARCH Models

This article introduces a semiparametric autoregressive conditional heteroscedasticity (ARCH) model that has conditional first and second moments given by autoregressive moving average and ARCH parametric formulations but a conditional density that is assumed only to be sufficiently smooth to be approximated by a nonparametric density estimator. For several particular conditional densities, the relative efficiency of the quasi-maximum likelihood estimator is compared with maximum likelihood under correct specification. These potential efficiency gains for a fully adaptive procedure are compared in a Monte Carlo experiment with the observed gains from using the proposed semiparametric procedure, and it is found that the estimator captures a substantial proportion of the potential. The estimator is applied to daily stock returns from small firms that are found to exhibit conditional skewness and kurtosis and to the British pound to dollar exchange rate.     

Goodness‐of‐fit Test for Directional Data

In this paper, we study the problem of testing the hypothesis on whether the density f of a random variable on a sphere belongs to a given parametric class of densities. We propose two test statistics based on the L² and L¹ distances between a non‐parametric density estimator adapted to circular data and a smoothed version of the specified density. The asymptotic distribution of the L² test statistic is provided under the null hypothesis and contiguous alternatives. We also consider a bootstrap method to approximate the distribution of both test statistics. Through a simulation study, we explore the moderate sample performance of the proposed tests under the null hypothesis and under different alternatives. Finally, the procedure is illustrated by analysing a real data set based on wind direction measurements.