Non-nested hypothesis testing inference for GAMLSS models

Two or more regression models are said to be non-nested if neither can be obtained from the remaining models when parametric restrictions are imposed. Tests for choosing between linear non-nested regression models are found in literature, such as J and MJ tests. In this paper we propose variants of these two tests for the GAMLSS (Generalized Additive Models for Location, Scale and Shape) class of models. We report Monte Carlo evidence on finite sample behaviour of the proposed tests. Bootstrap-based testing inference is also considered. Overall, bootstrap MJ test had the best performance. An empirical application is presented and discussed.     

Model specification tests against non-nested alternatives

Non-nested hypothesis tests provide a way to test the specification of an econometric model against the evidence provided by one or more non-nested alternatives. This paper surveys the recent literature on non-nested hypothesis testing in the context of regression and related models. Much of the purely statistical 1iterature which has evolved from the fundamental work of Cox (1961, 1962) is discussed briefly or not at all. Instead, emphasis is placed on those techniques which are easy to employ in practice and are likely to be useful to applied workers.     

Model specification tests against non-nested alternatives

Non-nested hypothesis tests provide a way to test the specification of an econometric model against the evidence provided by one or more non-nested alternatives. This paper surveys the recent literature on non-nested hypothesis testing in the context of regression and related models. Much of the purely statistical 1iterature which has evolved from the fundamental work of Cox (1961, 1962) is discussed briefly or not at all. Instead, emphasis is placed on those techniques which are easy to employ in practice and are likely to be useful to applied workers.     

COMPARING TESTS OF AUTOREGRESSIVE VERSUS MOVING AVERAGE ERRORS IN REGRESSION MODELS USING BAHADUR’S ASYMPTOTIC RELATIVE EFFICIENCY

ABSTRACT

The purpose of this paper is to use Bahadur's asymptotic relative efficiency measure to compare the performance of various tests of autoregressive (AR) versus moving average (MA) error processes in regression models. Tests to be examined include non-nested procedures of the models against each other, and classical procedures based upon testing both the AR and MA error processes against the more general autoregressive-moving average model.     

Alternative approaches to testing non-nested models with autocorrelated disturbances

Since departures from the classical assumptions regarding the disturbances in a linear tegression model arise frequently in empirical application, deveral computationally Straightforward procedutes are presented in this paper for testiog non-nested models when the disturbances of these models follow first- or higher-order autoregressive processes. Anempirical example is used to illustrate how the procedures may be used to test competing Keynesian and New Classical non-nested models of unemployment for the U.S using annual time series data for 1955-85.     

A robust test for non-nested hypotheses

This paper uses a modified rank score test for non-nested linear regression models. The modified rank score test is robust with respect to models with non-normal distributions and can be viewed as a robust version of the J test of Davidson and MacKinnon (Econometrica 49:781–793, 1981). Therefore, this test does not require a specification of error density function and is easy to implement. Also, a modified rank score test for multiple non-nested models is provided. Monte Carlo simulation results show that the test has good finite sample performances. Financial applications for two competing theories, the capital asset pricing model and the arbitrage pricing theory, are considered herein. Empirical evidence from the modified rank score test shows that the former is a better model for asset pricing.     

Inference after separated hypotheses testing: an empirical investigation for linear models

Model selection problems arise while constructing unbiased or asymptotically unbiased estimators of measures known as discrepancies to find the best model. Most of the usual criteria are based on goodness-of-fit and parsimony. They aim to maximize a transformed version of likelihood. For linear regression models with normally distributed error, the situation is less clear when two models are equivalent: are they close to or far from the unknown true model? In this work, based on stochastic simulation and parametric simulation, we study the results of Vuong's test, Cox's test, Akaike's information criterion, Bayesian information criterion, Kullback information criterion and bias corrected Kullback information criterion and the ability of these tests to discriminate between non-nested linear models.     

Estimation of firm-specific technological bias, technical change and total factor productivity growth: a dual approach

This paper deals with modeling firm-specific technical change (TC), and technological biases (inputs and scale) in estimating total factor productivity (TFP) growth. Several dual parametric econometric models are used for this purpose. We examine robustness of TFP growth and TC among competing models. These models include the traditional time trend (TT) model and the general index (GI) model. The TT and the GI models are generalized to accommodate firm-specific TC and technological bias (in inputs and output). Both nested and non-nested tests are used to select the appropriate models. Firm-level panel data from the Japanese chemical industry during 1968- 1987 is used as an application.     

Estimation of firm-specific technological bias,technical change and total factor productivity growth: a dual approach

This paper deals with modeling firm-specific technical change (TC), and technological biases (inputs and scale) in estimating total factor productivity (TFP) growth. Several dual parametric econometric models are used for this purpose. We examine robustness of TFP growth and TC among competing models. These models include the traditional time trend (TT) model and the general index (GI) model. The TT and the GI models are generalized to accommodate firm-specific TC and technological bias (in inputs and output). Both nested and non-nested tests are used to select the appropriate models. Firm-level panel data from the Japanese chemical industry during 1968- 1987 is used as an application.     

Testing non-nested log-linear models with pseudo estimator

As the number of random variables for the categorical data increases, the possible number of log-linear models which can be fitted to the data increases rapidly, so that various model selection methods are developed. However, we often found that some models chosen by different selection criteria do not coincide. In this paper, we propose a comparison method to test the final models which are non-nested. The statistic of Cox (1961, 1962) is applied to log-linear models for testing non-nested models, and the Kullback-Leibler measure of closeness (Pesaran 1987) is explored. In log-linear models, pseudo estimators for the expectation and the variance of Cox's statistic are not only derived but also shown to be consistent estimators.     

Towards a theory of point optimal testing

This paper puts the case for the inclusion of point optimal tests in the econometrician's repertoire. They do not suit every testing situation but the current evidence, which is reviewed here, indicates that they can have extremely useful Small-sample power properties. As well as being most powerful at a nominated point in the alternative hypothesis parameter space, they may also have optimum power at a number of other points and indeed be uniformly most powerful when such a test exists. Point optimal tests can also be used to trace out the maxemum attainable power envelope for a given testing problem, thus providing a benchmark against which test procedures can be evaluated. In some cases, point optimal tests can be constructed from tests of simple null hypothesis against a simple alternative. For a wide range of models of interst to econometricians, this paper shows how one can check whether a point optimal test can be constructed in this way. When it cannot, one may wish to consider approximately point optimal tests. As an illustration, the approach is applied to the non-nested problem of testing for AR(1) distrubances against MA(1) distrubances in the linear regression model.     

Towards a theory of point optimal testing

This paper puts the case for the inclusion of point optimal tests in the econometrician's repertoire. They do not suit every testing situation but the current evidence, which is reviewed here, indicates that they can have extremely useful Small-sample power properties. As well as being most powerful at a nominated point in the alternative hypothesis parameter space, they may also have optimum power at a number of other points and indeed be uniformly most powerful when such a test exists. Point optimal tests can also be used to trace out the maxemum attainable power envelope for a given testing problem, thus providing a benchmark against which test procedures can be evaluated. In some cases, point optimal tests can be constructed from tests of simple null hypothesis against a simple alternative. For a wide range of models of interst to econometricians, this paper shows how one can check whether a point optimal test can be constructed in this way. When it cannot, one may wish to consider approximately point optimal tests. As an illustration, the approach is applied to the non-nested problem of testing for AR(1) distrubances against MA(1) distrubances in the linear regression model.     

Some pitfalls of tests of separate families of hypotheses: normality vs. lognormality

It is often desirable to test non-nested hypotheses. Cox (1961, 1962) proposed forming a log-likelihood ratio from their maxima and then comparing this value to its expected value under the null hypothesis. Pitfalls exists when we apply Cox's test to the special case of testing normality versus lognormality. Pesaran (1981) and Kotz (1973) pointed out the slow convergence rate of the Cox's test. In this paper, this fact has been reemphasized; moreover, we propose an alternative likelihood ratio test which remedies problems arising from negative estimates of the asymptotic variance of Cox's test statistic and is uniformly more powerful than most commonly used tests.     

Probability model choice in single samples from exponential families using Poisson log-linear modelling,and model comparison using Bayes and posterior Bayes factors

This paper describes a method due to Lindsey (1974a) for fitting different exponential family distributions for a single population to the same data, using Poisson log-linear modelling of the density or mass function. The method is extended to Efron's (1986) double exponential family, giving exact ML estimation of the two parameters not easily achievable directly. The problem of comparing the fit of the non-nested models is addressed by both Bayes and posterior Bayes factors (Aitkin, 1991). The latter allow direct comparisons of deviances from the fitted distributions.     

Tracking interval for selecting between non-nested models: An investigation for Type II right censored data

In this paper, we consider the setting where the observed data is incomplete. For the general situation where the number of gaps as well as the number of unobserved values in some gaps go to infinity, the asymptotic behavior of maximum likelihood estimator is not clear. We derive and investigate the asymptotic properties of maximum likelihood estimator under censorship and drive a statistic for testing the null hypothesis that the proposed non-nested models are equally close to the true model against the alternative hypothesis that one model is closer when we are faced with a life-time situation. Furthermore rewrite a normalization of a difference of Akaike criterion for estimating the difference of expected Kullback–Leibler risk between the distributions in two different models.     

Testing nested and non-nested periodically integrated autoregressive models

Periodically integrated time series require a periodic differencing filter to remove the stochastic trend. A non-periodic integrated time series needs the first-difference filter for similar reasons. When the changing sea- sonal fluctuations for the non-periodic integrated series can be described by seasonal dummy variables for which the corresponding parameters are not constant within the sampie, such a series may not be easily & stinguished from a periodically integrated time series. In this paper, nested and non-nested testing procedures are proposed to distinguish between these two alternative stochastic and non-stochastic seasonal processes, When it is assumed there is a single unknown structural break in the seasonal dummy parameters. Several empirical examples using quarterly real macroeconomic time series for the United Kingdom illustrate the nested and non-nested approaches.     

Robust inference by influence functions

We first review briefly some basic approaches to robust inference and discuss the role and the place of some key concepts (influence function, breakdown point, robustness versus efficiency, etc.). We then discuss in some detail recent results on robust testing in general multivariate parametric models. Recent applications include inference in logistic regression and testing for non-nested hypotheses.     

Forecasting time series of economic processes by model averaging across data frames of various lengths

This paper presents an extension of mean-squared forecast error (MSFE) model averaging for integrating linear regression models computed on data frames of various lengths. Proposed method is considered to be a preferable alternative to best model selection by various efficiency criteria such as Bayesian information criterion (BIC), Akaike information criterion (AIC), F-statistics and mean-squared error (MSE) as well as to Bayesian model averaging (BMA) and naïve simple forecast average. The method is developed to deal with possibly non-nested models having different number of observations and selects forecast weights by minimizing the unbiased estimator of MSFE. Proposed method also yields forecast confidence intervals with a given significance level what is not possible when applying other model averaging methods. In addition, out-of-sample simulation and empirical testing proves efficiency of such kind of averaging when forecasting economic processes.     

Geometry of the log-likelihood ratio statistic in misspecified models

We show that the asymptotic mean of the log-likelihood ratio in a misspecified model is a differential geometric quantity that is related to the exponential curvature of Efron (1978), Amari (1982), and the preferred point geometry of [Critchley et al., 1993] and [Critchley et al., 1994]. The mean is invariant with respect to reparameterization, which leads to the differential geometrical approach where coordinate-system invariant quantities like statistical curvatures play an important role. When models are misspecified, the likelihood ratios do not have the chi-squared asymptotic limit, and the asymptotic mean of the likelihood ratio depends on two geometric factors, the departure of models from exponential families (i.e. the exponential curvature) and the departure of embedding spaces from being totally flat in the sense of Critchley et al. (1994). As a special case, the mean becomes the mean of the usual chi-squared limit (i.e. the half of the degrees of freedom) when these two curvatures vanish. The effect of curvatures is shown in the non-nested hypothesis testing approach of Vuong (1989), and we correct the numerator of the test statistic with an estimated asymptotic mean of the log-likelihood ratio to improve the asymptotic approximation to the sampling distribution of the test statistic.     

Joint covariate-adjusted score test statistics for recurrent events and a terminal event

Recurrent events data are frequently encountered and could be stopped by a terminal event in clinical trials. It is of interest to assess the treatment efficacy simultaneously with respect to both the recurrent events and the terminal event in many applications. In this paper we propose joint covariate-adjusted score test statistics based on joint models of recurrent events and a terminal event. No assumptions on the functional form of the covariates are needed. Simulation results show that the proposed tests can improve the efficiency over tests based on covariate unadjusted model. The proposed tests are applied to the SOLVD data for illustration.