The small sample properties of the reset test as applied to systems of equations

The RESET test for functional misspecification is generalised to cover systems of equations, and the properties of 7 versions are studied using Monte Carlo methods. The Rao F -test clearly exhibits the best performance as regards correct size, whilst the commonly used LRT (uncorrected for degrees-of-freedom), and LM and Wald tests (both corrected and uncorrected) behave badly even in single equations. The Rao test exhibits correct size even in ten equation systems, which is better than previous research concerning autocorrelation tests. The power of the test is low, however, when the number of equations grows and the correlation between the omitted variables and the RESET proxies is small.     

二元选择面板模型的设定检验

 本文将RESET检验扩展到二元选择面板数据模型的设定,考察了固定效应Probit模型和Logit模型的设定检验,包括异方差、遗漏变量和分布误设的检验。模拟结果表明Logit模型的RESET设定检验显示良好的水平和功效,而Probit模型的RESET检验可能由于估计方法的选择导致在某些方面的功效表现不好。但总体说来,在二元选择面板数据模型的设定检验上,RESET检验仍然是一个较好的选择。     

Monte carlo sampling approach to testing nonnested hypothesis: monte carlo results

Alternative ways of using Monte Carlo methods to implement a Cox-type test for separate families of hypotheses are considered. Monte Carlo experiments are designed to compare the finite sample performances of Pesaran and Pesaran's test, a RESET test, and two Monte Carlo hypothesis test procedures. One of the Monte Carlo tests is based on the distribution of the log-likelihood ratio and the other is based on an asymptotically pivotal statistic. The Monte Carlo results provide strong evidence that the size of the Pesaran and Pesaran test is generally incorrect, except for very large sample sizes. The RESET test has lower power than the other tests. The two Monte Carlo tests perform equally well for all sample sizes and are both clearly preferred to the Pesaran and Pesaran test, even in large samples. Since the Monte Carlo test based on the log-likelihood ratio is the simplest to calculate, we recommend using it.     

Eliminating the omitted variable bias by a regime-switching approach

This work shows a procedure that aims to eliminate or reduce the bias caused by omitted variables by means of the so-called regime-switching regressions. There is a bias estimation whenever the statistical (linear) model is under-specified, that is, when there are some omitted variables and they are correlated with the regressors. This work shows how an appropriate specification of a regime-switching model (independent or Markov-switching) can eliminate or reduce this correlation, hence the estimation bias. A demonstration is given, together with some Monte Carlo simulations. An empirical verification, based on Fisher's equation, is also provided.     

The robustness of tests of outliers and functional form

The purpose of this paper is to examine the robustness in finite samples of a test for outliers based on the maximum internally studentized residual and the RESET test for functional form misspecification. The effects of incorrect specification on the adequate detection of outliers and the presence of one or more outliers on the rejection frequencies of RESET are analysed. It is found that, ingeneral, the test for outliers does not seem to be robust to functional form misspecification, while the rejection frequencies of RESET can be reduced, sometimes dramatically, in the presence of outliers.     

An observation on regression-based specification tests

The use of regression-based specification tests, such as the nR² form of the Lagrange Multiplier test, has become quite widespread over the last 20 years. The popularization of the nR² form of the Lagrange Multiplier (LM) test, perhaps the most widely used class of regression-based tests, has come about in large part from the ease of its application to many tests of nonlinear restrictions and its asymptotic equivalence to Likelihood Ratio and Wald tests. Properly performed, these regression-based tests invariably include regressors which are orthogonal by construction to the dependent variable of the regression. The purpose of this paper is to motivate the inclusion of such variables by investigating implications for the test size and power if these regressors are erroneously omitted. It is straightforward to show that both the size and power of the test are adversely affected by omitting these regressors.     

Omitted variables in longitudinal data models

The omission of important variables is a well‐known model specification issue in regression analysis and mixed linear models. The author considers longitudinal data models that are special cases of the mixed linear models; in particular, they are linear models of repeated observations on a subject. Models of omitted variables have origins in both the econometrics and biostatistics literatures. The author describes regression coefficient estimators that are robust to and that provide the basis for detecting the influence of certain types of omitted variables. New robust estimators and omitted variable tests are introduced and illustrated with a case study that investigates the determinants of tax liability.     

Exact testing in multivariate regression

An F statistic due to Rao (1951,1973) tests uniform mixed linear restrictions in the multivariateregression model. In combination with a generalization of the Bera-Evans-Savin exact functional relationship between the W, LR, and LM statistics, Rao's F serves to unify a number of exact test procedures commonly applied in disparate empirical literatures. Examples in demand analysis and asset pricing are provided. The availability of exact tests of restrictions in certain nonlinear models when the model is linear under the null, originally explored by Milliken-Graybill (1970), is extended to multivariate regression. Generalized RESET, J-, and Hausman-Wu tests are resented. As an extension of Dufour (1989), bounds tests exist for nonlinear and inequality restrictions. Applications include conservative bound tests for symmetry or negativity of the substitution matrix in demand systems.     

Specification tests in ordered logit and probit models

In this paper, I study the application of various specification tests to ordered logit and probit models with heteroskedastic errors, with the primary focus on the ordered probit model. The tests are Lagrange multiplier tests, information matrix tests, and chi-squared goodness of fit tests. The alternatives are omitted variables in the regression equation, omitted varaibles in the equation describing the heteroskedasticity, and non-logistic/non-normal errors. The alternative error distributions include a generalized logistic distribution in the ordered logit model and the Pearson family in the ordered.     

Linear Transformations of Linear Mixed-Effects Models

A number of articles have discussed the way lower order polynomial and interaction terms should be handled in linear regression models. Only if all lower order terms are included in the model will the regression model be invariant with respect to coding transformations of the variables. If lower order terms are omitted, the regression model will not be well formulated. In this paper, we extend this work to examine the implications of the ordering of variables in the linear mixed-effects model. We demonstrate how linear transformations of the variables affect the model and tests of significance of fixed effects in the model. We show how the transformations modify the random effects in the model, as well as their covariance matrix and the value of the restricted log-likelihood. We suggest a variable selection strategy for the linear mixed-effects model.     

Gibbs sampling for Bayesian non-conjugate and hierarchical models by using auxiliary variables

We demonstrate the use of auxiliary (or latent) variables for sampling non-standard densities which arise in the context of the Bayesian analysis of non-conjugate and hierarchical models by using a Gibbs sampler. Their strategic use can result in a Gibbs sampler having easily sampled full conditionals. We propose such a procedure to simplify or speed up the Markov chain Monte Carlo algorithm. The strength of this approach lies in its generality and its ease of implementation. The aim of the paper, therefore, is to provide an alternative sampling algorithm to rejection-based methods and other sampling approaches such as the Metropolis–Hastings algorithm.     

Bayesian testing for independence of two categorical variables under two-stage cluster sampling with covariates

We consider Bayesian testing for independence of two categorical variables with covariates for a two-stage cluster sample. This is a difficult problem because we have a complex sample (i.e. cluster sample), not a simple random sample. Our approach is to convert the cluster sample with covariates into an equivalent simple random sample without covariates, which provides a surrogate of the original sample. Then, this surrogate sample is used to compute the Bayes factor to make an inference about independence. We apply our methodology to the data from the Trend in International Mathematics and Science Study [30] for fourth grade US students to assess the association between the mathematics and science scores represented as categorical variables. We show that if there is strong association between two categorical variables, there is no significant difference between the tests with and without the covariates. We also performed a simulation study to further understand the effect of covariates in various situations. We found that for borderline cases (moderate association between the two categorical variables), there are noticeable differences in the test with and without covariates.     

Evaluating Multivariate GARCH Models in the Nordic Electricity Markets

ABSTRACT

This article considers a variety of specification tests for multivariate GARCH models that are used for dynamic hedging in electricity markets. The test statistics include the robust conditional moments tests for sign-size bias along with the recently introduced copula tests for an appropriate dependence structure. We consider this effort worthwhile, since quite often the tests of multivariate GARCH models are omitted and the models become selected ad hoc depending on the results they generate. Hedging performance comparisons, in terms of unconditional and conditional ex-post variance portfolio reduction, are conducted.     

Testing for normally in censored regressions

This paper derives a Lagrange Multiplier test for normality in censored regressions. The test is derived against the generalized log-gamma distribution, in which normal is a special case. The resulting test statistic coincides to some extent with previously suggested score and conditional moment tests. Estimation of the variance is performed by using the matrix of second order derivatives in order to get an easy to use test statistic. Small sample performance of the test is studied and compared to other tests by Monte Carlo experiments.     

Power transformations to induce normality and their applications

Summary.  Random variables which are positive linear combinations of positive independent random variables can have heavily right-skewed finite sample distributions even though they might be asymptotically normally distributed. We provide a simple method of determining an appropriate power transformation to improve the normal approximation in small samples. Our method contains the Wilson–Hilferty cube root transformation for χ ² random variables as a special case. We also provide some important examples, including test statistics of goodness-of-fit and tail index estimators, where such power transformations can be applied. In particular, we study the small sample behaviour of two goodness-of-fit tests for time series models which have been proposed recently in the literature. Both tests are generalizations of the popular Box–Ljung–Pierce portmanteau test, one in the time domain and the other in the frequency domain. A power transformation with a finite sample mean and variance correction is proposed, which ameliorates the small sample effect. It is found that the corrected versions of the tests have markedly better size properties. The correction is also found to result in an overall increase in power which can be significant under certain alternatives. Furthermore, the corrected tests also have better power than the Box–Ljung–Pierce portmanteau test, unlike the uncorrected versions.     

Instrumental variable estimation in ordinal probit models with mismeasured predictors

Researchers in the medical, health, and social sciences routinely encounter ordinal variables such as self‐reports of health or happiness. When modelling ordinal outcome variables, it is common to have covariates, for example, attitudes, family income, retrospective variables, measured with error. As is well known, ignoring even random error in covariates can bias coefficients and hence prejudice the estimates of effects. We propose an instrumental variable approach to the estimation of a probit model with an ordinal response and mismeasured predictor variables. We obtain likelihood‐based and method of moments estimators that are consistent and asymptotically normally distributed under general conditions. These estimators are easy to compute, perform well and are robust against the normality assumption for the measurement errors in our simulation studies. The proposed method is applied to both simulated and real data. The Canadian Journal of Statistics 47: 653–667; 2019 © 2019 Statistical Society of Canada     

Frailty Models and Rank Tests

Connections are established between the theories of weighted logrank tests and of frailty models. These connections arise because omission of a balanced covariate from a proportional hazards model generally leads to a model with non-proportional hazards, for which the simple logrank test is no longer optimal. The optimal weighting function and the asymptotic relative efficiencies of the simple logrank test and of the optimally weighted logrank test relative to the adjusted test that would be used if the covariate values were known, are expressible in terms of the Laplace transform of the hazard ratio for the distribution of the omitted covariate. For example if this hazard ratio has a gamma distribution, the optimal test is a member of the G class introduced by Harrington and Fleming (1982). We also consider positive stable, inverse Gaussian, displaced Poisson and two-point frailty distribution. Results are obtained for parametric and nonparametric tests and are extended to include random censoring. We show that the loss of efficiency from omitting a covariate is generally more important than the additional loss due to misspecification of the resulting non-proportional hazards model as a proportional hazards model. However two-point frailty distributions can provide exceptions to this rule. Censoring generally increases the efficiency of the simple logrank test to the adjusted logrank test.     

Some new results on univariate and multivariate permutation tests for ordinal categorical variables under restricted alternatives

In several sciences, especially when dealing with performance evaluation, complex testing problems may arise due in particular to the presence of multidimensional categorical data. In such cases the application of nonparametric methods can represent a reasonable approach. In this paper, we consider the problem of testing whether a “treatment” is stochastically larger than a “control” when univariate and multivariate ordinal categorical data are present. We propose a solution based on the nonparametric combination of dependent permutation tests (Pesarin in Multivariate permutation test with application to biostatistics. Wiley, Chichester, 2001), on variable transformation, and on tests on moments. The solution requires the transformation of categorical response variables into numeric variables and the breaking up of the original problem’s hypotheses into partial sub-hypotheses regarding the moments of the transformed variables. This type of problem is considered to be almost impossible to analyze within likelihood ratio tests, especially in the multivariate case (Wang in J Am Stat Assoc 91:1676–1683, 1996). A comparative simulation study is also presented along with an application example.     

Bias correction through filtering omitted variables and instruments

This paper proposes a combination of the particle-filter-based method and the expectation-maximization algorithm (PFEM), in order to filter unobservable variables and hence, to reduce the omitted variables bias. Furthermore, I consider as an unobservable variable, an exogenous one that can be used as an instrument in the instrumental variable (IV) methodology. The aim is to show that the PFEM is able to eliminate or reduce both the omitted variable bias and the simultaneous equation bias by filtering the omitted variable and the unobserved instrument, respectively. In other words, the procedure provides (at least approximately) consistent estimates, without using additional information embedded in the omitted variable or in the instruments, since they are filtered by the observable variables. The validity of the procedure is shown both through simulations and through a comparison to an IV analysis which appeared in an important previous publication. As regards the latter point, I demonstrate that the procedure developed in this article yields similar results to those of the original IV analysis.     

Graphs for Margins of Bayesian Networks

Directed acyclic graph (DAG) models—also called Bayesian networks—are widely used in probabilistic reasoning, machine learning and causal inference. If latent variables are present, then the set of possible marginal distributions over the remaining (observed) variables is generally not represented by any DAG. Larger classes of mixed graphical models have been introduced to overcome this; however, as we show, these classes are not sufficiently rich to capture all the marginal models that can arise. We introduce a new class of hyper‐graphs, called mDAGs, and a latent projection operation to obtain an mDAG from the margin of a DAG. We show that each distinct marginal of a DAG model is represented by at least one mDAG and provide graphical results towards characterizing equivalence of these models. Finally, we show that mDAGs correctly capture the marginal structure of causally interpreted DAGs under interventions on the observed variables.