Likelihood Analysis of the I(2) Model

The I (2) model is defined as a submodel of the general vector autoregressive model, by two reduced rank conditions. The model describes stochastic processes with stationary second difference. A parametrization is suggested which makes likelihood inference feasible. Consistency of the maximum likelihood estimator is proved, and the asymptotic distribution of the maximum likelihood estimator is given. It is shown that the asymptotic distribution is either Gaussian, mixed Gaussian or, in some cases, even more complicated.     

The role of the constant and linear terms in cointegration analysis of nonstationary variables

The autoregressive model for cointegrated variables is analyzed with respect to the role of the constant and linear terms. Various models for 1(1) variables defined by restrictions on the deterministic terms are discussed, and it is shown that statistical inference can be performed by reduced rank regression. The asymptotic distributions of the test statistics and estimators are found. A similar analysis is given for models for 1(2) variables with a constant term.     

The role of the constant and linear terms in cointegration analysis of nonstationary variables

The autoregressive model for cointegrated variables is analyzed with respect to the role of the constant and linear terms. Various models for 1(1) variables defined by restrictions on the deterministic terms are discussed, and it is shown that statistical inference can be performed by reduced rank regression. The asymptotic distributions of the test statistics and estimators are found. A similar analysis is given for models for 1(2) variables with a constant term.     

Asymptotic distribution theory for the kalman filter state estimator

An asymptotic distribution theory for the state estimate from a Kalman filter in the absence of the usual Gaussian assumption is presented. It is found that the stability properties of the state transition matrix playa key role in the distribution theory. Specifically, when the state equation is neutrally stable (i.e., borderline stable-unstable) the state estimate is asymptotically normal when the random terms in the model have arbitrary distributions. This case includes the popular random walk state equation. However, when the state equation is either stable or unstable, at least some of the random terms in the model must be normally distributed beyond some finite time before the state estimate is asymptotically normal.     

Asymptotic biases of information and cross-validation criteria under canonical parametrization

An asymptotic expansion of the cross-validation criterion (CVC) using the Kullback-Leibler distance is derived when the leave-k-out method is used and when parameters are estimated by the weighted score method. By this expansion, the asymptotic bias of the Takeuchi information criterion (TIC) is derived as well as that of the CVC. Under canonical parametrization in the exponential family of distributions when maximum likelihood estimation is used, the magnitudes of the asymptotic biases of the Akaike information criterion (AIC) and CVC are shown to be smaller than that of the TIC. Examples in typical statistical distributions are shown.     

Likelihood-Based Inference for Weak Exogeneity in I(2) Cointegrated VAR Models

This article develops limit theory for likelihood analysis of weak exogeneity in I(2) cointegrated vector autoregressive (VAR) models incorporating deterministic terms. Conditions for weak exogeneity in I(2) VAR models are reviewed, and the asymptotic properties of conditional maximum likelihood estimators and a likelihood-based weak exogeneity test are then investigated. It is demonstrated that weak exogeneity in I(2) VAR models allows us to conduct asymptotic conditional inference based on mixed Gaussian distributions. It is then proved that a log-likelihood ratio test statistic for weak exogeneity in I(2) VAR models is asymptotically χ² distributed. The article also presents an empirical illustration of the proposed test for weak exogeneity using Japan's macroeconomic data.     

Modelling cell generation times by using the tempered stable distribution

Summary.  We show that the family of tempered stable distributions has considerable potential for modelling cell generation time data. Several real examples illustrate how these distributions can improve on currently assumed models, including the gamma and inverse Gaussian distributions which arise as special cases. Our applications concentrate on the generation times of oligodendrocyte progenitor cells and the yeast Saccharomyces cerevisiae . Numerical inversion of the Laplace transform of the probability density function provides fast and accurate approximations to the tempered stable density, for which no closed form generally exists. We also show how the asymptotic population growth rate is easily calculated under a tempered stable model.     

Further Results on the Limiting Distribution of GMM Sample Moment Conditions

In this article, we examine the limiting behavior of generalized method of moments (GMM) sample moment conditions and point out an important discontinuity that arises in their asymptotic distribution. We show that the part of the scaled sample moment conditions that gives rise to degeneracy in the asymptotic normal distribution is T-consistent and has a nonstandard limiting distribution. We derive the appropriate asymptotic (weighted chi-squared) distribution when this degeneracy occurs and show how to conduct asymptotically valid statistical inference. We also propose a new rank test that provides guidance on which (standard or nonstandard) asymptotic framework should be used for inference. The finite-sample properties of the proposed asymptotic approximation are demonstrated using simulated data from some popular asset pricing models.     

Likelihood Inference for Multivariate Extreme Value Distributions Whose Spectral Vectors have known Conditional Distributions

Multivariate extreme value statistical analysis is concerned with observations on several variables which are thought to possess some degree of tail dependence. The main approaches to inference for multivariate extremes consist in approximating either the distribution of block component‐wise maxima or the distribution of the exceedances over a high threshold. Although the expressions of the asymptotic density functions of these distributions may be characterized, they cannot be computed in general. In this paper, we study the case where the spectral random vector of the multivariate max‐stable distribution has known conditional distributions. The asymptotic density functions of the multivariate extreme value distributions may then be written through univariate integrals that are easily computed or simulated. The asymptotic properties of two likelihood estimators are presented, and the utility of the method is examined via simulation.     

Inference on cointegrating ranks using lr and lm tests based on pseudo-likelihoods

This paper considers Lagrange Multiplier (LM) and Likelihood Ratio (LR) tests for determining the cointegrating rank of a vector autoregressive system. n order to deal with outliers and possible fat-tailedness of the error process, non-Gaussian likelihoods are used to carry out the estimation. The limiting distributions of the tests based on these non-Gaussian pseudo-)likelihoods are derived. These distributions depend on nuisance parameters. An operational procedure is proposed to perform inference. It appears that the tests based on non-Gaussian pseudo-likelihoods are much more powerful than their Gaussian counterparts if the errors are fat-tailed. Moreover, the operational LM-type test has a better overall performance than the LR-type test. Copyright O 1998 by Marcel Dekker, Inc.     

Comments on specification of household expenditure functions and equivalence scales by nonparametric regression

This paper considers Lagrange Multiplier (LM) and Likelihood Ratio (LR) tests for determining the cointegrating rank of a vector autoregressive system. n order to deal with outliers and possible fat-tailedness of the error process, non-Gaussian likelihoods are used to carry out the estimation. The limiting distributions of the tests based on these non-Gaussian pseudo-)likelihoods are derived. These distributions depend on nuisance parameters. An operational procedure is proposed to perform inference. It appears that the tests based on non-Gaussian pseudo-likelihoods are much more powerful than their Gaussian counterparts if the errors are fat-tailed. Moreover, the operational LM-type test has a better overall performance than the LR-type test. Copyright O 1998 by Marcel Dekker, Inc.     

Testing for sub-models of the skew <Emphasis Type="Italic">t</Emphasis>-distribution

The skew t-distribution includes both the skew normal and the normal distributions as special cases. Inference for the skew t-model becomes problematic in these cases because the expected information matrix is singular and the parameter corresponding to the degrees of freedom takes a value at the boundary of its parameter space. In particular, the distributions of the likelihood ratio statistics for testing the null hypotheses of skew normality and normality are not asymptotically \(\chi ^2\). The asymptotic distributions of the likelihood ratio statistics are considered by applying the results of Self and Liang (J Am Stat Assoc 82:605–610, 1987) for boundary-parameter inference in terms of reparameterizations designed to remove the singularity of the information matrix. The Self–Liang asymptotic distributions are mixtures, and it is shown that their accuracy can be improved substantially by correcting the mixing probabilities. Furthermore, although the asymptotic distributions are non-standard, versions of Bartlett correction are developed that afford additional accuracy. Bootstrap procedures for estimating the mixing probabilities and the Bartlett adjustment factors are shown to produce excellent approximations, even for small sample sizes.     

Testing Homogeneity in Gamma Mixture Models

This paper characterizes the asymptotic behaviour of the likelihood ratio test statistic (LRTS) for testing homogeneity (i.e. no mixture) against gamma mixture alternatives. Under the null hypothesis, the LRTS is shown to be asymptotically equivalent to the square of Davies's Gaussian process test statistic and diverges at a log n rate to infinity in probability. Based on the asymptotic analysis, we propose and demonstrate a computationally efficient method to simulate the null distributions of the LRTS for small to moderate sample sizes.     

Statistical inference on asymptotic properties of two estimators for the partially linear single-index models

The outer product of gradients (OPG) estimation procedure based on least squares (LS) approach has been presented by Xia et al. [An adaptive estimation of dimension reduction space. J Roy Statist Soc Ser B. 2002;64:363–410] to estimate the single-index parameter in partially linear single-index models (PLSIM). However, its asymptotic property has not been established yet and the efficiency of LS-based method can be significantly affected by outliers and heavy-tailed distributions. In this paper, we firstly derive the asymptotic property of OPG estimator developed by Xia et al. [An adaptive estimation of dimension reduction space. J Roy Statist Soc Ser B. 2002;64:363–410] in theory, and a novel robust estimation procedure combining the ideas of OPG and local rank (LR) inference is further developed for PLSIM along with its theoretical property. Then, we theoretically derive the asymptotic relative efficiency (ARE) of the proposed LR-based procedure with respect to LS-based method, which is shown to possess an expression that is closely related to that of the signed-rank Wilcoxon test in comparison with the t-test. Moreover, we demonstrate that the new proposed estimator has a great efficiency gain across a wide spectrum of non-normal error distributions and almost not lose any efficiency for the normal error. Even in the worst case scenarios, the ARE owns a lower bound equalling to 0.864 for estimating the single-index parameter and a lower bound being 0.8896 for estimating the nonparametric function respectively, versus the LS-based estimators. Finally, some Monte Carlo simulations and a real data analysis are conducted to illustrate the finite sample performance of the estimators.     

On the interactions of unit roots and exogeneity

The paper considers the impact on estimation and inference of interactions between the existence of unit roots in a data generation process and the presence or absence of weak and strong exogeneity of conditioning variables for the parameters of interest in individual cointegrated linear relationships. The asymptotic distributions of estimators for single equation conditional linear relations are analyzed in conjunction with a Monte Carlo study. The results confirm the important role of weak exogeneity in single equation estimation from integratedcointegrated data; highlight the advantages of using an asymptotic analysis to understand the complicated interactions observed; and reveal the accuracy of the limiting distributions in characterizing finite sample behaviour.     

On the interactions of unit roots and exogeneity

The paper considers the impact on estimation and inference of interactions between the existence of unit roots in a data generation process and the presence or absence of weak and strong exogeneity of conditioning variables for the parameters of interest in individual cointegrated linear relationships. The asymptotic distributions of estimators for single equation conditional linear relations are analyzed in conjunction with a Monte Carlo study. The results confirm the important role of weak exogeneity in single equation estimation from integratedcointegrated data; highlight the advantages of using an asymptotic analysis to understand the complicated interactions observed; and reveal the accuracy of the limiting distributions in characterizing finite sample behaviour.     

On simultaneous confidence intervals based on rank-estimates with application to analysis of gene expression data

Abstract

Inferential methods based on ranks present robust and powerful alternative methodology for testing and estimation. In this article, two objectives are followed. First, develop a general method of simultaneous confidence intervals based on the rank estimates of the parameters of a general linear model and derive the asymptotic distribution of the pivotal quantity. Second, extend the method to high dimensional data such as gene expression data for which the usual large sample approximation does not apply. It is common in practice to use the asymptotic distribution to make inference for small samples. The empirical investigation in this article shows that for methods based on the rank-estimates, this approach does not produce a viable inference and should be avoided. A method based on the bootstrap is outlined and it is shown to provide a reliable and accurate method of constructing simultaneous confidence intervals based on rank estimates. In particular it is shown that commonly applied methods of normal or t-approximation are not satisfactory, particularly for large-scale inferences. Methods based on ranks are uniquely suitable for analysis of microarray gene expression data since they often involve large scale inferences based on small samples containing a large number of outliers and violate the assumption of normality. A real microarray data is analyzed using the rank-estimate simultaneous confidence intervals. Viability of the proposed method is assessed through a Monte Carlo simulation study under varied assumptions.     

Optimal rank set sampling estimates for a population proportion

This paper examines two different classes of estimates for a population proportion based on an unbalanced rank set sample. Specifically, the two classes correspond to the maximum likelihood estimator (MLE) and a weighted average (WA) estimate. Both estimators are asymptotically normal, so standard inference procedures can still be implemented. Furthermore, these results can be used to develop optimal allocation schemes for both estimators. The performances of the optimal estimators are studied in terms of both finite sample and asymptotic relative efficiency. In general, the MLE is more efficient than the WA estimate. Lastly, the practicality of the optimal sampling plans is addressed and illustrated via an example.     

HIGH-DIMENSIONAL PARAMETRIC MODELLING OF MULTIVARIATE EXTREME EVENTS

Multivariate extreme events are typically modelled using multivariate extreme value distributions. Unfortunately, there exists no finite parametrization for the class of multivariate extreme value distributions. One common approach is to model extreme events using some flexible parametric subclass. This approach has been limited to only two or three dimensions, primarily because suitably flexible high-dimensional parametric models have prohibitively complex density functions. We present an approach that allows a number of popular flexible models to be used in arbitrarily high dimensions. The approach easily handles missing and censored data, and can be employed when modelling componentwise maxima and multivariate threshold exceedances. The approach is based on a representation using conditionally independent marginal components, conditioning on positive stable random variables. We use Bayesian inference, where the conditioning variables are treated as auxiliary variables within Markov chain Monte Carlo simulations. We demonstrate these methods with an application to sea-levels, using data collected at 10 sites on the east coast of England.     

Bootstrapping Noncausal Autoregressions: With Applications to Explosive Bubble Modeling

In this article, we develop new bootstrap-based inference for noncausal autoregressions with heavy-tailed innovations. This class of models is widely used for modeling bubbles and explosive dynamics in economic and financial time series. In the noncausal, heavy-tail framework, a major drawback of asymptotic inference is that it is not feasible in practice as the relevant limiting distributions depend crucially on the (unknown) decay rate of the tails of the distribution of the innovations. In addition, even in the unrealistic case where the tail behavior is known, asymptotic inference may suffer from small-sample issues. To overcome these difficulties, we propose bootstrap inference procedures using parameter estimates obtained with the null hypothesis imposed (the so-called restricted bootstrap). We discuss three different choices of bootstrap innovations: wild bootstrap, based on Rademacher errors; permutation bootstrap; a combination of the two (“permutation wild bootstrap”). Crucially, implementation of these bootstraps do not require any a priori knowledge about the distribution of the innovations, such as the tail index or the convergence rates of the estimators. We establish sufficient conditions ensuring that, under the null hypothesis, the bootstrap statistics estimate consistently particular conditionaldistributions of the original statistics. In particular, we show that validity of the permutation bootstrap holds without any restrictions on the distribution of the innovations, while the permutation wild and the standard wild bootstraps require further assumptions such as symmetry of the innovation distribution. Extensive Monte Carlo simulations show that the finite sample performance of the proposed bootstrap tests is exceptionally good, both in terms of size and of empirical rejection probabilities under the alternative hypothesis. We conclude by applying the proposed bootstrap inference to Bitcoin/USD exchange rates and to crude oil price data. We find that indeed noncausal models with heavy-tailed innovations are able to fit the data, also in periods of bubble dynamics. Supplementary materials for this article are available online.