Dynamic Copula-Based Markov Time Series

This article examines a test procedure for checking the constancy of serial dependence via copulas for Markov time series data. It also provides a copula-based modeling approach for the dynamic serial dependence. Various parametric families of copulas offering different dependent structures are investigated. A score test is proposed for checking the constancy of a copula parameter. The score test is constructed and its asymptotic null distribution established under a two-stage estimation procedure. The test does not require specification of the probability distribution for the copula parameter. To capture the dynamics of dependence structure over time, autoregressive moving average and exponential type models are proposed. Illustrations are given based on simulated data and historic coffee prices data.     

Estimating linear representations of nonlinear processes

This paper considers the problem of estimating an autoregressive-moving average (ARMA) model when only ergodic and mixing assumptions can be made. The estimation procedure is based on the minimization of a sum of squared deviations about linear conditional expectations. It is shown that the estimator is strongly consistent and asymptotically normal. The results can be used to estimate weak linear representations of some nonlinear processes. Several examples of such linear representations are provided. Other potential areas of applications are inference for noncausal ARMA, aggregation and marginalization of linear processes. A numerical study is also presented. It appears that standard identification routines based on strong hypothesis on the innovation of ARMA models can be seriously misleading when these assumptions do not hold.     

Measuring serial dependence in categorical time series

The analysis of time-indexed categorical data is important in many fields, e.g., in telecommunication network monitoring, manufacturing process control, ecology, etc. Primary interest is in detecting and measuring serial associations and dependencies in such data. For cardinal time series analysis, autocorrelation is a convenient and informative measure of serial association. Yet, for categorical time series analysis an analogous convenient measure and corresponding concepts of weak stationarity have not been provided. For two categorical variables, several ways of measuring association have been suggested. This paper reviews such measures and investigates their properties in a serial context. We discuss concepts of weak stationarity of a categorical time series, in particular of stationarity in association measures. Serial association and weak stationarity are studied in the class of discrete ARMA processes introduced by Jacobs and Lewis (J. Time Ser. Anal. 4(1):19–36, 1983). An intrinsic feature of a time series is that, typically, adjacent observations are dependent. The nature of this dependence among observations of a time series is of considerable practical interest. Time series analysis is concerned with techniques for the analysis of this dependence. (Box et al. 1994p. 1)     

Inference for Random Coefficient INAR(1) Process Based on Frequency Domain Analysis

In this article, we present the explicit expressions for the higher-order moments and cumulants of the first-order random coefficient integer-valued autoregressive (RCINAR(1)) process. The spectral and bispectral density functions are also obtained, which can characterize the RCINAR(1) process in the frequency domain. We use a frequency domain approach which is named Whittle criterion to estimate the parameters of the process. We propose a test statistic which is based on the frequency domain approach for the hypothesis test, H₀: α = 0?H₁: 0 < α < 1, where α is the mean of the random coefficient in the process. The asymptotic distribution of the test statistic is obtained. We compare the proposed test statistic with other statistics that can test serial dependence in time series of count via a typically numerical simulation, which indicates that our proposed test statistic has a good power.     

Order identification for gaussian moving averages using the covariation

In the traditional Box-Jenkins procedure for fitting ARMA time series models to data, the first step is order identification. The sample autocorrelation function can be used to identify pure moving average behavior. In this paper we consider using the autocovariation function identify the order of a univariate Gaussian time series. Simulation evidence indicates the suggested method may be a superior order identification tool when at least 100 observations are taken.     

Consistent testing for non‐correlation of two cointegrated ARMA time series

A consistent approach to the problem of testing non‐correlation between two univariate infinite‐order autoregressive models was proposed by Hong (1996). His test is based on a weighted sum of squares of residual cross‐correlations, with weights depending on a kernel function. In this paper, the author follows Hong's approach to test non‐correlation of two cointegrated (or partially non‐stationary) ARMA time series. The test of Pham, Roy & Cédras (2003) may be seen as a special case of his approach, as it corresponds to the choice of a truncated uniform kernel. The proposed procedure remains valid for testing non‐correlation between two stationary invertible multivariate ARMA time series. The author derives the asymptotic distribution of his test statistics under the null hypothesis and proves that his procedures are consistent. He also studies the level and power of his proposed tests in finite samples through simulation. Finally, he presents an illustration based on real data.     

Spectral analysis with replicated time series

A doubly stochastic process {x(b,t);b?B,t?Z} is considered, with (B,β,P_β) being a probability space so that for each b, {X(b,t);t ? Z} is a stationary process with an absolutely continuous spectral distribution. The population spectrum is defined as f(ω) = E_B[Q(b,ω)] with Q(b,ω) being the spectral density function of X(b,t). The aim of this paper is to estimate f(ω) by means of a random sample b₁,…,b_r from (B,β,P_β). For each b₁? B, the processes X(b₁,t) are observed at the same times t=1,…,N. Thus, r time series (x(b₁,t)} are available in order to estimate f(ω). A model for each individual periodogram, which involves f(ω), is formulated. It has been proven that a certain family of linear stationary processes follows the above model In this context, a kernel estimator is proposed in order to estimate f(ω). The bias, variance and asymptotic distribution of this estimator are investigated under certain conditions.     

On modelling data from degradation sample paths over time

This paper is mainly concerned with modelling data from degradation sample paths over time. It uses a general growth curve model with Box‐Cox transformation, random effects and ARMA(p, q) dependence to analyse a set of such data. A maximum likelihood estimation procedure for the proposed model is derived and future values are predicted, based on the best linear unbiased prediction. The paper compares the proposed model with a nonlinear degradation model from a prediction point of view. Forecasts of failure times with various data lengths in the sample are also compared.     

A linear regression with unobserved dependent variables

Let (?,X) be a random vector such that E(X|?) = ? and Var(x|?) a + b? + c?² for some known constants a, b and c. Assume X₁,…,X_n are independent observations which have the same distribution as X. Let t(X) be the linear regression of ? on X. The linear empirical Bayes estimator is used to approximate the linear regression function. It is shown that under appropriate conditions, the linear empirical Bayes estimator approximates the linear regression well in the sense of mean squared error.     

Testing for Equal Predictability of Stationary ARMA Processes

In this work we use a measure of predictability of a time series following a stationary ARMA process to develop a test of equal predictability of two or more time series. The test is derived by a set of propositions which links the structure of the AR and MA coefficients to the predictability measure. A particular case of this general approach is constituted by time series having a Wold decomposition with weights having the same sign; in this framework the equal predictability is equivalent to parallelism among ARMA models and the null hypothesis of equal predictability is simply a set of linear restrictions. The ARMA representation of the GARCH models presents non-negative weights, so that this test can be extended to verify the equal predictability of squared time series following GARCH structures.     

Testing Serial Correlation in Semiparametric Varying-Coefficient Partially Linear Models

We propose two test statistics for testing serial correlation in semiparametric varying-coefficient partially linear models. The proposed test statistics are not only for testing zero first-order serial correlation, but also for testing higher-order serial correlations. Under the null hypothesis of no serial correlation, the test statistics are shown to have asymptotic normal or chi-square distributions. By using R, some Monte Carlo experiments are conducted to examine the finite sample performances of the proposed tests. Simulation results show that the estimated size and power of the proposed tests behave well.     

Forecasting Vector ARMA Processes With Systematically Missing Observations

The following two predictors are compared for time series with systematically missing observations: (a) A time series model is fitted to the full series X_t , and forecasts are based on this model, (b) A time series model is fitted to the series with systematically missing observations Y _τ, and forecasts are based on the resulting model. If the data generation processes are known vector autoregressive moving average (ARMA) processes, the first predictor is at least as efficient as the second one in a mean squared error sense. Conditions are given for the two predictors to be identical. If only the ARMA orders of the generation processes are known and the coefficients are estimated, or if the process orders and coefficients are estimated, the first predictor is again, in general, superior. There are, however, exceptions in which the second predictor, using seemingly less information, may be better. These results are discussed, using both asymptotic theory and small sample simulations. Some economic time series are used as illustrative examples.     

The table auto-regressive moving-average model for (categorical) stationary series: statistical properties (causality; from the all random to the conditional random)

A strictly stationary time series is modelled directly, once the variables' realizations fit into a table: no knowledge of a distribution is required other than the prior discretization. A multiplicative model with combined random ‘Auto-Regressive’ and ‘Moving-Average’ parts is considered for the serial dependence. Based on a multi-sequence of unobserved series that serve as differences and differences of differences from the main building block, a causal version is obtained; a condition that secures an exponential rate of convergence for its expected random coefficients is presented. For the remainder, writing the conditional probability as a function of past conditional probabilities, is within reach: subject to the presence of the moving-average segment in the original equation, what could be a long process of elimination with mathematical arguments concludes with a new derivation that does not support a simplistic linear dependence on the lagged probability values.     

A Restricted Subset Selection Rule for Selecting at Least One of the t Best Normal Populations in Terms of Their Means When Their Common Variance is Known,Case II

Consider k( ? 2) normal populations with unknown means μ₁, …, μ_k, and a common known variance σ². Let μ_[1] ? ??? ? μ_[k] denote the ordered μ_i.The populations associated with the t(1 ? t ? k ? 1) largest means are called the t best populations. Hsu and Panchapakesan (2004) proposed and investigated a procedure R_HPfor selecting a non empty subset of the k populations whose size is at most m(1 ? m ? k ? t) so that at least one of the t best populations is included in the selected subset with a minimum guaranteed probability P* whenever μ_{[k ? t + 1]} ? μ_{[k ? t]} ? δ*, where P*?and?δ* are specified in advance of the experiment. This probability requirement is known as the indifference-zone probability requirement. In the present article, we investigate the same procedure R_HP for the same goal as before but when k ? t < m ? k ? 1 so that at least one of the t best populations is included in the selected subset with a minimum guaranteed probability P* whatever be the configuration of the unknown μ_i. The probability requirement in this latter case is termed the subset selection probability requirement. Santner (1976) proposed and investigated a different procedure (R_S) based on samples of size n from each of the populations, considering both cases, 1 ? m ? k ? t and k ? t < m ? k. The special case of t = 1 was earlier studied by Gupta and Santner (1973) and Hsu and Panchapakesan (2002) for their respective procedures.     

The consistency of model selection for dynamic Semi-varying coefficient models with autocorrelated errors

The consistency of model selection criterion BIC has been well and widely studied for many nonlinear regression models. However, few of them had considered models with lag variables as regressors and auto-correlated errors in time series settings, which is common in both linear and nonlinear time series modeling. This paper studies a dynamic semi-varying coefficient model with ARMA errors, using an approach based on spectrum analysis of time series. The consistency property of the proposed model selection criteria is established and an implementation procedure of model selection is proposed for practitioners. Simulation studies have also been conducted to numerically show the consistency property.     

Nonparametric estimation of the derivatives of a density by the method of wavelet for mixing sequences

The problem of estimation of the derivative of a probability density f is considered, using wavelet orthogonal bases. We consider an important kind of dependent random variables, the so-called mixing random variables and investigate the precise asymptotic expression for the mean integrated error of the wavelet estimators. We show that the mean integrated error of the proposed estimator attains the same rate as when the observations are independent, under certain week dependence conditions imposed to the {X _i }, defined in {Ω, N, P}.     

Tests of serial independence based on Kendall's process

The authors propose new rank statistics for testing the white noise hypothesis in a time series. These statistics are Cramér‐von Mises and Kolmogorov‐Smirnov functionals of an empirical distribution function whose mean is related to a serial version of Kendall's tau through a linear transform. The authors determine the asymptotic behaviour of the underlying serial process and the large‐sample distribution of the proposed statistics under the null hypothesis of white noise. They also present simulation results showing the power of their tests.     

Objective Testing Procedures in Linear Models: Calibration of the p-values

Abstract.  An optimal Bayesian decision procedure for testing hypothesis in normal linear models based on intrinsic model posterior probabilities is considered. It is proven that these posterior probabilities are simple functions of the classical F -statistic, thus the evaluation of the procedure can be carried out analytically through the frequentist analysis of the posterior probability of the null. An asymptotic analysis proves that, under mild conditions on the design matrix, the procedure is consistent. For any testing hypothesis it is also seen that there is a one-to-one mapping – which we call calibration curve – between the posterior probability of the null hypothesis and the classical bi p -value. This curve adds substantial knowledge about the possible discrepancies between the Bayesian and the p -value measures of evidence for testing hypothesis. It permits a better understanding of the serious difficulties that are encountered in linear models for interpreting the p -values. A specific illustration of the variable selection problem is given.     

A recursive approach for estimating missing observations in an univariate time series

A linear recursive technique that does not use the Kalman filter approach is proposed to estimate missing observations in an univariate time series. It is assumed that the series follows an invertible ARIMA model. The procedure is based on the restricted forecasting approach, and the recursive linear estimators are optimal in terms of minimum mean-square error.     

基于图方法的MA和ARMA模型系数检验

应用图模型方法来讨论传统的MA和ARMA模型,证明了MA和ARMA模型的系数为去掉其他时间序列分量线性效应的条件下的偏相关系数,且利用图模型推断算法提出了一种新的参数估计和检验方法。