Nonparametric confidence intervals for location in time series data

We extend the confidence interval construction procedure for location for symmetric iid data using the one-sample Wilcoxon signed rank statistic (T⁺) to stationary time series data. We propose a normal approximation procedure when explicit knowledge of the underlying dependence structure/distribution is unknown. By conducting extensive simulations from linear and nonlinear time series models, we show that the extended procedure is a strong contender for use in the construction of confidence intervals in time series analysis. Finally we demonstrate real application implementations in two case studies.     

Recognizing and visualizing departures from independence in bivariate data using local Gaussian correlation

It is well known that the traditional Pearson correlation in many cases fails to capture non-linear dependence structures in bivariate data. Other scalar measures capable of capturing non-linear dependence exist. A common disadvantage of such measures, however, is that they cannot distinguish between negative and positive dependence, and typically the alternative hypothesis of the accompanying test of independence is simply “dependence”. This paper discusses how a newly developed local dependence measure, the local Gaussian correlation, can be used to construct local and global tests of independence. A global measure of dependence is constructed by aggregating local Gaussian correlation on subsets of \(\mathbb{R}^{2}\) , and an accompanying test of independence is proposed. Choice of bandwidth is based on likelihood cross-validation. Properties of this measure and asymptotics of the corresponding estimate are discussed. A bootstrap version of the test is implemented and tried out on both real and simulated data. The performance of the proposed test is compared to the Brownian distance covariance test. Finally, when the hypothesis of independence is rejected, local independence tests are used to investigate the cause of the rejection.     

Curve of Correlation for Time Series

The curve of correlation is a measure of local correlation between two random variables X and Y at the point X = x of the support of this variable. This article studies this local measure using the theory of time series for bivariate and univariate stationary stochastic process. We suggest local polynomial estimators for time series observing their consistency both theoretically and through simulations. For this, different sizes of series, bandwidths, and kernels, besides lags and models’ configurations were used. Applications have also been made using the daily returns of two financial series.     

Assessing case influence on confidence intervals in nonlinear regression

Diagnostic techniques are proposed for assessing the influence of individual cases on confidence intervals in nonlinear regression. The technique proposed uses the method of profile t-plots applied to the case-deletion model. The effect of the geometry of the statistical model on the influence measures is assessed, and an algorithm for computing case-deleted confidence intervals is described. This algorithm provides a direct method for constructing a simple diagnostic measure based on the ratio of the lengths of confidence intervals. The generalization of these methods to multiresponse models is discussed.     

Bootstrap approaches for estimation and confidence intervals of long memory processes

In this work, we investigate an alternative bootstrap approach based on a result of Ramsey [F.L. Ramsey, Characterization of the partial autocorrelation function, Ann. Statist. 2 (1974), pp. 1296–1301] and on the Durbin–Levinson algorithm to obtain a surrogate series from linear Gaussian processes with long range dependence. We compare this bootstrap method with other existing procedures in a wide Monte Carlo experiment by estimating, parametrically and semi-parametrically, the memory parameter d. We consider Gaussian and non-Gaussian processes to prove the robustness of the method to deviations from normality. The approach is also useful to estimate confidence intervals for the memory parameter d by improving the coverage level of the interval.     

Sieve bootstrapping the memory parameter in long-range dependent stationary functional time series

We consider a sieve bootstrap procedure to quantify the estimation uncertainty of long-memory parameters in stationary functional time series. We use a semiparametric local Whittle estimator to estimate the long-memory parameter. In the local Whittle estimator, discrete Fourier transform and periodogram are constructed from the first set of principal component scores via a functional principal component analysis. The sieve bootstrap procedure uses a general vector autoregressive representation of the estimated principal component scores. It generates bootstrap replicates that adequately mimic the dependence structure of the underlying stationary process. We first compute the estimated first set of principal component scores for each bootstrap replicate and then apply the semiparametric local Whittle estimator to estimate the memory parameter. By taking quantiles of the estimated memory parameters from these bootstrap replicates, we can nonparametrically construct confidence intervals of the long-memory parameter. As measured by coverage probability differences between the empirical and nominal coverage probabilities at three levels of significance, we demonstrate the advantage of using the sieve bootstrap compared to the asymptotic confidence intervals based on normality.

     

Comparing point and interval estimates in the bivariate <Emphasis Type="Italic">t</Emphasis>-copula model with application to financial data

The paper considers joint maximum likelihood (ML) and semiparametric (SP) estimation of copula parameters in a bivariate t-copula. Analytical expressions for the asymptotic covariance matrix involving integrals over special functions are derived, which can be evaluated numerically. These direct evaluations of the Fisher information matrix are compared to Hessian evaluations based on numerical differentiation in a simulation study showing a satisfactory performance of the computationally less demanding Hessian evaluations. Individual asymptotic confidence intervals for the t-copula parameters and the corresponding tail dependence coefficient are derived. For two financial datasets these confidence intervals are calculated using both direct evaluation of the Fisher information and numerical evaluation of the Hessian matrix. These confidence intervals are compared to parametric and nonparametric BCA bootstrap intervals based on ML and SP estimation, respectively, showing a preference for asymptotic confidence intervals based on numerical Hessian evaluations.     

On testing for independence between the innovations of several time series

Test statistics for checking the independence between the innovations of several time series are developed. The time series models considered allow for general specifications for the conditional mean and variance functions that could depend on common explanatory variables. In testing for independence between more than two time series, checking pairwise independence does not lead to consistent procedures. Thus a finite family of empirical processes relying on multivariate lagged residuals are constructed, and we derive their asymptotic distributions. In order to obtain simple asymptotic covariance structures, Möbius transformations of the empirical processes are studied, and simplifications occur. Under the null hypothesis of independence, we show that these transformed processes are asymptotically Gaussian, independent, and with tractable covariance functions not depending on the estimated parameters. Various procedures are discussed, including Cramér–von Mises test statistics and tests based on non‐parametric measures. The ranks of the residuals are considered in the new methods, giving test statistics which are asymptotically margin‐free. Generalized cross‐correlations are introduced, extending the concept of cross‐correlation to an arbitrary number of time series; portmanteau procedures based on them are discussed. In order to detect the dependence visually, graphical devices are proposed. Simulations are conducted to explore the finite sample properties of the methodology, which is found to be powerful against various types of alternatives when the independence is tested between two and three time series. An application is considered, using the daily log‐returns of Apple, Intel and Hewlett‐Packard traded on the Nasdaq financial market. The Canadian Journal of Statistics 40: 447–479; 2012 © 2012 Statistical Society of Canada     

The marked empirical process to test nonlinear time series against a large class of alternatives when the random vectors are nonstationary and absolutely regular

In this paper, we propose a method for testing absolutely regular and possibly nonstationary nonlinear time-series, with application to general AR-ARCH models. Our test statistic is based on a marked empirical process of residuals which is shown to converge to a Gaussian process with respect to the Skohorod topology. This testing procedure was first introduced by Stute [Nonparametric model checks for regression, Ann. Statist. 25 (1997), pp. 613–641] and then widely developed by Ngatchou-Wandji [Weak convergence of some marked empirical processes: Application to testing heteroscedasticity, J. Nonparametr. Stat. 14 (2002), pp. 325–339; Checking nonlinear heteroscedastic time series models, J. Statist. Plann. Inference 133 (2005), pp. 33–68; Local power of a Cramer-von Mises type test for parametric autoregressive models of order one, Compt. Math. Appl. 56(4) (2008), pp. 918–929] under more general conditions. Applications to general AR-ARCH models are given.     

Confidence intervals for nonparametric quantile regression: an emphasis on smoothing splines approach

In this paper we consider the problem of constructing confidence intervals for nonparametric quantile regression with an emphasis on smoothing splines. The mean‐based approaches for smoothing splines of Wahba (1983) and Nychka (1988) may not be efficient for constructing confidence intervals for the underlying function when the observed data are non‐Gaussian distributed, for instance if they are skewed or heavy‐tailed. This paper proposes a method of constructing confidence intervals for the unknown τth quantile function (0<τ<1) based on smoothing splines. In this paper we investigate the extent to which the proposed estimator provides the desired coverage probability. In addition, an improvement based on a local smoothing parameter that provides more uniform pointwise coverage is developed. The results from numerical studies including a simulation study and real data analysis demonstrate the promising empirical properties of the proposed approach.     

Approximated non parametric confidence regions for the ratio of two percentiles

In the wood industry, it is common practice to compare in terms of the ratio of the same-strength properties for lumber of two different dimensions, grades, or species. Because United States lumber standards are given in terms of population fifth percentile, and strength problems arise from the weaker fifth percentile rather than the stronger mean, so the ratio should be expressed in terms of the fifth percentiles rather than the means of two strength distributions. Percentiles are estimated by order statistics. This paper assumes small samples to derive new non parametric methods such as percentile sign test and percentile Wilcoxon signed rank test, construct confidence intervals with covergage rate 1 – αx for single percentiles, and compute confidence regions for ratio of percentiles based on confidence intervals for single percentiles. Small 1 – αx is enough to obtain good coverage rates of confidence regions most of the time.     

Estimators of the multiple correlation coefficient: Local robustness and confidence intervals

Many robust regression estimators are defined by minimizing a measure of spread of the residuals. An accompanying R ²-measure, or multiple correlation coefficient, is then easily obtained. In this paper, local robustness properties of these robust R ²-coefficients are investigated. It is also shown how confidence intervals for the population multiple correlation coefficient can be constructed in the case of multivariate normality.     

Testing symmetry based on empirical likelihood

In this paper, we propose a general kth correlation coefficient between the density function and distribution function of a continuous variable as a measure of symmetry and asymmetry. We first propose a root-n moment-based estimator of the kth correlation coefficient and present its asymptotic results. Next, we consider statistical inference of the kth correlation coefficient by using the empirical likelihood (EL) method. The EL statistic is shown to be asymptotically a standard chi-squared distribution. Last, we propose a residual-based estimator of the kth correlation coefficient for a parametric regression model to test whether the density function of the true model error is symmetric or not. We present the asymptotic results of the residual-based kth correlation coefficient estimator and also construct its EL-based confidence intervals. Simulation studies are conducted to examine the performance of the proposed estimators, and we also use our proposed estimators to analyze the air quality dataset.     

Some Properties of the Exact and Score Methods for Binomial Proportion and Sample Size Calculation

In this article, we point out some interesting relations between the exact test and the score test for a binomial proportion p. Based on the properties of the tests, we propose some approximate as well as exact methods of computing sample sizes required for the tests to attain a specified power. Sample sizes required for the tests are tabulated for various values of p to attain a power of 0.80 at level 0.05. We also propose approximate and exact methods of computing sample sizes needed to construct confidence intervals with a given precision. Using the proposed exact methods, sample sizes required to construct 95% confidence intervals with various precisions are tabulated for p = .05(.05).5. The approximate methods for computing sample sizes for score confidence intervals are very satisfactory and the results coincide with those of the exact methods for many cases.     

Confidence interval estimation and hypothesis testing for a common correlation coefficient

Several procedures have been proposed for testing the hypothesis that all off-diagonal elements of the correlation matrix of a multivariate normal distribution are equal. If the hypothesis of equal correlation can be accepted, it is then of interest to estimate and perhaps test hypotheses for the common correlation. In this paper, two versions of five different test statistics are compared via simulation in terms of adequacy of the normal approximation, coverage probabilities of confidence intervals, control of Type I error, and power. The results indicate that two test statistics based on the average of the Fisher z-transforms of the sample correlations should be used in most cases. A statistic based on the sample eigenvalues also gives reasonable results for confidence intervals and lower-tailed tests.     

Parameter estimation and inference with spatial lags and cointegration

This article studies dynamic panel data models in which the long run outcome for a particular cross-section is affected by a weighted average of the outcomes in the other cross-sections. We show that imposing such a structure implies a model with several cointegrating relationships that, unlike in the standard case, are nonlinear in the coe?cients to be estimated. Assuming that the weights are exogenously given, we extend the dynamic ordinary least squares methodology and provide a dynamic two-stage least squares estimator. We derive the large sample properties of our proposed estimator under a set of low-level assumptions. Then our methodology is applied to US financial market data, which consist of credit default swap spreads, as well as firm-specific and industry data. We construct the economic space using a “closeness” measure for firms based on input–output matrices. Our estimates show that this particular form of spatial correlation of credit default swap spreads is substantial and highly significant.     

Estimation of reliability from a bivariate log-normal data

It has been established that the bivariate log-normal distribution is appropriate for modelling certain paired observations. In this paper, we have developed large-sample confidence intervals of the dependence and reliability R=P(X>Y) parameters from a bivariate log-normal distribution with equal log-normal means. The parameter R provides a general measure of difference between the two populations and has applications in many areas. The performance of these confidence intervals has been examined by extensive simulation studies. The results are illustrated with an example dealing with a quantitative assay problem.     

Testing for parameter constancy in the time series direction in panel data models

We propose tests for parameter constancy in the time series direction in panel data models. We construct a locally best invariant test based on Tanaka [Time series analysis: nonstationary and noninvertible distribution theory. New York: Wiley; 1996] and an asymptotically point optimal test based on Elliott and Müller [Efficient tests for general persistent time variation in regression coefficients. Rev Econ Stud. 2006;73:907–940]. We derive the limiting distributions of the test statistics as T→∞ while N is fixed, and calculate the critical values by applying numerical integration and response surface regression. Simulation results show that the proposed tests perform well if we apply them appropriately.     

M‐estimation for general ARMA Processes with Infinite Variance

Abstract. General autoregressive moving average (ARMA) models extend the traditional ARMA models by removing the assumptions of causality and invertibility. The assumptions are not required under a non‐Gaussian setting for the identifiability of the model parameters in contrast to the Gaussian setting. We study M‐estimation for general ARMA processes with infinite variance, where the distribution of innovations is in the domain of attraction of a non‐Gaussian stable law. Following the approach taken by Davis et al. (1992) and Davis (1996) , we derive a functional limit theorem for random processes based on the objective function, and establish asymptotic properties of the M‐estimator. We also consider bootstrapping the M‐estimator and extend the results of Davis & Wu (1997) to the present setting so that statistical inferences are readily implemented. Simulation studies are conducted to evaluate the finite sample performance of the M‐estimation and bootstrap procedures. An empirical example of financial time series is also provided.     

Spatial effects in dynamic conditional correlations

The recent literature on time series has developed a lot of models for the analysis of the dynamic conditional correlation, involving the same variable observed in different locations; very often, in this framework, the consideration of the spatial interactions is omitted. We propose to extend a time-varying conditional correlation model (following an autoregressive moving average dynamics) to include the spatial effects, with a specification depending on the local spatial interactions. The spatial part is based on a fixed symmetric weight matrix, called Gaussian kernel matrix, but its effect will vary along the time depending on the degree of time correlation in a certain period. We show the theoretical aspects, with the support of simulation experiments, and apply this methodology to two space–time data sets, in a demographic and a financial framework, respectively.