The generalized linear chirp process

The linear chirp process is an important class of time series for which the instantaneous frequency changes linearly in time. Linear chirps have been used extensively to model a variety of physical signals such as radar, sonar, and whale clicks (see 1, 5 and 6). We introduce the stochastic linear chirp model and then define the generalized linear chirp (GLC) process as a special case of the G-stationary process studied by Jiang et al. (2006) to model data with time-varying frequencies. We then define GLC(p,q) processes and show that the relationship between stochastic linear chirp processes and GLC(p,q) processes is analogous to that between harmonic and ARMA models. The new methods are then applied to both simulated and actual data sets.     

Euler(p,q) Processes and Their Application to Non Stationary Time Series with Time Varying Frequencies

We introduce Euler(p, q) processes as an extension of the Euler(p) processes for purposes of obtaining more parsimonious models for non stationary processes whose periodic behavior changes approximately linearly in time. The discrete Euler(p, q) models are a class of multiplicative stationary (M-stationary) processes and basic properties are derived. The relationship between continuous and discrete mixed Euler processes is shown. Fundamental to the theory and application of Euler(p, q) processes is a dual relationship between discrete Euler(p, q) processes and ARMA processes, which is established. The usefulness of Euler(p, q) processes is examined by comparing spectral estimation with that obtained by existing methods using both simulated and real data.     

Spectral estimation for locally stationary time series with missing observations

Time series arising in practice often have an inherently irregular sampling structure or missing values, that can arise for example due to a faulty measuring device or complex time-dependent nature. Spectral decomposition of time series is a traditionally useful tool for data variability analysis. However, existing methods for spectral estimation often assume a regularly-sampled time series, or require modifications to cope with irregular or ‘gappy’ data. Additionally, many techniques also assume that the time series are stationary, which in the majority of cases is demonstrably not appropriate. This article addresses the topic of spectral estimation of a non-stationary time series sampled with missing data. The time series is modelled as a locally stationary wavelet process in the sense introduced by Nason et al. (J. R. Stat. Soc. B 62(2):271–292, 2000) and its realization is assumed to feature missing observations. Our work proposes an estimator (the periodogram) for the process wavelet spectrum, which copes with the missing data whilst relaxing the strong assumption of stationarity. At the centre of our construction are second generation wavelets built by means of the lifting scheme (Sweldens, Wavelet Applications in Signal and Image Processing III, Proc. SPIE, vol. 2569, pp. 68–79, 1995), designed to cope with irregular data. We investigate the theoretical properties of our proposed periodogram, and show that it can be smoothed to produce a bias-corrected spectral estimate by adopting a penalized least squares criterion. We demonstrate our method with real data and simulated examples.     

Multivariate autoregressive time semes modeling: one scalar autoregressive model at-A-time

Multivariate (or interchangeably multichannel) autoregressive (MCAR) modeling of stationary and nonstationary time series data is achieved doing things one channel at-a-time using only scalar computations on instantaneous data. The one channel at-a-time modeling is achieved as an instantaneous response multichannel autoregressive model with orthogonal innovations variance. Conventional MCAR models are expressible as linear algebraic transformations of the instantaneous response orthogonal innovations models. By modeling multichannel time series one channel at-a-time, the problems of modeling multichannel time series are reduced to problems in the modeling of scalar autoregressive time series. The three longstanding time series modeling problems of achieving a relatively parsimonious MCAR representation, of multichannel stationary time series spectral estimation and of the modeling of nonstationary covariance time series are addressed using this paradigm.     

Long memory and changepoint models: a spectral classification procedure

Time series within fields such as finance and economics are often modelled using long memory processes. Alternative studies on the same data can suggest that series may actually contain a ‘changepoint’ (a point within the time series where the data generating process has changed). These models have been shown to have elements of similarity, such as within their spectrum. Without prior knowledge this leads to an ambiguity between these two models, meaning it is difficult to assess which model is most appropriate. We demonstrate that considering this problem in a time-varying environment using the time-varying spectrum removes this ambiguity. Using the wavelet spectrum, we then use a classification approach to determine the most appropriate model (long memory or changepoint). Simulation results are presented across a number of models followed by an application to stock cross-correlations and US inflation. The results indicate that the proposed classification outperforms an existing hypothesis testing approach on a number of models and performs comparatively across others.     

Exact simulation of Gaussian Time Series from Nonparametric Spectral Estimates with Application to Bootstrapping

The circulant embedding method for generating statistically exact simulations of time series from certain Gaussian distributed stationary processes is attractive because of its advantage in computational speed over a competitive method based upon the modified Cholesky decomposition. We demonstrate that the circulant embedding method can be used to generate simulations from stationary processes whose spectral density functions are dictated by a number of popular nonparametric estimators, including all direct spectral estimators (a special case being the periodogram), certain lag window spectral estimators, all forms of Welch's overlapped segment averaging spectral estimator and all basic multitaper spectral estimators. One application for this technique is to generate time series for bootstrapping various statistics. When used with bootstrapping, our proposed technique avoids some – but not all – of the pitfalls of previously proposed frequency domain methods for simulating time series.     

Semiparametric estimation for seasonal long-memory time series using generalized exponential models

We consider a generalized exponential (GEXP) model in the frequency domain for modeling seasonal long-memory time series. This model generalizes the fractional exponential (FEXP) model [Beran, J., 1993. Fitting long-memory models by generalized linear regression. Biometrika 80, 817–822] to allow the singularity in the spectral density occurring at an arbitrary frequency for modeling persistent seasonality and business cycles. Moreover, the short-memory structure of this model is characterized by the Bloomfield [1973. An exponential model for the spectrum of a scalar time series. Biometrika 60, 217–226] model, which has a fairly flexible semiparametric form. The proposed model includes fractionally integrated processes, Bloomfield models, FEXP models as well as GARMA models [Gray, H.L., Zhang, N.-F., Woodward, W.A., 1989. On generalized fractional processes. J. Time Ser. Anal. 10, 233–257] as special cases. We develop a simple regression method for estimating the seasonal long-memory parameter. The asymptotic bias and variance of the corresponding long-memory estimator are derived. Our methodology is applied to a sunspot data set and an Internet traffic data set for illustration.     

The Effectiveness of Multistage Ranked Set Sampling in Stratifying the Population

The spectral analysis of Gaussian linear time-series processes is usually based on uni-frequential tools because the spectral density functions of degree 2 and higher are identically zero and there is no polyspectrum in this case. In finite samples, such an approach does not allow the resolution of closely adjacent spectral lines, except by using autoregressive models of excessively high order in the method of maximum entropy. In this article, multi-frequential periodograms designed for the analysis of discrete and mixed spectra are defined and studied for their properties in finite samples. For a given vector of frequencies ω, the sum of squares of the corresponding trigonometric regression model fitted to a time series by unweighted least squares defines the multi-frequential periodogram statistic IM(ω). When ω is unknown, it follows from the properties of nonlinear models whose parameters separate (i.e., the frequencies and the cosine and sine coefficients here) that the least-squares estimator of frequencies is obtained by maximizing I ^M(ω). The first-order, second-order and distribution properties of I ^M(ω) are established theoretically in finite samples, and are compared with those of Schuster's uni-frequential periodogram statistic. In the multi-frequential periodogram analysis, the least-squares estimator of frequencies is proved to be theoretically unbiased in finite samples if the number of periodic components of the time series is correctly estimated. Here, this number is estimated at the end of a stepwise procedure based on pseudo-Flikelihood ratio tests. Simulations are used to compare the stepwise procedure involving I ^M(ω) with a stepwise procedure using Schuster's periodogram, to study an approximation of the asymptotic theory for the frequency estimators in finite samples in relation to the proximity and signal-to-noise ratio of the periodic components, and to assess the robustness of I ^M(ω) against autocorrelation in the analysis of mixed spectra. Overall, the results show an improvement of the new method over the classical approach when spectral lines are adjacent. Finally, three examples with real data illustrate specific aspects of the method, and extensions (i.e., unequally spaced observations, trend modeling, replicated time series, periodogram matrices) are outlined.     

中国季度GDP的季节调整：结构时间序列方法

 内容提要：本文利用结构时间序列方法讨论了中国季度GDP的季节调整问题,从季节单位根、季节自相关、周期自相关等多个方面对不同季节模式的调整结果进行了比较。结论认为,随机虚拟变量形式和三角函数形式得到的调整结果非常相似;结构时间序列方法更好地捕捉到了时变季节特征,明显优于X-11和SEATS方法;非高斯稳健季节调整的结果表明,高斯结构时间序列方法具有较好的稳定性。     

Frequency Domain Tests of Semiparametric Hypotheses for Locally Stationary Processes

Abstract.  Many time series in applied sciences obey a time-varying spectral structure. In this article, we focus on locally stationary processes and develop tests of the hypothesis that the time-varying spectral density has a semiparametric structure, including the interesting case of a time-varying autoregressive moving-average (tvARMA) model. The test introduced is based on a L ₂ -distance measure of a kernel smoothed version of the local periodogram rescaled by the time-varying spectral density of the estimated semiparametric model. The asymptotic distribution of the test statistic under the null hypothesis is derived. As an interesting special case, we focus on the problem of testing for the presence of a tvAR model. A semiparametric bootstrap procedure to approximate more accurately the distribution of the test statistic under the null hypothesis is proposed. Some simulations illustrate the behaviour of our testing methodology in finite sample situations.     

A New Type of Discrete Self-Decomposability and Its Application to Continuous-Time Markov Processes for Modeling Count Data Time Series

We propose a family of extended thinning operators, indexed by a parameter γ in [0, 1), with the boundary case of γ=0 corresponding to the well-known binomial thinning operator. The extended thinning operators can be used to construct a class of continuous-time Markov processes for modeling count time series data. The class of stationary distributions of these processes is called generalized discrete self-decomposable, denoted by DSD (γ). We obtain characterization results for the DSD (γ) class and investigate relationships among the classes for different γ's.     

The “Caterpillar”-SSA method for analysis of time series with missing values

The paper concerns the problem of applying singular spectrum analysis to time series with missing data. A method of filling in the missing data is proposed and is applied to time series of finite rank. Conditions of exact reconstruction of missing data are developed and versions of the algorithm applicable to real-life time series are presented. The proposed algorithms result in the extraction of additive components of time series such as trends and periodic components, with simultaneous filling in of the missing data. An example is presented.     

The Distribution of Sums of Certain I.I.D. Pareto Variates

ABSTRACT

Though the Pareto distribution is important to actuaries and economists, an exact expression for the distribution of the sum of n i.i.d. Pareto variates has been difficult to obtain in general. This article considers Pareto random variables with common probability density function (pdf) f(x) = (α/β) (1 + x/β)^α+1 for x > 0, where α = 1,2,… and β > 0 is a scale parameter. To date, explicit expressions are known only for a few special cases: (i) α = 1 and n = 1,2,3; (ii) 0 < α < 1 and n = 1,2,…; and (iii) 1 < α < 2 and n = 1,2,…. New expressions are provided for the more general case where β > 0, and α and n are positive integers. Laplace transforms and generalized exponential integrals are used to derive these expressions, which involve integrals of real valued functions on the positive real line. An important attribute of these expressions is that the integrands involved are non oscillating.     

Multitaper testing of spectral lines and the detection of the solar rotation frequency and its harmonics

We develop statistical testing methodology for closely spaced spectral lines based on multitaper spectrum estimates and apply it to a time series of solar magnetic field magnitude data recorded by the Ulysses spacecraft. The test is formulated through complex-valued weighted least squares. Using this test in combination with the test for well-separated lines, we can accurately detect the solar equatorial rotation frequency of the sun, and its harmonics, from data recorded by Ulysses's magnetometer at solar mid-latitudes; this is a potentially important result for solar physicists, since it has implications for the structure and dynamics of magnetic fields in the solar corona.     

New methods for fitting multiple sinusoids from irregularly sampled data

A novel framework is proposed for the estimation of multiple sinusoids from irregularly sampled time series. This spectral analysis problem is addressed as an under-determined inverse problem, where the spectrum is discretized on an arbitrarily thin frequency grid. As we focus on line spectra estimation, the solution must be sparse, i.e. the amplitude of the spectrum must be zero almost everywhere. Such prior information is taken into account within the Bayesian framework. Two models are used to account for the prior sparseness of the solution, namely a Laplace prior and a Bernoulli–Gaussian prior, associated to optimization and stochastic sampling algorithms, respectively. Such approaches are efficient alternatives to usual sequential prewhitening methods, especially in case of strong sampling aliases perturbating the Fourier spectrum. Both methods should be intensively tested on real data sets by physicists.     

Nonparametric Testing of an Exclusion Restriction in Quantile Regression

Using the framework proposed by Bickel et al. (2006 Bickel , P. J. , Ritov , Y. , Stoker , T. ( 2006 ). Tailor-made tests for goodness-of-fit to semiparametric hypotheses . Ann. Stat. 34 ( 2 ): 721 – 741 . [Google Scholar]), we provide a score-based testing method to check the exclusion restriction in quantile regression, i.e., H: ν_α(Y|U, V) = ν_α(Y|U) w.p.1, where ν_α denotes the αth (0 < α < 1) quantile. A subsampling method is suggested to acquire the critical values and justified. The tests are all found to be consistent against fixed alternatives and have discriminating power against local alternatives at root-n scale. We address this particular problem as a representative among a wide family of semiparametric model checking problems. The methodology can be carried over to other goodness-of-fit testing of semiparametric models, possibly involve non smooth functions.     

Optimal transformations and the spectral envelope for real-valued time series

The concept of a spectral envelope for exploring the periodic nature of real-valued time series is introduced. This concept follows naturally from the data-dependent approach proposed by Stoffer et al. (1993) for spectral analysis and scaling of categorical processes. Here, the notion of the spectral envelope is applied in the context of transformations of a time series, and a data-dependent approach for selecting optimal transformations is proposed. These transformations help emphasize periodicities that may exist in the real-valued process. The definition of the spectral envelope is also extended to include multivariate time series. Several examples are used to illustrate the application of this methodology and asymptotic properties of the procedure are established.     

Rates of convergence of autocorrelation estimates for periodically correlated autoregressive Hilbertian processes

Autoregressive Hilbertian (ARH) processes are of great importance in the analysis of functional time series data and estimation of the autocorrelation operators attracts the attention of various researchers. In this paper, we study estimators of the autocorrelation operators of periodically correlated autoregressive Hilbertian processes of order one (PCARH(1)), which is an extension of ARH(1) processes. The estimation method is based on the spectral decomposition of the covariance operator and considers two main cases: known and unknown eigenvectors. We show the consistency in the mean integrated quadratic sense of the estimators of the autocorrelation operators and present upper bounds for the corresponding rates.     

Bootstrapping frequency domain tests in multivariate time series with an application to comparing spectral densities

Summary.  We propose a general bootstrap procedure to approximate the null distribution of non-parametric frequency domain tests about the spectral density matrix of a multivariate time series. Under a set of easy-to-verify conditions, we establish asymptotic validity of the bootstrap procedure proposed. We apply a version of this procedure together with a new statistic to test the hypothesis that the spectral densities of not necessarily independent time series are equal. The test statistic proposed is based on an L ₂-distance between the non-parametrically estimated individual spectral densities and an overall, 'pooled' spectral density, the latter being obtained by using the whole set of m time series considered. The effects of the dependence between the time series on the power behaviour of the test are investigated. Some simulations are presented and a real life data example is discussed.