Wavelet packet transfer function modelling of nonstationary time series

This article shows how a non-decimated wavelet packet transform (NWPT) can be used to model a response time series, Y _t, in terms of an explanatory time series, X _t. The proposed computational technique transforms the explanatory time series into a NWPT representation and then uses standard statistical modelling methods to identify which wavelet packets are useful for modelling the response time series. We exhibit S-Plus functions from the freeware WaveThresh package that implement our methodology.The proposed modelling methodology is applied to an important problem from the wind energy industry: how to model wind speed at a target location using wind speed and direction from a reference location. Our method improves on existing target site wind speed predictions produced by widely used industry standard techniques. However, of more importance, our NWPT representation produces models to which we can attach physical and scientific interpretations and in the wind example enable us to understand more about the transfer of wind energy from site to site.     

Forecasting using locally stationary wavelet processes

Locally stationary wavelet (LSW) processes, built on non-decimated wavelets, can be used to analyse and forecast non-stationary time series. They have been proved useful in the analysis of financial data. In this paper, we first carry out a sensitivity analysis, then propose some practical guidelines for choosing the wavelet bases for these processes. The existing forecasting algorithm is found to be vulnerable to outliers, and a new algorithm is proposed to overcome the weakness. The new algorithm is shown to be stable and outperforms the existing algorithm when applied to real financial data. The volatility forecasting ability of LSW modelling based on our new algorithm is then discussed and shown to be competitive with traditional GARCH models.     

On simple wavelet estimators of random signals and their small-sample properties

In the paper we suggest certain nonparametric estimators of random signals based on the wavelet transform. We consider stochastic signals embedded in white noise and extractions with wavelet denoizing algorithms utilizing the non-decimated discrete wavelet transform and the idea of wavelet scaling. We evaluate properties of these estimators via extensive computer simulations and partially also analytically. Our wavelet estimators of random signals have clear advantages over parametric maximum likelihood methods as far as computational issues are concerned, while at the same time they can compete with these methods in terms of precision of estimation in small samples. An illustrative example concerning smoothing of survey data is also provided.     

Matching pursuit by undecimated discrete wavelet transform for non-stationary time series of arbitrary length

We describe how to formulate a matching pursuit algorithm which successively approximates a periodic non-stationary time series with orthogonal projections onto elements of a suitable dictionary. We discuss how to construct such dictionaries derived from the maximal overlap (undecimated) discrete wavelet transform (MODWT). Unlike the standard discrete wavelet transform (DWT), the MODWT is equivariant under circular shifts and may be computed for an arbitrary length time series, not necessarily a multiple of a power of 2. We point out that when using the MODWT and continuing past the level where the filters are wrapped, the norms of the dictionary elements may, depending on N, deviate from the required value of unity and require renormalization.We analyse a time series of subtidal sea levels from Crescent City, California. The matching pursuit shows in an iterative fashion how localized dictionary elements (scale and position) account for residual variation, and in particular emphasizes differences in construction for varying parts of the series.     

Real nonparametric regression using complex wavelets

Summary.  Wavelet shrinkage is an effective nonparametric regression technique, especially when the underlying curve has irregular features such as spikes or discontinuities. The basic idea is simple: take the discrete wavelet transform of data consisting of a signal corrupted by noise; shrink or remove the wavelet coefficients to remove the noise; then invert the discrete wavelet transform to form an estimate of the true underlying curve. Various researchers have proposed increasingly sophisticated methods of doing this by using real-valued wavelets. Complex-valued wavelets exist but are rarely used. We propose two new complex-valued wavelet shrinkage techniques: one based on multiwavelet style shrinkage and the other using Bayesian methods. Extensive simulations show that our methods almost always give significantly more accurate estimates than methods based on real-valued wavelets. Further, our multiwavelet style shrinkage method is both simpler and dramatically faster than its competitors. To understand the excellent performance of this method we present a new risk bound on its hard thresholded coefficients.     

Wavelet shrinkage for unequally spaced data

Wavelet shrinkage (WaveShrink) is a relatively new technique for nonparametric function estimation that has been shown to have asymptotic near-optimality properties over a wide class of functions. As originally formulated by Donoho and Johnstone, WaveShrink assumes equally spaced data. Because so many statistical applications (e.g., scatterplot smoothing) naturally involve unequally spaced data, we investigate in this paper how WaveShrink can be adapted to handle such data. Focusing on the Haar wavelet, we propose four approaches that extend the Haar wavelet transform to the unequally spaced case. Each approach is formulated in terms of continuous wavelet basis functions applied to a piecewise constant interpolation of the observed data, and each approach leads to wavelet coefficients that can be computed via a matrix transform of the original data. For each approach, we propose a practical way of adapting WaveShrink. We compare the four approaches in a Monte Carlo study and find them to be quite comparable in performance. The computationally simplest approach (isometric wavelets) has an appealing justification in terms of a weighted mean square error criterion and readily generalizes to wavelets of higher order than the Haar.     

Spectral estimation for locally stationary time series with missing observations

Time series arising in practice often have an inherently irregular sampling structure or missing values, that can arise for example due to a faulty measuring device or complex time-dependent nature. Spectral decomposition of time series is a traditionally useful tool for data variability analysis. However, existing methods for spectral estimation often assume a regularly-sampled time series, or require modifications to cope with irregular or ‘gappy’ data. Additionally, many techniques also assume that the time series are stationary, which in the majority of cases is demonstrably not appropriate. This article addresses the topic of spectral estimation of a non-stationary time series sampled with missing data. The time series is modelled as a locally stationary wavelet process in the sense introduced by Nason et al. (J. R. Stat. Soc. B 62(2):271–292, 2000) and its realization is assumed to feature missing observations. Our work proposes an estimator (the periodogram) for the process wavelet spectrum, which copes with the missing data whilst relaxing the strong assumption of stationarity. At the centre of our construction are second generation wavelets built by means of the lifting scheme (Sweldens, Wavelet Applications in Signal and Image Processing III, Proc. SPIE, vol. 2569, pp. 68–79, 1995), designed to cope with irregular data. We investigate the theoretical properties of our proposed periodogram, and show that it can be smoothed to produce a bias-corrected spectral estimate by adopting a penalized least squares criterion. We demonstrate our method with real data and simulated examples.     

Covariance structure of wavelet coefficients: theory and models in a Bayesian perspective

We present theoretical results on the random wavelet coefficients covariance structure. We use simple properties of the coefficients to derive a recursive way to compute the within- and across-scale covariances. We point out a useful link between the algorithm proposed and the two-dimensional discrete wavelet transform. We then focus on Bayesian wavelet shrinkage for estimating a function from noisy data. A prior distribution is imposed on the coefficients of the unknown function. We show how our findings on the covariance structure make it possible to specify priors that take into account the full correlation between coefficients through a parsimonious number of hyperparameters. We use Markov chain Monte Carlo methods to estimate the parameters and illustrate our method on bench-mark simulated signals.     

Solving Noisy ICA Using Multivariate Wavelet Denoising with an Application to Noisy Latent Variables Regression

A novel approach to solve the independent component analysis (ICA) model in the presence of noise is proposed. We use wavelets as natural denoising tools to solve the noisy ICA model. To do this, we use a multivariate wavelet denoising algorithm allowing spatial and temporal dependency. We propose also using a statistical approach, named nested design of experiments, to select the parameters such as wavelet family and thresholding type. This technique helps us to select more convenient combination of the parameters. This approach could be extended to many other problems in which one needs to choose parameters between many choices. The performance of the proposed method is illustrated on the simulated data and promising results are obtained. Also, the suggested method applied in latent variables regression in the presence of noise on real data. The good results confirm the ability of multivariate wavelet denoising to solving noisy ICA.     

A Fast Wavelet Algorithm for Analyzing One-Dimensional Signal Processing and Asymptotic Distribution of Wavelet Coefficients With Numerical Example and Simulation

In this article, we consider a sample point (t _j , s _j ) including a value s _j  = f(t _j ) at height s _j and abscissa (time or location) t _j . We apply wavelet decomposition by using shifts and dilations of the basic Häar transform and obtain an algorithm to analyze a signal or function f. We use this algorithm in practical to approximating function by numerical example. Some relationships between wavelets coefficients and asymptotic distribution of wavelet coefficients are investigated. At the end, we illustrate the results on simulated data by using MATLAB and R software.     

Nonparametric estimation of a two dimensional continuous–discrete density function by wavelets

We consider the estimation of a two dimensional continuous–discrete density function. A new methodology based on wavelets is proposed. We construct a linear wavelet estimator and a non-linear wavelet estimator based on a term-by-term thresholding. Their rates of convergence are established under the mean integrated squared error over Besov balls. In particular, we prove that our adaptive wavelet estimator attains a fast rate of convergence. A simulation study illustrates the usefulness of the proposed estimators.     

Denoising ozone concentration measurements with BAMS filtering

We propose a method for filtering self-similar geophysical signals infected by an autoregressive noise using a combination of non-decimated wavelet transform and a Bayesian model. In the application part, we consider separating the instrumentation noise from high frequency ozone concentration measurements sampled in the atmospheric boundary layer. The elicitation of priors needed to specify the statistical model in this application is guided by the well-known Kolmogorov K41-theory, which describes the statistical structure of turbulent high frequency scalar concentration fluctuations.     

Discrimination Measures for Fractional Integrated Models Based on Wavelets

Discrimination measures have been well developed for stationary time series. However in a large number of phenomena, long-term dependencies are involved. In this article, we are dealing with discrimination of fractional integrated models. Kullback–Leibler and Chernoff's discrimination measures are approximated, using the discrete wavelet transform (DWT) for discrimination of these time series classes. The simulation study indicates low misclassification rate, related to the approximations of Kullback–Leibler and Chernoff discrimination measures. Application to problem of classifying seismic data showed that our procedure performs as well as other procedures.     

A ‘nondecimated’ lifting transform

Classical nondecimated wavelet transforms are attractive for many applications. When the data comes from complex or irregular designs, the use of second generation wavelets in nonparametric regression has proved superior to that of classical wavelets. However, the construction of a nondecimated second generation wavelet transform is not obvious. In this paper we propose a new ‘nondecimated’ lifting transform, based on the lifting algorithm which removes one coefficient at a time, and explore its behavior. Our approach also allows for embedding adaptivity in the transform, i.e. wavelet functions can be constructed such that their smoothness adjusts to the local properties of the signal. We address the problem of nonparametric regression and propose an (averaged) estimator obtained by using our nondecimated lifting technique teamed with empirical Bayes shrinkage. Simulations show that our proposed method has higher performance than competing techniques able to work on irregular data. Our construction also opens avenues for generating a ‘best’ representation, which we shall explore.     

A multi-resolution census algorithm for calculating vortex statistics in turbulent flows

Summary.  The fundamental equations that model turbulent flow do not provide much insight into the size and shape of observed turbulent structures. We investigate the efficient and accurate representation of structures in two-dimensional turbulence by applying statistical models directly to the simulated vorticity field. Rather than extract the coherent portion of the image from the background variation, as in the classical signal-plus-noise model, we present a model for individual vortices using the non-decimated discrete wavelet transform. A template image, which is supplied by the user, provides the features to be extracted from the vorticity field. By transforming the vortex template into the wavelet domain, specific characteristics that are present in the template, such as size and symmetry, are broken down into components that are associated with spatial frequencies. Multivariate multiple linear regression is used to fit the vortex template to the vorticity field in the wavelet domain. Since all levels of the template decomposition may be used to model each level in the field decomposition, the resulting model need not be identical to the template. Application to a vortex census algorithm that records quantities of interest (such as size, peak amplitude and circulation) as the vorticity field evolves is given. The multiresolution census algorithm extracts coherent structures of all shapes and sizes in simulated vorticity fields and can reproduce known physical scaling laws when processing a set of vorticity fields that evolve over time.     

Efficient computation of the discrete autocorrelation wavelet inner product matrix

Discrete autocorrelation (a.c.) wavelets have recently been applied in the statistical analysis of locally stationary time series for local spectral modelling and estimation. This article proposes a fast recursive construction of the inner product matrix of discrete a.c. wavelets which is required by the statistical analysis. The recursion connects neighbouring elements on diagonals of the inner product matrix using a two-scale property of the a.c. wavelets. The recursive method is an (log (N)³) operation which compares favourably with the (N log N) operations required by the brute force approach. We conclude by describing an efficient construction of the inner product matrix in the (separable) two-dimensional case.     

Modelling and forecasting by wavelets, and the application to exchange rates

This paper investigates the modelling and forecasting method for non-stationary time series. Using wavelets, the authors propose a modelling procedure that decomposes the series as the sum of three separate components, namely trend, harmonic and irregular components. The estimates suggested in this paper are all consistent. This method has been used for the modelling of US dollar against DM exchange rate data, and ten steps ahead (2 weeks) forecasting are compared with several other methods. Under the Average Percentage of forecasting Error (APE) criterion, the wavelet approach is the best one. The results suggest that forecasting based on wavelets is a viable alternative to existing methods.     

Wavelet-based estimation for multivariate stable laws

In this article, an estimation problem for multivariate stable laws using wavelets has been studied. The method of applying wavelets, which has already been done, to estimate parameters in univariate stable laws, has been extended to multivariate stable laws. The proposed estimating method is based on a nonlinear regression model on wavelet coefficients of characteristic functions. In particular, two parametric sub-classes of stable laws are considered: the class of multivariate stable laws with discrete spectral measure, and sub-Gaussian laws. Using a simulation study, the proposed method has been compared with well-known estimation procedures.     

A Review of Some Modern Approaches to the Problem of Trend Extraction

This article presents a review of some modern approaches to trend extraction for one-dimensional time series, which is one of the major tasks of time series analysis. The trend of a time series is usually defined as a smooth additive component which contains information about the time series global change, and we discuss this and other definitions of the trend. We do not aim to review all the novel approaches, but rather to observe the problem from different viewpoints and from different areas of expertise. The article contributes to understanding the concept of a trend and the problem of its extraction. We present an overview of advantages and disadvantages of the approaches under consideration, which are: the model-based approach (MBA), nonparametric linear filtering, singular spectrum analysis (SSA), and wavelets. The MBA assumes the specification of a stochastic time series model, which is usually either an autoregressive integrated moving average (ARIMA) model or a state space model. The nonparametric filtering methods do not require specification of model and are popular because of their simplicity in application. We discuss the Henderson, LOESS, and Hodrick–Prescott filters and their versions derived by exploiting the Reproducing Kernel Hilbert Space methodology. In addition to these prominent approaches, we consider SSA and wavelet methods. SSA is widespread in the geosciences; its algorithm is similar to that of principal components analysis, but SSA is applied to time series. Wavelet methods are the de facto standard for denoising in signal procession, and recent works revealed their potential in trend analysis.     

Denoising radiocommunications signals by using iterative wavelet shrinkage

Summary. Radiocommunications signals pose particular problems in the context of statistical signal processing. This is because short-term fluctuations (noise) are a consequence of atmospheric effects whose characteristics vary in both the short and the longer term. We contrast traditional time domain and frequency domain filters with wavelet methods. We also propose an iterative wavelet procedure which appears to provide benefits over existing wavelet methods.