Real nonparametric regression using complex wavelets

Summary.  Wavelet shrinkage is an effective nonparametric regression technique, especially when the underlying curve has irregular features such as spikes or discontinuities. The basic idea is simple: take the discrete wavelet transform of data consisting of a signal corrupted by noise; shrink or remove the wavelet coefficients to remove the noise; then invert the discrete wavelet transform to form an estimate of the true underlying curve. Various researchers have proposed increasingly sophisticated methods of doing this by using real-valued wavelets. Complex-valued wavelets exist but are rarely used. We propose two new complex-valued wavelet shrinkage techniques: one based on multiwavelet style shrinkage and the other using Bayesian methods. Extensive simulations show that our methods almost always give significantly more accurate estimates than methods based on real-valued wavelets. Further, our multiwavelet style shrinkage method is both simpler and dramatically faster than its competitors. To understand the excellent performance of this method we present a new risk bound on its hard thresholded coefficients.     

On Combining Wavelets Expansion and Sparse Linear Models for Regression on Metabolomic Data and Biomarker Selection

Wavelet thresholding of spectra has to be handled with care when the spectra are the predictors of a regression problem. Indeed, a blind thresholding of the signal followed by a regression method often leads to deteriorated predictions. The scope of this article is to show that sparse regression methods, applied in the wavelet domain, perform an automatic thresholding: the most relevant wavelet coefficients are selected to optimize the prediction of a given target of interest. This approach can be seen as a joint thresholding designed for a predictive purpose. The method is illustrated on a real world problem where metabolomic data are linked to poison ingestion. This example proves the usefulness of wavelet expansion and the good behavior of sparse and regularized methods. A comparison study is performed between the two-steps approach (wavelet thresholding and regression) and the one-step approach (selection of wavelet coefficients with a sparse regression). The comparison includes two types of wavelet bases, various thresholding methods, and various regression methods and is evaluated by calculating prediction performances. Information about the location of the most important features on the spectra was also obtained and used to identify the most relevant metabolites involved in the mice poisoning.     

Wavelet Estimator in Nonparametric Regression Model with Dependent Error’s Structure

In this article, we consider a nonparametric regression model with replicated observations based on the dependent error’s structure, for exhibiting dependence among the units. The wavelet procedures are developed to estimate the regression function. The moment consistency, the strong consistency, strong convergence rate and asymptotic normality of wavelet estimator are established under suitable conditions. A simulation study is undertaken to assess the finite sample performance of the proposed method.     

工业取用水监测奇异数据挖掘与重构方法

提高工业取用水监测数据质量是目前国家水资源监控能力建设的重要内容,而奇异值问题已成为影响监测数据质量的关键短板。本文在解析现阶段工业取用水监测数据奇异值主要类型基础上,以国家水资源管理系统数据库中工业取用水监测数据为样本,利用小波变换模极大值模型提取工业取用水监测数据时频变化特征,并利用傅里叶函数对其残差序列进行修正,进而运用相对误差控制方法挖掘监测数据奇异值。在此基础上,采用混沌粒子群优化的最小二乘支持向量机模型重构填补奇异值数据。研究结果表明：小波变换模极大值模型能够较好地提取工业取用水监测数据序列的时频变化特征,但是同时容易导致监测数据的信息损失,利用傅里叶函数对小波变换进行残差修正则可进一步提升取用水监测数据序列的特征提取效果;以小波变换模极大值特征序列为基础,通过相对误差控制可实现对监测数据奇异值的高效挖掘;对于挖掘出的奇异值重构填补问题,可选取混沌粒子群优化的最小二乘支持向量机模型,其重构精度要优于多项式曲线拟合等传统统计学方法和普通最小二乘支持向量机模型。上述工业取用水监测数据奇异值挖掘重构策略为现阶段国家水资源监控能力建设的推进提供了重要技术方法支持。     

Adaptive density estimation: A curse of support?

This paper deals with the classical problem of density estimation on the real line. Most of the existing papers devoted to minimax properties assume that the support of the underlying density is bounded and known. But this assumption may be very difficult to handle in practice. In this work, we show that, exactly as a curse of dimensionality exists when the data lie in R^d, there exists a curse of support as well when the support of the density is infinite. As for the dimensionality problem where the rates of convergence deteriorate when the dimension grows, the minimax rates of convergence may deteriorate as well when the support becomes infinite. This problem is not purely theoretical since the simulations show that the support-dependent methods are really affected in practice by the size of the density support, or by the weight of the density tail. We propose a method based on a biorthogonal wavelet thresholding rule that is adaptive with respect to the nature of the support and the regularity of the signal, but that is also robust in practice to this curse of support. The threshold, that is proposed here, is very accurately calibrated so that the gap between optimal theoretical and practical tuning parameters is almost filled.     

股指期货信息内含股价变动信息的挖掘 ――小波框架与支持向量回归的金融建模应用

 内容提要：中国股指期货的推出指日可待，交易者多了一种投资工具的同时也带来了新的风险。建立准确的金融时间序列预测模型是逐利及避险的方法之一，一直是学者专家研究的热点。本研究结合小波转换与支持向量回归，提出一个二阶段时间序列预测模型。先以离散小波框架将预测变量分解成不同尺度的多个子序列，揭示隐藏在预测变量内的信息，再以支持向量回归为工具，以这些子序列为预测变量建构SVR模型。本研究以日经225指数开盘价为预测目标，以期货开盘价为预测变量对模型进行实证研究，结果显示，该模型的预测绩效比单纯SVR模型及随机漫步模型好。未来可尝试以不同的基底函数作进一步研究。     

Wavelet Shrinkage with Double Weibull Prior

In this article, we propose a denoising methodology in the wavelet domain based on a Bayesian hierarchical model using Double Weibull prior. We propose two estimators, one based on posterior mean (Double Weibull Wavelet Shrinker, DWWS) and the other based on larger posterior mode (DWWS-LPM), and show how to calculate them efficiently. Traditionally, mixture priors have been used for modeling sparse wavelet coefficients. The interesting feature of this article is the use of non-mixture prior. We show that the methodology provides good denoising performance, comparable even to state-of-the-art methods that use mixture priors and empirical Bayes setting of hyperparameters, which is demonstrated by extensive simulations on standardly used test functions. An application to real-word dataset is also considered.     

A New Approach for Testing Periodicity

This article describes testing for periodicity in the presence of FD processes. We propose two approaches for testing the periodicity based on Fisher's test. The first one is performed using the periodogram which has been divided into different parts. The second one is based on the discrete wavelet transform. Properties of the tests are illustrated by means of Monte Carlo simulations.     

On Wavelet Estimation of the Derivatives of a Density Based on Biased Data

Here, we consider wavelet based estimation of the derivatives of a probability density function under random sampling from a weighted distribution and extend the results regarding the asymptotic convergence rates under the i.i.d. setup studied in Prakasa Rao (1996 Rao, B. L.S. (1996). Nonparametric estimation of the derivatives of a density by the method of wavelets. Bull. Inform. Cybernat. 28:91–100. [Google Scholar]) to the biased-data setup. We compare the performance of the wavelet based estimator with that of the kernel based estimator obtained by differentiating the Efromovich (2004 Efromovich, S. (2004). Density estimation for biased data. Ann. Statist. 32:1137–1161.[Crossref], [Web of Science ®] , [Google Scholar]) kernel density estimator through a simulation study.     

Wavelet density estimation for stratified size-biased sample

In this paper we consider the estimation of a density function on the basis of a random stratified sample from weighted distributions. We propose a linear wavelet density estimator and prove its consistency. The behavior of the proposed estimator and its smoothed versions is eventually illustrated by simulated examples and a case study involving alcohol blood level in DUI cases.