Functional data: local linear estimation of the conditional density and its application

In this paper, we introduce a new nonparametric estimation procedure of the conditional density of a scalar response variable given a random variable taking values in a semi-metric space. Under some general conditions, we establish both the pointwise and the uniform almost-complete consistencies with convergence rates of the conditional density estimator related to this estimation procedure. Moreover, we give some particular cases of our results which can also be considered as novel in the finite-dimensional setting. Notice also that the results of this paper are used to derive some asymptotic properties of the local linear estimator of the conditional mode.     

Rate of uniform consistency for nonparametric estimates with functional variables

In this paper we investigate nonparametric estimation of some functionals of the conditional distribution of a scalar response variable Y given a random variable X taking values in a semi-metric space. These functionals include the regression function, the conditional cumulative distribution, the conditional density and some other ones. The literature on nonparametric functional statistics is only concerning pointwise consistency results, and our main aim is to prove the uniform almost complete convergence (with rate) of the kernel estimators of these nonparametric models. Unlike in standard multivariate cases, the gap between pointwise and uniform results is not immediate. So, suitable topological considerations are needed, implying changes in the rates of convergence which are quantified by entropy considerations. These theoretical uniform consistency results are (or will be) key tools for many further developments in functional data analysis.     

Local linear estimation of a generalized regression function with functional dependent data

This work deals with a local linear non parametric estimation of the generalized regression function in the case of a scalar response variable given a random variable taking values in a semimetric space. The rates of pointwise and uniform almost complete convergence are established for the studied estimator when the sample is an α-mixing sequence. Two real datasets are used to illustrate the performance of a studied estimator with respect to the kernel method.     

Rate of uniform consistency for a class of mode regression on functional stationary ergodic data

The aim of this paper is to study the asymptotic properties of a class of kernel conditional mode estimates whenever functional stationary ergodic data are considered. To be more precise on the matter, in the ergodic data setting, we consider a random elements (X, Z) taking values in some semi-metric abstract space \(E\times F\). For a real function \(\varphi \) defined on the space F and \(x\in E\), we consider the conditional mode of the real random variable \(\varphi (Z)\) given the event “\(X=x\)”. While estimating the conditional mode function, say \(\theta _\varphi (x)\), using the well-known kernel estimator, we establish the strong consistency with rate of this estimate uniformly over Vapnik–Chervonenkis classes of functions \(\varphi \). Notice that the ergodic setting offers a more general framework than the usual mixing structure. Two applications to energy data are provided to illustrate some examples of the proposed approach in time series forecasting framework. The first one consists in forecasting the daily peak of electricity demand in France (measured in Giga-Watt). Whereas the second one deals with the short-term forecasting of the electrical energy (measured in Giga-Watt per Hour) that may be consumed over some time intervals that cover the peak demand.     

Estimation and simulation of conditional hazard function in the quasi-associated framework when the observations are linked via a functional single-index structure

We consider the estimation of the conditional hazard function of a scalar response variable Y given a Hilbertian random variable X when the observations are linked via a single-index structure in the quasi-associated framework. We establish the pointwise almost complete convergence and the uniform almost complete convergence (with the rate) of the estimate of this model. A simulation is given to illustrate the good behavior in the practice of our methodology.     

Pointwise and uniform convergence of multivariate kernel density estimators using random bandwidths

We obtain the rates of pointwise and uniform convergence of multivariate kernel density estimators using a random bandwidth vector obtained by some data-based algorithm. We are able to obtain faster rate for pointwise convergence. The uniform convergence rate is obtained under some moment condition on the marginal distribution. The rates are obtained under i.i.d. and strongly mixing type dependence assumptions.     

The conditional cumulative distribution function in single functional index model

ABSTRACT

We consider the estimation of the conditional cumulative distribution function of a scalar response variable Y given a Hilbertian random variable X when the observations are linked via a single-index structure. We establish the pointwise and the uniform almost complete convergence (with the rate) of the kernel estimate of this model. As an application, we show how our result can be applied in the prediction problem via the conditional median estimate. Also, the choice of the functional index via the cross-validation procedure is also discussed but not attacked.     

Consistency of the Generalized MLE with Interval-Censored and Masked Competing Risks Data

We consider nonparametric estimation based on interval-censored competing risks data with masked failure cause. The generalized maximum likelihood estimator of the joint survival function of the failure time and the failure cause is studied under mixed case interval censorship and random partition masking. Strong consistency in the L ₁(μ)-topology is established for some finite measure μ which is derived from the joint censoring and masking distribution. Under additional regularity assumptions we also establish the strong consistencies in the topologies of weak convergence, point-wise convergence, and uniform convergence.     

Consistency of the kernel density estimator: a survey

Various consistency proofs for the kernel density estimator have been developed over the last few decades. Important milestones are the pointwise consistency and almost sure uniform convergence with a fixed bandwidth on the one hand and the rate of convergence with a fixed or even a variable bandwidth on the other hand. While considering global properties of the empirical distribution functions is sufficient for strong consistency, proofs of exact convergence rates use deeper information about the underlying empirical processes. A unifying character, however, is that earlier and more recent proofs use bounds on the probability that a sum of random variables deviates from its mean.     

Asymptotic properties for estimates of nonparametric regression model with martingale difference errors

Consider the nonparametric regression model with martingale difference errors. Nonparametric estimator g _n (x) of regression function g(x) will be introduced, and its asymptotic properties are studied. In particular, the pointwise and uniform convergence of g _n (x) and its asymptotic normality will be investigated. This extends the earlier work on independent random errors.     

Properties of occurrence-exposure rate processes in multiple decrement theory

In a basic multiple decrement model empirical occurrence-exposure rates are defined for each of k risks to which a cohort from an animal or human population is exposed over a time interval. These rates are viewed as the evolution of a stochastic process. Some asymptotic properties of this process are considered. Weak convergence of the process and its uniform strong convergence are shown under mild conditions.     

Shrinkage estimation of varying covariate effects based on quantile regression

Varying covariate effects often manifest meaningful heterogeneity in covariate-response associations. In this paper, we adopt a quantile regression model that assumes linearity at a continuous range of quantile levels as a tool to explore such data dynamics. The consideration of potential non-constancy of covariate effects necessitates a new perspective for variable selection, which, under the assumed quantile regression model, is to retain variables that have effects on all quantiles of interest as well as those that influence only part of quantiles considered. Current work on l ₁-penalized quantile regression either does not concern varying covariate effects or may not produce consistent variable selection in the presence of covariates with partial effects, a practical scenario of interest. In this work, we propose a shrinkage approach by adopting a novel uniform adaptive LASSO penalty. The new approach enjoys easy implementation without requiring smoothing. Moreover, it can consistently identify the true model (uniformly across quantiles) and achieve the oracle estimation efficiency. We further extend the proposed shrinkage method to the case where responses are subject to random right censoring. Numerical studies confirm the theoretical results and support the utility of our proposals.     

Average Collapsibility of Distribution Dependence and Quantile Regression Coefficients

Abstract. The Yule–Simpson paradox notes that an association between random variables can be reversed when averaged over a background variable. Cox and Wermuth introduced the concept of distribution dependence between two random variables X and Y, and gave two dependence conditions, each of which guarantees that reversal of qualitatively similar conditional dependences cannot occur after marginalizing over the background variable. Ma, Xie and Geng studied the uniform collapsibility of distribution dependence over a background variable W, under stronger homogeneity condition. Collapsibility ensures that associations are the same for conditional and marginal models. In this article, we use the notion of average collapsibility, which requires only the conditional effects average over the background variable to the corresponding marginal effect and investigate its conditions for distribution dependence and for quantile regression coefficients.     

Asymptotic Normality for Regression Function Estimate Under Truncation and α-Mixing Conditions

In this article we establish pointwise asymptotic normality of nonparametric kernel estimator of regression function for a left truncation model. It is assumed that the lifetime observations with multivariate covariates form a stationary α-mixing sequence. Also, the asymptotic normality of the estimation of the covariable's density is considered. As a by-product, we obtain a uniform weak convergence rate for the product-limit estimator of the lifetime and truncated distributions under dependence, which is interesting independently. Finite sample behavior of the estimator of the regression function is investigated as well.     

Regression operator estimation by delta-sequences method for functional data and its applications

In this paper, we introduce a somewhat more general class of nonparametric estimators (delta-sequences estimators) for estimating an unknown regression operator from noisy data. The regressor is assumed to take values in an infinite-dimensional separable Banach space, when the response variable is a scalar. Under some general conditions, we establish the uniform almost-complete convergence with the rates of these estimators. Moreover, we give some particular cases of our results, which can also be considered as novel in the finite-dimensional setting. Moreover, after giving some examples of the impact of our results, we show how to use them in some statistical applications (prediction procedure and curve discrimination).     

The kernel regression estimation for randomly censored functional stationary ergodic data

In this paper, we investigate the asymptotic properties of the kernel estimator for non parametric regression operator when the functional stationary ergodic data with randomly censorship are considered. More precisely, we introduce the kernel-type estimator of the non parametric regression operator with the responses randomly censored and obtain the almost surely convergence with rate as well as the asymptotic normality of the estimator. As an application, the asymptotic (1 ? ζ) confidence interval of the regression operator is also presented (0 < ζ < 1). Finally, the simulation study is carried out to show the finite-sample performances of the estimator.     

Additive Regression Model for Continuous Time Processes

In the setting of additive regression model for continuous time process, we establish the optimal uniform convergence rates and optimal asymptotic quadratic error of additive regression. To build our estimate, we use the marginal integration method.     

On the pointwise mean squared error of a multidimensional term-by-term thresholding wavelet estimator

In this paper we provide a theoretical contribution to the pointwise mean squared error of an adaptive multidimensional term-by-term thresholding wavelet estimator. A general result exhibiting fast rates of convergence under mild assumptions on the model is proved. It can be applied for a wide range of non parametric models including possible dependent observations. We give applications of this result for the non parametric regression function estimation problem (with random design) and the conditional density estimation problem.     

Optimal global rates of convergence for nonparametric regression with unbounded data

Estimation of regression functions from independent and identically distributed data is considered. The _L2$L_2$ error with integration with respect to the design measure is used as an error criterion. Usually in the analysis of the rate of convergence of estimates a boundedness assumption on the explanatory variable X$X$ is made besides smoothness assumptions on the regression function and moment conditions on the response variable Y$Y$. In this article we consider the kernel estimate and show that by replacing the boundedness assumption on X$X$ by a proper moment condition the same (optimal) rate of convergence can be shown as for bounded data. This answers Question 1 in Stone [1982. Optimal global rates of convergence for nonparametric regression. Ann. Statist., 10, 1040–1053].     

A note on variable selection in functional regression via random subspace method

Variable selection problem is one of the most important tasks in regression analysis, especially in a high-dimensional setting. In this paper, we study this problem in the context of scalar response functional regression model, which is a linear model with scalar response and functional regressors. The functional model can be represented by certain multiple linear regression model via basis expansions of functional variables. Based on this model and random subspace method of Mielniczuk and Teisseyre (Comput Stat Data Anal 71:725–742, 2014), two simple variable selection procedures for scalar response functional regression model are proposed. The final functional model is selected by using generalized information criteria. Monte Carlo simulation studies conducted and a real data example show very satisfactory performance of new variable selection methods under finite samples. Moreover, they suggest that considered procedures outperform solutions found in the literature in terms of correctly selected model, false discovery rate control and prediction error.