On the asymptotic behaviour of the recursive Nadaraya–Watson estimator associated with the recursive sliced inverse regression method

We investigate the asymptotic behaviour of the recursive Nadaraya–Watson estimator for the estimation of the regression function in a semiparametric regression model. On the one hand, we make use of the recursive version of the sliced inverse regression method for the estimation of the unknown parameter of the model. On the other hand, we implement a recursive Nadaraya–Watson procedure for the estimation of the regression function which takes into account the previous estimation of the parameter of the semiparametric regression model. We establish the almost sure convergence as well as the asymptotic normality for our Nadaraya–Watson estimate. We also illustrate our semiparametric estimation procedure on simulated data.     

Non parametric regression analysis for longitudinal data with time-depending autoregressive error process

This paper considers a non parametric longitudinal model, where the within-subject correlation structure is represented by a time-depending autoregressive error process. An initial estimator without taking into account the within-subject correlation is obtained to fit the time-depending autoregressive error process. With the initial estimator, we construct a two-stage local linear estimator of the mean function. According to the asymptotic normality of the initial and two-stage estimators, it is discovered that the two-stage estimator has a smaller asymptotic variance. The simulation results show us that the two-stage estimation has some good properties. The analysis of a data set demonstrates its application.     

Functional data analysis: estimation of the relative error in functional regression under random left-truncation model

In this paper, we investigate the relationship between a functional random covariable and a scalar response which is subject to left-truncation by another random variable. Precisely, we use the mean squared relative error as a loss function to construct a nonparametric estimator of the regression operator of these functional truncated data. Under some standard assumptions in functional data analysis, we establish the almost sure consistency, with rates, of the constructed estimator as well as its asymptotic normality. Then, a simulation study, on finite-sized samples, was carried out in order to show the efficiency of our estimation procedure and to highlight its superiority over the classical kernel estimation, for different levels of simulated truncated data.     

Estimation of causal continuous‐time autoregressive moving average random fields

We estimate model parameters of Lévy‐driven causal continuous‐time autoregressive moving average random fields by fitting the empirical variogram to the theoretical counterpart using a weighted least squares (WLS) approach. Subsequent to deriving asymptotic results for the variogram estimator, we show strong consistency and asymptotic normality of the parameter estimator. Furthermore, we conduct a simulation study to assess the quality of the WLS estimator for finite samples. For the simulation, we utilize numerical approximation schemes based on truncation and discretization of stochastic integrals and we analyze the associated simulation errors in detail. Finally, we apply our results to real data of the cosmic microwave background.     

Large sample behavior of the Bernstein copula estimator

Bernstein polynomial estimators have been used as smooth estimators for density functions and distribution functions. The idea of using them for copula estimation has been given in Sancetta and Satchell (2004). In the present paper we study the asymptotic properties of this estimator: almost sure consistency rates and asymptotic normality. We also obtain explicit expressions for the asymptotic bias and asymptotic variance and show the improvement of the asymptotic mean squared error compared to that of the classical empirical copula estimator. A small simulation study illustrates this superior behavior in small samples.     

Varying kernel marginal density estimator for a positive time series

This paper analyses the large sample behaviour of a varying kernel density estimator of the marginal density of a non-negative stationary and ergodic time series that is also strongly mixing. In particular we obtain an approximation for bias, mean square error and establish asymptotic normality of this density estimator. We also derive an almost sure uniform consistency rate over bounded intervals of this estimator. A finite sample simulation shows some superiority of the proposed density estimator over the one based on a symmetric kernel.     

Statistic inference for a single-index ARCH-M model

For a single-index autoregressive conditional heteroscedastic (ARCH-M) model, estimators of the parametric and non parametric components are proposed by the profile likelihood method. The research results had shown that all the estimators have consistency and the parametric estimators have asymptotic normality. We extend this line of research by deriving the asymptotic normality of the non parametric estimator. Based on the asymptotic properties, we propose Wald statistic and generalized likelihood ratio statistic to investigate the testing problems for ARCH effect and goodness of fit, respectively. A simulation study is conducted to evaluate the finite-sample performance of the proposed estimation methodology and testing procedure.     

On Estimating the Integrated Co-Volatility Using Noisy High-Frequency Data with Jumps

In this article, we consider the estimation of covariation of two asset prices which contain jumps and microstructure noise, based on high-frequency data. We propose a realized covariance estimator, which combines pre-averaging method to remove the microstructure noise and the threshold method to reduce the jumps effect. The asymptotic properties, such as consistency and asymptotic normality, are investigated. The estimator allows very general structure of jumps, for example, infinity activity or even infinity variation. Simulation is also included to illustrate the performance of the proposed procedure.     

Asymptotic results for random coefficient bifurcating autoregressive processes

The purpose of this paper is to study the asymptotic behaviour of the weighted least-squares estimators of the unknown parameters of random coefficient bifurcating autoregressive processes. Under suitable assumptions on the immigration and the inheritance, we establish the almost sure convergence of our estimators, as well as a quadratic strong law and central limit theorems. Our study mostly relies on limit theorems for vector-valued martingales.     

Conditional mode estimation for functional stationary ergodic data with responses missing at random

In this paper, we investigate the asymptotic properties of a non-parametric conditional mode estimation given a functional explanatory variable, when functional stationary ergodic data and missing at random responses are observed. First of all, we establish asymptotic properties for a conditional density estimator from which we derive almost sure convergence (with rate) and asymptotic normality of a conditional mode estimator. This new estimate take into account missing data, and a simulation study is performed to illustrate how this fact allows to get higher predictive performances than those obtained with standard estimates.     

Asymptotic and Bootstrap Inference for AR(∞) Processes with Conditional Heteroskedasticity

The main contribution of this paper is a proof of the asymptotic validity of the application of the bootstrap to AR(∞) processes with unmodelled conditional heteroskedasticity. We first derive the asymptotic properties of the least-squares estimator of the autoregressive sieve parameters when the data are generated by a stationary linear process with martingale difference errors that are possibly subject to conditional heteroskedasticity of unknown form. These results are then used in establishing that a suitably constructed bootstrap estimator will have the same limit distribution as the least-squares estimator. Our results provide theoretical justification for the use of either the conventional asymptotic approximation based on robust standard errors or the bootstrap approximation of the distribution of autoregressive parameters. A simulation study suggests that the bootstrap approach tends to be more accurate in small samples.     

Asymptotic and Bootstrap Inference for AR(∞) Processes with Conditional Heteroskedasticity

The main contribution of this paper is a proof of the asymptotic validity of the application of the bootstrap to AR(∞) processes with unmodelled conditional heteroskedasticity. We first derive the asymptotic properties of the least-squares estimator of the autoregressive sieve parameters when the data are generated by a stationary linear process with martingale difference errors that are possibly subject to conditional heteroskedasticity of unknown form. These results are then used in establishing that a suitably constructed bootstrap estimator will have the same limit distribution as the least-squares estimator. Our results provide theoretical justification for the use of either the conventional asymptotic approximation based on robust standard errors or the bootstrap approximation of the distribution of autoregressive parameters. A simulation study suggests that the bootstrap approach tends to be more accurate in small samples.     

Variable selection in joint mean and variance models of Box–Cox transformation

In many applications, a single Box–Cox transformation cannot necessarily produce the normality, constancy of variance and linearity of systematic effects. In this paper, by establishing a heterogeneous linear regression model for the Box–Cox transformed response, we propose a hybrid strategy, in which variable selection is employed to reduce the dimension of the explanatory variables in joint mean and variance models, and Box–Cox transformation is made to remedy the response. We propose a unified procedure which can simultaneously select significant variables in the joint mean and variance models of Box–Cox transformation which provide a useful extension of the ordinary normal linear regression models. With appropriate choice of the tuning parameters, we establish the consistency of this procedure and the oracle property of the obtained estimators. Moreover, we also consider the maximum profile likelihood estimator of the Box–Cox transformation parameter. Simulation studies and a real example are used to illustrate the application of the proposed methods.     

On the Estimation of the Density of a Directional Data Stream

Many directional data such as wind directions can be collected extremely easily so that experiments typically yield a huge number of data points that are sequentially collected. To deal with such big data, the traditional nonparametric techniques rapidly require a lot of time to be computed and therefore become useless in practice if real time or online forecasts are expected. In this paper, we propose a recursive kernel density estimator for directional data which (i) can be updated extremely easily when a new set of observations is available and (ii) keeps asymptotically the nice features of the traditional kernel density estimator. Our methodology is based on Robbins–Monro stochastic approximations ideas. We show that our estimator outperforms the traditional techniques in terms of computational time while being extremely competitive in terms of efficiency with respect to its competitors in the sequential context considered here. We obtain expressions for its asymptotic bias and variance together with an almost sure convergence rate and an asymptotic normality result. Our technique is illustrated on a wind dataset collected in Spain. A Monte‐Carlo study confirms the nice properties of our recursive estimator with respect to its non‐recursive counterpart.     

Bootstrapping quantiles in a fixed design regression model with censored data

We consider the problem of estimating the quantiles of a distribution function in a fixed design regression model in which the observations are subject to random right censoring. The quantile estimator is defined via a conditional Kaplan-Meier type estimator for the distribution at a given design point. We establish an a.s. asymptotic representation for this quantile estimator, from which we obtain its asymptotic normality. Because a complicated estimation procedure is necessary for estimating the asymptotic bias and variance, we use a resampling procedure, which provides us, via an asymptotic representation for the bootstrapped estimator, with an alternative for the normal approximation.     

Improved estimation for Poisson INAR(1) models

We consider the first-order Poisson autoregressive model proposed by McKenzie [Some simple models for discrete variate time series. Water Resour Bull. 1985;21:645–650] and Al-Osh and Alzaid [First-order integer valued autoregressive (INAR(1)) process. J Time Ser Anal. 1987;8:261–275], which may be suitable in situations where the time series data are non-negative and integer valued. We derive the second-order bias of the squared difference estimator [Weiß. Process capability analysis for serially dependent processes of Poisson counts. J Stat Comput Simul. 2012;82:383–404] for one of the parameters and show that this bias can be used to define a bias-reduced estimator. The behaviour of a modified conditional least-squares estimator is also studied. Furthermore, we access the asymptotic properties of the estimators here discussed. We present numerical evidence, based upon Monte Carlo simulation studies, showing that the here proposed bias-adjusted estimator outperforms the other estimators in small samples. We also present an application to a real data set.     

A modified kernel quantile estimator under censoring

Based on right-censored data from a lifetime distribution F₀, a modification of the kernel quantile estimator is proposed. The advantage of this estimator is that the data play a role in the degree of smoothing of the estimator while retaining the desirable features of the kernel estimator. Convergence in probability and almost sure convergence of the estimator are discussed. Also, asymptotic normality and confidence bands are presented and some examples are given.     

A general quantile residual life model for length‐biased right‐censored data

The quantile residual lifetime function provides comprehensive quantitative measures for residual life, especially when the distribution of the latter is skewed or heavy‐tailed and/or when the data contain outliers. In this paper, we propose a general class of semiparametric quantile residual life models for length‐biased right‐censored data. We use the inverse probability weighted method to correct the bias due to length‐biased sampling and informative censoring. Two estimating equations corresponding to the quantile regressions are constructed in two separate steps to obtain an efficient estimator. Consistency and asymptotic normality of the estimator are established. The main difficulty in implementing our proposed method is that the estimating equations associated with the quantiles are nondifferentiable, and we apply the majorize–minimize algorithm and estimate the asymptotic covariance using an efficient resampling method. We use simulation studies to evaluate the proposed method and illustrate its application by a real‐data example.     

Efficient Inference for Longitudinal Data Varying‐coefficient Regression Models

Informative identification of the within‐subject correlation is essential in longitudinal studies in order to forecast the trajectory of each subject and improve the validity of inferences. In this paper, we fit this correlation structure by employing a time adaptive autoregressive error process. Such a process can automatically accommodate irregular and possibly subject‐specific observations. Based on the fitted correlation structure, we propose an efficient two‐stage estimator of the unknown coefficient functions by using a local polynomial approximation. This procedure does not involve within‐subject covariance matrices and hence circumvents the instability of calculating their inverses. The asymptotic normality of resulting estimators is established. Numerical experiments were conducted to check the finite sample performance of our method and an example of an application involving a set of medical data is also illustrated.