A robust nonparametric estimation of the autoregression function under an ergodic hypothesis

The authors propose a family of robust nonparametric estimators for regression or autoregression functions based on kernel methods. They show the strong uniform consistency of these estimators under a general ergodicity condition when the data are unbounded and range over suitably increasing sequences of compact sets. They give some implications of these results for stating the prediction in Markovian processes with finite order and show, through simulation, the efficiency of the predictors they propose.     

Nonparametric regression for threshold data

Consider a detector which records the times at which the endogenous variable of a nonparametric regression model exceeds a certain threshold. If the error distribution is known, the regression function can still be identified from these threshold data. The author constructs estimators for the regression function that are transformations of kernel estimators. She determines the bandwidth that minimizes the asymptotic mean average squared error. Her investigation was motivated by recent work on stochastic resonance in neuroscience and signal detection theory, where it was observed that detection of a subthreshold signal is enhanced by the addition of noise. The author compares her model with several others that have been proposed in the recent past.     

ESTIMATION FOR THE GENERAL SAMPLE SELECTION MODELS

Consider a general regression model with an arbitrary and unknown link function and a stochastic selection variable that determines whether the outcome variable is observable or missing. The paper proposes U-statistics that are based on kernel functions as estimators for the directions of the parameter vectors in the link function and the selection equation, and shows that these estimators are consistent and asymptotically normal.     

Simple Transformation Techniques for Improved Non-parametric Regression

We propose and investigate two new methods for achieving less bias in non- parametric regression. We show that the new methods have bias of order h ⁴, where h is a smoothing parameter, in contrast to the basic kernel estimator's order h ². The methods are conceptually very simple. At the first stage, perform an ordinary non-parametric regression on { x_i , Y_i } to obtain m^ ( x_i ) (we use local linear fitting). In the first method, at the second stage, repeat the non-parametric regression but on the transformed dataset { m^ ( x_i , Y_i )}, taking the estimator at x to be this second stage estimator at m^ ( x ). In the second, and more appealing, method, again perform non-parametric regression on { m^ ( x_i , Y_i )}, but this time make the kernel weights depend on the original x scale rather than using the m^ ( x ) scale. We concentrate more of our effort in this paper on the latter because of its advantages over the former. Our emphasis is largely theoretical, but we also show that the latter method has practical potential through some simulated examples.     

A Note on the Predictors of Differenced Sequences

In this note we consider the problems of optimal linear prediction (o.l.p.) and the minimum mean squared error prediction (m.m.s.e.p.) of a sequence X_t, which fits to a stationary and invertible ARMA model through the filter (1 - B^s)^d X_t= Y_t. It is shown that these two predictors are not identical in general from the theoretical point of view. Permitting the degree of differencing d to take any real value, a set of conditions for these commonly applied prediction formulas to be identical is given.     

LOCAL POLYNOMIAL QUASI-LIKELIHOOD REGRESSION ON RANDOM FIELDS

In this paper, local quasi‐likelihood regression is considered for stationary random fields of dependent variables. In the case of independent data, local polynomial quasi‐likelihood regression is known to have several appealing features such as minimax efficiency, design adaptivity and good boundary behaviour. These properties are shown to carry over to the case of random fields. The asymptotic normality of the regression estimator is established and explicit formulae for its asymptotic bias and variance are derived for strongly mixing stationary random fields. The extension to multi‐dimensional covariates is also provided in full generality. Moreover, evaluation of the finite sample performance is made through a simulation study.     

On independence of Markov kernels and a generalization of two theorems of Basu

Markov kernels play an important role in probability theory and mathematical statistics, conditional distributions being the main example.     

Nonparametric estimation of the hazard function under dependence conditions

The estimation of the hazard rate has a great number of practical appli¬cations in dependence situations (seismicity analysis, reliability, economics), Based on kernel estimates of the density and the distribution function, we study the properties of the nonparametric estimator of the hazard function as-sociated with a strongly mixing time series. We prove consistency and asymp¬totic normality properties, and a cross-validation method for the smoothing parameter selection is studied. Some simulations and a practical application to real data are also shown.     

Smooth nonparametric estimation of thedistribution and density functions from record-breaking data

In some experiments, such as destructive stress testing and industrial quality control experiments, only values smaller than all previous ones are observed. Here, for such record-breaking data, kernel estimation of the cumulative distribution function and smooth density estimation is considered. For a single record-breaking sample, consistent estimation is not possible, and replication is required for global results. For m independent record-breaking samples, the proposed distribution function and density estimators are shown to be strongly consistent and asymptotically normal as m → ∞. Also, for small m, the mean squared errors and biases of the estimators and their smoothing parameters are investigated through computer simulations.