Non-parametric estimation of the long-range dependence exponent for Gaussian processes

We consider a class of long-range-dependent Gaussian processes defined in a semiparametric framework. We propose a new estimator of the long-range dependence parameter, based on the integration of the periodogram in two windows. We show that it is asymptotically Gaussian and calculate the rate of convergence. We optimise parameters defining the window function for the minimum mean-square-error criterion. In a Monte-Carlo study, we compare the proposed estimator with previously studied estimators.     

Estimation of slowly time-varying trend function in long memory regression models

ABSTRACT

We study the asymptotic properties of the least-squares estimator for the trend function of a particular class of locally stationary models, which are defined by considering a smooth variation of the trend function. Additionally, errors are assumed to be realizations from a long-range dependent stationary Gaussian process. Our findings are then illustrated through Monte Carlo simulations.     

A statistical test for the hypothesis of Gaussian random function

A Gaussian random function is a functional version of the normal distribution. This paper proposes a statistical hypothesis test to test whether or not a random function is a Gaussian random function. A parameter that is equal to 0 under Gaussian random function is considered, and its unbiased estimator is given. The asymptotic distribution of the estimator is studied, which is used for constructing a test statistic and discussing its asymptotic power. The performance of the proposed test is investigated through several numerical simulations. An illustrative example is also presented.     

Asymptotic efficiency of model selection criteria: the nonzero mean gaussian ar(∞) case

Motivated by Shibata’s (1980) asymptotic efficiency results this paper dis-cusses the asymptotic efficiency of the order selected by a selection procedure for an infinite order autoregressive process with nonzero mean and unob servable errors that constitute a sequence of independent Gaussian random variables with mean zero and variance σ² The asymptotic efficiency is established for AIC–type selection criteria such as AIC’, FPE, and S_n(k). In addition, some asymptotic results about the estimators of the parameters of the process and the error–sequence are presented.     

Precise Asymptotics in Complete Moment Convergence of Parameter Estimator in the Gaussian Autoregressive Process

In this article, we study the precise asymptotic behaviors of the least-squares estimator in the Gaussian autoregressive process. Two kinds of complete moment convergence of this estimator can be obtained by the methods of deviation inequalities for this estimator and nonuniform Berry-Esseen bound for martingales.     

Large Deviations Limit Theorems for the Kernel Density Estimator

We establish pointwise and uniform large deviations limit theorems of Chernoff-type for the non-parametric kernel density estimator based on a sequence of independent and identically distributed random variables. The limits are well-identified and depend upon the underlying kernel and density function. We derive then some implications of our results in the study of asymptotic efficiency of the goodness-of-fit test based on the maximal deviation of the kernel density estimator as well as the inaccuracy rate of this estimate     

Local Estimation of the Conditional Stable Tail Dependence Function

We consider the local estimation of the stable tail dependence function when a random covariate is observed together with the variables of main interest. Our estimator is a weighted version of the empirical estimator adapted to the covariate framework. We provide the main asymptotic properties of our estimator, when properly normalized, in particular the convergence of the empirical process towards a tight centred Gaussian process. The finite sample performance of our estimator is illustrated on a small simulation study and on a dataset of air pollution measurements.     

Semiparametric Approach to a Random Effects Quantile Regression Model

We consider a random effects quantile regression analysis of clustered data and propose a semiparametric approach using empirical likelihood. The random regression coefficients are assumed independent with a common mean, following parametrically specified distributions. The common mean corresponds to the population-average effects of explanatory variables on the conditional quantile of interest, while the random coefficients represent cluster specific deviations in the covariate effects. We formulate the estimation of the random coefficients as an estimating equations problem and use empirical likelihood to incorporate the parametric likelihood of the random coefficients. A likelihood-like statistical criterion function is yield, which we show is asymptotically concave in a neighborhood of the true parameter value and motivates its maximizer as a natural estimator. We use Markov Chain Monte Carlo (MCMC) samplers in the Bayesian framework, and propose the resulting quasi-posterior mean as an estimator. We show that the proposed estimator of the population-level parameter is asymptotically normal and the estimators of the random coefficients are shrunk toward the population-level parameter in the first order asymptotic sense. These asymptotic results do not require Gaussian random effects, and the empirical likelihood based likelihood-like criterion function is free of parameters related to the error densities. This makes the proposed approach both flexible and computationally simple. We illustrate the methodology with two real data examples.     

Nonparametric estimation of the conditional distribution function in a semiparametric censorship model

In this paper we propose a new nonparametric estimator of the conditional distribution function under a semiparametric censorship model. We establish an asymptotic representation of the estimator as a sum of iid random variables, balanced by some kernel weights. This representation is used for obtaining large sample results such as the rate of uniform convergence of the estimator, or its limit distributional law. We prove that the new estimator outperforms the conditional Kaplan–Meier estimator for censored data, in the sense that it exhibits lower asymptotic variance. Illustration through real data analysis is provided.     

Lack-of-fit testing of a regression model with response missing at random

This paper proposes a class of lack-of-fit tests for fitting a linear regression model when some response variables are missing at random. These tests are based on a class of minimum integrated square distances between a kernel type estimator of a regression function and the parametric regression function being fitted. These tests are shown to be consistent against a large class of fixed alternatives. The corresponding test statistics are shown to have asymptotic normal distributions under null hypothesis and a class of nonparametric local alternatives. Some simulation results are also presented.     

ON THE EFFICIENCY OF THE QUASI-LIKELIHOOD ESTIMATORS FOR EXPONENTIAL FAMILIES WITH EXTRA VARIATION

Bounds are obtained for the asymptotic efficiency of the quasi-likelihood estimator relative to the likelihood estimators for exponential families with random variables in the exponent. We conclude that the quasi-likelihood is very efficient in the Poisson case for small means or small extra variation.     

Ordinary and weighted least-squares estimators

We propose a method of estimating the asymptotic relative efficiency (ARE) of the weighted least-squares estimator (WLSE) with respect to the ordinary least-squares estimator (OLSE) in a heteroscedastic linear regression model with a large number of observations but a small number of replicates at each value of the regressors. The weights used in the WLSE are the reciprocals of the (within-group) average of squared residuals. It is shown that the OLSE is more efficient than the WLSE if the maximum number of replicates is not larger than two. The proposed estimator of the ARE is consistent as the number of observations tends to infinity. Finite-sample performance of this estimator is examined in a simulation study. An adaptive estimator, which is asymptotically more efficient than the OLSE and the WLSE, is proposed.     

Improved precision in the analysis of randomized trials with survival outcomes,without assuming proportional hazards

We present a new estimator of the restricted mean survival time in randomized trials where there is right censoring that may depend on treatment and baseline variables. The proposed estimator leverages prognostic baseline variables to obtain equal or better asymptotic precision compared to traditional estimators. Under regularity conditions and random censoring within strata of treatment and baseline variables, the proposed estimator has the following features: (i) it is interpretable under violations of the proportional hazards assumption; (ii) it is consistent and at least as precise as the Kaplan–Meier and inverse probability weighted estimators, under identifiability conditions; (iii) it remains consistent under violations of independent censoring (unlike the Kaplan–Meier estimator) when either the censoring or survival distributions, conditional on covariates, are estimated consistently; and (iv) it achieves the nonparametric efficiency bound when both of these distributions are consistently estimated. We illustrate the performance of our method using simulations based on resampling data from a completed, phase 3 randomized clinical trial of a new surgical treatment for stroke; the proposed estimator achieves a 12% gain in relative efficiency compared to the Kaplan–Meier estimator. The proposed estimator has potential advantages over existing approaches for randomized trials with time-to-event outcomes, since existing methods either rely on model assumptions that are untenable in many applications, or lack some of the efficiency and consistency properties (i)–(iv). We focus on estimation of the restricted mean survival time, but our methods may be adapted to estimate any treatment effect measure defined as a smooth contrast between the survival curves for each study arm. We provide R code to implement the estimator.

     

OPTIMAL IV ESTIMATION OF SYSTEMS WITH STOCHASTIC REGRESSORS AND VAR DISTURBANCES WITH APPLICATIONS TO DYNAMIC SYSTEMS

This paper considers the general problem of Feasible Generalized Least Squares Instrumental Variables (FGLS IV) estimation using optimal instruments. First we summarize the sufficient conditions for the FGLS IV estimator to be asymptotically equivalent to an optimal GLS IV estimator. Then we specialize to stationary dynamic systems with stationary VAR errors, and use the sufficient conditions to derive new moment conditions for these models. These moment conditions produce useful IVs from the lagged endogenous variables, despite the correlation between errors and endogenous variables. This use of the information contained in the lagged endogenous variables expands the class of IV estimators under consideration and thereby potentially improves both asymptotic and small-sample efficiency of the optimal IV estimator in the class. Some Monte Carlo experiments compare the new methods with those of Hatanaka (1976). For the DGP used in the Monte Carlo experiments, asymptotic efficiency is strictly improved by the new IVs, and experimental small-sample efficiency is improved as well.     

OPTIMAL IV ESTIMATION OF SYSTEMS WITH STOCHASTIC REGRESSORS AND VAR DISTURBANCES WITH APPLICATIONS TO DYNAMIC SYSTEMS

This paper considers the general problem of Feasible Generalized Least Squares Instrumental Variables (FGLS IV) estimation using optimal instruments. First we summarize the sufficient conditions for the FGLS IV estimator to be asymptotically equivalent to an optimal GLS IV estimator. Then we specialize to stationary dynamic systems with stationary VAR errors, and use the sufficient conditions to derive new moment conditions for these models. These moment conditions produce useful IVs from the lagged endogenous variables, despite the correlation between errors and endogenous variables. This use of the information contained in the lagged endogenous variables expands the class of IV estimators under consideration and thereby potentially improves both asymptotic and small-sample efficiency of the optimal IV estimator in the class. Some Monte Carlo experiments compare the new methods with those of Hatanaka (1976). For the DGP used in the Monte Carlo experiments, asymptotic efficiency is strictly improved by the new IVs, and experimental small-sample efficiency is improved as well.     

Asymptotic and Bootstrap Inference for AR(∞) Processes with Conditional Heteroskedasticity

The main contribution of this paper is a proof of the asymptotic validity of the application of the bootstrap to AR(∞) processes with unmodelled conditional heteroskedasticity. We first derive the asymptotic properties of the least-squares estimator of the autoregressive sieve parameters when the data are generated by a stationary linear process with martingale difference errors that are possibly subject to conditional heteroskedasticity of unknown form. These results are then used in establishing that a suitably constructed bootstrap estimator will have the same limit distribution as the least-squares estimator. Our results provide theoretical justification for the use of either the conventional asymptotic approximation based on robust standard errors or the bootstrap approximation of the distribution of autoregressive parameters. A simulation study suggests that the bootstrap approach tends to be more accurate in small samples.     

LOCAL POLYNOMIAL QUASI-LIKELIHOOD REGRESSION ON RANDOM FIELDS

In this paper, local quasi‐likelihood regression is considered for stationary random fields of dependent variables. In the case of independent data, local polynomial quasi‐likelihood regression is known to have several appealing features such as minimax efficiency, design adaptivity and good boundary behaviour. These properties are shown to carry over to the case of random fields. The asymptotic normality of the regression estimator is established and explicit formulae for its asymptotic bias and variance are derived for strongly mixing stationary random fields. The extension to multi‐dimensional covariates is also provided in full generality. Moreover, evaluation of the finite sample performance is made through a simulation study.     

A unified approach to regression analysis under double-sampling designs

We propose a unified approach to the estimation of regression parameters under double-sampling designs, in which a primary sample consisting of data on the rough or proxy measures for the response and/or explanatory variables as well as a validation subsample consisting of data on the exact measurements are available. We assume that the validation sample is a simple random subsample from the primary sample. Our proposal utilizes a specific parametric model to extract the partial information contained in the primary sample. The resulting estimator is consistent even if such a model is misspecified, and it achieves higher asymptotic efficiency than the estimator based only on the validation data. Specific cases are discussed to illustrate the application of the estimator proposed.     

Lifetime estimation from doubly censored data and dirichlet process prior knowledge on the observable random vector

The purpose of this paper is to present a nonparametric Bayesian procedure for estimating a survival curve in a double censoring situation. Assuming a proportional hazard rates model, we propose a consistent estimation of lifetime, based on a Dirichlet process prior knowledge on the observable random vector. Some large sample properties of this estimator are also derived, We prove strong consistency and asymptotic weak convergence to a Gaussian pro cess. Finally, a simulation study is presented in order to analyze the behavior of the proposed estimator, and establish some comparisons to other estimators.     

Efficient Estimation in Heteroscedastic Partially Linear Varying Coefficient Models

This article considers statistical inference for the heteroscedastic partially linear varying coefficient models. We construct an efficient estimator for the parametric component by applying the weighted profile least-squares approach, and show that it is semiparametrically efficient in the sense that the inverse of the asymptotic variance of the estimator reaches the semiparametric efficiency bound. Simulation studies are conducted to illustrate the performance of the proposed method.