Weak consistency of M-estimator in linear regression model with asymptotically almost negatively associated errors

Abstract

This paper studies a linear regression model with asymptotically almost negatively associated (AANA, in short) random errors. Under some mild conditions, the weak consistency of M-estimator of the unknown parameter is investigated, which extend the corresponding results for independent random errors and negatively associated (NA, in short) random errors. At last, two simulation examples are presented to verify the weak consistency of M-estimator in the model.     

Robust nonparametric estimation for spatial regression

In this paper, we investigate a nonparametric robust estimation for spatial regression. More precisely, given a strictly stationary random field _Zi=(_Xi,_{Yi)i∈NNN≥1}$Z_{\mathbf{i}}=(X_{\mathbf{i}},Y_{\mathbf{i}}{)}_{\mathbf{i}\in {\mathbb{N}}^{N}N\ge 1}$, we consider a family of robust nonparametric estimators for a regression function based on the kernel method. Under some general mixing assumptions, the almost complete consistency and the asymptotic normality of these estimators are obtained. A robust procedure to select the smoothing parameter adapted to the spatial data is also discussed.     

Asymptotic normality and mean consistency for the weighted estimator in nonparametric regression models

In this paper, we mainly study the asymptotic properties of weighted estimator for the nonparametric regression model based on linearly negative quadrant dependent (LNQD, for short) errors. We obtain the rate of uniformly asymptotic normality of the weighted estimator which is nearly $O\left(n^{?1∕4}\right)$ when the moment condition is appropriate. The results generalize the corresponding ones of Yang (2003) from NA samples to LNQD samples and improve or extend the corresponding one of Li et al. (2012) for LNQD samples. Moreover, we obtain some results on mean consistency, uniformly mean consistency, and the rate of mean consistency for the weighted estimator. Finally we carry out some simulations to verify the validity of our results.     

Asymptotic properties of nonparametric regression for long memory random fields

The kernel estimator of spatial regression function is investigated for stationary long memory (long range dependent) random fields observed over a finite set of spatial points. A general result on the strong consistency of the kernel density estimator is first obtained for the long memory random fields, and then, under some mild regularity assumptions, the asymptotic behaviors of the regression estimator are established. For the linear long memory random fields, a weak convergence theorem is also obtained for kernel density estimator. Finally, some related issues on the inference of long memory random fields are discussed through a simulation example.     

Using difference-based methods for inference in nonparametric regression with time series errors

Summary. We show that difference-based methods can be used to construct simple and explicit estimators of error covariance and autoregressive parameters in nonparametric regression with time series errors. When the error process is Gaussian our estimators are efficient, but they are available well beyond the Gaussian case. As an illustration of their usefulness we show that difference-based estimators can be used to produce a simplified version of time series cross-validation. This new approach produces a bandwidth selector that is equivalent, to both first and second orders, to that given by the full time series cross-validation algorithm. Other applications of difference-based methods are to variance estimation and construction of confidence bands in nonparametric regression.     

Asymptotic behavior of iterative m-estimators for the linear model

In this paper, we study the M-estimators for the linear model when they are computed by a class of numerical iterative procedures. This class includes the usual method of Newton-Raphson, iteratively reweighted least squares and iterative winsorization. We show that under mild conditions, the numerical iterative procedures converge and the resulting estimators are consistent and asymptotically normal.     

Detecting discontinuities in nonparametric regression curves and surfaces

The existence of a discontinuity in a regression function can be inferred by comparing regression estimates based on the data lying on different sides of a point of interest. This idea has been used in earlier research by Hall and Titterington (1992), Müller (1992) and later authors. The use of nonparametric regression allows this to be done without assuming linear or other parametric forms for the continuous part of the underlying regression function. The focus of the present paper is on assessing the evidence for the presence of a discontinuity within a regression function through examination of the standardised differences of ‘left’ and ‘right’ estimators at a variety of covariate values. The calculations for the test are carried out through distributional results on quadratic forms. A graphical method in the form of a reference band to highlight the sources of the evidence for discontinuities is proposed. The methods are also developed for the two covariate case where there are additional issues associated with the presence of a jump location curve. Methods for estimating this curve are also developed. All the techniques, for the one and two covariate situations, are illustrated through applications.     

Parameterization and inference for nonparametric regression problems

We consider local likelihood or local estimating equations, in which a multivariate function () is estimated but a derived function () of () is of interest. In many applications, when most naturally formulated the derived function is a non-linear function of (). In trying to understand whether the derived non-linear function is constant or linear, a problem arises with this approach: when the function is actually constant or linear, the expectation of the function estimate need not be constant or linear, at least to second order. In such circumstances, the simplest standard methods in nonparametric regression for testing whether a function is constant or linear cannot be applied. We develop a simple general solution which is applicable to nonparametric regression, varying-coefficient models, nonparametric generalized linear models, etc. We show that, in local linear kernel regression, inference about the derived function () is facilitated without a loss of power by reparameterization so that () is itself a component of (). Our approach is in contrast with the standard practice of choosing () for convenience and allowing ()> to be a non-linear function of (). The methods are applied to an important data set in nutritional epidemiology.     

MOSUM monitoring for variance change in nonparametric regression models

ABSTRACT

This article considers the monitoring for variance change in nonparametric regression models. First, the local linear estimator of the regression function is given. A moving square cumulative sum procedure is proposed based on residuals of the estimator. And the asymptotic results of the statistic under the null hypothesis and the alternative hypothesis are obtained. Simulations and Application support our procedure.     

Asymptotic normality of the lengths of a class of nonparametric confidence intervals for a regression parameter

In the linear regression model, the asymptotic distributions of certain functions of confidence bounds of a class of confidence intervals for the regression parameter arc investigated. The class of confidence intervals we consider in this paper are based on the usual linear rank statistics (signed as well as unsigned). Under suitable assumptions, if the confidence intervals are based on the signed linear rank statistics, it is established that the lengths, properly normalized, of the confidence intervals converge in law to the standard normal distributions; if the confidence intervals arc based on the unsigned linear rank statistics, it is then proved that a linear function of the confidence bounds converges in law to a normal distribution.     

On the Edgeworth expansion and bootstrap approximation for the cox regression model under random censorship

We establish the one-term Edgeworth expansion for various statistics related to Cox semipara-metric regression model when the covariate is one-dimensional and the observations are i.i.d. We show that the bootstrap approximation method is second-order correct. The second-order-correct estimates of the sampling distribution can be obtained without Monte Carlo simulation. We pay special attention to the Studentized version of the statistics and show that their distributions are different from those of the original statistics to order n^-½     

Asymptotic properties of maximum quasi-likelihood estimator in quasi-likelihood non linear models with stochastic regression

In this paper, we establish the asymptotic properties of maximum quasi-likelihood estimator (MQLE) in quasi-likelihood non linear models (QLNMs) with stochastic regression under some mild regular conditions. We also investigate the existence, strong consistency, and asymptotic normality of MQLE in QLNMs with stochastic regression.     

Double-smoothing for bias reduction in local linear regression

Local linear regression involves fitting a straight line segment over a small region whose midpoint is the target point x, and the local linear estimate at x   is the estimated intercept of that straight line segment, with an asymptotic bias of order h²$h^2$ and variance of order (nh)^-1$(\mathit{nh}{)}^{-1}$ (h is the bandwidth). In this paper, we propose a new estimator, the double-smoothing local linear estimator, which is constructed by integrally combining all fitted values at x   of local lines in its neighborhood with another round of smoothing. The proposed estimator attempts to make use of all information obtained from fitting local lines. Without changing the order of variance, the new estimator can reduce the bias to an order of h⁴$h^4$. The proposed estimator has better performance than local linear regression in situations with considerable bias effects; it also has less variability and more easily overcomes the sparse data problem than local cubic regression. At boundary points, the proposed estimator is comparable to local linear regression. Simulation studies are conducted and an ethanol example is used to compare the new approach with other competitive methods.     

Asymptotic approach for a renewal-reward process with a general interference of chance

ABSTRACT

In this study, a renewal-reward process with a discrete interference of chance is constructed and considered. Under weak conditions, the ergodicity of the process X(t) is proved and exact formulas for the ergodic distribution and its moments are found. Within some assumptions for the discrete interference of chance in general form, two-term asymptotic expansions for all moments of the ergodic distribution are obtained. Additionally, kurtosis coefficient, skewness coefficient, and coefficient of variation of the ergodic distribution are computed. As a special case, a semi-Markovian inventory model of type (s, S) is investigated.     

Optimal cross-over designs for nonlinear mixed models using a first-order expansion

We consider the construction of optimal cross-over designs for nonlinear mixed effect models based on the first-order expansion. We show that for AB/BA designs a balanced subject allocation is optimal when the parameters depend on treatments only. For multiple period, multiple sequence designs, uniform designs are optimal among dual balanced designs under the same conditions. As a by-product, the same results hold for multivariate linear mixed models with variances depending on treatments.     

A nonparametric Bayesian model for inference in related longitudinal studies

Summary.  We discuss a method for combining different but related longitudinal studies to improve predictive precision. The motivation is to borrow strength across clinical studies in which the same measurements are collected at different frequencies. Key features of the data are heterogeneous populations and an unbalanced design across three studies of interest. The first two studies are phase I studies with very detailed observations on a relatively small number of patients. The third study is a large phase III study with over 1500 enrolled patients, but with relatively few measurements on each patient. Patients receive different doses of several drugs in the studies, with the phase III study containing significantly less toxic treatments. Thus, the main challenges for the analysis are to accommodate heterogeneous population distributions and to formalize borrowing strength across the studies and across the various treatment levels. We describe a hierarchical extension over suitable semiparametric longitudinal data models to achieve the inferential goal. A nonparametric random-effects model accommodates the heterogeneity of the population of patients. A hierarchical extension allows borrowing strength across different studies and different levels of treatment by introducing dependence across these nonparametric random-effects distributions. Dependence is introduced by building an analysis of variance (ANOVA) like structure over the random-effects distributions for different studies and treatment combinations. Model structure and parameter interpretation are similar to standard ANOVA models. Instead of the unknown normal means as in standard ANOVA models, however, the basic objects of inference are random distributions, namely the unknown population distributions under each study. The analysis is based on a mixture of Dirichlet processes model as the underlying semiparametric model.