Variance estimation in nonparametric regression with jump discontinuities

Variance estimation is an important topic in nonparametric regression. In this paper, we propose a pairwise regression method for estimating the residual variance. Specifically, we regress the squared difference between observations on the squared distance between design points, and then estimate the residual variance as the intercept. Unlike most existing difference-based estimators that require a smooth regression function, our method applies to regression models with jump discontinuities. Our method also applies to the situations where the design points are unequally spaced. Finally, we conduct extensive simulation studies to evaluate the finite-sample performance of the proposed method and compare it with some existing competitors.     

Testing discontinuities in nonparametric regression

In nonparametric regression, it is often needed to detect whether there are jump discontinuities in the mean function. In this paper, we revisit the difference-based method in [13] and propose to further improve it. To achieve the goal, we first reveal that their method is less efficient due to the inappropriate choice of the response variable in their linear regression model. We then propose a new regression model for estimating the residual variance and the total amount of discontinuities simultaneously. In both theory and simulation, we show that the proposed variance estimator has a smaller mean-squared error compared to the existing estimator, whereas the estimation efficiency for the total amount of discontinuities remains unchanged. Finally, we construct a new test procedure for detection of discontinuities using the proposed method; and via simulation studies, we demonstrate that our new test procedure outperforms the existing one in most settings.     

Nonparametric regression estimators in complex surveys

In this article, we extend smoothing splines to model the regression mean structure when data are sampled through a complex survey. Smoothing splines are evaluated both with and without sample weights, and are compared with local linear estimator. Simulation studies find that nonparametric estimators perform better when sample weights are incorporated, rather than being treated as if iid. They also find that smoothing splines perform better than local linear estimator through completely data-driven bandwidth selection methods.     

Some remarks about the gasser-sroka-jennen-steinmetz variance estimator

This article proposes some simplifications of the residual variance estimator of Gasset, Sroka, and Jeneen-Steinmetz (GSJ, 1986) which is often used in conjunction with non parametric regression. The GSJ estimator is a quadratic form of the data, which depends on the relative spacings of the design points. When the errors are independent, identically distributed Gaussian variables, and the true regression curve is flat, the estimate is distributed as a weighted sum of x² variables. By matching the first two moments, the distribution can be approximated by a x² with degrees of freedom determined by the coefficients of the. quadratic form. Computation of the estimated degrees of freedom requires computing the trace of the square of an n x n matrix, where n is the number of design points. In this article, (n-2)/3 is shown to be a conservative estimate of the approximate degrees of freedom, and (n-2)/2 is shown to be conservative for many designs. In addition, a simplified version of the estimator is shown to be asymptotically equivalent, under many conditions.     

New difference-based estimator of parameters in semiparametric regression models

The paper introduces a new difference-based Liu estimator β?_Ldiff=([Xtilde]′[Xtilde]+I)^?1([Xtilde]′[ytilde]+η β?_diff) of the regression parameters β in the semiparametric regression model, y=Xβ+f+?. Difference-based estimator, β?_diff=([Xtilde]′[Xtilde])^?1[Xtilde]′[ytilde] and difference-based Liu estimator are analysed and compared with respect to mean-squared error (mse) criterion. Finally, the performance of the new estimator is evaluated for a real data set. Monte Carlo simulation is given to show the improvement in the scalar mse of the estimator.     

Some tests of whether several samples are from identical populations

We observe s Independent samples, from unknown continuous distributions. The problem is to test the hypothesis that all the distributions are identical. The distribution of the numbers of observations from s-1 of the samples which fall in cells whose Boundaries are selected order statistics of the remaining sample, the number of cells increasing gradually with the sample sizes, is investigated. It is shown that under the null hypothesis and nearDy alternatives, as the sample sizes Increase these numbers of observations can be considered to be slightly rounded off normal random variables, the amount rounded off decreasing as sample sizes increase. Using these results, various tests of the hypothesis can be constructed and analyzed.     

Problems related to confidence intervals for impulse responses of autoregressive processes

Confidence intervals for impulse responses computed from autoregressive processes are considered. A detailed analysis of the methods in current use shows that they are not very reliable in some cases. In particular, there are theoretical reasons for them to have actual coverage probabilities which deviate considerably from the nominal level in some situations of practical importance. For a simple case alternative bootstrap methods are proposed which provide correct results asymptotically.     

Variance estimation of the Buckley–James estimator under discrete assumptions

The Buckley–James estimator (BJE) is a widely recognized approach in dealing with right-censored linear regression models. There have been a lot of discussions in the literature on the estimation of the BJE as well as its asymptotic distribution. So far, no simulation has been done to directly estimate the asymptotic variance of the BJE. Kong and Yu [Asymptotic distributions of the Buckley–James estimator under nonstandard conditions, Statist. Sinica 17 (2007), pp. 341–360] studied the asymptotic distribution under discontinuous assumptions. Based on their methodology, we recalculate and correct some missing terms in the expression of the asymptotic variance in Theorem 2 of their work. We propose an estimator of the standard deviation of the BJE by using plug-in estimators. The estimator is shown to be consistent. The performance of the estimator is accessed through simulation studies under discrete underline distributions. We further extend our studies to several continuous underline distributions through simulation. The estimator is also applied to a real medical data set. The simulation results suggest that our estimation is a good approximation to the true standard deviation with reference to the empirical standard deviation.