A note on asymptotics for quantile smoothing splines

When cubic smoothing splines are used to estimate the conditional quantile function, thereby balancing fidelity to the data with a smoothness requirement, the resulting curve is the solution to a quadratic program. Using this quadratic characterization and through comparison with the sample conditional quan-tiles, we show strong consistency and asymptotic normality for the quantile smoothing spline.     

Goodness-of-fit tests for parametric models in censored regression

The authors propose a goodness-of-fit test for parametric regression models when the response variable is right-censored. Their test compares an estimation of the error distribution based on parametric residuals to another estimation relying on nonparametric residuals. They call on a bootstrap mechanism in order to approximate the critical values of tests based on Kolmogorov-Smirnov and Cramér-von Mises type statistics. They also present the results of Monte Carlo simulations and use data from a study about quasars to illustrate their work.     

SADDLEPOINT METHODS FOR BOOTSTRAP CONFIDENCE BANDS IN NONPARAMETRIC REGRESSION

Bootstrap techniques have been used to construct confidence bands in nonparametric regression problems (Härdle & Bowman, 1988). Yet the required simulation is generally computationally intensive and therefore makes it difficult to conduct further investigations. In this paper, two saddlepoint methods are considered as alternatives to the naive simulation procedure. Some improvements to Härdle & Bowman's bootstrap method are suggested. The improvements are numerically verified using these efficient and accurate analytic methods.     

One-sample distribution-free test statistic V(n,k) sensitive to location differences

A location sensitive one—sample test V(n,n) similar to the Wilcoxon two—sample test was proposed by Riedwyl (1967) and stuided by Carnal and Riedwyl (1972). A generalization for grouped data was given by Maag, Streit and Drouilly (1973). In the present paper we discuss the application of the test for grouped data. We present a table of the significance limits and discuss the approximation by means of the normal distribution.     

Bandwidth-based nonparametric inference

Nonparametric curve estimation is an extremely common statistical procedure. While its primary purpose has been exploratory, some advances in inference have been made. This paper provides a critical review of inferential tests that make fundamental use of a key element of nonparametric smoothing, the bandwidth, to determine the significance of certain features. A major focus is on two important problems that have been tackled using bandwidth-based inference: testing for the multimodality of a density and testing for the monotonicity of a regression curve. Early research in bandwidth-based inference is surveyed, as well as recent theoretical advances. Possible future directions in bandwidth-based inference are discussed.     

Linear Quantile Regression Based on EM Algorithm

This article aims to put forward a new method to solve the linear quantile regression problems based on EM algorithm using a location-scale mixture of the asymmetric Laplace error distribution. A closed form of the estimator of the unknown parameter vector β based on EM algorithm, is obtained. In addition, some simulations are conducted to illustrate the performance of the proposed method. Simulation results demonstrate that the proposed algorithm performs well. Finally, the classical Engel data is fitted and the Bootstrap confidence intervals for estimators are provided.     

Cramér‐von Mises regression

Consider a linear regression model with unknown regression parameters β₀ and independent errors of unknown distribution. Block the observations into q groups whose independent variables have a common value and measure the homogeneity of the blocks of residuals by a Cramér‐von Mises q‐sample statistic T_q(β). This statistic is designed so that its expected value as a function of the chosen regression parameter β has a minimum value of zero precisely at the true value β₀. The minimizer β of T_q(β) over all β is shown to be a consistent estimate of β₀. It is also shown that the bootstrap distribution of T_q(β₀) can be used to do a lack of fit test of the regression model and to construct a confidence region for β₀     

Compare diagnostic tests using transformation-invariant smoothed ROC curves()

Receiver operating characteristic (ROC) curve, plotting true positive rates against false positive rates as threshold varies, is an important tool for evaluating biomarkers in diagnostic medicine studies. By definition, ROC curve is monotone increasing from 0 to 1 and is invariant to any monotone transformation of test results. And it is often a curve with certain level of smoothness when test results from the diseased and non-diseased subjects follow continuous distributions. Most existing ROC curve estimation methods do not guarantee all of these properties. One of the exceptions is Du and Tang (2009) which applies certain monotone spline regression procedure to empirical ROC estimates. However, their method does not consider the inherent correlations between empirical ROC estimates. This makes the derivation of the asymptotic properties very difficult. In this paper we propose a penalized weighted least square estimation method, which incorporates the covariance between empirical ROC estimates as a weight matrix. The resulting estimator satisfies all the aforementioned properties, and we show that it is also consistent. Then a resampling approach is used to extend our method for comparisons of two or more diagnostic tests. Our simulations show a significantly improved performance over the existing method, especially for steep ROC curves. We then apply the proposed method to a cancer diagnostic study that compares several newly developed diagnostic biomarkers to a traditional one.     

Goodness of fit and homogeneity tests on the basis of N-distances

In this paper we propose an application of N-distance theory [Klebanov, L.B., 2005. N-distances and their applications. Karolinum, Prague] for testing simple hypotheses of goodness of fit and homogeneity. The asymptotic null distribution of test statistics is established and coincides with the distribution of infinite quadratic form of independent standard normal random variables. A construction of multivariate free-of-distribution homogeneity test is considered. The power of proposed criteria is compared with classical tests using Monte-Carlo simulations.     

THE SEQUENTIAL BOOTSTRAP: A COMPARISON WITH REGULAR BOOTSTRAP

Based on Bradley Efron's observation that individual resamples in the regular bootstrap have support on approximately 63% of the original observations, C. R. Rao, P. K. Pathak and V. I. Koltchinskii [1] Rao, C. R., Pathak, P. K. and Koltchinskii, V. I. 1997. Bootstrap by Sequential Resampling. Journal of Statistical Planning and Inference, 64: 257–281. [Crossref], [Web of Science ®] , [Google Scholar]have proposed a sequential resampling scheme. This sequential bootstrap stabilizes the information content of each resample by fixing the number of unique observations and letting N, the number of observatons in each resample, vary. The Rao-Pathak-Koltchinskii paper establishes the asymptotic correctness (consistency) of the sequential bootstrap. The main object of our investigation is to study the empirical properties of the Rao-Pathak-Koltchinskii sequential bootstrap as compared to the regular bootstrap. In all our settings, sequential bootstrap performs as well or better than regular bootstrap. In the particular case where we estimate standard errors of sample medians, we find that sequential bootstrap outperforms regular bootstrap by reducing variability in the final bootstrap estimates.     

Matching estimators and optimal bandwidth choice

Optimal bandwidth choice for matching estimators and their finite sample properties are examined. An approximation to their MSE is derived, as a basis for a plug-in bandwidth selector. In small samples, this approximation is not very accurate, though. Alternatively, conventional cross-validation bandwidth selection is considered and performs rather well in simulation studies: Compared to standard pair-matching, kernel and ridge matching achieve reductions in MSE of about 25 to 40%. Local linear matching and weighting perform poorly. Furthermore, the scope for developing better bandwidth selectors seems to be limited for ridge matching, but non-negligible for kernel and local linear matching.     

Testing Normality Using Transformed Data

In this article, we first present a characterization of the normal distribution and then we introduce an exact goodness of fit test for normal distribution. The power of the proposed test under various alternatives is compared with the existing tests, by simulation.     

On Testing Equality of Distributions of Technical Efficiency Scores

The challenge of the econometric problem in production efficiency analysis is that the efficiency scores to be analyzed are unobserved. Statistical properties have recently been discovered for a type of estimator popular in the literature, known as data envelopment analysis (DEA). This opens up a wide range of possibilities for well-grounded statistical inference about the true efficiency scores from their DEA estimates. In this paper we investigate the possibility of using existing tests for the equality of two distributions in such a context. Considering the statistical complications pertinent to our context, we consider several approaches to adapting the Li test to the context and explore their performance in terms of the size and power of the test in various Monte Carlo experiments. One of these approaches shows good performance for both the size and the power of the test, thus encouraging its use in empirical studies. We also present an empirical illustration analyzing the efficiency distributions of countries in the world, following up a recent study by Kumar and Russell (2002), and report very interesting results.     

Some results on bootstrap prediction intervals

We investigate the construction of a BC_a-type bootstrap procedure for setting approximate prediction intervals for an efficient estimator θ_m of a scalar parameter θ, based on a future sample of size m. The results are also extended to nonparametric situations, which can be used to form bootstrap prediction intervals for a large class of statistics. These intervals are transformation-respecting and range-preserving. The asymptotic performance of our procedure is assessed by allowing both the past and future sample sizes to tend to infinity. The resulting intervals are then shown to be second-order correct and second-order accurate. These second-order properties are established in terms of min(m, n), and not the past sample size n alone.     

Pivotal Quantities Based on Sequential Data: A Bootstrap Approach

A bootstrap algorithm is provided for obtaining a confidence interval for the mean of a probability distribution when sequential data are considered. For this kind of data the empirical distribution can be biased but its bias is bounded by the coefficient of variation of the stopping rule associated with the sequential procedure. When using this distribution for resampling the validity of the bootstrap approach is established by means of a series expansion of the corresponding pivotal quantity. A simulation study is carried out using Wang and Tsiatis type tests and considering the normal and exponential distributions to generate the data. This study confirms that for moderate coefficients of variation of the stopping rule, the bootstrap method allows adequate confidence intervals for the parameters to be obtained, whichever is the distribution of data.     

On the Performance of Some Robust Instrumental Variables Estimators

This article considers instrumental variables versions of the quantile and rank regression estimators. The asymptotic properties of the estimators are discussed, and a small-scale Monte Carlo study is used to illustrate the potential advantages of the approach. Finally, the proposed methods are implemented for two empirical examples.     

Goodness-of-fit tests for parametric regression with selection biased data

Consider the nonparametric location-scale regression model Y=m(X)+σ(X)ε$Y=m(X)+\sigma (X)\epsilon$, where the error ε$\epsilon$ is independent of the covariate X$X$, and m$m$ and σ$\sigma$ are smooth but unknown functions. The pair (X,Y)$(X,Y)$ is allowed to be subject to selection bias. We construct tests for the hypothesis that m(·)$m(·)$ belongs to some parametric family of regression functions. The proposed tests compare the nonparametric maximum likelihood estimator (NPMLE) based on the residuals obtained under the assumed parametric model, with the NPMLE based on the residuals obtained without using the parametric model assumption. The asymptotic distribution of the test statistics is obtained. A bootstrap procedure is proposed to approximate the critical values of the tests. Finally, the finite sample performance of the proposed tests is studied in a simulation study, and the developed tests are applied on environmental data.