The estimation of derivatives of a nonparametric regression function when the data are correlated

A kernel estimator of a derivative of arbitrary order of a nonparametric average population curve is considered for a correlated-errors model with balanced replicate measurements at each design point. Asymptotic expansions of the mean squared error are derived for two classes of correlation functions in the model. Consistency, choice of smoothing parameter, and rates of convergence are examined for the important special cases of estimating the first and second derivatives.     

On shrinkage least squares estimation in a parallelism problem

In a multi-sample simple regression model, generally, homogeneity of the regression slopes leads to improved estimation of the intercepts. Analogous to the preliminary test estimators, (smooth) shrinkage least squares estimators of Intercepts based on the James-Stein rule on regression slopes are considered. Relative pictures on the (asymptotic) risk of the classical, preliminary test and the shrinkage least squares estimators are also presented. None of the preliminary test and shrinkage least squares estimators may dominate over the other, though each of them fares well relative to the other estimators.     

Minimax prediction in finite populations

In this paper, minimax predictors are considered for some population quantities of interest, under some specific superpopulation models. Minimax predictors are derived under a binomial superpopulation model. The well known ratio estimator is shown to be minimax under the usual simple regression normal model. Nonparametric minimax predictors are considered under some models. Some of the predictors considered also shown to be admis s ible.     

Kernel Density Estimation with Generalized Binning

We propose kernel density estimators based on prebinned data. We use generalized binning schemes based on the quantiles points of a certain auxiliary distribution function. Therein the uniform distribution corresponds to usual binning. The statistical accuracy of the resulting kernel estimators is studied, i.e. we derive mean squared error results for the closeness of these estimators to both the true function and the kernel estimator based on the original data set. Our results show the influence of the choice of the auxiliary density on the binned kernel estimators and they reveal that non-uniform binning can be worthwhile.     

Testing lack of fit of regression models under heteroscedasticity

A test is proposed for assessing the lack of fit of heteroscedastic nonlinear regression models that is based on comparison of nonparametric kernel and parametric fits. A data-driven method is proposed for bandwidth selection using the asymptotically optimal bandwidth of the parametric null model which leads to a test that has a limiting normal distribution under the null hypothesis and is consistent against any fixed alternative. The resulting test is applied to the problem of testing the lack of fit of a generalized linear model.     

Pointwise and uniform convergence of multivariate kernel density estimators using random bandwidths

We obtain the rates of pointwise and uniform convergence of multivariate kernel density estimators using a random bandwidth vector obtained by some data-based algorithm. We are able to obtain faster rate for pointwise convergence. The uniform convergence rate is obtained under some moment condition on the marginal distribution. The rates are obtained under i.i.d. and strongly mixing type dependence assumptions.     

Shrinkage and Orthogonal Decomposition

ABSTRACT. The problem of estimating the mean of a multivariate normal distribution when the parameter space allows an orthogonal decomposition is discussed. Risk functions and lower bounds for a class of shrinkage estimators that includes Stein's estimator are derived, and an improvement on Stein's estimator that takes advantage of the orthogonal decomposition is introduced. Uniform asymptotics related to Pinsker's minimax risk is derived and we give conditions for attaining the lower risk bound. Special cases including regression and analysis of variance are discussed.     

A test of normality using nonparametrlic residuals

In this paper, we develop a test of the normality assumption of the errors using the residuals from a nonparametric kernel regression. Contrary to the existing tests based on the residuals from a parametric regression, our test is thus robust to misspecification of the regression function. The test statistic proposed here is a Bera-Jarque type test of skewness and kurtosis. We show that the test statistic has the usual x²(2) limit distribution under the null hypothesis. In contrast to the results of Rilstone (1992), we provide a set of primitive assumptions that allow weakly dependent observations and data dependent bandwidth parameters. We also establish consistency property of the test. Monte Carlo experiments show that our test has reasonably good size and power performance in small samples and perfornu better than some of the alternative tests in various situations.     

Optimal choice of sample fraction in univariate financial tail index estimation

This study introduces a technique to estimate the Pareto distribution of the stock exchange index by using the maximum-likelihood Hill estimator. Recursive procedures based on the goodness-of-fit statistics are used to determine the optimal threshold fraction of extreme values to be included in tail estimation. These procedures are applied to three indices in the Malaysian stock market which included the consideration of a drastic economic event such as the Asian financial crisis. The empirical results evidenced alternating varying behavior of heavy-tailed distributions in the regimes for both upper and lower tails.     

Approximate Confidence Limits for the Difference between Parameters of Two Pólya Distributions

The problem of calculating approximate confidence limits for the difference between success probability parameters of two Pólya distributions is solved for the first time. We suggest some new methods for determining these approximate confidence limits and consider their application to special cases: namely for the binomial and hypergeometric distributions. The various approximate confidence limits are evaluated and compared.