Selection of bandwidth for kernel regression

ABSTRACT

The most important factor in kernel regression is a choice of a bandwidth. Considerable attention has been paid to extension the idea of an iterative method known for a kernel density estimate to kernel regression. Data-driven selectors of the bandwidth for kernel regression are considered. The proposed method is based on an optimally balanced relation between the integrated variance and the integrated square bias. This approach leads to an iterative quadratically convergent process. The analysis of statistical properties shows the rationale of the proposed method. In order to see statistical properties of this method the consistency is determined. The utility of the method is illustrated through a simulation study and real data applications.     

On selecting the best population

This paper deals with the problem of selecting the “best” population from a given number of populations in a decision theoretic framework. The class of selection rules considered is based on a suitable partition of the sample space. A selection rule is given which is shown to have certain optimum properties among the selection rules in the given class for a mal rules are known.     

A Class of Multivariate Bilateral Selection t Distributions and Its Properties

This article proposes a class of multivariate bilateral selection t distributions useful for analyzing non-normal (skewed and/or bimodal) multivariate data. The class is associated with a bilateral selection mechanism, and it is obtained from a marginal distribution of the centrally truncated multivariate t. It is flexible enough to include the multivariate t and multivariate skew-t distributions and mathematically tractable enough to account for central truncation of a hidden t variable. The class, closed under linear transformation, marginal, and conditional operations, is studied from several aspects such as shape of the probability density function, conditioning of a distribution, scale mixtures of multivariate normal, and a probabilistic representation. The relationships among these aspects are given, and various properties of the class are also discussed. Necessary theories and two applications are provided.     

Asymptotic Results for Spatial ARMA Models

Causal quadrantal-type spatial ARMA(p, q) models with independent and identically distributed innovations are considered. In order to select the orders (p, q) of these models and estimate their autoregressive parameters, estimators of the autoregressive coefficients, derived from the extended Yule–Walker equations are defined. Consistency and asymptotic normality are obtained for these estimators. Then, spatial ARMA model identification is considered and simulation study is given.     

Estimating the order of moving average models: the max X2 method

The max X² technique for estimating rhe order of autoregressive processes (McClave (1976)) is extended to moving average models. The autöregressive-moving average duality is exploited by using the inverse autocorrelation function and the subset autoregression algorithm. The technique is demonstrated via simulations, and is applied to Box and Jenkins (1970) Series A.     

Univaiuate anu multivariate categorical data analysis for block designs

Analysis for univariate and multivariate categorical data in block designs is given and illustrated through examples. The univariate analysis compares the treatments on the basis of their pooled frequency distributions (pooled over blocks). The test statistic used is called Q after Cochran (1950). The large sample null distribution of Q is a chi-square. Analysis of p-variate categorical data (kth variable having ck classes, K=1,...,p) can be done by treating it as a univariate categorical problem with [d] classes. Very often [d] is large in relation to the size of the experiment. This makes the expected frequencies for some of the cells very small, making the univariate method inapplicable. In these circumstances it may be reasonable to compare the treatments on the basis of marginal distributions up to the mth dimension, 1[d] , which is given in this paper. This method is also illustrated for missing observations     

On Calculations Involving the Maximum Cell Frequency

We describe a method of computing the cumulative distribution function of the maximum and minimum cell frequencies in sampling distributions commonly encountered in the analysis of categorical data.The procedure is efficient for exact or approximate calculation in both homogeneous and non-homogeneous cases, is non-recursive, and does not require Dirichlet integrals.Some related statistical problems are also discussed.     

An extension of bayesian measure of information to regression

This paper extends Lindley's measure of average information to the linear model, E(Y∣ß) = Xß. An expression which quantifies the average amount of information provided by the nxl vector of observations Y about the pxl vector of coefficient parameters ß will be derived. The effect of the structure of the regressor matrix, X, on the information measure is discussed. An information theoretic optimal design is characterized. Some applications are suggested.     

Bootstrap method in ranking and slippage problems

In this paper, the bootstrap method of Efron (1979) is given for a ranking and a slippage problem, where the ranking (or slippage) is with respect to the mean of the distributions. The method is also applied to obtain a confidence interval for the largest mean.     

Least significant spacing for ‘one versus the rest’ normal populations

Consider sample means from k(≥2) normal populations where the variances and sample sizes are equal. The problem is to find the ‘least significant difference’ or ‘spacing’ (LSS) between the two largest means, so that if an observed spacing is larger we have confidence 1 - α that the population with largest sample mean also has the largest population mean.

When the variance is known it is shown that the maximum LSS occurs when k = 2, provided a < .2723. In other words, for any value of k we may use the usual (one-tailed) least significant difference to demonstrate that one population has a population mean greater than (or equal to) the rest.

When the variance is estimated bounds are obtained for the confidence which indicate that this last result is approximately correct.