Nonparametric estimation of conditional expectation

Denote the integer lattice points in the N  -dimensional Euclidean space by Z^N${\mathbb{Z}}^N$ and assume that (_Xi,_Yi)$(X_{\mathbf{i}},Y_{\mathbf{i}})$, i∈Z^N$\mathbf{i}\in {\mathbb{Z}}^N$ is a mixing random field. Estimators of the conditional expectation r(x)=E[_Yi|_Xi=x]$r(\mathbf{x})=\mathrm{E}[Y_{\mathbf{i}}|X_{\mathbf{i}}=\mathbf{x}]$ by nearest neighbor methods are established and investigated. The main analytical result of this study is that, under general mixing assumptions, the estimators considered are asymptotically normal. Many difficulties arise since points in higher dimensional space N?2$N?2$ cannot be linearly ordered. Our result applies to many situations where parametric methods cannot be adopted with confidence.     

Truncated linear estimation of a bounded multivariate normal mean

We consider the problem of estimating the mean θ$\theta$ of an _Np(θ,_Ip)${\mathrm{N}}_{\mathrm{p}}(\theta ,I_p)$ distribution with squared error loss ∥δ−θ∥²$\parallel \delta -\theta {\parallel }^2$ and under the constraint ∥θ∥≤m$\parallel \theta \parallel \le m$, for some constant m>0$m>0$. Using Stein's identity to obtain unbiased estimates of risk, Karlin's sign change arguments, and conditional risk analysis, we compare the risk performance of truncated linear estimators with that of the maximum likelihood estimator _δmle${\delta }_{\mathrm{mle}}$. We obtain for fixed (m,p)$(m,p)$ sufficient conditions for dominance. An asymptotic framework is developed, where we demonstrate that the truncated linear minimax estimator dominates _δmle${\delta }_{\mathrm{mle}}$, and where we obtain simple and accurate measures of relative improvement in risk. Numerical evaluations illustrate the effectiveness of the asymptotic framework for approximating the risks for moderate or large values of p.     

Distribution of concomitants of order statistics and their order statistics

For a random sample of size n$n$ from an absolutely continuous random vector (X,Y)$(X,Y)$, let _Yi:n$Y_{i:n}$ be i$i$th Y$Y$-order statistic and _Y[j:n]$Y_{[j:n]}$ be the Y$Y$-concomitant of _Xj:n$X_{j:n}$. We determine the joint pdf of _Yi:n$Y_{i:n}$ and _Y[j:n]$Y_{[j:n]}$ for all i,j=1$i,j=1$ to n$n$, and establish some symmetry properties of the joint distribution for symmetric populations. We discuss the uses of the joint distribution in the computation of moments and probabilities of various ranks for _Y[j:n]$Y_{[j:n]}$. We also show how our results can be used to determine the expected cost of mismatch in broken bivariate samples and approximate the first two moments of the ratios of linear functions of _Yi:n$Y_{i:n}$ and _Y[j:n]$Y_{[j:n]}$. For the bivariate normal case, we compute the expectations of the product of _Yi:n$Y_{i:n}$ and _Y[i:n]$Y_{[i:n]}$ for n=2$n=2$ to 8 for selected values of the correlation coefficient and illustrate their uses.     

Limit laws for the cumulative number of ties for the maximum in a random sequence

Let {_Xn,n?1}$\{X_n,n?1\}$ be a sequence of independent identically distributed random variables, taking nonnegative integer values. An observation _Xn$X_n$ is a tie for the maximum if _Xn=max{_X1,…,_Xn-1}$X_n=\max \{X_1,\dots ,X_{n-1}\}$. In this paper, we obtain weak and strong laws of large numbers and central limit theorems for the cumulative number of ties for the maximum among the first n$n$ observations.     

Improving density estimators of discretely observed processes by interpolation

We consider density estimation for a smooth stationary process _Xt$X_t$, t∈R$t\in \mathbf{R}$, based on a discrete sample _Yi=_XΔi$Y_i=X_{\mathrm{\Delta }i}$, i=0,…,n=T/Δ$i=0,\dots ,n=T/\Delta$. By a suitable interpolation scheme of order p  , we augment data to form an approximation _Xp,t$X_{p,t}$, t∈[0,T]$t\in [0,T]$, of the continuous-time process and base our density estimate on the augmented sample path. Our results show that this can improve the rate of convergence (measured in terms of n) of the density estimate. Among other things, this implies that recording n   observations using a small Δ$\Delta$ can be more efficient than recording n independent observations.     

The use of an identity in Anderson for multivariate multiple testing

Consider the model where there are I$I$ independent multivariate normal treatment populations with p×1$p\times 1$ mean vectors _μi${\mathit{\mu }}_i$, i=1,…,I$i=1,\dots ,I$, and covariance matrix Σ$\Sigma$. Independently the (I+1)$(I+1)$st population corresponds to a control and it too is multivariate normal with mean vector _μI+1${\mathit{\mu }}_{I+1}$ and covariance matrix Σ$\Sigma$. Now consider the following two multiple testing problems.     

On asymptotic properties of the parameter estimator for a type of SPDE

In this paper, we study a random field _U?(t,x)$U_{?}(t,x)$ governed by some type of stochastic partial differential equations with an unknown parameter θ$\theta$ and a small noise ?$?$. We construct an estimator of θ$\theta$ based on the continuous observation of N   Fourier coefficients of _U?(t,x)$U_{?}(t,x)$, and prove the strong convergence and asymptotic normality of the estimator when the noise ?$?$ tends to zero.     

Rates of convergence for the k-nearest neighbor estimators with smoother regression functions

Let (X, Y  ) be a R^d×R-valued${\mathbb{R}}^d\times \mathbb{R}\mathrm{-}\mathrm{valued}$ random vector. In regression analysis one wants to estimate the regression function m(x)?E(Y|X=x)$m(x)?\mathbf{E}(Y|X=x)$ from a data set. In this paper we consider the rate of convergence for the k-nearest neighbor estimators in case that X   is uniformly distributed on [0,1]^d$[\mathrm{0,1}{]}^d$, Var(Y|X=x)$\mathbf{Var}(Y|X=x)$ is bounded, and m is (p, C)-smooth. It is an open problem whether the optimal rate can be achieved by a k  -nearest neighbor estimator for 1<p≤1.5$1<p\le 1.5$. We solve the problem affirmatively. This is the main result of this paper. Throughout this paper, we assume that the data is independent and identically distributed and as an error criterion we use the expected L₂ error.     

Representing a function of two variables as a superposition over angles of ridge functions with a given shape via linear programming

A ridge function with shape function g   in the horizontal direction is a function of the form g(x)h(y,0)$g(x)h(y,0)$. Along each horizontal line it has the shape g(x)$g(x)$, multiplied by a function h(y,0)$h(y,0)$ which depends on the y-value of the horizontal line. Similarly a ridge function with shape function g   in the vertical direction has the form g(y)h(x,π/2)$g(y)h(x,\pi /2)$. For a given shape function g it may or may not be possible to represent an arbitrary   function f(x,y)$f(x,y)$ as a superposition over all angles of a ridge function with shape g   in each direction, where h=_hf=_hf,g$h=h_f=h_{f,g}$ depends on the functions f and g   and also on the direction, θ:h=_hf,g(·,θ)$\theta :h=h_{f,g}(·,\theta )$. We show that if g   is Gaussian centered at zero then this is always possible and we give the function _hf,g$h_{f,g}$ for a given f(x,y)$f(x,y)$. For highpass or for odd shapes g  , we show it is impossible to represent an arbitrary f(x,y)$f(x,y)$, i.e. in general there is no _hf,g$h_{f,g}$. Note that our problem is similar to tomography, where the problem is to invert the Radon transform, except that the use of the word inversion is here somewhat “inverted”: in tomography f(x,y)$f(x,y)$ is unknown and we find it by inverting the projections of f  ; here, f(x,y)$f(x,y)$ is known, g(z)$g(z)$ is known, and _hf(·,θ)=_hf,g(·,θ)$h_f(·,\theta )=h_{f,g}(·,\theta )$ is the unknown.     

Double shrink methodologies to determine the sample size via covariance structures

We consider fixed-size estimation for a linear function of mean vectors from _πi:_Np(_μi,_Σi)${\pi }_i:{\mathrm{N}}_p({\mathit{\mu }}_i,{\mathbf{\Sigma }}_i)$, i=1,…,k$i=1,\dots ,k$, when every _Σi${\mathbf{\Sigma }}_i$ has some structure. The goal of inference is to construct a fixed-span confidence region with required accuracy. We find a sample size for each _πi${\pi }_i$ with the help of the ‘double shrink methodology’, that is introduced by this paper, via covariance structures of _Σi${\mathbf{\Sigma }}_i$, i=1,…,k$i=1,\dots ,k$. We estimate the sample size in a two-stage sampling and give a fixed-span confidence region that has the coverage probability approximately second-order consistent with the required accuracy. Some simulations are carried out to see moderate sample size performances of the proposed methodologies.