Laguerre and Hermite bases for inverse problems

We present inverse problems of nonparametric statistics which have a smart solution using projection estimators on bases of functions with non compact support, namely, a Laguerre basis or a Hermite basis. The models are $Y_i=X_i{U}_i,Z_i=X_i+{\Sigma }_i,$ where the $X_i$’s are i.i.d. with unknown density $f$, the ${\Sigma }_i$’s are i.i.d. with known density $f_{\Sigma }$, the $U_i$’s are i.i.d. with uniform density on $[0,1]$. The sequences $\left(X_i\right),\left(U_i\right),\left({\Sigma }_i\right)$ are independent. We define projection estimators of $f$ in the two cases of indirect observations of $(X_1,\dots ,X_n)$, and we give upper bounds for their ${\mathbb{L}}^2$-risks on specific Sobolev–Laguerre or Sobolev–Hermite spaces. Data-driven procedures are described and proved to perform automatically the bias–variance compromise.     

Characterizations based on record values and order statistics

Consider a sequence of independent and identically distributed random variables {_Xi,i?1}$\{X_i,i?1\}$ with a common absolutely continuous distribution function F  . Let _X1:n?_X2:n???_Xn:n$X_{1:n}?X_{2:n}???X_{n:n}$ be the order statistics of {_X1,_X2,…,_Xn}$\{X_1,X_2,\dots ,X_n\}$ and {_Yl,l?1}$\{Y_l,l?1\}$ be the sequence of record values generated by {_Xi,i?1}$\{X_i,i?1\}$. In this work, the conditional distribution of _Yl$Y_l$ given _Xn:n$X_{n:n}$ is established. Some characterizations of F   based on record values and _Xn:n$X_{n:n}$ are then given.     

Nonparametric estimation of conditional expectation

Denote the integer lattice points in the N  -dimensional Euclidean space by Z^N${\mathbb{Z}}^N$ and assume that (_Xi,_Yi)$(X_{\mathbf{i}},Y_{\mathbf{i}})$, i∈Z^N$\mathbf{i}\in {\mathbb{Z}}^N$ is a mixing random field. Estimators of the conditional expectation r(x)=E[_Yi|_Xi=x]$r(\mathbf{x})=\mathrm{E}[Y_{\mathbf{i}}|X_{\mathbf{i}}=\mathbf{x}]$ by nearest neighbor methods are established and investigated. The main analytical result of this study is that, under general mixing assumptions, the estimators considered are asymptotically normal. Many difficulties arise since points in higher dimensional space N?2$N?2$ cannot be linearly ordered. Our result applies to many situations where parametric methods cannot be adopted with confidence.     

A new goodness-of-fit test for certain bivariate distributions applicable to traffic accidents

T. Cacoullos and H. Papageorgiou [On some bivariate probability models applicable to traffic accidents and fatalities, Int. Stat. Rev. 48 (1980) 345–356] studied a special class of bivariate discrete distributions appropriate for modeling traffic accidents, and fatalities resulting therefrom. The corresponding random variable may be written as $Z={(N,Y)}^{\prime }$, with $Y={\sum }_{j=1}^N{X}_j$, where ${\left\{X_j\right\}}_{j=1}^N$, are independent copies of a (discrete) random variable $X$, and $N$ is independent of ${\left\{X_j\right\}}_{j=1}^N$, and follows a Poisson law. If $X$ follows a Poisson law (resp. Binomial law), the resulting distribution is termed Poisson–Poisson (resp. Poisson–Binomial). L2-type goodness-of-fit statistics are constructed for the ‘general distribution’ of this kind, where $X$ may be an arbitrary discrete nonnegative random variable. The test statistics utilize a simple characterization involving the corresponding probability generating function, and are shown to be consistent. The proposed procedures are shown to perform satisfactorily in simulated data, while their application to accident data leads to positive conclusions regarding the modeling ability of this class of bivariate distributions.     

Optimal Berry–Esseen bound for parameter estimation of SPDE with small noise

We investigate a rate of convergence on asymptotic normality of the maximum likelihood estimator (MLE) for parameter $\theta$ appearing in parabolic SPDEs of the form

$d{u}^{?}(t,x)=(A_0+\theta A_1)u^{?}(t,x)dt+?dW(t,x),$

where $A_0$ and$A_1$ are partial differential operators, $W$ is a cylindrical Brownian motion (CBM) and $?\downarrow 0$. We find an optimal Berry–Esseen bound for central limit theorem (CLT) of the MLE. It is proved by developing techniques based on combining Malliavin calculus and Stein’s method.     

Linear sufficiency and completeness in the context of estimating the parametric function in the general Gauss–Markov model

In this paper we consider linear sufficiency and linear completeness in the context of estimating the estimable parametric function K^′β${\mathbf{K}}^{\prime }\mathit{\beta }$ under the general Gauss–Markov model {y,Xβ,σ²V}$\{\mathbf{y},\mathbf{X}\mathit{\beta },{\sigma }^2\mathbf{V}\}$. We give new characterizations for linear sufficiency, and define and characterize linear completeness in a case of estimation of K^′β${\mathbf{K}}^{\prime }\mathit{\beta }$. Also, we consider a predictive approach for obtaining the best linear unbiased estimator of K^′β${\mathbf{K}}^{\prime }\mathit{\beta }$, and subsequently, we give the linear analogues of the Rao–Blackwell and Lehmann–Scheffé Theorems in the context of estimating K^′β${\mathbf{K}}^{\prime }\mathit{\beta }$.     

Confidence intervals for P(Y

《Statistical Methodology》2012,9(3):445-455

Some properties of extreme stable laws and related infinitely divisible random variables

In the course of studying the moment sequence {nⁿ:n=0,1,…}$\{n^n:n=0,1,\dots \}$, Eaton et al. [1971. On extreme stable laws and some applications. J. Appl. Probab. 8, 794–801] have shown that this sequence, which is, indeed, the moment sequence of a log-extreme stable law with characteristic exponent γ=1$\gamma =1$, corresponds to a scale mixture of exponential distributions and hence to a distribution with decreasing failure rate. Following essentially the approach of Shanbhag et al. [1977. Some further results in infinite divisibility. Math. Proc. Cambridge Philos. Soc. 82, 289–295] we show that, under certain conditions, log-extreme stable laws with characteristic exponent γ∈[1,2)$\gamma \in [1,2)$ are scale mixtures of exponential distributions and hence are infinitely divisible and have decreasing failure rates. In addition, we study the moment problem associated with the log-extreme stable laws with characteristic exponent γ∈(0,2]$\gamma \in (0,2]$ and throw further light on the existing literature on the subject. As a by-product, we show that generalized Poisson and generalized negative binomial distributions are mixed Poisson distributions. Finally, we address some relevant questions on structural aspects of infinitely divisible distributions, and make new observations, including in particular that certain results appearing in Steutel and van Harn [2004. Infinite Divisibility of Probability Distributions on the Real Line. Marcel Dekker, New York] have links with the Wiener–Hopf factorization met in the theory of random walk.     

Approximating moments of continuous functions of random variables using Bernstein polynomials

Bernstein polynomials have many interesting properties. In statistics, they were mainly used to estimate density functions and regression relationships. The main objective of this paper is to promote further use of Bernstein polynomials in statistics. This includes (1) providing a high-level approximation of the moments of a continuous function $g\left(X\right)$ of a random variable $X$, and (2) proving Jensen’s inequality concerning a convex function without requiring second differentiability of the function. The approximation in (1) is demonstrated to be quite superior to the delta method, which is used to approximate the variance of $g\left(X\right)$ with the added assumption of differentiability of the function. Two numerical examples are given to illustrate the application of the proposed methodology in (1).     

Empirical Bayes regression analysis with many regressors but fewer observations

In this paper, we consider the prediction problem in multiple linear regression model in which the number of predictor variables, p, is extremely large compared to the number of available observations, n  . The least-squares predictor based on a generalized inverse is not efficient. We propose six empirical Bayes estimators of the regression parameters. Three of them are shown to have uniformly lower prediction error than the least-squares predictors when the vector of regressor variables are assumed to be random with mean vector zero and the covariance matrix (1/n)X^tX$(1/n){\mathit{X}}^{\mathrm{t}}\mathit{X}$ where X^t=(_x1,…,_xn)${\mathit{X}}^{\mathrm{t}}=({\mathit{x}}_1,\dots ,{\mathit{x}}_n)$ is the p×n$p\times n$ matrix of observations on the regressor vector centered from their sample means. For other estimators, we use simulation to show its superiority over the least-squares predictor.