Asymptotic normality and mean consistency for the weighted estimator in nonparametric regression models

In this paper, we mainly study the asymptotic properties of weighted estimator for the nonparametric regression model based on linearly negative quadrant dependent (LNQD, for short) errors. We obtain the rate of uniformly asymptotic normality of the weighted estimator which is nearly $O\left(n^{?1∕4}\right)$ when the moment condition is appropriate. The results generalize the corresponding ones of Yang (2003) from NA samples to LNQD samples and improve or extend the corresponding one of Li et al. (2012) for LNQD samples. Moreover, we obtain some results on mean consistency, uniformly mean consistency, and the rate of mean consistency for the weighted estimator. Finally we carry out some simulations to verify the validity of our results.     

A method for high-dimensional smoothing

We consider the problem of the computation of smoothed additive functionals, which are some integrals with respect to the joint smoothing distribution. It is a key issue in inference for general state-space models as these quantities appear naturally for maximum likelihood parameter inference. The computation of smoothed additive functionals is very challenging as exact computations are not possible for non-linear non-Gaussian state-space models. It becomes even more difficult when the hidden state lies in a high dimensional space because traditional numerical methods suffer from the curse of dimensionality. We propose a new algorithm to efficiently calculate the smoothed additive functionals in an online manner for a specific family of high-dimensional state-space models in discrete time, which is named the Space–Time Forward Smoothing (STFS) algorithm. The cost of this algorithm is at least $O\left(N^2{d}^{2}T\right)$, which is polynomial in $d$. $T$ and $N$ denote the number of time steps and the number of particles respectively, while $d$ is the dimension of the hidden state space. Its superior performance over other existing methods is illustrated by various simulation studies. Moreover, STFS algorithm is successfully applied to perform Maximum Likelihood estimation for static model parameters both in an online and an offline manner.     

A modified LGB method for detecting significant effects based on a half-normal probability plot

In analyzing data from unreplicated factorial designs, the half-normal probability plot is commonly used to screen for the ‘vital few’ effects. Recently, many formal methods have been proposed to overcome the subjectivity of this plot. Lawson (1998) (hereafter denoted as LGB) suggested a hybrid method based on the half-normal probability plot, which is a blend of Lenth (1989) and Loh (1992) method. The method consists of fitting a simple least squares line to the inliers, which are determined by the Lenth method. The effects exceeding the prediction limits based on the fitted line are candidates for the vital few effects. To improve the accuracy of partitioning the effects into inliers and outliers, we propose a modified LGB method (hereafter denoted as the Mod_LGB method), in which more outliers can be classified by using both the Carling’s modification of the box plot (Carling, 2000) and Lenth method. If no outlier exists or there is a wide range in the inliers as determined by the Lenth method, more outliers can be found by the Carling method. A simulation study is conducted in unreplicated $2^4$ designs with the number of active effects ranging from 1 to 6 to compare the efficiency of the Lenth method, original LGB methods, and the proposed modified version of the LGB method.     

Pseudo MLE for semiparametric transformation model with doubly truncated data

In this article, we consider the efficient estimation of the semiparametric transformation model with doubly truncated data. We propose a two-step approach for obtaining the pseudo maximum likelihood estimators (PMLE) of regression parameters. In the first step, the truncation time distribution is estimated by the nonparametric maximum likelihood estimator (Shen, 2010a) when the distribution function $K$ of the truncation time is unspecified or by the conditional maximum likelihood estimator (Bilker and Wang, 1996) when $K$ is parameterized. In the second step, using the pseudo complete-data likelihood function with the estimated distribution of truncation time, we propose expectation–maximization algorithms for obtaining the PMLE. We establish the consistency of the PMLE. The simulation study indicates that the PMLE performs well in finite samples. The proposed method is illustrated using an AIDS data set.     

Asymptotic approximation of the likelihood of stationary determinantal point processes

Continuous determinantal point processes (DPPs) are a class of repulsive point processes on ${ℝ}^d$ with many statistical applications. Although an explicit expression of their density is known, it is too complicated to be used directly for maximum likelihood estimation. In the stationary case, an approximation using Fourier series has been suggested, but it is limited to rectangular observation windows and no theoretical results support it. In this contribution, we investigate a different way to approximate the likelihood by looking at its asymptotic behavior when the observation window grows toward ${ℝ}^d$. This new approximation is not limited to rectangular windows, is faster to compute than the previous one, does not require any tuning parameter, and some theoretical justifications are provided. It moreover provides an explicit formula for estimating the asymptotic variance of the associated estimator. The performances are assessed in a simulation study on standard parametric models on ${ℝ}^d$ and compare favorably to common alternative estimation methods for continuous DPPs.     

Laguerre and Hermite bases for inverse problems

We present inverse problems of nonparametric statistics which have a smart solution using projection estimators on bases of functions with non compact support, namely, a Laguerre basis or a Hermite basis. The models are $Y_i=X_i{U}_i,Z_i=X_i+{\Sigma }_i,$ where the $X_i$’s are i.i.d. with unknown density $f$, the ${\Sigma }_i$’s are i.i.d. with known density $f_{\Sigma }$, the $U_i$’s are i.i.d. with uniform density on $[0,1]$. The sequences $\left(X_i\right),\left(U_i\right),\left({\Sigma }_i\right)$ are independent. We define projection estimators of $f$ in the two cases of indirect observations of $(X_1,\dots ,X_n)$, and we give upper bounds for their ${\mathbb{L}}^2$-risks on specific Sobolev–Laguerre or Sobolev–Hermite spaces. Data-driven procedures are described and proved to perform automatically the bias–variance compromise.     

Minimum projection uniformity for computer experiment with quantitative factors

Computer experiments involving quantitative factors at high levels are becoming more and more important in the study of complex experiments arising in the area of science and engineering. Uniform designs are found to be widely applicable in computer experiments in the form of space-filling designs. In this paper, the projection uniformity for quantitative designs is studied under wrap-around $L_2$-discrepancy. A lower bound of uniformity pattern for general asymmetric designs is provided, which can be used to serve as a benchmark for both comparing different designs and also to determine the optimal design. As a byproduct, a lower bound of wrap-around $L_2$-discrepancy measure for the asymmetric design is also obtained. Some illustrative examples and numerical comparisons are also provided for supporting our theoretical results.     

Optimal Berry–Esseen bound for parameter estimation of SPDE with small noise

We investigate a rate of convergence on asymptotic normality of the maximum likelihood estimator (MLE) for parameter $\theta$ appearing in parabolic SPDEs of the form

$d{u}^{?}(t,x)=(A_0+\theta A_1)u^{?}(t,x)dt+?dW(t,x),$

where $A_0$ and$A_1$ are partial differential operators, $W$ is a cylindrical Brownian motion (CBM) and $?\downarrow 0$. We find an optimal Berry–Esseen bound for central limit theorem (CLT) of the MLE. It is proved by developing techniques based on combining Malliavin calculus and Stein’s method.     

Robust median estimator in logistic regression

This paper introduces a median estimator of the logistic regression parameters. It is defined as the classical _L1$L_1$-estimator applied to continuous data _Z1,…,_Zn$Z_1,\dots ,Z_n$ obtained by a statistical smoothing of the original binary logistic regression observations _Y1,…,_Yn$Y_1,\dots ,Y_n$. Consistency and asymptotic normality of this estimator are proved. A method called enhancement is introduced which in some cases increases the efficiency of this estimator. Sensitivity to contaminations and leverage points is studied by simulations and compared in this manner with the sensitivity of some robust estimators previously introduced to the logistic regression. The new estimator appears to be more robust for larger sample sizes and higher levels of contamination.     

A bivariate distribution with Lomax and geometric margins

We develop a stochastic model describing the joint distribution of $(X,N)$, where $N$ has a geometric distribution while $X$ is the sum of $N$ dependent, heavy-tail Pareto components. Models of this form arise in many applications, ranging from hydro-climatology to finance and insurance. We present fundamental properties of this vector, including marginal and conditional distributions, moments, representations, and parameter estimation. We also include an example from finance, illustrating modeling potential of this new bivariate distribution.     

Asymptotic properties of the maximum smoothed partial likelihood estimator in the change-plane Cox model

The change-plane Cox model is a popular tool for the subgroup analysis of survival data. Despite the rich literature on this model, there has been limited investigation into the asymptotic properties of the estimators of the finite-dimensional parameter. Particularly, the convergence rate, not to mention the asymptotic distribution, has not been fully characterized for the general model where classification is based on multiple covariates. To bridge this theoretical gap, this study proposes a maximum smoothed partial likelihood estimator and establishes the following asymptotic properties. First, it shows that the convergence rate for the classification parameter can be arbitrarily close to $n^{-1}$ up to a logarithmic factor under a certain condition on covariates and the choice of tuning parameter. Given this convergence rate result, it also establishes the asymptotic normality for the regression parameter.     

Testing of a sub-hypothesis in linear regression models with long memory errors and deterministic design

This paper considers the problem of testing a sub-hypothesis in homoscedastic linear regression models where errors form long memory moving average processes and designs are non-random. Unlike in the random design case, asymptotic null distribution of the likelihood ratio type test based on the Whittle quadratic form is shown to be non-standard and non-chi-square. Moreover, the rate of consistency of the minimum Whittle dispersion estimator of the slope parameter vector is shown to be n^-(1-α)/2$n^{-(1-\alpha )/2}$, different from the rate n^-1/2$n^{-1/2}$ obtained in the random design case, where α$\alpha$ is the rate at which the error spectral density explodes at the origin. The proposed test is shown to be consistent against fixed alternatives and has non-trivial asymptotic power against local alternatives that converge to null hypothesis at the rate n^-(1-α)/2$n^{-(1-\alpha )/2}$.