Robust median estimator in logistic regression

This paper introduces a median estimator of the logistic regression parameters. It is defined as the classical _L1$L_1$-estimator applied to continuous data _Z1,…,_Zn$Z_1,\dots ,Z_n$ obtained by a statistical smoothing of the original binary logistic regression observations _Y1,…,_Yn$Y_1,\dots ,Y_n$. Consistency and asymptotic normality of this estimator are proved. A method called enhancement is introduced which in some cases increases the efficiency of this estimator. Sensitivity to contaminations and leverage points is studied by simulations and compared in this manner with the sensitivity of some robust estimators previously introduced to the logistic regression. The new estimator appears to be more robust for larger sample sizes and higher levels of contamination.     

On boosting kernel regression

In this paper we propose a simple multistep regression smoother which is constructed in an iterative manner, by learning the Nadaraya–Watson estimator with _L2$L_2$ boosting. We find, in both theoretical analysis and simulation experiments, that the bias converges exponentially fast, and the variance diverges exponentially slow. The first boosting step is analysed in more detail, giving asymptotic expressions as functions of the smoothing parameter, and relationships with previous work are explored. Practical performance is illustrated by both simulated and real data.     

A sequential design for a clinical trial with a linear prognostic factor

We study a randomized adaptive design to assign one of the L$L$ treatments to patients who arrive sequentially by means of an urn model. At each stage n$n$, a reward is distributed between treatments. The treatment applied is rewarded according to its response, 0?_Yn?1$0?Y_n?1$, and 1-_Yn$1-Y_n$ is distributed among the other treatments according to their performance until stage n-1$n-1$. Patients can be classified in K+1$K+1$ levels and we assume that the effect of this level in the response to the treatments is linear. We study the asymptotic behavior of the design when the ordinary least square estimators are used as a measure of performance until stage n-1$n-1$.     

Prediction in moving average processes

For the stationary invertible moving average process of order one with unknown innovation distribution F, we construct root-n   consistent plug-in estimators of conditional expectations E(h(_Xn+1)|_X1,…,_Xn)$E(h(X_{n+1})|X_1,\dots ,X_n)$. More specifically, we give weak conditions under which such estimators admit Bahadur-type representations, assuming some smoothness of h or of F. For fixed h it suffices that h   is locally of bounded variation and locally Lipschitz in _L2(F)$L_2(F)$, and that the convolution of h and F   is continuously differentiable. A uniform representation for the plug-in estimator of the conditional distribution function P(_Xn+1?·|_X1,…,_Xn)$P(X_{n+1}?·|X_1,\dots ,X_n)$ holds if F has a uniformly continuous density. For a smoothed version of our estimator, the Bahadur representation holds uniformly over each class of functions h that have an appropriate envelope and whose shifts are F-Donsker, assuming some smoothness of F. The proofs use empirical process arguments.     

Multivariate orthogonal series estimates for random design regression

In this paper a new multivariate regression estimate is introduced. It is based on ideas derived in the context of wavelet estimates and is constructed by hard thresholding of estimates of coefficients of a series expansion of the regression function. Multivariate functions constructed analogously to the classical Haar wavelets are used for the series expansion. These functions are orthogonal in _L2(_μn)$L_2({\mu }_n)$, where _μn${\mu }_n$ denotes the empirical design measure. The construction can be considered as designing adapted Haar wavelets.     

Simultaneous estimation of Poisson means of the selected subset

Let _π1,_π2,…,_πp${\pi }_1,{\pi }_2,\dots ,{\pi }_p$ be p   independent Poisson populations with means _λ1,…,_λp${\lambda }_1,\dots ,{\lambda }_p$, respectively. Let {X₁,…,X_p} denote the set of observations, where X_i is from _πi${\pi }_i$. Suppose a subset of populations is selected using Gupta and Huang's (1975) selection rule which selects _πi${\pi }_i$ if and only if _Xi+1?_cX(1)$X_i+1?{\mathit{cX}}_{(1)}$, where X₍₁₎=max{X₁,…,X_p}, and 0<c<1$0<c<1$. In this paper, the simultaneous estimation of the Poisson means associated with the selected populations is considered for the k-normalized squared error loss function. It is shown that the natural estimator is positively biased. Also, a class of estimators that are better than the natural estimator is obtained by solving certain difference inequalities over the sample space. A class of estimators which dominate the UMVUE is also obtained. Monte carlo simulations are used to assess the percentage improvements and an application to a real-life example is also discussed.     

Generalizing Clatworthy group divisible designs

In this paper a neat construction is provided for three new families of group divisible designs that generalize some designs from Clatworthy's table of the only 11 designs with two associate classes that have block size four, three groups, and replication numbers at most 10. In each case (namely, _λ1=4${\lambda }_1=4$ and _λ2=5${\lambda }_2=5$, _λ1=4${\lambda }_1=4$ and _λ2=2${\lambda }_2=2$, and _λ1=8${\lambda }_1=8$ and _λ2=4${\lambda }_2=4$), we have proved that the necessary conditions found are also sufficient for the existence of such GDD's with block size four and three groups, with one possible exception.     

Distribution of record statistics in a geometrically increasing population

The probability function and binomial moments of the number _Nn$N_n$ of (upper) records up to time (index) n in a geometrically increasing population are obtained in terms of the signless q-Stirling numbers of the first kind, with q   being the inverse of the proportion λ$\lambda$ of the geometric progression. Further, a strong law of large numbers and a central limit theorem for the sequence of random variables _Nn$N_n$, n=1,2,…,$n=1,2,\dots ,$ are deduced. As a corollary the probability function of the time _Tk$T_k$ of the kth record is also expressed in terms of the signless q  -Stirling numbers of the first kind. The mean of _Tk$T_k$ is obtained as a q  -series with terms of alternating sign. Finally, the probability function of the inter-record time _Wk=_Tk-_Tk-1$W_k=T_k-T_{k-1}$ is obtained as a sum of a finite number of terms of q  -numbers. The mean of _Wk$W_k$ is expressed by a q-series. As k   increases to infinity the distribution of _Wk$W_k$ converges to a geometric distribution with failure probability q. Additional properties of the q-Stirling numbers of the first kind, which facilitate the present study, are derived.     

Laws of iterated logarithm for quasi-maximum likelihood estimator in generalized linear model

For the case that the expectation of the response variable Y   is correctly specified in the generalized linear model (GLM), under some regular assumptions, we obtain and prove the law of the iterated logarithm and Chung type law of the iterated logarithm for the quasi-maximum likelihood estimator (QMLE) _βn${\beta }_n$ in this model.     

Empirical Bayes regression analysis with many regressors but fewer observations

In this paper, we consider the prediction problem in multiple linear regression model in which the number of predictor variables, p, is extremely large compared to the number of available observations, n  . The least-squares predictor based on a generalized inverse is not efficient. We propose six empirical Bayes estimators of the regression parameters. Three of them are shown to have uniformly lower prediction error than the least-squares predictors when the vector of regressor variables are assumed to be random with mean vector zero and the covariance matrix (1/n)X^tX$(1/n){\mathit{X}}^{\mathrm{t}}\mathit{X}$ where X^t=(_x1,…,_xn)${\mathit{X}}^{\mathrm{t}}=({\mathit{x}}_1,\dots ,{\mathit{x}}_n)$ is the p×n$p\times n$ matrix of observations on the regressor vector centered from their sample means. For other estimators, we use simulation to show its superiority over the least-squares predictor.     

Testing spatial randomness based on empirical distribution function: A study on lattice data

In this article, we extended the empirical distribution function based test statistic _Ik$I_k$ of Skaug and Tjostheim [1993. Nonparametric test of serial independence based on the empirical distribution function. Biometrika 80, 591–602] in the time series setting to _Dn$D_n$ for spatial lattice data and derived the asymptotic distribution of the proposed test statistic _Dn$D_n$ under the null hypothesis of spatial independence. The size and power of the proposed test statistic under conditional autoregressive model (CAR) were simulated. We applied _Dn$D_n$, Moran's I and Geary's c   to the transformed and well-studied sudden infant death syndrome data from North Carolina and found that _Dn$D_n$ produced a much smaller p$p$-value in testing spatial independence.     

Prediction of long memory processes on same-realisation

For the class of stationary Gaussian long memory processes, we study some properties of the least-squares predictor of _Xn+1$X_{n+1}$ based on (_Xn,…,_X1)$(X_n,\dots ,X_1)$. The predictor is obtained by projecting _Xn+1$X_{n+1}$ onto the finite past and the coefficients of the predictor are estimated on the same realisation. First we prove moment bounds for the inverse of the empirical covariance matrix. Then we deduce an asymptotic expression of the mean-squared error. In particular we give a relation between the number of terms used to estimate the coefficients and the number of past terms used for prediction, which ensures the L²$L^2$- sense convergence of the predictor. Finally we prove a central limit theorem when our predictor converges to the best linear predictor based on all the past.     

Characterizations based on record values and order statistics

Consider a sequence of independent and identically distributed random variables {_Xi,i?1}$\{X_i,i?1\}$ with a common absolutely continuous distribution function F  . Let _X1:n?_X2:n???_Xn:n$X_{1:n}?X_{2:n}???X_{n:n}$ be the order statistics of {_X1,_X2,…,_Xn}$\{X_1,X_2,\dots ,X_n\}$ and {_Yl,l?1}$\{Y_l,l?1\}$ be the sequence of record values generated by {_Xi,i?1}$\{X_i,i?1\}$. In this work, the conditional distribution of _Yl$Y_l$ given _Xn:n$X_{n:n}$ is established. Some characterizations of F   based on record values and _Xn:n$X_{n:n}$ are then given.