Prediction in moving average processes

For the stationary invertible moving average process of order one with unknown innovation distribution F, we construct root-n   consistent plug-in estimators of conditional expectations E(h(_Xn+1)|_X1,…,_Xn)$E(h(X_{n+1})|X_1,\dots ,X_n)$. More specifically, we give weak conditions under which such estimators admit Bahadur-type representations, assuming some smoothness of h or of F. For fixed h it suffices that h   is locally of bounded variation and locally Lipschitz in _L2(F)$L_2(F)$, and that the convolution of h and F   is continuously differentiable. A uniform representation for the plug-in estimator of the conditional distribution function P(_Xn+1?·|_X1,…,_Xn)$P(X_{n+1}?·|X_1,\dots ,X_n)$ holds if F has a uniformly continuous density. For a smoothed version of our estimator, the Bahadur representation holds uniformly over each class of functions h that have an appropriate envelope and whose shifts are F-Donsker, assuming some smoothness of F. The proofs use empirical process arguments.     

Empirical Bayes regression analysis with many regressors but fewer observations

In this paper, we consider the prediction problem in multiple linear regression model in which the number of predictor variables, p, is extremely large compared to the number of available observations, n  . The least-squares predictor based on a generalized inverse is not efficient. We propose six empirical Bayes estimators of the regression parameters. Three of them are shown to have uniformly lower prediction error than the least-squares predictors when the vector of regressor variables are assumed to be random with mean vector zero and the covariance matrix (1/n)X^tX$(1/n){\mathit{X}}^{\mathrm{t}}\mathit{X}$ where X^t=(_x1,…,_xn)${\mathit{X}}^{\mathrm{t}}=({\mathit{x}}_1,\dots ,{\mathit{x}}_n)$ is the p×n$p\times n$ matrix of observations on the regressor vector centered from their sample means. For other estimators, we use simulation to show its superiority over the least-squares predictor.     

Multivariate orthogonal series estimates for random design regression

In this paper a new multivariate regression estimate is introduced. It is based on ideas derived in the context of wavelet estimates and is constructed by hard thresholding of estimates of coefficients of a series expansion of the regression function. Multivariate functions constructed analogously to the classical Haar wavelets are used for the series expansion. These functions are orthogonal in _L2(_μn)$L_2({\mu }_n)$, where _μn${\mu }_n$ denotes the empirical design measure. The construction can be considered as designing adapted Haar wavelets.     

Moderate deviations for LS estimator in simple linear EV regression model

In this paper, we consider the following simple linear Errors-in-Variables (EV) regression model _ηi=θ+β_xi+_?i${\eta }_i=\theta +\beta x_i+{?}_i$, _ξi=_xi+_δi${\xi }_i=x_i+{\delta }_i$, 1?i?n$1?i?n$. The moderate deviation principle for the least squares (LS) estimators of the unknown parameters θ$\theta$, β$\beta$ in the model are obtained.     

Characterizations based on record values and order statistics

Consider a sequence of independent and identically distributed random variables {_Xi,i?1}$\{X_i,i?1\}$ with a common absolutely continuous distribution function F  . Let _X1:n?_X2:n???_Xn:n$X_{1:n}?X_{2:n}???X_{n:n}$ be the order statistics of {_X1,_X2,…,_Xn}$\{X_1,X_2,\dots ,X_n\}$ and {_Yl,l?1}$\{Y_l,l?1\}$ be the sequence of record values generated by {_Xi,i?1}$\{X_i,i?1\}$. In this work, the conditional distribution of _Yl$Y_l$ given _Xn:n$X_{n:n}$ is established. Some characterizations of F   based on record values and _Xn:n$X_{n:n}$ are then given.     

Nonparametric estimation of conditional expectation

Denote the integer lattice points in the N  -dimensional Euclidean space by Z^N${\mathbb{Z}}^N$ and assume that (_Xi,_Yi)$(X_{\mathbf{i}},Y_{\mathbf{i}})$, i∈Z^N$\mathbf{i}\in {\mathbb{Z}}^N$ is a mixing random field. Estimators of the conditional expectation r(x)=E[_Yi|_Xi=x]$r(\mathbf{x})=\mathrm{E}[Y_{\mathbf{i}}|X_{\mathbf{i}}=\mathbf{x}]$ by nearest neighbor methods are established and investigated. The main analytical result of this study is that, under general mixing assumptions, the estimators considered are asymptotically normal. Many difficulties arise since points in higher dimensional space N?2$N?2$ cannot be linearly ordered. Our result applies to many situations where parametric methods cannot be adopted with confidence.     

A sequential design for a clinical trial with a linear prognostic factor

We study a randomized adaptive design to assign one of the L$L$ treatments to patients who arrive sequentially by means of an urn model. At each stage n$n$, a reward is distributed between treatments. The treatment applied is rewarded according to its response, 0?_Yn?1$0?Y_n?1$, and 1-_Yn$1-Y_n$ is distributed among the other treatments according to their performance until stage n-1$n-1$. Patients can be classified in K+1$K+1$ levels and we assume that the effect of this level in the response to the treatments is linear. We study the asymptotic behavior of the design when the ordinary least square estimators are used as a measure of performance until stage n-1$n-1$.     

Distribution of record statistics in a geometrically increasing population

The probability function and binomial moments of the number _Nn$N_n$ of (upper) records up to time (index) n in a geometrically increasing population are obtained in terms of the signless q-Stirling numbers of the first kind, with q   being the inverse of the proportion λ$\lambda$ of the geometric progression. Further, a strong law of large numbers and a central limit theorem for the sequence of random variables _Nn$N_n$, n=1,2,…,$n=1,2,\dots ,$ are deduced. As a corollary the probability function of the time _Tk$T_k$ of the kth record is also expressed in terms of the signless q  -Stirling numbers of the first kind. The mean of _Tk$T_k$ is obtained as a q  -series with terms of alternating sign. Finally, the probability function of the inter-record time _Wk=_Tk-_Tk-1$W_k=T_k-T_{k-1}$ is obtained as a sum of a finite number of terms of q  -numbers. The mean of _Wk$W_k$ is expressed by a q-series. As k   increases to infinity the distribution of _Wk$W_k$ converges to a geometric distribution with failure probability q. Additional properties of the q-Stirling numbers of the first kind, which facilitate the present study, are derived.     

Robust median estimator in logistic regression

This paper introduces a median estimator of the logistic regression parameters. It is defined as the classical _L1$L_1$-estimator applied to continuous data _Z1,…,_Zn$Z_1,\dots ,Z_n$ obtained by a statistical smoothing of the original binary logistic regression observations _Y1,…,_Yn$Y_1,\dots ,Y_n$. Consistency and asymptotic normality of this estimator are proved. A method called enhancement is introduced which in some cases increases the efficiency of this estimator. Sensitivity to contaminations and leverage points is studied by simulations and compared in this manner with the sensitivity of some robust estimators previously introduced to the logistic regression. The new estimator appears to be more robust for larger sample sizes and higher levels of contamination.     

Design selection criteria for discrimination/estimation for nested models and a binomial response

The aim of an experiment is often to enable discrimination between competing forms for a response model. We investigate the selection of a continuous design for a non-sequential strategy when there are two competing generalized linear models for a binomial response, with a common link function and the linear predictor of one model nested within that of the other. A new criterion, _TE$T_E$-optimality, is defined, based on the difference in the deviances from the two models, and comparisons are made with T$T$-, _Ds$D_s$- and D$D$-optimality. Issues are raised through the study of two examples in which designs are assessed using simulation studies of the power to reject the null hypothesis of the smaller model being correct, when the data are generated from the larger model. Parameter estimation for discrimination designs is also discussed and a simple method is investigated of combining designs to form a hybrid design in order to achieve both model discrimination and estimation. This method has a computational advantage over the use of a compound criterion and the similar performance of the designs obtained from the two approaches is illustrated in an example.     

Optimal mixed-level k-circulant supersaturated designs

Supersaturated designs (SSDs) offer a potentially useful way to investigate many factors with only few experiments in the preliminary stages of experimentation. This paper explores how to construct E(_fNOD)$E(f_{\mathrm{NOD}})$-optimal mixed-level SSDs using k-cyclic generators. The necessary and sufficient conditions for the existence of mixed-level k-circulant SSDs with the equal occurrence property are provided. Properties of the mixed-level k  -circulant SSDs are investigated, in particular, the sufficient condition under which the generator vector produces an E(_fNOD)$E(f_{\mathrm{NOD}})$-optimal SSD is obtained. Moreover, many new E(_fNOD)$E(f_{\mathrm{NOD}})$-optimal mixed-level SSDs are constructed and listed. The method here generalizes the one proposed by Liu and Dean [2004. k$k$-circulant supersaturated designs. Technometrics 46, 32–43] for two-level SSDs and the one due to Georgiou and Koukouvinos [2006. Multi-level k-circulant supersaturated designs. Metrika 64, 209–220] for the multi-level case.     

Regression models for functional data by reproducing kernel Hilbert spaces methods

Non-parametric regression models are developed when the predictor is a function-valued random variable X={_Xt}t∈T$X=\{X_t{\}}_{t\in T}$. Based on a representation of the regression function f(X)$f(X)$ in a reproducing kernel Hilbert space such models generalize the classical setting used in statistical learning theory. Two applications corresponding to scalar and categorical response random variable are performed on stock-exchange and medical data. The results of different regression models are compared.