Double-smoothing for bias reduction in local linear regression

Local linear regression involves fitting a straight line segment over a small region whose midpoint is the target point x, and the local linear estimate at x   is the estimated intercept of that straight line segment, with an asymptotic bias of order h²$h^2$ and variance of order (nh)^-1$(\mathit{nh}{)}^{-1}$ (h is the bandwidth). In this paper, we propose a new estimator, the double-smoothing local linear estimator, which is constructed by integrally combining all fitted values at x   of local lines in its neighborhood with another round of smoothing. The proposed estimator attempts to make use of all information obtained from fitting local lines. Without changing the order of variance, the new estimator can reduce the bias to an order of h⁴$h^4$. The proposed estimator has better performance than local linear regression in situations with considerable bias effects; it also has less variability and more easily overcomes the sparse data problem than local cubic regression. At boundary points, the proposed estimator is comparable to local linear regression. Simulation studies are conducted and an ethanol example is used to compare the new approach with other competitive methods.     

A test for the parametric form of the variance function in a partial linear regression model

We consider the problem of testing for a parametric form of the variance function in a partial linear regression model. A new test is derived, which can detect local alternatives converging to the null hypothesis at a rate n^-1/2$n^{-1/2}$ and is based on a stochastic process of the integrated variance function. We establish weak convergence to a Gaussian process under the null hypothesis, fixed and local alternatives. In the special case of testing for homoscedasticity the limiting process is a scaled Brownian bridge. We also compare the finite sample properties with a test based on an L²$L^2$-distance, which was recently proposed by You and Chen [2005. Testing heteroscedasticity in partially linear regression models. Statist. Probab. Lett. 73, 61–70].     

On the distributions of multivariate sample skewness

In this paper, we consider the multivariate normality test based on measure of multivariate sample skewness defined by Srivastava (1984). Srivastava derived asymptotic expectation up to the order N⁻¹ for the multivariate sample skewness and approximate χ²${\chi }^2$ test statistic, where N   is sample size. Under normality, we derive another expectation and variance for Srivastava's multivariate sample skewness in order to obtain a better test statistic. From this result, improved approximate χ²${\chi }^2$ test statistic using the multivariate sample skewness is also given for assessing multivariate normality. Finally, the numerical result by Monte Carlo simulation is shown in order to evaluate accuracy of the obtained expectation, variance and improved approximate χ²${\chi }^2$ test statistic. Furthermore, upper and lower percentiles of χ²${\chi }^2$ test statistic derived in this paper are compared with those of χ²${\chi }^2$ test statistic derived by Mardia (1974) which is used multivariate sample skewness defined by Mardia (1970).     

Construction of blocked two-level regular designs with general minimum lower order confounding

Zhang et al. (2008) proposed a general minimum lower order confounding (GMC for short) criterion, which aims to select optimal factorial designs in a more elaborate and explicit manner. By extending the GMC criterion to the case of blocked designs, Wei et al. (submitted for publication) proposed a B¹-GMC criterion. The present paper gives a construction theory and obtains the B¹-GMC 2^n−m:2^r$2^{n-m}:2^r$ designs with n≥5N/16+1$n\ge 5N/16+1$, where 2^n−m:2^r$2^{n-m}:2^r$ denotes a two-level regular blocked design with N=2^n−m$N=2^{n-m}$ runs, n   treatment factors, and 2^r$2^r$ blocks. The construction result is simple. Up to isomorphism, the B¹-GMC 2^n−m:2^r$2^{n-m}:2^r$ designs can be constructed as follows: the n   treatment factors and the 2^r−1$2^r-1$ block effects are, respectively, assigned to the last n   columns and specific 2^r−1$2^r-1$ columns of the saturated 2^{(N−1)−(N−1−n+m)}$2^{(N-1)-(N-1-n+m)}$ design with Yates order. With such a simple structure, the B¹-GMC designs can be conveniently used in practice. Examples are included to illustrate the theory.     

Regularization and variable selection for infinite variance autoregressive models

Autoregressive models with infinite variance are of great importance in modeling heavy-tailed time series and have been well studied. In this paper, we propose a penalized method to conduct model selection for autoregressive models with innovations having Pareto-like distributions with index α∈(0,2)$\alpha \in (\mathrm{0,2})$. By combining the least absolute deviation loss function and the adaptive lasso penalty, the proposed method is able to consistently identify the true model and at the same time produce efficient estimators with a convergence rate of n^−1/α$n^{-1/\alpha }$. In addition, our approach provides a unified way to conduct variable selection for autoregressive models with finite or infinite variance. A simulation study and a real data analysis are conducted to illustrate the effectiveness of our method.     

Quasi-minimax estimation in the general linear regression model

This paper is mainly concerned with minimax estimation in the general linear regression model y=Xβ+ε$y=X\beta +\epsilon$ under ellipsoidal restrictions on the parameter space and quadratic loss function. We confine ourselves to estimators that are linear in the response vector y  . The minimax estimators of the regression coefficient β$\beta$ are derived under homogeneous condition and heterogeneous condition, respectively. Furthermore, these obtained estimators are the ridge-type estimators and mean dispersion error (MDE) superior to the best linear unbiased estimator b=(X^′W^-1X)^-1X^′W^-1y$b=(X^{\prime }{W}^{-1}X{)}^{-1}{X}^{\prime }{W}^{-1}y$ under some conditions.     

Addition of runs to an s-level supersaturated design

The purpose of the present work is to extend the work of Gupta et al. (2010) to s  -level column balanced supersaturated designs. Addition of runs to an existing E(χ²)-optimal$E({\chi }^2)\mathrm{-}\mathrm{optimal}$ supersaturated design and to study the optimality of the resulting design is an important issue. This paper considers the study of the optimality of the resulting design. A lower bound to E(χ²)$E({\chi }^2)$ has been obtained for the extended supersaturated designs. Some examples and a small catalogue of E(χ²)-optimal$E({\chi }^2)\mathrm{-}\mathrm{optimal}$ supersaturated designs are also presented.     

Rates of convergence for the k-nearest neighbor estimators with smoother regression functions

Let (X, Y  ) be a R^d×R-valued${\mathbb{R}}^d\times \mathbb{R}\mathrm{-}\mathrm{valued}$ random vector. In regression analysis one wants to estimate the regression function m(x)?E(Y|X=x)$m(x)?\mathbf{E}(Y|X=x)$ from a data set. In this paper we consider the rate of convergence for the k-nearest neighbor estimators in case that X   is uniformly distributed on [0,1]^d$[\mathrm{0,1}{]}^d$, Var(Y|X=x)$\mathbf{Var}(Y|X=x)$ is bounded, and m is (p, C)-smooth. It is an open problem whether the optimal rate can be achieved by a k  -nearest neighbor estimator for 1<p≤1.5$1<p\le 1.5$. We solve the problem affirmatively. This is the main result of this paper. Throughout this paper, we assume that the data is independent and identically distributed and as an error criterion we use the expected L₂ error.     

General minimum lower order confounding designs: An overview and a construction theory

For fractional factorial (FF) designs, Zhang et al. (2008) introduced a new pattern for assessing regular designs, called aliased effect-number pattern (AENP), and based on the AENP, proposed a general minimum lower order confounding (denoted by GMC for short) criterion for selecting design. In this paper, we first have an overview of the existing optimality criteria of FF designs, and then propose a construction theory for 2^n−m$2^{n-m}$ GMC designs with 33N/128≤n≤5N/16$33N/128\le n\le 5N/16$, where N=2^n−m$N=2^{n-m}$ is the run size and n is the number of factors, for all N's and n  's, via the doubling theory and SOS resolution IV designs. The doubling theory is extended with a new approach. By introducing a notion of rechanged (RC) Yates order for the regular saturated design, the construction result turns out to be quite transparent: every GMC 2^n−m$2^{n-m}$ design simply consists of the last n columns of the saturated design with a specific RC Yates order. This can be very conveniently applied in practice.     

On E(s)-optimal supersaturated designs

A popular measure to assess 2-level supersaturated designs is the E(s²)$E(s^2)$ criterion. In this paper, improved lower bounds on E(s²)$E(s^2)$ are obtained. The same improvement has recently been established by Ryan and Bulutoglu [2007. E(s²)$E(s^2)$-optimal supersaturated designs with good minimax properties. J. Statist. Plann. Inference 137, 2250–2262]. However, our analysis provides more details on precisely when an improvement is possible, which is lacking in Ryan and Bulutoglu [2007. E(s²)$E(s^2)$-optimal supersaturated designs with good minimax properties. J. Statist. Plann. Inference 137, 2250–2262]. The equivalence of the bounds obtained by Butler et al. [2001. A general method of constructing E(s²)$E(s^2)$-optimal supersaturated designs. J. Roy. Statist. Soc. B 63, 621–632] (in the cases where their result applies) and those obtained by Bulutoglu and Cheng [2004. Construction of E(s²)$E(s^2)$-optimal supersaturated designs. Ann. Statist. 32, 1662–1678] is established. We also give two simple methods of constructing E(s²)$E(s^2)$-optimal designs.     

Lattice and Schröder paths with periodic boundaries

We consider paths in the plane with (1,0$1,0$), (0,1$0,1$), and (a,b$a,b$)-steps that start at the origin, end at height n$n$, and stay strictly to the left of a given non-decreasing right boundary. We show that if the boundary is periodic and has slope at most b/a$b/a$, then the ordinary generating function for the number of such paths ending at height n   is algebraic. Our argument is in two parts. We use a simple combinatorial decomposition to obtain an Appell relation or “umbral” generating function, in which the power zⁿ$z^n$ is replaced by a power series of the form zⁿ_φn(z),$z^n{\phi }_n(z),$ where _φn(0)=1.${\phi }_n(0)=1.$ Then we convert (in an explicit way) the umbral generating function to an ordinary generating function by solving a system of linear equations and a polynomial equation. This conversion implies that the ordinary generating function is algebraic. We give several concrete examples, including an alternative way to solve the tennis ball problem.     

On empirical likelihood for linear models with missing responses

Suppose that we have a linear regression model Y=X^′β+_ν0(X)ε$Y=X^{\prime }\beta +{\nu }_0(X)\epsilon$ with random error ε$\epsilon$, where X is a random design variable and is observed completely, and Y is the response variable and some Y-values are missing at random (MAR). In this paper, based on the ‘complete’ data set for Y after inverse probability weighted imputation, we construct empirical likelihood statistics on EY   and β$\beta$ which have the χ²${\chi }^2$-type limiting distributions under some new conditions compared with Xue (2009). Our results broaden the applicable scope of the approach combined with Xue (2009).     

Statistical properties of Rechtschaffner designs

Rechtschaffner designs are saturated designs of resolution V   in which main effects and two-factor interactions are estimable if three-factor and higher order interactions are negligible. Statistical properties of Rechtschaffner designs are studied in this paper. Best linear unbiased estimators of main effects and two-factor interactions are given explicitly and asymptotic properties of correlations between these estimators are studied as well. It is shown that designs recommended by Rechtschaffner [1967. Saturated fractions of 2ⁿ$2^n$ and 3ⁿ$3^n$ factorial designs, Technometrics 9, 569–576] are not only A-optimal but also D-optimal. Comparisons of Rechtschaffner designs with other A- and D-optimal designs of resolution V are also discussed.     

On batch queueing systems: A combinatorial approach

We consider batch queueing systems M/M^H/1$M/M^H/1$ and M^H/M/1$M^H/M/1$ with catastrophes. The transient probability functions of these queueing systems are obtained by a Lattice Path Combinatorics approach that utilizes randomization and dual processes. Steady state distributions are also determined. Generalization to systems having batches of different sizes are discussed.     

Testing of a sub-hypothesis in linear regression models with long memory errors and deterministic design

This paper considers the problem of testing a sub-hypothesis in homoscedastic linear regression models where errors form long memory moving average processes and designs are non-random. Unlike in the random design case, asymptotic null distribution of the likelihood ratio type test based on the Whittle quadratic form is shown to be non-standard and non-chi-square. Moreover, the rate of consistency of the minimum Whittle dispersion estimator of the slope parameter vector is shown to be n^-(1-α)/2$n^{-(1-\alpha )/2}$, different from the rate n^-1/2$n^{-1/2}$ obtained in the random design case, where α$\alpha$ is the rate at which the error spectral density explodes at the origin. The proposed test is shown to be consistent against fixed alternatives and has non-trivial asymptotic power against local alternatives that converge to null hypothesis at the rate n^-(1-α)/2$n^{-(1-\alpha )/2}$.