Asymptotic normality of Huber–Dutter estimators in a linear model with AR(1) processes

The paper studies a linear regression model with first order autoregressive (AR(1)) processes. The Huber–Dutter (HD) estimators of unknown parameters are given, and the asymptotic normality of the HD estimators is investigated. An example is presented to illustrate the proposed method.     

Extended BIC for linear regression models with diverging number of relevant features and high or ultra-high feature spaces

In many conventional scientific investigations with high or ultra-high dimensional feature spaces, the relevant features, though sparse, are large in number compared with classical statistical problems, and the magnitude of their effects tapers off. It is reasonable to model the number of relevant features as a diverging sequence when sample size increases. In this paper, we investigate the properties of the extended Bayes information criterion (EBIC) (Chen and Chen, 2008) for feature selection in linear regression models with diverging number of relevant features in high or ultra-high dimensional feature spaces. The selection consistency of the EBIC in this situation is established. The application of EBIC to feature selection is considered in a SCAD cum EBIC procedure. Simulation studies are conducted to demonstrate the performance of the SCAD cum EBIC procedure in finite sample cases.     

Two Pitfalls of Using Standard Regression Diagnostics When Both X and Y Have Measurement Error

Modern exploratory data analysis produces models that are not based on physical theory but that are consistent with pictures of the data. When both X and Y have error this can be risky, because important features are hidden. Two examples are given that show that systematic model departures and heteroscedasticity may not be detectable with standard regression diagnostics.     

Hierarchical Variable Selection in Polynomial Regression Models

Significance tests on coefficients of lower-order terms in polynomial regression models are affected by linear transformations. For this reason, a polynomial regression model that excludes hierarchically inferior predictors (i.e., lower-order terms) is considered to be not well formulated. Existing variable-selection algorithms do not take into account the hierarchy of predictors and often select as “best” a model that is not hierarchically well formulated. This article proposes a theory of the hierarchical ordering of the predictors of an arbitrary polynomial regression model in m variables, where m is any arbitrary positive integer. Ways of modifying existing algorithms to restrict their search to well-formulated models are suggested. An algorithm that generates all possible well-formulated models is presented.     

Resolving the Mixed Models Controversy

Two standard mixed models with interactions are discussed. When each is viewed in the context of superpopulation models, the mixed models controversy is resolved. The tests suggested by the expected mean squares under the constrained-parameters model are correct for testing the main effects and interactions under both the unconstrained-and constrained-parameters models.     

Pmc-optimal nonparametric quantile estimator

According to Pitman's Measure of Closeness, if T₁and T₂are two estimators of a real parameter $[d], then T₁is better than T₂if Po[d]{T₁-o[d] < T₂-0[d]} > 1/2 for all 0[d]. It may however happen that while T₁is better than T₂and T₂is better than T₃, T₃is better than T₁. Given q ? (0,1) and a sample X₁, X₂, ..., X_nfrom an unknown F ? F, an estimator T* = T*(X₁,X₂...X_n)of the q-th quantile of the distribution F is constructed such that P_F{F(T*)-q <[d] F(T)-q} >[d] 1/2 for all F?F and for all T€T, where F is a nonparametric family of distributions and T is a class of estimators. It is shown that T* =X_j:n'for a suitably chosen jth order statistic.     

A class of weighted normal distributions and its variants useful for inequality constrained analysis

This article develops a class of the weighted normal distributions for which the probability density function has the form of a product of a normal density and a weight function. The class constitutes marginal distributions obtained from various kinds of doubly truncated bivariate normal distributions. This class of distributions strictly includes the normal, skew–normal and two-piece skew–normal and is useful for selection modelling and inequality constrained normal mean analysis. Some distributional properties and Bayesian perspectives of the class are given. Probabilistic representation of the distributions is also given. The representation is shown to be straightforward to specify distribution and to implement computation, with output readily adapted for required analysis. Necessary theories and illustrative examples are provided.     

Reducing component estimation for varying coefficient models

The estimation problem for varying coefficient models has been studied by many authors. We consider the problem in the case that the unknown functions admit different degrees of smoothness. In this paper we propose a reducing component local polynomial method to estimate the unknown functions. It is shown that all of our estimators achieve the optimal convergence rates. The asymptotic distributions of our estimators are also derived. The established asymptotic results and the simulation results show that our estimators outperform the the existing two-step estimators when the coefficient functions admit different degrees of smoothness. We also develop methods to speed up the estimation of the model and the selection of the bandwidths.     

Asymptotically minimax non–parametric function estimation with positivity constraints I

The spatially inhomogeneous smoothness of the non-parametric density or regression-function to be estimated by non-parametric methods is often modelled by Besov- and Triebel-type smoothness constraints. For such problems, Donoho and Johnstone [D.L. Donoho and I.M. Johnstone, Minimax estimation via wavelet shrinkage. Ann. Stat. 26 (1998), pp. 879–921.], Delyon and Juditsky [B. Delyon and A. Juditsky, On minimax wavelet estimators, Appl. Comput. Harmon. Anal. 3 (1996), pp. 215–228.] studied minimax rates of convergence for wavelet estimators with thresholding, while Lepski et al. [O.V. Lepski, E. Mammen, and V.G. Spokoiny, Optimal spatial adaptation to inhomogeneous smoothness: an approach based on kernel estimators with variable bandwidth selectors, Ann. Stat. 25 (1997), pp. 929–947.] proposed a variable bandwidth selection for kernel estimators that achieved optimal rates over Besov classes. However, a second challenge in many real applications of non-parametric curve estimation is that the function must be positive. Here, we show how to construct estimators under positivity constraints that satisfy these constraints and also achieve minimax rates over the appropriate smoothness class.