Strong consistency of least squares estimates with i.i.d. errors with mean values not necessarily defined

We establish strong consistency of the least squares estimates in multiple regression models discarding the usual assumption of the errors having null mean value. Thus, we required them to be i.i.d. with absolute moment of order r, 0<r<2, and null mean value when r>1. Only moderately restrictive conditions are imposed on the model matrix. In our treatment, we use an extension of the Marcinkiewicz–Zygmund strong law to overcome the errors mean value not being defined. In this way, we get a unified treatment for the case of i.i.d. errors extending the results of some previous papers.     

Optimal orthogonal block designs for four-mixture components in two blocks based on F-squares for Becker's models and K-model

Orthogonal block designs in mixture experiments have been extensively studied by various authors. Aggarwal et al. [M.L. Aggarwal, P. Singh, V. Sarin, and B. Husain, Mixture designs in orthogonal blocks using F-squares, METRON – Int. J. Statist. LXVII(2) (2009), pp. 105–128] considered the case of components assuming the same volume fractions and obtained mixture designs in orthogonal blocks using F-squares. In this paper, we have used the class of designs presented by Aggarwal et al. and have obtained D-, A- and E-optimal orthogonal block designs for four components in two blocks for Becker's mixture models and K-model, respectively. Orthogonality conditions for the considered models are also given.     

On sufficient conditions for the strong consistency of least-squares estimates

The strong consistency of the least-squares estimates in regression models is obtained when the errors are i.i.d. with absolute moment of order r, 0<r? 2. The assumptions presented for the random error sequence will permit us to obtain improvements of the conditions on the regressors in order to obtain the strong consistency of the least-squares estimates in linear and nonlinear regression models.     

Statistical inference on asymptotic properties of two estimators for the partially linear single-index models

The outer product of gradients (OPG) estimation procedure based on least squares (LS) approach has been presented by Xia et al. [An adaptive estimation of dimension reduction space. J Roy Statist Soc Ser B. 2002;64:363–410] to estimate the single-index parameter in partially linear single-index models (PLSIM). However, its asymptotic property has not been established yet and the efficiency of LS-based method can be significantly affected by outliers and heavy-tailed distributions. In this paper, we firstly derive the asymptotic property of OPG estimator developed by Xia et al. [An adaptive estimation of dimension reduction space. J Roy Statist Soc Ser B. 2002;64:363–410] in theory, and a novel robust estimation procedure combining the ideas of OPG and local rank (LR) inference is further developed for PLSIM along with its theoretical property. Then, we theoretically derive the asymptotic relative efficiency (ARE) of the proposed LR-based procedure with respect to LS-based method, which is shown to possess an expression that is closely related to that of the signed-rank Wilcoxon test in comparison with the t-test. Moreover, we demonstrate that the new proposed estimator has a great efficiency gain across a wide spectrum of non-normal error distributions and almost not lose any efficiency for the normal error. Even in the worst case scenarios, the ARE owns a lower bound equalling to 0.864 for estimating the single-index parameter and a lower bound being 0.8896 for estimating the nonparametric function respectively, versus the LS-based estimators. Finally, some Monte Carlo simulations and a real data analysis are conducted to illustrate the finite sample performance of the estimators.     

Invariance In the linear model – an argument for χ2 and F in nonnormal situations

For a suitable norm, conservation of the distance between expectation and hypothesis may furnish a basis for data reduction by invariance in the linear, not neces-sarily normal, model. If the norm is Euclidean (i.e. based on some inner product), the maximal invariant is a pair of sums of squares. This provides support for traditional χ² (or F) - methods also in nonnormal cases. If the norm is l^p p≠2, or the supnorm, the maximal invariant is, at the best a air of order statistics.     

An Empirical Study of Statistical Properties of Variance Partition Coefficients for Multi-Level Logistic Regression Models

Partitioning the variance of a response by design levels is challenging for binomial and other discrete outcomes. Goldstein (2003 Goldstein , H. ( 2003 ). Multilevel Statistical Models. 3rd ed . London : Edward Arnold . [Google Scholar]) proposed four definitions for variance partitioning coefficients (VPC) under a two-level logistic regression model. In this study, we explicitly derived formulae for multi-level logistic regression model and subsequently studied the distributional properties of the calculated VPCs. Using simulations and a vegetation dataset, we demonstrated associations between different VPC definitions, the importance of methods for estimating VPCs (by comparing VPC obtained using Laplace and penalized quasilikehood methods), and bivariate dependence between VPCs calculated at different levels. Such an empirical study lends an immediate support to wider applications of VPC in scientific data analysis.     

On the Detection of Contemporaneous Relationships Among Multiple Time Series

A study is carried out of a sampling from a half-normal and exponential distributions to develop a test of hypothesis on the mean. Although these distributions are similar, the corresponding uniformly most paerful test statistics are different. The exact distributions of these statistics my be written in terms of the incomplete gamma function. If the experimental data my be fitted by either distributions, it is advisable to carryout the test based on the half-normal distribution as it is generally more powerful than the one based on the exponential one.     

Variable Selection for Partially Linear Models with Randomly Censored Data

This article proposes a variable selection procedure for partially linear models with right-censored data via penalized least squares. We apply the SCAD penalty to select significant variables and estimate unknown parameters simultaneously. The sampling properties for the proposed procedure are investigated. The rate of convergence and the asymptotic normality of the proposed estimators are established. Furthermore, the SCAD-penalized estimators of the nonzero coefficients are shown to have the asymptotic oracle property. In addition, an iterative algorithm is proposed to find the solution of the penalized least squares. Simulation studies are conducted to examine the finite sample performance of the proposed method.     

Analyzing Supersaturated Designs by Means of an Information Based Criterion

The cost and time consumption of many industrial experimentations can be reduced using the class of supersaturated designs since this can be used for screening out the important factors from a large set of potentially active variables. A supersaturated design is a design for which there are fewer runs than effects to be estimated. Although there exists a wide study of construction methods for supersaturated designs, their analysis methods are yet in an early research stage. In this article, we propose a method for analyzing data using a correlation-based measure, named as symmetrical uncertainty. This method combines measures from the information theory field and is used as the main idea of variable selection algorithms developed in data mining. In this work, the symmetrical uncertainty is used from another viewpoint in order to determine more directly the important factors. The specific method enables us to use supersaturated designs for analyzing data of generalized linear models for a Bernoulli response. We evaluate our method by using some of the existing supersaturated designs, obtained according to methods proposed by Tang and Wu (1997 Tang , B. , Wu , C. F. J. (1997). A method for constructing supersaturated designs and its E(s ²)-optimality. Canadian Journal of Statistics 25:191–201.[Crossref], [Web of Science ®] , [Google Scholar]) as well as by Koukouvinos et al. (2008 Koukouvinos , C. , Mylona , K. , Simos , D. E. ( 2008 ). E(s ²)-optimal and minimax-optimal cyclic supersaturated designs via multi-objective simulated annealing . Journal of Statistical Planning and Inference 138 : 1639 – 1646 .[Crossref], [Web of Science ®] , [Google Scholar]). The comparison is performed by some simulating experiments and the Type I and Type II error rates are calculated. Additionally, Receiver Operating Characteristics (ROC) curves methodology is applied as an additional statistical tool for performance evaluation.