Linear models that allow perfect estimation

The general Gauss–Markov model, Y = Xβ + e, E(e) = 0, Cov(e) = σ ² V, has been intensively studied and widely used. Most studies consider covariance matrices V that are nonsingular but we focus on the most difficult case wherein C(X), the column space of X, is not contained in C(V). This forces V to be singular. Under this condition there exist nontrivial linear functions of Q′Xβ that are known with probability 1 (perfectly) where ${C(Q)=C(V)^\perp}$ . To treat ${C(X) \not \subset C(V)}$ , much of the existing literature obtains estimates and tests by replacing V with a pseudo-covariance matrix T = V + XUX′ for some nonnegative definite U such that ${C(X) \subset C(T)}$ , see Christensen (Plane answers to complex questions: the theory of linear models, 2002, Chap. 10). We find it more intuitive to first eliminate what is known about Xβ and then to adjust X while keeping V unchanged. We show that we can decompose β into the sum of two orthogonal parts, β = β ₀ + β ₁, where β ₀ is known. We also show that the unknown component of X β is ${X\beta_1 \equiv \tilde{X} \gamma}$ , where ${C(\tilde{X})=C(X)\cap C(V)}$ . We replace the original model with ${Y-X\beta_0=\tilde{X}\gamma+e}$ , E(e) = 0, ${Cov(e)=\sigma^2V}$ and perform estimation and tests under this new model for which the simplifying assumption ${C(\tilde{X}) \subset C(V)}$ holds. This allows us to focus on the part of that parameters that are not known perfectly. We show that this method provides the usual estimates and tests.     

Estimation of Main Effect When Covariates Have Non-Proportional Hazards

The Cox proportional hazards (PH) regression model has been widely used to analyze survival data in clinical trials and observational studies. In addition to estimating the main treatment or exposure group effect, it is common to adjust for additional covariates using the Cox model. It is well known that violation of the PH assumption can lead to estimates that are biased and difficult to interpret, and model checking has become a routine procedure. However, such checking might focus on the primary group comparisons, and the assumption can still be violated when adjusting for many of the potential covariates. We study the effect of violation of the PH assumption of the covariates on the estimation of the main group effect in the Cox model. The results are summarized in terms of the bias and the coverage properties of the confidence intervals. Overall in randomized clinical trials, the bias caused by misspecifying the PH assumption on the covariates is no more than 15% in absolute value regardless of sample size. In observational studies where the covariates are likely correlated with the group variable, however, the bias can be very severe. The coverage properties largely depend on sample size, as expected, as bias becomes dominating with increasing sample size. These findings should serve as cautionary notes when adjusting for potential confounders in observational studies, as the violation of PH assumption on the confounders can lead to erroneous results.     

Notes on Test Homogeneity of the Odds Ratio in Matched Pairs Under Stratified Sampling: A Monte Carlo Evaluation

Using Monte Carlo simulation, we compare the performance of five asymptotic test procedures and a randomized permutation test procedure for testing the homogeneity of odds ratio under the stratified matched-pair design. We note that the weighted-least-square test procedure is liberal, while Pearson's goodness-of-fit (PGF) test procedure with the continuity correction is conservative. We note that PGF without the continuity correction, the conditional likelihood ratio test procedure, and the randomized permutation test procedure can generally perform well with respect to Type I error. We use the data taken from a case–control study regarding the endometrial cancer incidence published elsewhere to illustrate the use of these test procedures.     

Group Variable Selection with Oracle Property by Weight-Fused Adaptive Elastic Net Model for Strongly Correlated Data

This paper is the generalization of weight-fused elastic net (Fu and Xu, 2012 Fu, G., Xu, Q. (2012). Grouping variable selection by weight fused elastic net for multi-collinear data. Communications in Statistics-Simulation and Computation 41(2):205–221.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), which performs group variable selection by combining weight-fused LASSO(wfLasso) and elastic net (Zou and Hastie, 2005 Zou, H., Hastie, T. (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 67(2):301–320.[Crossref], [Web of Science ®] , [Google Scholar]) penalties. In this study, the elastic net penalty is replaced by adaptive elastic net penalty (AdaEnet) (Zou and Zhang, 2009 Zou, H., Zhang, H. (2009). On the adaptive elastic-net with a diverging number of parameters. Annals of Statistics 37(4):1733–1751.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), and a new group variable selection algorithm with oracle property (Fan and Li, 2001 Fan, J., Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association 96(456):1348–1360.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]; Zou, 2006 Zou, H. (2006). The adaptive lasso and its oracle properties. Journal of the American Statistical Association 101(476):1418–1429.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) is obtained.     

A simple method to obtain minimum aberration split-plot designs

ABSTRACT

Split-plot designs have been utilized in factorial experiments with some factors applied to larger units and others to smaller units. Such designs with low aberration are preferred when the experimental size and the number of factors considered in both whole plot and subplot are determined. The minimum aberration split-plot designs can be obtained using either computer algorithms or the exhausted search. In this article, we propose a simple, easy-to-operate approach by using two ordered sequences of columns from two orthogonal arrays in obtaining minimum aberration split-plot designs for experiments of sizes 16 and 32.     

Parallel tempering for dynamic generalized linear models

ABSTRACT

Markov chain Monte Carlo (MCMC) methods can be used for statistical inference. The methods are time-consuming due to time-vary. To resolve these problems, parallel tempering (PT), as a parallel MCMC method, is tried, for dynamic generalized linear models (DGLMs), as well as the several optimal properties of our proposed method. In PT, two or more samples are drawn at the same time, and samples can exchange information with each other. We also present some simulations of the DGLMs in the case and provide two applications of Poisson-type DGLMs in financial research.     

Empirical Likelihood for Single-Index Regression Models under Negatively Associated Errors

In this article, we use bockwise empirical likelihood technique to construct confidence regions for the parameter of the single-index models under negatively associated errors. It is shown that the blockwise empirical likelihood ratio statistic for the parameter of interest is asymptotically χ²-type distributed. The result can be used to obtain confidence regions for the parameter of interest.     

Empirical Likelihood Inference for the Parameter in Additive Partially Linear EV Models

In this article, we consider empirical likelihood inference for the parameter in the additive partially linear models when the linear covariate is measured with error. By correcting for attenuation, a corrected-attenuation empirical log-likelihood ratio statistic for the unknown parameter β, which is of primary interest, is suggested. We show that the proposed statistic is asymptotically standard chi-square distribution without requiring the undersmoothing of the nonparametric components, and hence it can be directly used to construct the confidence region for the parameter β. Some simulations indicate that, in terms of comparison between coverage probabilities and average lengths of the confidence intervals, the proposed method performs better than the profile-based least-squares method. We also give the maximum empirical likelihood estimator (MELE) for the unknown parameter β, and prove the MELE is asymptotically normal under some mild conditions.     

Multiplicative Adjustment Method for Semiparametric Regression with Mixing Dependent Data

In this article, we extend a semiparametric regression estimator with multiplicative adjustment to time series context. The asymptotic theory and results from a simulation study are discussed. Theoretical results and numerical comparison show that, in the time series case, the semiparametric estimator is better than the traditional local polynomial estimator in a wide neighbourhood around the true regression function.