A Note on High-Dimensional Linear Regression With Interactions

The problem of interaction selection in high-dimensional data analysis has recently received much attention. This note aims to address and clarify several fundamental issues in interaction selection for linear regression models, especially when the input dimension p is much larger than the sample size n. We first discuss how to give a formal definition of “importance” for main and interaction effects. Then we focus on two-stage methods, which are computationally attractive for high-dimensional data analysis but thus far have been regarded as heuristic. We revisit the counterexample of Turlach and provide new insight to justify two-stage methods from the theoretical perspective. In the end, we suggest new strategies for interaction selection under the marginality principle and provide some simulation results.     

Combined asymmetric spatial weights matrix with application to housing prices

In this study, a combined asymmetric spatial weights matrix is proposed for capturing the unequal spatial dependence of housing prices, where the advantage of this matrix was demonstrated by a non-nested hypothesis test. To explore the heterogeneous spatial impacts of urban essential characteristics on housing prices over the eastern, central, and western regions of China, after the Lagrange multiplier and likelihood ratio tests, the spatial Durbin model using the proposed weights matrix was applied to each region. The estimation results showed that the direct impacts of college and new employment were significantly negative in the eastern region, but not significant in the central and western regions. By contrast, the direct impacts of hospitals and scenic spots were significantly positive in eastern China, but not significant in central and western China. In addition, the indirect impacts of the four variables were not significant in the three regions. These results suggest that in eastern China, the government may increase the requirements for using medical resources and close tourist attractions in a single city to cool down the skyrocketing housing prices in this area.     

Comparison of methods for analyzing binary repeated measures data: A simulation-based study (comparison of methods for binary repeated measures)

In this study, some methods suggested for binary repeated measures, namely, Weighted Least Squares (WLS), Generalized Estimating Equations (GEE), and Generalized Linear Mixed Models (GLMM) are compared with respect to power, type 1 error, and properties of estimates. The results indicate that with adequate sample size, no missing data, the only covariate being time effect, and a relatively limited number of time points, the WLS method performs well. The GEE approach performs well only for large sample sizes. The GLMM method is satisfactory with respect to type I error, but its estimates have poorer properties than the other methods.     

Weighted kappa as a function of unweighted kappas

The kappa coefficient is a widely used measure for assessing agreement on a nominal scale. Weighted kappa is an extension of Cohen's kappa that is commonly used for measuring agreement on an ordinal scale. In this article, it is shown that weighted kappa can be computed as a function of unweighted kappas. The latter coefficients are kappa coefficients that correspond to smaller contingency tables that are obtained by merging categories.     

Saddlepoint p-values for group of linear rank tests

Many nonparametric tests in one sample problem, matched pairs, and competingrisks under censoring have the same underlying permutation distribution. This article proposes a saddlepoint approximation to the exact p-values of these tests instead of the asymptotic approximations. The performance of the saddlepoint approximation is assessed by using simulation studies that show the superiority of the saddlepoint methods over the asymptotic approximations in several settings. The use of the saddlepoint to approximate the p-values of class of two sample tests under complete randomized design is also discussed.     

Bootstrap methods for multivariate hypothesis testing

The nonparametric and parametric bootstrap methods for multivariate hypothesis testing are developed. They are used to approximate the null distribution of the test statistics proposed by Duchesne and Francq (2015 Duchesne, P., Francq, C. (2015). Multivariate hypothesis testing using generalized and {2}-inverses—with applications. Statistics 49:475–496.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]), resulting in bootstrap testing procedures. In the problem of testing for the mean vector of a multivariate distribution, the asymptotic validity of the bootstrap methods is proved. The finite sample performance of the new solutions is demonstrated by means of Monte Carlo simulation studies. They indicate that for small-sample size, the bootstrap tests provide a better finite sample properties than the asymptotic tests considered by Duchesne and Francq (2015 Duchesne, P., Francq, C. (2015). Multivariate hypothesis testing using generalized and {2}-inverses—with applications. Statistics 49:475–496.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]).     

Optimum designs for parameter estimation in a mixture experiment with two correlated responses

In this paper, we investigate a mixture problem with two responses, which are functions of the mixing proportions, and are correlated with known dispersion matrix. We obtain D- and A-optimal designs for estimating the parameters of the response functions, when none or some of the regression coefficients of the two functions are the same. It is shown that when no prior knowledge about the regression coefficients is available, the D-optimal design is independent of the dispersion matrix, while the A-optimal design depends on it, provided the response functions are of different degree. On the other hand, when some of the regression coefficients are known to be the same for both the functions, the D-optimal design depends on the dispersion matrix when the two response functions are not of the same degree.     

An evaluation of the reconstructed coefficient of determination and potential adjustments

Previously, a method was proposed for calculating a reconstructed coefficient of determination in the case of right-censored regression using the expectation–maximization (EM) algorithm. This measure is assessed via simulation study for the purpose of evaluating the utility of model fit. Further, several reconstructed adjusted coefficients of determination are proposed and compared via simulation study for the purpose of model selection. The application of these proposed measures is illustrated on a real dataset.     

Finite-sample distributions of the Wald,likelihood ratio,and Lagrange multiplier test statistics in the classical linear model

In this note, it is shown that the finite-sample distributions of the Wald, likelihood ratio, and Lagrange multiplier statistics in the classical linear regression model are members of the generalized beta model introduced by McDonald and Xu (1995a McDonald, J.B., Xu, Y.J. (1995a). A generalization of the beta distribution with applications. J. Econom. 66:133–152.[Crossref], [Web of Science ®] , [Google Scholar]). This is useful for examining the properties of these test statistics. For example, this characterization makes it easy to find distribution, quantile, and density functions for each test statistic, makes it clear why Wald tests may overreject the null hypothesis using asymptotic critical values, and formalizes the fact that the Lagrange multiplier statistic follows a distribution with bounded support.