On comparing,classifying and clustering several dependent regression models

Classifying several regression models fitted on a dataset is one of the most problems in data analysis. In other words, scientists are interested in comparing several regression models that can be used for a dataset. In this paper, an approach will be used to compare and classify several dependent regression models. Then the performance of the proposed method is investigated using simulation study and real example.     

Model selection in high-dimensional noisy data: a simulation study

In many practical applications, high-dimensional regression analyses have to take into account measurement error in the covariates. It is thus necessary to extend regularization methods, that can handle the situation where the number of covariates p largely exceed the sample size n, to the case in which covariates are also mismeasured. A variety of methods are available in this context, but many of them rely on knowledge about the measurement error and the structure of its covariance matrix. In this paper, we set the goal to compare some of these methods, focusing on situations relevant for practical applications. In particular, we will evaluate these methods in setups in which the measurement error distribution and dependence structure are not known and have to be estimated from data. Our focus is on variable selection, and the evaluation is based on extensive simulations.     

Diagnostics of multiple group influential observations for logistic regression models

In this paper, two new multiple influential observation detection methods, GCD.GSPR and mCD*, are introduced for logistic regression. The proposed diagnostic measures are compared with the generalized difference in fits (GDFFITS) and the generalized squared difference in beta (GSDFBETA), which are multiple influential diagnostics. The simulation study is conducted with one, two and five independent variable logistic regression models. The performance of the diagnostic measures is examined for a single contaminated independent variable for each model and in the case where all the independent variables are contaminated with certain contamination rates and intensity. In addition, the performance of the diagnostic measures is compared in terms of the correct identification rate and swamping rate via a frequently referred to data set in the literature.     

Finite mixture of regression models for a stratified sample

Despite the popularity and importance, there is limited work on modelling data which come from complex survey design using finite mixture models. In this work, we explored the use of finite mixture regression models when the samples were drawn using a complex survey design. In particular, we considered modelling data collected based on stratified sampling design. We developed a new design-based inference where we integrated sampling weights in the complete-data log-likelihood function. The expectation–maximisation algorithm was developed accordingly. A simulation study was conducted to compare the new methodology with the usual finite mixture of a regression model. The comparison was done using bias-variance components of mean square error. Additionally, a simulation study was conducted to assess the ability of the Bayesian information criterion to select the optimal number of components under the proposed modelling approach. The methodology was implemented on real data with good results.     

Assessing the market values of soccer players – a robust analysis of data from German 1. and 2. Bundesliga

The paper examines to what extent a player's market value depends on his skills. Therefore, a data set covering 28 performance measures and the market values of about 493 players from 1. and 2. German Bundesliga is analysed. Applying robust analysis techniques, we are able to robustly estimate market values of soccer players. The results show (1) that there are significantly underrated and overrated players and (2) that a player's affiliation to a certain team may contribute to his market value. We conclude that a club's reputation affects the market values of its players and that star players are in tendency overrated.     

Quantile regression for large-scale data via sparse exponential transform method

In recent decades, quantile regression has received much more attention from academics and practitioners. However, most of existing computational algorithms are only effective for small or moderate size problems. They cannot solve quantile regression with large-scale data reliably and efficiently. To this end, we propose a new algorithm to implement quantile regression on large-scale data using the sparse exponential transform (SET) method. This algorithm mainly constructs a well-conditioned basis and a sampling matrix to reduce the number of observations. It then solves a quantile regression problem on this reduced matrix and obtains an approximate solution. Through simulation studies and empirical analysis of a 5% sample of the US 2000 Census data, we demonstrate efficiency of the SET-based algorithm. Numerical results indicate that our new algorithm is effective in terms of computation time and performs well for large-scale quantile regression.     

Graphical representation of survival curves in the presence of time-dependent categorical covariates with application to liver transplantation

Graphical representation of survival curves is often used to illustrate associations between exposures and time-to-event outcomes. However, when exposures are time-dependent, calculation of survival probabilities is not straightforward. Our aim was to develop a method to estimate time-dependent survival probabilities and represent them graphically. Cox models with time-dependent indicators to represent state changes were fitted, and survival probabilities were plotted using pre-specified times of state changes. Time-varying hazard ratios for the state change were also explored. The method was applied to data from the Adult-to-Adult Living Donor Liver Transplantation Cohort Study (A2ALL). Survival curves showing a ‘split’ at a pre-specified time t allow for the qualitative comparison of survival probabilities between patients with similar baseline covariates who do and do not experience a state change at time t. Time since state change interactions can be visually represented to reflect changing hazard ratios over time. A2ALL study results showed differences in survival probabilities among those who did not receive a transplant, received a living donor transplant, and received a deceased donor transplant. These graphical representations of survival curves with time-dependent indicators improve upon previous methods and allow for clinically meaningful interpretation.     

The exponentiated power exponential regression model with different regression structures: application in nursing data

We define the exponentiated power exponential distribution and propose a regression model with different systematic structures based on the new distribution. We show that the new regression model can be applied to dispersion data since it represents a parametric family of models that includes as sub-models some widely-known regression models. It then can be used more effectively in the analysis of real data. We use maximum likelihood estimation and derive the appropriate matrices for assessing local influence on the parameter estimates under different perturbation schemes. Some global-influence measurements are also investigated and simulation studies are performed to evaluate the accuracy of the estimates. We provide an application of the regression model with four systematic structures to nursing activities score data in the Unit of the Medical Clinic of University of São Paulo (USP) Hospital.     

Cox regression of clustered event times with covariates missing not at random

Motivated by a recent tuberculosis (TB) study, this paper is concerned with covariates missing not at random (MNAR) and models the potential intracluster correlation by a frailty. We consider the regression analysis of right‐censored event times from clustered subjects under a Cox proportional hazards frailty model and present the semiparametric maximum likelihood estimator (SPMLE) of the model parameters. An easy‐to‐implement pseudo‐SPMLE is then proposed to accommodate more realistic situations using readily available supplementary information on the missing covariates. Algorithms are provided to compute the estimators and their consistent variance estimators. We demonstrate that both the SPMLE and the pseudo‐SPMLE are consistent and asymptotically normal by the arguments based on the theory of modern empirical processes. The proposed approach is examined numerically via simulation and illustrated with an analysis of the motivating TB study data.     

The effect of small sample on optimal designs for logistic regression models

Asymptotic methods are commonly used in statistical inference for unknown parameters in binary data models. These methods are based on large sample theory, a condition which may be in conflict with small sample size and hence leads to poor results in the optimal designs theory. In this paper, we apply the second order expansions of the maximum likelihood estimator and derive a matrix formula for the mean square error (MSE) to obtain more precise optimal designs based on the MSE. Numerical results indicate the new optimal designs are more efficient than the optimal designs based on the information matrix.