ROC Curves in Non‐Parametric Location‐Scale Regression Models

Abstract. The receiver operating characteristic (ROC) curve is a tool of extensive use to analyse the discrimination capability of a diagnostic variable in medical studies. In certain situations, the presence of a covariate related to the diagnostic variable can increase the discriminating power of the ROC curve. In this article, we model the effect of the covariate over the diagnostic variable by means of non‐parametric location‐scale regression models. We propose a new non‐parametric estimator of the conditional ROC curve and study its asymptotic properties. We also present some simulations and an illustration to a data set concerning diagnosis of diabetes.     

Quantile Regression via the EM Algorithm

The three-parameter asymmetric Laplace distribution (ALD) has received increasing attention in the field of quantile regression due to an important feature between its location and asymmetric parameters. On the basis of the representation of the ALD as a normal-variance–mean mixture with an exponential mixing distribution, this article develops EM and generalized EM algorithms, respectively, for computing regression quantiles of linear and nonlinear regression models. It is interesting to show that the proposed EM algorithm and the MM (Majorization–Minimization) algorithm for quantile regressions are really the same in terms of computation, since the updating formula of them are the same. This provides a good example that connects the EM and MM algorithms. Simulation studies show that the EM algorithm can successfully recover the true parameters in quantile regressions.     

A Non‐parametric ANOVA‐type Test for Regression Curves Based on Characteristic Functions

This article studies a new procedure to test for the equality of k regression curves in a fully non‐parametric context. The test is based on the comparison of empirical estimators of the characteristic functions of the regression residuals in each population. The asymptotic behaviour of the test statistic is studied in detail. It is shown that under the null hypothesis, the distribution of the test statistic converges to a finite combination of independent chi‐squared random variables with one degree of freedom. The coefficients in this linear combination can be consistently estimated. The proposed test is able to detect contiguous alternatives converging to the null at the rate n ^{? 1 ∕ 2}. The practical performance of the test based on the asymptotic null distribution is investigated by means of simulations.     

Linear Quantile Regression Based on EM Algorithm

This article aims to put forward a new method to solve the linear quantile regression problems based on EM algorithm using a location-scale mixture of the asymmetric Laplace error distribution. A closed form of the estimator of the unknown parameter vector β based on EM algorithm, is obtained. In addition, some simulations are conducted to illustrate the performance of the proposed method. Simulation results demonstrate that the proposed algorithm performs well. Finally, the classical Engel data is fitted and the Bootstrap confidence intervals for estimators are provided.     

Bayesian Elastic Net Tobit Quantile Regression

In this article, the problem of parameter estimation and variable selection in the Tobit quantile regression model is considered. A Tobit quantile regression with the elastic net penalty from a Bayesian perspective is proposed. Independent gamma priors are put on the l₁ norm penalty parameters. A novel aspect of the Bayesian elastic net Tobit quantile regression is to treat the hyperparameters of the gamma priors as unknowns and let the data estimate them along with other parameters. A Bayesian Tobit quantile regression with the adaptive elastic net penalty is also proposed. The Gibbs sampling computational technique is adapted to simulate the parameters from the posterior distributions. The proposed methods are demonstrated by both simulated and real data examples.     

Quantile regression-based Bayesian semiparametric mixed-effects models for longitudinal data with non-normal,missing and mismeasured covariate

Quantile regression (QR) models have received increasing attention recently for longitudinal data analysis. When continuous responses appear non-centrality due to outliers and/or heavy-tails, commonly used mean regression models may fail to produce efficient estimators, whereas QR models may perform satisfactorily. In addition, longitudinal outcomes are often measured with non-normality, substantial errors and non-ignorable missing values. When carrying out statistical inference in such data setting, it is important to account for the simultaneous treatment of these data features; otherwise, erroneous or even misleading results may be produced. In the literature, there has been considerable interest in accommodating either one or some of these data features. However, there is relatively little work concerning all of them simultaneously. There is a need to fill up this gap as longitudinal data do often have these characteristics. Inferential procedure can be complicated dramatically when these data features arise in longitudinal response and covariate outcomes. In this article, our objective is to develop QR-based Bayesian semiparametric mixed-effects models to address the simultaneous impact of these multiple data features. The proposed models and method are applied to analyse a longitudinal data set arising from an AIDS clinical study. Simulation studies are conducted to assess the performance of the proposed method under various scenarios.     

Non‐parametric Regression for Circular Responses

Regression with a circular response is a topic of current interest. We introduce non‐parametric smoothing for this problem. Simple adaptations of a weight function enable a unified formulation for both real‐line and circular predictors, whereas these cases have been tackled by quite distinct parametric methods. Additionally, we discuss various methodological extensions, obtaining a number of promising techniques – totally new in circular statistics – such as confidence intervals for the value of a circular regression and non‐parametric autoregression in circular time series. The findings are also illustrated through real data examples.     

Non‐parametric Bayesian Hazard Regression for Chronic Disease Risk Assessment

Assessing the absolute risk for a future disease event in presently healthy individuals has an important role in the primary prevention of cardiovascular diseases (CVD) and other chronic conditions. In this paper, we study the use of non‐parametric Bayesian hazard regression techniques and posterior predictive inferences in the risk assessment task. We generalize our previously published Bayesian multivariate monotonic regression procedure to a survival analysis setting, combined with a computationally efficient estimation procedure utilizing case–base sampling. To achieve parsimony in the model fit, we allow for multidimensional relationships within specified subsets of risk factors, determined either on a priori basis or as a part of the estimation procedure. We apply the proposed methods for 10‐year CVD risk assessment in a Finnish population. © 2014 Board of the Foundation of the Scandinavian Journal of Statistics     

A Copula‐Based Non‐parametric Measure of Regression Dependence

Abstract. This article presents a framework for comparing bivariate distributions according to their degree of regression dependence. We introduce the general concept of a regression dependence order (RDO). In addition, we define a new non‐parametric measure of regression dependence and study its properties. Besides being monotone in the new RDOs, the measure takes on its extreme values precisely at independence and almost sure functional dependence, respectively. A consistent non‐parametric estimator of the new measure is constructed and its asymptotic properties are investigated. Finally, the finite sample properties of the estimate are studied by means of a small simulation study.     

Semiparametric Quantile Regression Analysis of Right‐censored and Length‐biased Failure Time Data with Partially Linear Varying Effects

Right‐censored and length‐biased failure time data arise in many fields including cross‐sectional prevalent cohort studies, and their analysis has recently attracted a great deal of attention. It is well‐known that for regression analysis of failure time data, two commonly used approaches are hazard‐based and quantile‐based procedures, and most of the existing methods are the hazard‐based ones. In this paper, we consider quantile regression analysis of right‐censored and length‐biased data and present a semiparametric varying‐coefficient partially linear model. For estimation of regression parameters, a three‐stage procedure that makes use of the inverse probability weighted technique is developed, and the asymptotic properties of the resulting estimators are established. In addition, the approach allows the dependence of the censoring variable on covariates, while most of the existing methods assume the independence between censoring variables and covariates. A simulation study is conducted and suggests that the proposed approach works well in practical situations. Also, an illustrative example is provided.     

Model‐Based Non‐parametric Variance Estimation for Systematic Sampling

Abstract. Systematic sampling is frequently used in surveys, because of its ease of implementation and its design efficiency. An important drawback of systematic sampling, however, is that no direct estimator of the design variance is available. We describe a new estimator of the model‐based expectation of the design variance, under a non‐parametric model for the population. The non‐parametric model is sufficiently flexible that it can be expected to hold at least approximately in many situations with continuous auxiliary variables observed at the population level. We prove the model consistency of the estimator for both the anticipated variance and the design variance under a non‐parametric model with a univariate covariate. The broad applicability of the approach is demonstrated on a dataset from a forestry survey.     

Quantile Regression for Location‐Scale Time Series Models with Conditional Heteroscedasticity

This paper considers quantile regression for a wide class of time series models including autoregressive and moving average (ARMA) models with asymmetric generalized autoregressive conditional heteroscedasticity errors. The classical mean‐variance models are reinterpreted as conditional location‐scale models so that the quantile regression method can be naturally geared into the considered models. The consistency and asymptotic normality of the quantile regression estimator is established in location‐scale time series models under mild conditions. In the application of this result to ARMA‐generalized autoregressive conditional heteroscedasticity models, more primitive conditions are deduced to obtain the asymptotic properties. For illustration, a simulation study and a real data analysis are provided.     

Non‐parametric Copula Estimation Under Bivariate Censoring

In this paper, we consider non‐parametric copula inference under bivariate censoring. Based on an estimator of the joint cumulative distribution function, we define a discrete and two smooth estimators of the copula. The construction that we propose is valid for a large range of estimators of the distribution function and therefore for a large range of bivariate censoring frameworks. Under some conditions on the tails of the distributions, the weak convergence of the corresponding copula processes is obtained in l^∞([0,1]²). We derive the uniform convergence rates of the copula density estimators deduced from our smooth copula estimators. Investigation of the practical behaviour of these estimators is performed through a simulation study and two real data applications, corresponding to different censoring settings. We use our non‐parametric estimators to define a goodness‐of‐fit procedure for parametric copula models. A new bootstrap scheme is proposed to compute the critical values.     

Nonlinear Quantile Regression Estimation of Longitudinal Data

This article examines a weighted version of the quantile regression estimator as defined by Koenker and Bassett (1978 Koenker , R. , Bassett , G. ( 1978 ). Regression quantiles . Econometrica 46 : 33 – 50 .[Crossref], [Web of Science ®] , [Google Scholar]), adjusted to the case of nonlinear longitudinal data. Using a four-parameter logistic growth function and error terms following an AR(1) model, different weights are used and compared in a simulation study. The findings indicate that the nonlinear quantile regression estimator is performing well, especially for the median regression case, that the differences between the weights are small, and that the estimator performs better when the correlation in the AR(1) model increases. A comparison is also made with the corresponding mean regression estimator, which is found to be less robust. Finally, the estimator is applied to a data set with growth patterns of two genotypes of soybean, which gives some insights into how the quantile regressions provide a more complete picture of the data than the mean regression.     

Non‐parametric Regression Tests Using Dimension Reduction Techniques

Abstract. Testing for parametric structure is an important issue in non‐parametric regression analysis. A standard approach is to measure the distance between a parametric and a non‐parametric fit with a squared deviation measure. These tests inherit the curse of dimensionality from the non‐parametric estimator. This results in a loss of power in finite samples and against local alternatives. This article proposes to circumvent the curse of dimensionality by projecting the residuals under the null hypothesis onto the space of additive functions. To estimate this projection, the smooth backfitting estimator is used. The asymptotic behaviour of the test statistic is derived and the consistency of a wild bootstrap procedure is established. The finite sample properties are investigated in a simulation study.     

Sample Path Asymmetries in Non‐Gaussian Random Processes

We tackle an important although rarely addressed question of accounting for a variety of asymmetries frequently observed in stochastic temporal/spatial records. First, we review some measures intending to capture such asymmetries that have been introduced on various occasions in the past and then propose a family of measures that is motivated by Rice's formula for crossing level distributions of the slope. We utilize those asymmetry measures to demonstrate how a class of second‐order models built on the skewed Laplace distributions can account for sample path asymmetries. It is shown that these models are capable of mimicking not only distributional skewness but also more complex geometrical asymmetries in the sample path such as tilting, front‐back slope asymmetry and time irreversibility. Simple moment‐based estimation techniques are briefly discussed to allow direct application to modelling and fitting actual records.     

Convergence Analysis of MCMC Algorithms for Bayesian Multivariate Linear Regression with Non‐Gaussian Errors

When Gaussian errors are inappropriate in a multivariate linear regression setting, it is often assumed that the errors are iid from a distribution that is a scale mixture of multivariate normals. Combining this robust regression model with a default prior on the unknown parameters results in a highly intractable posterior density. Fortunately, there is a simple data augmentation (DA) algorithm and a corresponding Haar PX‐DA algorithm that can be used to explore this posterior. This paper provides conditions (on the mixing density) for geometric ergodicity of the Markov chains underlying these Markov chain Monte Carlo algorithms. Letting d denote the dimension of the response, the main result shows that the DA and Haar PX‐DA Markov chains are geometrically ergodic whenever the mixing density is generalized inverse Gaussian, log‐normal, inverted Gamma (with shape parameter larger than d /2) or Fréchet (with shape parameter larger than d /2). The results also apply to certain subsets of the Gamma, F and Weibull families.     

Quantile Regression Estimator for GARCH Models

Abstract. In this article, we study the quantile regression estimator for GARCH models. We formulate the quantile regression problem by a reparametrization method and verify that the obtained quantile regression estimator is strongly consistent and asymptotically normal under certain regularity conditions. We also present our simulation results and a real data analysis for illustration.     

基于非对称分布散点分位数的区间数据回归分析

许多经济变量(如GDP)水平序列随着时间变化具有单调趋势,截面数据(如各地区GDP)之间存在差异,为了研究经济变量在一段时间内的平均发展水平和相互关系,文章基于区间型符号数据的研究视角,提出了一种基于分位数思想的Bayesian回归方法,用以分析内部存在非对称分布散点的区间数据,既可以估计数据的区间,也可以预测数据在此区间内的偏度和离散程度。在模拟研究中,通过对评价指标数值的假设检验分析了该模型相对于上、下限和中点半径模型的效果,并根据真实数据中存在异常信息的现象,在模拟数据中加入异常值,进一步验证分位数方法的优势和稳健性。在实证研究中,运用提出的分位数方法,上、下限法和中点半径法对我国各地区GDP和工业生产总值年度数据进行区间回归分析,评价指标显示分位数模型Bayesian方法具有更优的拟合和预测效果,在GDP发展水平不同的地区,工业增长的贡献存在差异。     

Non‐parametric Maximum Likelihood Estimation for Cox Regression with Subject‐Specific Measurement Error

Abstract. Many epidemiological studies have been conducted to identify an association between nutrient consumption and chronic disease risk. To this problem, Cox regression with additive covariate measurement error has been well developed in the literature. However, researchers are concerned with the validity of the additive measurement error assumption for self‐report nutrient data. Recently, some study designs using more reliable biomarker data have been considered, in which the additive measurement error assumption is more likely to hold. Biomarker data are often available in a subcohort. Self‐report data often encounter with a variety of serious biases. Complications arise primarily because the magnitude of measurement errors is often associated with some characteristics of a study subject. A more general measurement error model has been developed for self‐report data. In this paper, a non‐parametric maximum likelihood (NPML) estimator using an EM algorithm is proposed to simultaneously adjust for the general measurement errors.