左删失数据的双惩罚贝叶斯Tobit分位回归方法

在含潜变量的纵向数据混合效应模型应用中,通常包含大量截尾数据,若直接采用一般贝叶斯Tobit分位回归模型,参数估计的马尔科夫链蒙特卡罗抽样算法将会极其复杂,造成计算效率低下且估计结果偏差较大。同时,在高维情形下,由于受大量未知随机效应的干扰,固定效应中关键变量的选择与系数估计变得更为困难。为了解决上述问题,文章提出了一种新的双Adaptive Lasso惩罚贝叶斯Tobit分位回归方法,主要研究响应变量左删失情形下高维纵向数据的变量选择与参数估计问题。通过将Adaptive Lasso惩罚同时引入固定效应与随机效应的先验分布中,构造了参数估计的Gibbs抽样算法。蒙特卡罗模拟结果表明,新方法较无惩罚法和Lasso惩罚法在重要变量选择及系数估计上均更占优势。     

面板数据分位回归模型中固定与随机效应的选择

随机效应的引入为面板数据建模中样本相关和异方差问题提供了重要解决途径,过多的随机效应不仅会极大地增加模型复杂度,而且给固定效应系数的估计带来偏差.文章在考虑到随机效应具有整体性基础上,以横截面个体为单位,对其进行整体压缩.通过对固定和随机效应分别引入不同形式的条件Laplace先验,构造了一种与Group Lasso-Lasso惩罚相等价的贝叶斯双惩罚分位回归估计方法.通过设计切片Gibbs抽样算法,快速有效地解决了模型参数估计问题.计算机模拟显示,该方法不仅能对固定和随机效应参数进行精确估计,而且能对模型中真实包含的固定和随机效应进行自动选择.     

Gibbs抽样在正态混合模型中的参数估计

文章针对正态混合模型,推导出了Gibbs抽样在正态混合模型中的迭代公式,并通过Matlab编程进行了实例分析.     

贝叶斯分位数回归组间组内变量选择及其应用

文章利用贝叶斯方法研究分位数回归的组间和组内双变量选择问题。基于偏态拉普拉斯分布和贝叶斯统计推断方法,结合组间和组内系数的Spike-and-Slab先验分布,提出了分位数回归的贝叶斯双层变量选择方法,并给出易于实施的Gibbs后验抽样算法。通过大量数值模拟和实证分析验证了所提变量选择方法的有效性。     

非参数固定效应Panel Data模型的分位数回归推断

利用分位数回归方法,讨论了非参数固定效应Panel Data模型的估计和检验问题,得到了参数估计的渐近正态性及收敛速度。同时,建立一个秩得分(rank score)统计量来检验模型的固定效应,并证明了这个统计量渐近服从标准正态分布。     

混合贝塔分布随机波动模型及其贝叶斯分析

为了更准确地揭示金融资产收益率数据的真实数据生成过程,提出了基于混合贝塔分布的随机波动模型,讨论了混合贝塔分布随机波动模型的贝叶斯估计方法,并给出了一种Gibbs抽样算法。以上证A股综指简单收益率为例,分别建立了基于正态分布和混合贝塔分布的随机波动模型,研究表明,基于混合贝塔分布的随机波动模型更准确地描述了样本数据的真实数据生成过程,而正态分布的随机波动模型将高峰厚尾等现象归结为波动冲击,从而低估了收益率的平均波动水平,高估了波动的持续性和波动的冲击扰动。     

稳健学生t回归模型的非迭代贝叶斯抽样算法

与正态回归相比,学生t回归模型是一种对异常值较稳健的回归模型,通常用Gibbs抽样算法估计参数.而Gibbs抽样是一种迭代算法,所得样本不是独立样本,统计推断之前需判断其收敛性.文章探讨了一种基于逆贝叶斯公式的非迭代抽样算法,该算法利用t分布的正态混合表示,结合EM算法和重要再抽样算法,得到参数的独立同分布的后验样本,该样本可直接用于统计推断,从而避免了Gibbs抽样中的问题.     

贝叶斯支持向量回归及其应用

支持向量回归（SVR）是机器学习中重要的数据挖掘方法,当前关于SVR的研究大多基于二次规划理论,同时,利用交叉验证或一些智能算法选取模型中的超参数,然而,基于二次规划理论的SVR估计方法不仅计算量较大,而且不能进行后续的统计推断分析。文章基于贝叶斯方法研究SVR,通过引入两个潜在变量将SVR的?不敏感损失函数表示为双重正态-尺度混合模型并构建似然函数,通过选取适当的先验分布获得兴趣参数和超参数的Gibbs抽样算法。为筛选重要变量和最优模型,引入0-1指示变量并选取回归参数的Spike and Slab先验来获得贝叶斯变量选择算法。数值模拟证明了所提算法的有效性,并在非正态误差下表现出很好的稳健性。最后将所提方法应用于房价数据分析,得到了有意义的结果。     

高维混合效应模型的双正则化分位回归方法研究

针对高维混合效应模型,本文提出了一种双正则化分位回归方法.通过对随机和固定效应系数同时实施L1正则化惩罚,一方面能够对重要解释变量进行挑选,另一方面能够消除个体随机波动带来的偏差.求解参数估计的交替迭代算法不仅破解了要同时确定两个调整参数的难题,而且算法速度快.模拟结果也表明该方法不仅对误差类型有很强的抗干扰能力,同时在模型有不同稀疏程度时均表现良好,尤其是对于解释变量多于样本的高维情况.为了方便在实际问题中选择最优正则化参数,本文还对两种参数选取标准进行了比较研究.最后利用新方法对一个教育方面的数据进行了实证演示,找出了在各个分位点处对学生成绩有影响的重要因素.     

基于Gibbs抽样正态混合模型的参数估计

文章运用Gibbs抽样方法,推导了正态混合模型参数估计的迭代公式,并且进行了计算机模拟,得到了较好的效果.     

Nonparametric Inference for Time-Varying Coefficient Quantile Regression

The article considers nonparametric inference for quantile regression models with time-varying coefficients. The errors and covariates of the regression are assumed to belong to a general class of locally stationary processes and are allowed to be cross-dependent. Simultaneous confidence tubes (SCTs) and integrated squared difference tests (ISDTs) are proposed for simultaneous nonparametric inference of the latter models with asymptotically correct coverage probabilities and Type I error rates. Our methodologies are shown to possess certain asymptotically optimal properties. Furthermore, we propose an information criterion that performs consistent model selection for nonparametric quantile regression models of nonstationary time series. For implementation, a wild bootstrap procedure is proposed, which is shown to be robust to the dependent and nonstationary data structure. Our method is applied to studying the asymmetric and time-varying dynamic structures of the U.S. unemployment rate since the 1940s. Supplementary materials for this article are available online.     

Quantile Regression Estimator for GARCH Models

Abstract. In this article, we study the quantile regression estimator for GARCH models. We formulate the quantile regression problem by a reparametrization method and verify that the obtained quantile regression estimator is strongly consistent and asymptotically normal under certain regularity conditions. We also present our simulation results and a real data analysis for illustration.     

Bayesian Elastic Net Tobit Quantile Regression

In this article, the problem of parameter estimation and variable selection in the Tobit quantile regression model is considered. A Tobit quantile regression with the elastic net penalty from a Bayesian perspective is proposed. Independent gamma priors are put on the l₁ norm penalty parameters. A novel aspect of the Bayesian elastic net Tobit quantile regression is to treat the hyperparameters of the gamma priors as unknowns and let the data estimate them along with other parameters. A Bayesian Tobit quantile regression with the adaptive elastic net penalty is also proposed. The Gibbs sampling computational technique is adapted to simulate the parameters from the posterior distributions. The proposed methods are demonstrated by both simulated and real data examples.     

Bayesian Semiparametric Modelling in Quantile Regression

Abstract. We propose a Bayesian semiparametric methodology for quantile regression modelling. In particular, working with parametric quantile regression functions, we develop Dirichlet process mixture models for the error distribution in an additive quantile regression formulation. The proposed non‐parametric prior probability models allow the shape of the error density to adapt to the data and thus provide more reliable predictive inference than models based on parametric error distributions. We consider extensions to quantile regression for data sets that include censored observations. Moreover, we employ dependent Dirichlet processes to develop quantile regression models that allow the error distribution to change non‐parametrically with the covariates. Posterior inference is implemented using Markov chain Monte Carlo methods. We assess and compare the performance of our models using both simulated and real data sets.     

R-squared for Bayesian Regression Models

The usual definition of R² (variance of the predicted values divided by the variance of the data) has a problem for Bayesian fits, as the numerator can be larger than the denominator. We propose an alternative definition similar to one that has appeared in the survival analysis literature: the variance of the predicted values divided by the variance of predicted values plus the expected variance of the errors.     

Evaluating Value-at-Risk Models via Quantile Regression

This article is concerned with evaluating Value-at-Risk estimates. It is well known that using only binary variables, such as whether or not there was an exception, sacrifices too much information. However, most of the specification tests (also called backtests) available in the literature, such as Christoffersen (1998) and Engle and Manganelli (2004) are based on such variables. In this article we propose a new backtest that does not rely solely on binary variables. It is shown that the new backtest provides a sufficient condition to assess the finite sample performance of a quantile model whereas the existing ones do not. The proposed methodology allows us to identify periods of an increased risk exposure based on a quantile regression model (Koenker and Xiao 2002). Our theoretical findings are corroborated through a Monte Carlo simulation and an empirical exercise with daily S&P500 time series.     

Influence Measures in Quantile Regression Models

In this article, we use the asymmetric Laplace distribution to define a new method to determine the influence of a certain observation in the fit of quantile regression models. Our measure is based on the likelihood displacement function and we propose two types of measures in order to determine influential observations in a set of conditional quantiles conjointly or in each conditional quantile of interest. We verify the validity of our average measure in a simulated data set as well in an illustrative example with data about air pollution.     

Nonparametric Testing of an Exclusion Restriction in Quantile Regression

Using the framework proposed by Bickel et al. (2006 Bickel , P. J. , Ritov , Y. , Stoker , T. ( 2006 ). Tailor-made tests for goodness-of-fit to semiparametric hypotheses . Ann. Stat. 34 ( 2 ): 721 – 741 . [Google Scholar]), we provide a score-based testing method to check the exclusion restriction in quantile regression, i.e., H: ν_α(Y|U, V) = ν_α(Y|U) w.p.1, where ν_α denotes the αth (0 < α < 1) quantile. A subsampling method is suggested to acquire the critical values and justified. The tests are all found to be consistent against fixed alternatives and have discriminating power against local alternatives at root-n scale. We address this particular problem as a representative among a wide family of semiparametric model checking problems. The methodology can be carried over to other goodness-of-fit testing of semiparametric models, possibly involve non smooth functions.