带有有序变量的结构方程模型中的模型选择

文章着重研究了带有有序分类变量的结构方程模型的模型选择问题,并将一个基于贝叶斯准则的统计量称为测度,应用到此类模型中进行模型选择。通过实例分析说明了上述方法的应用,并给出了根据贝叶斯因子进行模型选择的结果。     

贝叶斯分位数回归组间组内变量选择及其应用

文章利用贝叶斯方法研究分位数回归的组间和组内双变量选择问题。基于偏态拉普拉斯分布和贝叶斯统计推断方法,结合组间和组内系数的Spike-and-Slab先验分布,提出了分位数回归的贝叶斯双层变量选择方法,并给出易于实施的Gibbs后验抽样算法。通过大量数值模拟和实证分析验证了所提变量选择方法的有效性。     

财务困境预测模型变量选择方法的改进

传统的企业财务困境预测模型变量选择方法存在如下不足数学模型的选择与变量选择相关性极大;变量选择与样本选择相关;变量的数目受到限制,未能充分反映企业财务的全部信息;对非线性响应考虑不够.对于具有非线性响应的财务预测模型来说,变量选择极大地影响到所建模型的好坏.使用正交设计和神经网络可以解决非线性响应问题,得到更合理的模型及结果.     

面板有序响应模型多种参数估计方法的仿真比较

面板有序响应模型已经被广泛应用于主观评价问题的研究,但在估计方法上,该模型依据对排序变量的处理规则不同产生了多种估计技术。因此,有必要设计蒙特卡罗仿真实验,综合考察这些方法在模型参数估计以及假设检验两个方面的表现,进而判别其优劣,其结果对于应用研究的方法选择也具有重要的指导意义。基于仿真实验的研究结果表明,OMD方法在小样本下会存在严重的估计偏误与假设检验的显著性水平扭曲现象,在超大样本下该方法可以产生有效的估计结果与检验结论,但效率改进的幅度不明显。DvS、BUC和CML方法在各种样本条件下都可以获得稳健一致的估计结果,但是对于参数的约束检验,CML方法会产生较明显的错误结论。针对以上结果产生的建议是,应该优先使用DvS或者BUC方法来估计面板有序响应模型并开展后续的假设检验工作。     

基于贝叶斯搜索方法的TAR模型研究

文章基于贝叶斯随机搜索方法的思想,提出一种有效解决门限自回归(TAR)模型的贝叶斯方法,在不假设固定的机制个数条件下,借助拉丁变量建立贝叶斯随机搜索TAR模型.在此模型下,拉丁变量的后验分布包含了机制的个数和门限参数的信息,因此滞后阶数、门限值和所有回归系数等的估计均通过MCMC方法从其后验分布抽样.并从模型AR(1)、TAR(2,1,1)、TAR(3,1,1,1)中产生样本,模拟结果表明此方法能很好地估计机制数、延迟参数、门限值及各机制下的回归系数.用贝叶斯随机搜索TAR模型对太阳黑子年度数据集进行分析,找到三个门限值,即10.2,40和73,与已有文献中用其他方法得到的结果一致.     

贝叶斯支持向量回归及其应用

支持向量回归（SVR）是机器学习中重要的数据挖掘方法，当前关于SVR的研究大多基于二次规划理论，同时，利用交叉验证或一些智能算法选取模型中的超参数，然而，基于二次规划理论的SVR估计方法不仅计算量较大，而且不能进行后续的统计推断分析。文章基于贝叶斯方法研究SVR，通过引入两个潜在变量将SVR的?不敏感损失函数表示为双重正态-尺度混合模型并构建似然函数，通过选取适当的先验分布获得兴趣参数和超参数的Gibbs抽样算法。为筛选重要变量和最优模型，引入0-1指示变量并选取回归参数的Spike and Slab先验来获得贝叶斯变量选择算法。数值模拟证明了所提算法的有效性，并在非正态误差下表现出很好的稳健性。最后将所提方法应用于房价数据分析，得到了有意义的结果。     

二值型响应与连续型响应联合建模的变量选择

由于多重响应变量之间可能存在相关性,文章考虑对二值型响应变量和连续型响应变量进行联合建模.利用probit模型,对二值响应引入了具有正态分布的潜变量,从而对多重响应建立线性回归模型,能得到二值变量和连续变量的联合分布.然后考虑回归系数会存在稀疏性,通过对似然函数加惩罚,从而对二重响应的回归系数和协方差矩阵的逆矩阵进行估计,达到参数估计和变量选择的目标.文中目标函数基于l1惩罚.数值模拟和实证分析展示了所提出方法的良好性质.     

缺失数据下部分线性模型的变量选择

文章结合基函数逼近以及惩罚最小二乘技术,对响应变量随机缺失下的部分线性模型,给出了一个变量选择方法.并结合局部二次逼近,得到了一个迭代算法.数据模拟表明该变量选择方法是可行的.     

基于贝叶斯学习的惩罚因子的选择

文章基于贝叶斯学习,将正则化方法从贝叶斯分析的角度展开,在响应变量服从正态分布、回归系数服从指数型先验分布族的条件下,用贝叶斯准则给出了惩罚因子的取值与响应变量、系数的方差之间的关系,并将这一结果应用到岭回归和lasso回归中惩罚因子的选择.实例检验结果表明,当响应变量和系数服从正态分布,惩罚因子的值取二者方差商的方法比岭迹法和广义交叉验证法(GCV)拟合效果更优.     

有序变量分析的主要模型与方法综述

有序变量是定性数据中较为常见的数据形式,其统计分析方法的研究一直备受国内外学术界关注。本文对国内外处理有序变量的主要模型与方法进行了梳理,指出了当前我国在有序变量研究领域存在的不足,并提出了希冀。     

Bayesian variable selection in a class of mixture models for ordinal data: a comparative study

In this paper, we consider a special finite mixture model named Combination of Uniform and shifted Binomial (CUB), recently introduced in the statistical literature to analyse ordinal data expressing the preferences of raters with regards to items or services. Our aim is to develop a variable selection procedure for this model using a Bayesian approach. Bayesian methods for variable selection and model choice have become increasingly popular in recent years, due to advances in Markov chain Monte Carlo computational algorithms. Several methods have been proposed in the case of linear and generalized linear models (GLM). In this paper, we adapt to the CUB model some of these algorithms: the Kuo–Mallick method together with its ‘metropolized’ version and the Stochastic Search Variable Selection method. Several simulated examples are used to illustrate the algorithms and to compare their performance. Finally, an application to real data is introduced.     

Bayesian Analysis of Ordinal Survey Data Using the Dirichlet Process to Account for Respondent Personality Traits

This article presents a Bayesian latent variable model used to analyze ordinal response survey data by taking into account the characteristics of respondents. The ordinal response data are viewed as multivariate responses arising from continuous latent variables with known cut-points. Each respondent is characterized by two parameters that have a Dirichlet process as their joint prior distribution. The proposed mechanism adjusts for classes of personalities. The model is applied to student survey data in course evaluations. Goodness-of-fit (GoF) procedures are developed for assessing the validity of the model. The proposed GoF procedures are simple, intuitive, and do not seem to be a part of current Bayesian practice.     

Latent variable models with ordinal categorical covariates

We propose a general latent variable model for multivariate ordinal categorical variables, in which both the responses and the covariates are ordinal, to assess the effect of the covariates on the responses and to model the covariance structure of the response variables. A?fully Bayesian approach is employed to analyze the model. The Gibbs sampler is used to simulate the joint posterior distribution of the latent variables and the parameters, and the parameter expansion and reparameterization techniques are used to speed up the convergence procedure. The proposed model and method are demonstrated by simulation studies and a real data example.     

A comparison of ordinal logistic regression models using Classical and Bayesian approaches in an analysis of factors associated with diabetic retinopathy

Estimating the risk factors of a disease such as diabetic retinopathy (DR) is one of the important research problems among bio-medical and statistical practitioners as well as epidemiologists. Incidentally many studies have focused in building models with binary outcomes, that may not exploit the available information. This article has investigated the importance of retaining the ordinal nature of the response variable (e.g. severity level of a disease) while determining the risk factors associated with DR. A generalized linear model approach with appropriate link functions has been studied using both Classical and Bayesian frameworks. From the result of this study, it can be observed that the ordinal logistic regression with probit link function could be more appropriate approach in determining the risk factors of DR. The study has emphasized the ways to handle the ordinal nature of the response variable with better model fit compared to other link functions.     

A Bayesian conditional model for bivariate mixed ordinal and skew continuous longitudinal responses using quantile regression

In this paper, we develop a conditional model for analyzing mixed bivariate continuous and ordinal longitudinal responses. We propose a quantile regression model with random effects for analyzing continuous responses. For this purpose, an Asymmetric Laplace Distribution (ALD) is allocated for continuous response given random effects. For modeling ordinal responses, a cumulative logit model is used, via specifying a latent variable model, with considering other random effects. Therefore, the intra-association between continuous and ordinal responses is taken into account using their own exclusive random effects. But, the inter-association between two mixed responses is taken into account by adding a continuous response term in the ordinal model. We use a Bayesian approach via Markov chain Monte Carlo method for analyzing the proposed conditional model and to estimate unknown parameters, a Gibbs sampler algorithm is used. Moreover, we illustrate an application of the proposed model using a part of the British Household Panel Survey data set. The results of data analysis show that gender, age, marital status, educational level and the amount of money spent on leisure have significant effects on annual income. Also, the associated parameter is significant in using the best fitting proposed conditional model, thus it should be employed rather than analyzing separate models.     

基于稀疏结构连续比率模型的消费金融风控研究

近年来,我国消费金融发展迅速,但同时也面临着更加复杂的欺诈和信用风险,为了更好地对消费金融中借贷客户的信用风险进行监测,本文提出了基于稀疏结构连续比率模型的风控方法。相对于传统的二分类模型,该模型的特点是可以处理借贷客户被分为三类或三类以上的有序数据,估计系数的同时能从众多纷繁复杂的数据中自动筛选重要变量,并在变量筛选过程中考虑不同子模型系数的结构特征。通过蒙特卡洛模拟发现,本文所提出的稀疏结构连续比率模型在分类泛化误差和变量筛选上的表现都较好。最后将本文提出的模型应用到实际的消费金融信用风险分析中,针对传统征信信息不足的借款人,通过引入高频电商消费行为数据,利用本文提出的高维有序多分类模型能有效识别借款人的信用风险,可以弥补传统征信方法的不足。     

Predictive comparisons in ordinal models

Bayesian predictive probability function approximations are derived and compared for ordinal logistic regression models. Classification and variable selection problems are also discussed. The methods are illustrated on a large data set of head injury patients.     

Joint modeling of mixed skewed continuous and ordinal longitudinal responses: a Bayesian approach

In this paper, a joint model for analyzing multivariate mixed ordinal and continuous responses, where continuous outcomes may be skew, is presented. For modeling the discrete ordinal responses, a continuous latent variable approach is considered and for describing continuous responses, a skew-normal mixed effects model is used. A Bayesian approach using Markov Chain Monte Carlo (MCMC) is adopted for parameter estimation. Some simulation studies are performed for illustration of the proposed approach. The results of the simulation studies show that the use of the separate models or the normal distributional assumption for shared random effects and within-subject errors of continuous and ordinal variables, instead of the joint modeling under a skew-normal distribution, leads to biased parameter estimates. The approach is used for analyzing a part of the British Household Panel Survey (BHPS) data set. Annual income and life satisfaction are considered as the continuous and the ordinal longitudinal responses, respectively. The annual income variable is severely skewed, therefore, the use of the normality assumption for the continuous response does not yield acceptable results. The results of data analysis show that gender, marital status, educational levels and the amount of money spent on leisure have a significant effect on annual income, while marital status has the highest impact on life satisfaction.     

Bayesian analysis of semiparametric Bernstein polynomial regression models for data with sample selection

In regression analysis, a sample selection scheme often applies to the response variable, which results in missing not at random observations on the variable. In this case, a regression analysis using only the selected cases would lead to biased results. This paper proposes a Bayesian methodology to correct this bias based on a semiparametric Bernstein polynomial regression model that incorporates the sample selection scheme into a stochastic monotone trend constraint, variable selection, and robustness against departures from the normality assumption. We present the basic theoretical properties of the proposed model that include its stochastic representation, sample selection bias quantification, and hierarchical model specification to deal with the stochastic monotone trend constraint in the nonparametric component, simple bias corrected estimation, and variable selection for the linear components. We then develop computationally feasible Markov chain Monte Carlo methods for semiparametric Bernstein polynomial functions with stochastically constrained parameter estimation and variable selection procedures. We demonstrate the finite-sample performance of the proposed model compared to existing methods using simulation studies and illustrate its use based on two real data applications.     

A Bayesian multivariate partially linear single-index probit model for ordinal responses

Combining the multivariate probit models with the multivariate partially linear single-index models, we propose new semiparametric latent variable models for multivariate ordinal response data. Based on the reversible jump Markov chain Monte Carlo technique, we develop a fully Bayesian method with free-knot splines to analyse the proposed models. To address the problem that the ordinary Gibbs sampler usually converges slowly, we make use of the partial-collapse and parameter-expansion techniques in our algorithm. The proposed methodology are demonstrated by simulated and real data examples.