Nonstationary nonlinear quantile regression

This study examines estimation and inference based on quantile regression for parametric nonlinear models with an integrated time series covariate. We first derive the limiting distribution of the nonlinear quantile regression estimator and then consider testing for parameter restrictions, when the regression function is specified as an asymptotically homogeneous function. We also study linear-in-parameter regression models when the regression function is given by integrable regression functions as well as asymptotically homogeneous regression functions. We, furthermore, propose a fully modified estimator to reduce the bias in the original estimator under a certain set of conditions. Finally, simulation studies show that the estimators behave well, especially when the regression error term has a fat-tailed distribution.     

Properties of maximum likelihood estimates of the ratio of parameters in ordinal response regression models

The properties of a method of estimating the ratio of parameters for ordered categorical response regression models are discussed. If the link function relating the response variable to the linear combination of covariates is unknown then it is only possible to estimate the ratio of regression parameters. This ratio of parameters has a substitutability or relative importance interpretation.

The maximum likelihood estimate of the ratio of parameters, assuming a logistic function (McCullagh, 1980), is found to have very small bias for a wide variety of true link functions. Further it is shown using Monte Carlo simulations that this maximum likelihood estimate, has good coverage properties, even if the link function is incorrectly specified. It is demonstrated that combining adjacent categories to make the response binary can result in an analysis which is appreciably less efficient. The size of the efficiency loss on, among other factors, the marginal distribution in the ordered categories     

Distribution and density functions of the feasible generalized ridge regression estimator

In this paper, we derive the distribution and density functions of the feasible generalized ridge regression (GRR) estimator. It is shown that when the absolute value of a regression coefficient is close to zero, the distribution of the feasible GRR estimator is bimodal and has thinner tails than that of the OLS estimator.     

The log-exponentiated generalized gamma regression model for censored data

For the first time, we introduce a generalized form of the exponentiated generalized gamma distribution [Cordeiro et al. The exponentiated generalized gamma distribution with application to lifetime data, J. Statist. Comput. Simul. 81 (2011), pp. 827–842.] that is the baseline for the log-exponentiated generalized gamma regression model. The new distribution can accommodate increasing, decreasing, bathtub- and unimodal-shaped hazard functions. A second advantage is that it includes classical distributions reported in the lifetime literature as special cases. We obtain explicit expressions for the moments of the baseline distribution of the new regression model. The proposed model can be applied to censored data since it includes as sub-models several widely known regression models. It therefore can be used more effectively in the analysis of survival data. We obtain maximum likelihood estimates for the model parameters by considering censored data. We show that our extended regression model is very useful by means of two applications to real data.     

Regression Tolerance Intervals

In this article, we discuss the utility of tolerance intervals for various regression models. We begin with a discussion of tolerance intervals for linear and nonlinear regression models. We then introduce a novel method for constructing nonparametric regression tolerance intervals by extending the well-established procedure for univariate data. Simulation results and application to real datasets are presented to help visualize regression tolerance intervals and to demonstrate that the methods we discuss have coverage probabilities very close to the specified nominal confidence level.     

Improving predictive accuracy of logistic regression model using ranked set samples

Logistic regression is often confronted with separation of likelihood problem, especially with unbalanced success–failure distribution. We propose to address this issue by drawing a ranked set sample (RSS). Simulation studies illustrated the advantages of logistic regression models fitted with RSS samples with small sample size regardless of the distribution of the binary response. As sample size increases, RSS eventually becomes comparable to SRS, but still has the advantage over SRS in mitigating the problem of separation of likelihood. Even in the presence of ranking errors, models from RSS samples yield higher predictive ability than its SRS counterpart.     

基于copula回归模型的损失预测

在非寿险损失预测的广义线性模型中,通常假设损失次数与损失强度相互独立,事实上二者之间往往存在一定的相依关系,可通过copula函数来刻画.在损失已经发生的条件下,假设损失次数服从零截断泊松分布,损失强度服从伽玛分布,可以建立损失次数与损失强度相互依赖的copula回归模型.把损失强度的分布扩展到逆高斯分布,并将此模型应用于一组车险保单数据进行实证研究.结果表明:该模型不但在损失预测方面优于独立假设下的广义线性模型,而且也优于损失强度服从伽马分布假设下的copula回归模型.     

Semiparametric Regression Models with Applications to Scoring: A Review

Semiparametric regression models have been proposed in the econometric literature as a trade-off between the simple but easily implementable and interpretable parametric models and the flexible but structure free smoothing techniques. Some semiparametric models for binary response with possible application to scoring data are reviewed: single-index models, generalized partially linear models, generalized partially linear single-index models, and multiple-index models. All these models are extensions of the classical logistic regression.     

A characterization of the efficiency of individualized logistic regressions

The use of individualized regressions, which reduces the polychotomous logistic regression model to several dichotomous models, has been proposed as a solution to some practical difficulties for binary covariates (Begg and Gray 1984, Biometrika, 71, 11–18). Its disadvantages, however, include loss of efficiency and the complexity of making comparisons among regressions. Using expressions for the large-sample distribution of the maximum-likelihood estimates, the efficiency of the individualized procedure relative to the polychotomous procedure is evaluated for the case in which the covariates are assumed to follow a multivariate normal distribution. The relative efficiency when the logistic slope vectors from different regressions are collinear can be substantially lower compared to the efficiency with orthogonal slope vectors. Further evaluations for binary covariates using collinear and orthogonal slope parametrizations lead to a similar characterization.     

Double logistic curve in regression modeling

The logistic sigmoid curve is widely used in nonlinear regression and in binary response modeling. There are problems corresponding to a double sigmoid behavior which consists of the first increase to an early saturation at an intermediate level, and the second sigmoid with the eventual plateau of saturation. A double sigmoid behavior is usually achieved using additive or multiplicative combinations of logit and more complicated functions with numerous parameters. In this work, double sigmoid functions are constructed as logistic ones with a sign defining the point of inflection and with an additional powering parameter. The elaborated models describe rather complicated double saturation behavior via only four or five parameters which can be efficiently estimated by nonlinear optimization techniques. Theoretical features and practical applications of the models are discussed.     

The heteroscedastic odd log-logistic generalized gamma regression model for censored data

We propose a four-parameter extended generalized gamma model, which includes as special cases some important distributions and it is very useful for modeling lifetime data. A advantage is that it can represent the error distribution for a new heteroscedastic log-odd log-logistic generalized gamma regression model. The proposed heteroscedastic regression model can be used more effectively in the analysis of survival data since it includes as special models several widely-known regression models. Further, for different parameter settings, sample sizes and censoring percentages, various simulations are performed. Overall, the new regression model is very useful to the analysis of real data.     

A Non‐parametric ANOVA‐type Test for Regression Curves Based on Characteristic Functions

This article studies a new procedure to test for the equality of k regression curves in a fully non‐parametric context. The test is based on the comparison of empirical estimators of the characteristic functions of the regression residuals in each population. The asymptotic behaviour of the test statistic is studied in detail. It is shown that under the null hypothesis, the distribution of the test statistic converges to a finite combination of independent chi‐squared random variables with one degree of freedom. The coefficients in this linear combination can be consistently estimated. The proposed test is able to detect contiguous alternatives converging to the null at the rate n ^{? 1 ∕ 2}. The practical performance of the test based on the asymptotic null distribution is investigated by means of simulations.     

Formulas for the Exact LMS and LQS Estimators

The author presents the derivation of formulas for the calculation of critical values of the median function or the general version of it, namely, the quantile functions. In statistics, these functions are used to detect outliers in the data set and to make predictions that are resistant to outliers. Therefore, these formulas can also be used as estimators for these regressions. The fact that these formulas are able to calculate the global optimum gives the exact least median squares or the exact least quantile of squares estimators. The author provides the theoretical background for deriving these estimator formulas and derives the estimator formulas for regression models up to three parameters. In addition, the author provides guides for the derivation of formulas for other models, illustrates the use of these formulas, and emphasizes their properties that are useful for future works. One important conclusion is that each regression model has its own set of formulas.     

Bayesian Semiparametric Modelling in Quantile Regression

Abstract. We propose a Bayesian semiparametric methodology for quantile regression modelling. In particular, working with parametric quantile regression functions, we develop Dirichlet process mixture models for the error distribution in an additive quantile regression formulation. The proposed non‐parametric prior probability models allow the shape of the error density to adapt to the data and thus provide more reliable predictive inference than models based on parametric error distributions. We consider extensions to quantile regression for data sets that include censored observations. Moreover, we employ dependent Dirichlet processes to develop quantile regression models that allow the error distribution to change non‐parametrically with the covariates. Posterior inference is implemented using Markov chain Monte Carlo methods. We assess and compare the performance of our models using both simulated and real data sets.     

Bayesian parameter estimation via variational methods

We consider a logistic regression model with a Gaussian prior distribution over the parameters. We show that an accurate variational transformation can be used to obtain a closed form approximation to the posterior distribution of the parameters thereby yielding an approximate posterior predictive model. This approach is readily extended to binary graphical model with complete observations. For graphical models with incomplete observations we utilize an additional variational transformation and again obtain a closed form approximation to the posterior. Finally, we show that the dual of the regression problem gives a latent variable density model, the variational formulation of which leads to exactly solvable EM updates.     

A log-linear regression model for the odd Weibull distribution with censored data

We introduce the log-odd Weibull regression model based on the odd Weibull distribution (Cooray, 2006). We derive some mathematical properties of the log-transformed distribution. The new regression model represents a parametric family of models that includes as sub-models some widely known regression models that can be applied to censored survival data. We employ a frequentist analysis and a parametric bootstrap for the parameters of the proposed model. We derive the appropriate matrices for assessing local influence on the parameter estimates under different perturbation schemes and present some ways to assess global influence. Further, for different parameter settings, sample sizes and censoring percentages, some simulations are performed. In addition, the empirical distribution of some modified residuals are given and compared with the standard normal distribution. These studies suggest that the residual analysis usually performed in normal linear regression models can be extended to a modified deviance residual in the proposed regression model applied to censored data. We define martingale and deviance residuals to check the model assumptions. The extended regression model is very useful for the analysis of real data.     

Inverse Regression in Binary Response LDV Model

Sliced inverse regression, a link-free and distribution-free method, is applied to binary response limited dependent variable models. An inverse regression property of binary response LDV model is found. Based on this property, if the distributions of X _j (j = 1, 2,…, p) satisfy the linearity condition, then β can be estimated up to a positive multiplicative scalar without any assumptions on the distribution of error ε. Moreover, the estimator can be proved to be asymptotically normal based on which testing hypotheses are considered. Simulations results are reported.     

On variable selection in generalized linear and related regression models

This paper is concerned with selection of explanatory variables in generalized linear models (GLM). The class of GLM's is quite large and contains e.g. the ordinary linear regression, the binary logistic regression, the probit model and Poisson regression with linear or log-linear parameter structure. We show that, through an approximation of the log likelihood and a certain data transformation, the variable selection problem in a GLM can be converted into variable selection in an ordinary (unweighted) linear regression model. As a consequence no specific computer software for variable selection in GLM's is needed. Instead, some suitable variable selection program for linear regression can be used. We also present a simulation study which shows that the log likelihood approximation is very good in many practical situations. Finally, we mention briefly possible extensions to regression models outside the class of GLM's.     

A flexible semiparametric regression model for bimodal,asymmetric and censored data

In this paper, we propose a new semiparametric heteroscedastic regression model allowing for positive and negative skewness and bimodal shapes using the B-spline basis for nonlinear effects. The proposed distribution is based on the generalized additive models for location, scale and shape framework in order to model any or all parameters of the distribution using parametric linear and/or nonparametric smooth functions of explanatory variables. We motivate the new model by means of Monte Carlo simulations, thus ignoring the skewness and bimodality of the random errors in semiparametric regression models, which may introduce biases on the parameter estimates and/or on the estimation of the associated variability measures. An iterative estimation process and some diagnostic methods are investigated. Applications to two real data sets are presented and the method is compared to the usual regression methods.     

Bootstrap estimation of the variance of the error term in monotonic regression models

The variance of the error term in ordinary regression models and linear smoothers is usually estimated by adjusting the average squared residual for the trace of the smoothing matrix (the degrees of freedom of the predicted response). However, other types of variance estimators are needed when using monotonic regression (MR) models, which are particularly suitable for estimating response functions with pronounced thresholds. Here, we propose a simple bootstrap estimator to compensate for the over-fitting that occurs when MR models are estimated from empirical data. Furthermore, we show that, in the case of one or two predictors, the performance of this estimator can be enhanced by introducing adjustment factors that take into account the slope of the response function and characteristics of the distribution of the explanatory variables. Extensive simulations show that our estimators perform satisfactorily for a great variety of monotonic functions and error distributions.