Multivariate Birnbaum–Saunders regression model

In this paper, we propose a multivariate log-linear Birnbaum–Saunders regression model. We discuss maximum-likelihood estimation of the model parameters and provide closed-form expressions for the score function and for Fisher's information matrix. Hypothesis testing is performed using approximations obtained from the asymptotic normality of the maximum-likelihood estimator. Some influence methods, such as the local influence and generalized leverage are discussed and the normal curvatures for studying local influence are derived under some perturbation schemes. Further, a test for the homogeneity of the shape parameter of the multivariate regression model is investigated. A real data set is presented for illustrative purposes.     

Multivariate log-Birnbaum–Saunders regression models

In this paper, we present a multivariate version of the skewed log-Birnbaum–Saunders regression model. This new family of distributions holds good properties such as marginal variables following univariate skewed log-Birnbaum–Saunders distributions, besides presenting the usual log-Birnbaum–Saunders distribution as a particular case. Furthermore, the model parameters are estimated through maximum-likelihood methods, a closed-form expression for the Fisher’s information matrix is presented, and testing hypothesis for model parameters is performed. Two real datasets are analyzed and results are discussed.     

What price semiparametric Cox regression?

Lifetime Data Analysis - Cox’s proportional hazards regression model is the standard method for modelling censored life-time data with covariates. In its standard form, this method relies on...     

Gro¨bner basis strategies in regression

The Gröbner basis method in experimental design (Pistone & Wynn, 1996) is developed in a practical setting. The computational algebraic techniques (Gröbner bases in particular) are coupled with statistical strategies and the links to more standard approaches made. A new method of analysing a non-orthogonal experiment based on the Gröbner basis method is introduced. Examples are given utilizing the approaches.     

Sup–Hellinger consistency for local density regression

Abstract

This article studies the consistency of a local density regression model under a supremum Hellinger distance. Such model applies a piecewise structure where a mixture of Dirichlet process model (MDP) is assigned as the fixed density on each piece. The piecewise construction is a straightforward way to establish sup–Hellinger consistency in a regression settings. A specific piecewise density example is presented in a simulation study.     

Influence diagnostics in Birnbaum–Saunders nonlinear regression models

We consider the issue of assessing influence of observations in the class of Birnbaum–Saunders nonlinear regression models, which is useful in lifetime data analysis. Our results generalize those in Galea et al. [8 Galea, M., Leiva, V. and Paula, G. A. 2004. Influence diagnostics in log-Birnbaum–Saunders regression models. J. Appl. Stat., 31: 1049–1064. [Taylor & Francis Online], [Web of Science ®] [Google Scholar]] which are confined to Birnbaum–Saunders linear regression models. Some influence methods, such as the local influence, total local influence of an individual and generalized leverage are discussed. Additionally, the normal curvatures for studying local influence are derived under some perturbation schemes. We also give an application to a real fatigue data set.     

Discontinuities in robust nonparametric regression with α-mixing dependence

The main idea of the paper is to introduce a robust regression estimation method under an α-mixing dependence assumption, staying free of any parametric model restrictions while also allowing for some sudden changes in the unknown regression function. The sudden changes in the model may correspond to discontinuity points (jumps) or higher order breaks (jumps in corresponding derivatives) as well. We firstly derive some important statistical properties for local polynomial M-smoother estimates and we will propose a statistical test to decide whether some given point of interest is significantly important for a change to occur or not. As the asymptotic distribution of the test statistic depends on quantities which are left unknown we also introduce a bootstrap algorithm which can be used to mimic the target distribution of interest. All necessary proofs are provided together with some experimental results from a simulation study and a real data example.     

Influence analysis in skew-Birnbaum–Saunders regression models and applications

In this paper, we propose a method to assess influence in skew-Birnbaum–Saunders regression models, which are an extension based on the skew-normal distribution of the usual Birnbaum–Saunders (BS) regression model. An interesting characteristic that the new regression model has is the capacity of predicting extreme percentiles, which is not possible with the BS model. In addition, since the observed likelihood function associated with the new regression model is more complex than that from the usual model, we facilitate the parameter estimation using a type-EM algorithm. Moreover, we employ influence diagnostic tools that considers this algorithm. Finally, a numerical illustration includes a brief simulation study and an analysis of real data in order to show the proposed methodology.     

Model uncertainty and variable selection in Bayesian lasso regression

While Bayesian analogues of lasso regression have become popular, comparatively little has been said about formal treatments of model uncertainty in such settings. This paper describes methods that can be used to evaluate the posterior distribution over the space of all possible regression models for Bayesian lasso regression. Access to the model space posterior distribution is necessary if model-averaged inference—e.g., model-averaged prediction and calculation of posterior variable inclusion probabilities—is desired. The key element of all such inference is the ability to evaluate the marginal likelihood of the data under a given regression model, which has so far proved difficult for the Bayesian lasso. This paper describes how the marginal likelihood can be accurately computed when the number of predictors in the model is not too large, allowing for model space enumeration when the total number of possible predictors is modest. In cases where the total number of possible predictors is large, a simple Markov chain Monte Carlo approach for sampling the model space posterior is provided. This Gibbs sampling approach is similar in spirit to the stochastic search variable selection methods that have become one of the main tools for addressing Bayesian regression model uncertainty, and the adaption of these methods to the Bayesian lasso is shown to be straightforward.     

Empirical Bayes approach to wavelet regression using ϵ-contaminated priors

We consider an empirical Bayes approach to standard nonparametric regression estimation using a nonlinear wavelet methodology. Instead of specifying a single prior distribution on the parameter space of wavelet coefficients, which is usually the case in the existing literature, we elicit the ?-contamination class of prior distributions that is particularly attractive to work with when one seeks robust priors in Bayesian analysis. The type II maximum likelihood approach to prior selection is used by maximizing the predictive distribution for the data in the wavelet domain over a suitable subclass of the ?-contamination class of prior distributions. For the prior selected, the posterior mean yields a thresholding procedure which depends on one free prior parameter and it is level- and amplitude-dependent, thus allowing better adaptation in function estimation. We consider an automatic choice of the free prior parameter, guided by considerations on an exact risk analysis and on the shape of the thresholding rule, enabling the resulting estimator to be fully automated in practice. We also compute pointwise Bayesian credible intervals for the resulting function estimate using a simulation-based approach. We use several simulated examples to illustrate the performance of the proposed empirical Bayes term-by-term wavelet scheme, and we make comparisons with other classical and empirical Bayes term-by-term wavelet schemes. As a practical illustration, we present an application to a real-life data set that was collected in an atomic force microscopy study.     

The structured elastic net for quantile regression and?support vector classification

In view of its ongoing importance for a variety of practical applications, feature selection via ℓ ₁-regularization methods like the lasso has been subject to extensive theoretical as well empirical investigations. Despite its popularity, mere ℓ ₁-regularization has been criticized for being inadequate or ineffective, notably in situations in which additional structural knowledge about the predictors should be taken into account. This has stimulated the development of either systematically different regularization methods or double regularization approaches which combine ℓ ₁-regularization with a second kind of regularization designed to capture additional problem-specific structure. One instance thereof is the ‘structured elastic net’, a generalization of the proposal in Zou and Hastie (J. R. Stat. Soc. Ser. B 67:301–320, 2005), studied in Slawski et al. (Ann. Appl. Stat. 4(2):1056–1080, 2010) for the class of generalized linear models.     

Significance test for linear regression: how to test without P-values?

The discussion on the use and misuse of p-values in 2016 by the American Statistician Association was a timely assertion that statistical concept should be properly used in science. Some researchers, especially the economists, who adopt significance testing and p-values to report their results, may felt confused by the statement, leading to misinterpretations of the statement. In this study, we aim to re-examine the accuracy of the p-value and introduce an alternative way for testing the hypothesis. We conduct a simulation study to investigate the reliability of the p-value. Apart from investigating the performance of p-value, we also introduce some existing approaches, Minimum Bayes Factors and Belief functions, for replacing p-value. Results from the simulation study confirm unreliable p-value in some cases and that our proposed approaches seem to be useful as the substituted tool in the statistical inference. Moreover, our results show that the plausibility approach is more accurate for making decisions about the null hypothesis than the traditionally used p-values when the null hypothesis is true. However, the MBFs of Edwards et al. [Bayesian statistical inference for psychological research. Psychol. Rev. 70(3) (1963), pp. 193–242]; Vovk [A logic of probability, with application to the foundations of statistics. J. Royal Statistical Soc. Series B (Methodological) 55 (1993), pp. 317–351] and Sellke et al. [Calibration of p values for testing precise null hypotheses. Am. Stat. 55(1) (2001), pp. 62–71] provide more reliable results compared to all other methods when the null hypothesis is false.KEYWORDS: Ban of P-value, Minimum Bayes Factors, belief functions