Bayesian analysis for a change in the intercept of simple linear regression

A Bayesian approach is considered to detect a change-point in the intercept of simple linear regression. The Jeffreys noninformative prior is employed and compared with the uniform prior in Bayesian analysis. The marginal posterior distributions of the change-point, the amount of shift and the slope are derived. Mean square errors, mean absolute errors and mean biases of some Bayesian estimates are considered by Monte Carlo methad and some numerical results are also shown.     

Testing for a change point in linear regression models

In this paper, the Schwarz Information Criterion (SIC) is proposed to locate a change point in the simple linear regression model, as well as in the multiple linear regression model. The method is then applied to a financial data set, and a change point is successfully detected.     

Testing for a change lit the regression matrix of a multivariate linear model

A Bayesian test procedure Is developed to test; the null hypothesis of no change In the regression matrix of a multivariate lin¬ear model against the alternative hypothesis of exactly one change The resulting test is based on the marginal posterior distribution of the change point; To illustrate the test procedure a numerical example using a bivariate regression model is considered.     

Detecting change points and monitoring biomedical data

Bayesian and likelihood approaches to on-line detecting change points in time series are discussed and applied to analyze biomedical data. Using a linear dynamic model, the Bayesian analysis outputs the conditional posterior probability of a change at time t ? 1, given the data up to time t and the status of changes occurred before time t ? 1. The likelihood method is based on a change-point regression model and tests whether there is no change-point.     

Structural changes in multivariate regression models

This study generalizes the work of chin choy and Broemeling (1980) who investigated the change in the regression parameters of univariate linear models.

The marginal posterior distributions of the change point, the regression matrices,and the precision matrix are found with the use of a proper multivariate normal-Wishart distribution for the parameters of the model.

A numerical study is undertaken in order to gain some insight into the effect that changes in sample size and certain parameter values have on these marginal posterior distributions.     

Estimation of random coefficient regression models

Linear regression models with coefficients across individual units regarded as random samples from some population are studied in this article from a Bayesian viewpoint. A prior distribution of the secondary parameters is derived following the Jeffreys rule. Posterior distribution of the primary and secondary parameters, and the predictive distribution of the future value are then examined. Computations of the parameter estimates are found to be rather straightforward. Data from a performance test on pigs is analysed and discussed. We also discuss the difficulties involved in using a Lindley and Smith (1972) prior in this problem.     

Bayesian forecasting with changing linear models

This investigation considers a general linear model which changes parameters exactly once during the observation period. Assuming all the parameters are unknown and a proper prior distribution, the Bayesian predictive distribution of the future observations is derived.

It is shown that the predictive distribution is a mixture of multivariate t distributions and that the mixing distribution is the marginal posterior mass function of the change point parameter.     

Partially linear models and their applications to change point detection of chemical process data

In many chemical data sets, the amount of radiation absorbed (absorbance) is related to the concentration of the element in the sample by Lambert–Beer's law. However, this relation changes abruptly when the variable concentration reaches an unknown threshold level, the so-called change point. In the context of analytical chemistry, there are many methods that describe the relationship between absorbance and concentration, but none of them provide inferential procedures to detect change points. In this paper, we propose partially linear models with a change point separating the parametric and nonparametric components. The Schwarz information criterion is used to locate a change point. A back-fitting algorithm is presented to obtain parameter estimates and the penalized Fisher information matrix is obtained to calculate the standard errors of the parameter estimates. To examine the proposed method, we present a simulation study. Finally, we apply the method to data sets from the chemistry area. The partially linear models with a change point developed in this paper are useful supplements to other methods of absorbance–concentration analysis in chemical studies, for example, and in many other practical applications.     

Reparameterization strategies for hidden Markov models and Bayesian approaches to maximum likelihood estimation

This paper synthesizes a global approach to both Bayesian and likelihood treatments of the estimation of the parameters of a hidden Markov model in the cases of normal and Poisson distributions. The first step of this global method is to construct a non-informative prior based on a reparameterization of the model; this prior is to be considered as a penalizing and bounding factor from a likelihood point of view. The second step takes advantage of the special structure of the posterior distribution to build up a simple Gibbs algorithm. The maximum likelihood estimator is then obtained by an iterative procedure replicating the original sample until the corresponding Bayes posterior expectation stabilizes on a local maximum of the original likelihood function.     

Detection and estimation of structural change in heavy-tailed sequence

In this paper, bootstrap detection and ratio estimation are proposed to analysis mean change in heavy-tailed distribution. First, the test statistic is constructed into a ratio form on the CUSUM process. Then, the asymptotic distribution of test statistic is obtained and the consistency of the test is proved. To solve the problem that the null distribution of the test statistic contains unknown tail index, we present a bootstrap approximation method to determine the critical values of the null distribution. We also discuss how to estimate change point based on ratio method. The consistency and rate of convergence for the change-point estimator are established. Finally, the excellent performance of our method is demonstrated through simulations using artificial and real data sets. Especially the simulation results of bootstrap test are better than those of another existing method.     

Bayes factor in testing precise hypotheses

Substitution of a mixed prior distribution by a continuous one for the point null hypothesis testing problem is discussed. Conditions are established in order to approximate the Bayes factors for the two problems. Besides, trough this approximation an assignation of priorprobabilities is suggested.     

On biased linear estimators in models with arbitrary rank

In this paper we define a class of biased linear estimators for the unknown parameters in linear models with arbitrary rank. The feature of our approach is to reduce the estimation problem in arbitrary rank models to the one in full-rank models. Some important properties are discussed. As special cases of our class, we extend to deficient-rank models six known biased linear estimators.     

Prior distribution elicitation for generalized linear and piecewise-linear models

An elicitation method is proposed for quantifying subjective opinion about the regression coefficients of a generalized linear model. Opinion between a continuous predictor variable and the dependent variable is modelled by a piecewise-linear function, giving a flexible model that can represent a wide variety of opinion. To quantify his or her opinions, the expert uses an interactive computer program, performing assessment tasks that involve drawing graphs and bar-charts to specify medians and other quantiles. Opinion about the regression coefficients is represented by a multivariate normal distribution whose parameters are determined from the assessments. It is practical to use the procedure with models containing a large number of parameters. This is illustrated through practical examples and the benefit from using prior knowledge is examined through cross-validation.     

Nonparametric estimation of a change point in positive shift models

Six nonparametric estimators of the change point are compared via Monte Carlo simulation in positive shift models of widely different taillengths. It is found that the best estimator in terms of smallest mean-squared error depends on the taillength of the underlying distribution. Overall, an estimator of Lombard (1987) based on a Wilcoxon scores rank statistic is recommended.     

Robust estimation of a multilevel model with structural change

We postulate a spatiotemporal multilevel model and estimate using forward search algorithm and MLE imbedded into the backfitting algorithm. Forward search algorithm ensures robustness of the estimates by filtering the effect of temporary structural changes in the estimation of the group-level covariates, the individual-level covariates and spatial parameters. Backfitting algorithm provides computational efficiency of estimation procedure assuming an additive model. Simulation studies show that estimates are robust even in the presence of structural changes induced for example by epidemic outbreak. The model also produced robust estimates even for small sample and short time series common in epidemiological settings.     

Bayesian methods for generalized linear models with covariates missing at random

The authors propose methods for Bayesian inference for generalized linear models with missing covariate data. They specify a parametric distribution for the covariates that is written as a sequence of one‐dimensional conditional distributions. They propose an informative class of joint prior distributions for the regression coefficients and the parameters arising from the covariate distributions. They examine the properties of the proposed prior and resulting posterior distributions. They also present a Bayesian criterion for comparing various models, and a calibration is derived for it. A detailed simulation is conducted and two real data sets are examined to demonstrate the methodology.     

Bounds on the effect of heteroscedasticity on the chow test for structural change

This paper considers the effect of heteroscedastic regression errors on the size of the Chow test for structural stability. We show that bounds can be placed on the true size of this test in the light of such misspecification, and on the true critical value needed to achieve any desired significance level when using the test under various degrees of heteroscedasticity. These bounds are data-independent, and some cases are tabulated. Examples are given to illustrate the practical application of the critical value bounds.     

Homogeneity of variances in normal linear regression with a change point

Two methods for testing the equality of variances in straight lines regression with a change point are considered. One is likelihood ratio test and the other is Bayesian confidence interval, based on the highest posterior density for the ratio of variances, using non-informative priors. Methods are applied to the renal transplant data analyzed by Smith and Cook(1980) and Stephens(1994).     

Equality and inequality constrained multivariate linear models: Objective model selection using constrained posterior priors

In objective Bayesian model selection, a well-known problem is that standard non-informative prior distributions cannot be used to obtain a sensible outcome of the Bayes factor because these priors are improper. The use of a small part of the data, i.e., a training sample, to obtain a proper posterior prior distribution has become a popular method to resolve this issue and seems to result in reasonable outcomes of default Bayes factors, such as the intrinsic Bayes factor or a Bayes factor based on the empirical expected-posterior prior.