A Bayesian analysis of the change-point problem for directional data

In this paper, we discuss a simple fully Bayesian analysis of the change-point problem for the directional data in the parametric framework with von Mises or circular normal distribution as the underlying distribution. We first discuss the problem of detecting change in the mean direction of the circular normal distribution using a latent variable approach when the concentration parameter is unknown. Then, a simpler approach, beginning with proper priors for all the unknown parameters – the sampling importance resampling technique – is used to obtain the posterior marginal distribution of the change-point. The method is illustrated using the wind data [E.P. Weijers, A. Van Delden, H.F. Vugts and A.G.C.A. Meesters, The composite horizontal wind field within convective structures of the atmospheric surface layer, J. Atmos. Sci. 52 (1995. 3866–3878]. The method can be adapted for a variety of situations involving both angular and linear data and can be used with profit in the context of statistical process control in Phase I of control charting and also in Phase II in conjunction with control charts.     

Change-point mle in the rate of exponential sequences with application to Indonesian seismological data

In this paper, we derive explicit computable expressions for the asymptotic distribution of the maximum likelihood estimate of an unknown change-point in a sequence of independently and exponentially distributed random variables. First we state and prove a theorem that shows asymptotic equivalence of the change-point mle for the cases of both known and unknown parameters, respectively. Thereafter, the computational form of the asymptotic distribution of the change-point mle is derived for the case of known parameter situation only. Simulations show that the distribution for the known case applies very well to the case where the parameters are estimated. Further, it is seen from simulations that the derived unconditional mle shows better performance compared to the conditional solution of Cobb. Application of change detection methodology and the derived estimation methodology show strong support in favor the dynamic triggering hypothesis for seismic faults in Sumatra, Indonesia region.     

A change-point estimator with the hazard ratio

The problem of estimation of parameters in hazard rate change models with a change-point is considered. A change-point estimator using the hazard ratio is suggested and compared with the previously developed change-point estimators. The proposed estimator is shown to be consistent. The performance of the proposed estimator is checked and compared with other change-point estimators via simulation.     

位置参数变点的统计推断

关于随机变量序列中是否存在变点的问题一直不断地有人研究,对变点进行估计具有很重要的应用价值。为此,研究至多一个变点的位置参数变点问题,对变点是否存在进行假设检验,论证相关统计量的渐进性质,在此基础上提出变点的一种点估计,并证明估计的强相合性。     

The LAD estimation of the change-point linear model with randomly censored data

Abstract

In this paper, a change-point linear model with randomly censored data is investigated. We propose the least absolute deviation estimation procedure for regression and change-point parameters simultaneously. The asymptotic properties of the change-point and regression parameter estimators are obtained. We show that the resulting regression parameter estimator is asymptotically normal, and the change-point estimator converges weakly to the minimizer of a given random process. The extensive simulation studies and the analysis of an acute myocardial infarction data set are conducted to illustrate the finite sample performance of the proposed method.     

Maximum likelihood estimation in hazard rate models with a change-point

The problem of estimation of parameters in hazard rate models with a change-point is considered. An interesting feature of this problem is that the likelihood function is unbounded. A maximum likelihood estimator of the change-point subject to a natural constraint is proposed, which is shown to be consistent.The limiting distributions are also derived.     

Asymptotic study of the change-point mle in multivariate Gaussian families under contiguous alternatives

The problem of estimating an unknown change-point in the mean vector or covariance matrix of a sequence of independent multivariate Gaussian random variables is considered. Adapting the estimation methodology that Hinkley pursued for the case of abrupt changes, we develop theory for deriving the asymptotic distribution of the maximum likelihood estimator of the change-point when the amount of change is a function of the sample size and goes to zero in a smooth fashion as the sample size goes to infinity, yielding a contiguous change-point model. Simulations have been performed to illustrate the closeness of the asymptotic distribution with the empirical distribution, and to evaluate its robustness to departures from normality for reasonable sample sizes as well as parameter changes. Finally, we apply the methodology to estimate the change-point in the daily log-returns data of BLS (BellSouth) and VZ (Verizon) from NYSE.     

Wavelets in statistics: A review

The field of nonparametric function estimation has broadened its appeal in recent years with an array of new tools for statistical analysis. In particular, theoretical and applied research on the field of wavelets has had noticeable influence on statistical topics such as nonparametric regression, nonparametric density estimation, nonparametric discrimination and many other related topics. This is a survey article that attempts to synthetize a broad variety of work on wavelets in statistics and includes some recent developments in nonparametric curve estimation that have been omitted from review articles and books on the subject. After a short introduction to wavelet theory, wavelets are treated in the familiar context of estimation of «smooth» functions. Both «linear» and «nonlinear» wavelet estimation methods are discussed and cross-validation methods for choosing the smoothing parameters are addressed. Finally, some areas of related research are mentioned, such as hypothesis testing, model selection, hazard rate estimation for censored data, and nonparametric change-point problems. The closing section formulates some promising research directions relating to wavelets in statistics.     

Linear statistics in change-point estimation and their asymptotic behaviour

ABSTRACT The limiting behaviour of Bayes procedures in the asymptotic setting of the change-point estimation problem is studied. It is shown that the distribution of the difference between the Bayes estimator and the parameter converges to the distribution of a fairly complicated random variable. A class of linear statistics is introduced, and the form of the Bayes estimator within this class is deduced. The asymptotic properties of this linear estimator are investigated in two different settings for the prior distribution.     

Bayesian multiple change-point estimation for exponential distribution with truncated and censored data

This paper considers the multiple change-point estimation for exponential distribution with truncated and censored data by Gibbs sampling. After all the missing data of interest is filled in by some sampling methods such as rejection sampling method, the complete-data likelihood function is obtained. The full conditional distributions of all parameters are discussed. The means of Gibbs samples are taken as Bayesian estimations of the parameters. The implementation steps of Gibbs sampling are introduced in detail. Finally random simulation test is developed, and the results show that Bayesian estimations are fairly accurate.     

A comparison of estimators for regression models with change points

We consider two problems concerning locating change points in a linear regression model. One involves jump discontinuities (change-point) in a regression model and the other involves regression lines connected at unknown points. We compare four methods for estimating single or multiple change points in a regression model, when both the error variance and regression coefficients change simultaneously at the unknown point(s): Bayesian, Julious, grid search, and the segmented methods. The proposed methods are evaluated via a simulation study and compared via some standard measures of estimation bias and precision. Finally, the methods are illustrated and compared using three real data sets. The simulation and empirical results overall favor both the segmented and Bayesian methods of estimation, which simultaneously estimate the change point and the other model parameters, though only the Bayesian method is able to handle both continuous and dis-continuous change point problems successfully. If it is known that regression lines are continuous then the segmented method ranked first among methods.     

Detection and estimation of structural change in heavy-tailed sequence

In this paper, bootstrap detection and ratio estimation are proposed to analysis mean change in heavy-tailed distribution. First, the test statistic is constructed into a ratio form on the CUSUM process. Then, the asymptotic distribution of test statistic is obtained and the consistency of the test is proved. To solve the problem that the null distribution of the test statistic contains unknown tail index, we present a bootstrap approximation method to determine the critical values of the null distribution. We also discuss how to estimate change point based on ratio method. The consistency and rate of convergence for the change-point estimator are established. Finally, the excellent performance of our method is demonstrated through simulations using artificial and real data sets. Especially the simulation results of bootstrap test are better than those of another existing method.     

Inference for a change-point problem under an OU setting with unequal and unknown volatilities

An Ornstein–Uhlenbeck (OU) process is employed as a versatile model to capture the mean-reverting and stochastic evolution of many variables in various fields of applications including finance and economics. Within the OU setting, we develop a new estimation method to determine the unknown change-point location under the assumption that the volatilities before and after the change point in a time series are unequal. Our method hinges on the concept of a weighted least sum of squared errors approach and enhanced by a fusion of an iterative algorithm. The consistency of the change-point estimator is established. This article highlights a numerical implementation on simulated and observed financial market data demonstrating the significant flexibility and accuracy of our proposed modelling and estimation method. The Canadian Journal of Statistics 48: 62–78; 2020 © 2019 Statistical Society of Canada     

Truncated sequential change-point detection based on renewal counting processes II

The standard approach in change-point theory is to base the statistical analysis on a sample of fixed size. Alternatively, one observes some random phenomenon sequentially and takes action as soon as one observes some statistically significant deviation from the “normal” behaviour. The present paper is a continuation of Gut and Steinebach [2002. Truncated sequential change-point detection based on renewal counting processes. Scand. J. Statist. 29, 693–719] the main point being that here we look in more detail into the behaviour of the relevant stopping times, in particular the time it takes from the actual change-point until the change is detected, more precisely, we prove asymptotics for stopping times under alternatives.     

Asymptotic theory for bent-cable regression—the basic case

We use what we call the bent-cable model to describe potential change-point phenomena. The class of bent cables includes the commonly used broken stick (a bent cable without a bend segment). Theory for least-squares (LS) estimation is developed for the basic bent cable, whose incoming and outgoing linear phases have slopes 0 and 1, respectively, and are joined smoothly by a quadratic bend. Conditions on the design are given to ensure regularity of the estimation problem, despite non-differentiability of the model's first partial derivatives (with respect to the covariate and model parameters). Under such conditions, we show that the LS estimators (i) are consistent, regardless of a zero or positive true bend width; and (ii) asymptotically follow a bivariate normal distribution, if the underlying cable has all three segments. In the latter case, we show that the deviance statistic has an asymptotic chi-squared distribution with two degrees of freedom.     

A Bayesian model for multiple change point to extremes,with application to environmental and financial data

Abrupt changes often occur for environmental and financial time series. Most often, these changes are due to human intervention. Change point analysis is a statistical tool used to analyze sudden changes in observations along the time series. In this paper, we propose a Bayesian model for extreme values for environmental and economic datasets that present a typical change point behavior. The model proposed in this paper addresses the situation in which more than one change point can occur in a time series. By analyzing maxima, the distribution of each regime is a generalized extreme value distribution. In this model, the change points are unknown and considered parameters to be estimated. Simulations of extremes with two change points showed that the proposed algorithm can recover the true values of the parameters, in addition to detecting the true change points in different configurations. Also, the number of change points was a problem to be considered, and the Bayesian estimation can correctly identify the correct number of change points for each application. Environmental and financial data were analyzed and results showed the importance of considering the change point in the data and revealed that this change of regime brought about an increase in the return levels, increasing the number of floods in cities around the rivers. Stock market levels showed the necessity of a model with three different regimes.     

Information approach for a lifetime change-point model based on the exponential-logarithmic distribution

ABSTRACT

The exponential-logarithmic distribution is a distribution which has a decreasing failure function and various applications such as in biological and engineering fields. In this paper, we study a change-point problem of this distribution. A procedure based on Schwarz information criterion is proposed to detect changes in parameters of this distribution. Simulations are conducted to indicate the performance of the proposed procedure under different scenarios. Applications on two real data are provided to illustrate the detection procedure.     

A BAYESIAN INTERPRETATION OF MULTIPLE POINT ESTIMATES

Consider a large number of econometric investigations using different estimation techniques and/or different subsets of all available data to estimate a fixed set of parameters. The resulting empirical distribution of point estimates can be shown - under suitable conditions - to coincide with a Bayesian posterior measure on the parameter space induced by a minimum information procedure. This Bayesian interpretation makes it easier to combine the results of various empirical exercises for statistical decision making. The collection of estimators may be generated by one investigator to ensure the satisfaction of our conditions, or they may be collected from published works, where behavioral assumptions need to be made regarding the dependence structure of econometric studies.     

Maximum likelihood estimation of the parameters of a multiple step-stress model from the Birnbaum-Saunders distribution under time-constraint: A comparative study

The cumulative exposure model (CEM) is a commonly used statistical model utilized to analyze data from a step-stress accelerated life testing which is a special class of accelerated life testing (ALT). In practice, researchers conduct ALT to: (1) determine the effects of extreme levels of stress factors (e.g., temperature) on the life distribution, and (2) to gain information on the parameters of the life distribution more rapidly than under normal operating (or environmental) conditions. In literature, researchers assume that the CEM is from well-known distributions, such as the Weibull family. This study, on the other hand, considers a p-step-stress model with q stress factors from the two-parameter Birnbaum-Saunders distribution when there is a time constraint on the duration of the experiment. In this comparison paper, we consider different frameworks to numerically compute the point estimation for the unknown parameters of the CEM using the maximum likelihood theory. Each framework implements at least one optimization method; therefore, numerical examples and extensive Monte Carlo simulations are considered to compare and numerically examine the performance of the considered estimation frameworks.     

Some results on estimating a change-point using non-parametric type statistics

A Mann-Whitney type statistic is used to estimate a change-point when a change, at an unknown point in a sequence of random variables, has taken place. This estimate is compared, using Monte Carlo techniques, with the normal theory maximum likelihood estimate, when a location change has occurred, for different underlying distributions ranging from the normal to the long tailed “normal over uniform” distribution. The distribution of the Mann-Whitney type estimate remains fairly constant over the various distributions. Two generalisations of the statistic are considered and investigated.