Empirical bayesInterval estimates: An application to geographical epidemiology

Summary Empirical Bayes estimates have been advocated as an improvement for mapping rare diseases or health events aggregated in small areas. In particular different parametric approaches have been proposed for dealing with non-normal data, assuming that disease occurrencies follow non-homogeneous Poisson law, whose parameters are treated as random variables. This paper shows how to conduct a complete Empirical Bayes analysis under an exchangeable model in the context of Geographical Epidemiology. Three different approaches for defining confidence limits obtained using a parametric bootstrap are compared: method 1 relies only on the first and second moment of the bootstrapped posterior distributions; method 2 computes the centiles of the bootstrapped posteriors; method 3 equates to α the average of the probabilities derived from the estimated bootstrapped cumulative posterior distributions. The simple Poisson-Gamma formulation was used to model mortality data on Larynx Cancer in the Local Health Units of Tuscany (1980–82 males). Two areas of significant elevated risk are identified.     

Approximations to the p-values of tests for a change-point under non-standard conditions

Three test statistics for a change-point in a linear model, variants of those considered by Andrews and Ploberger [Optimal tests when a nusiance parameter is present only under the alternative. Econometrica. 1994;62:1383–1414]: the sup-likelihood ratio (LR) statistic; a weighted average of the exponential of LR-statistics and a weighted average of LR-statistics, are studied. Critical values for the statistics with time trend regressors, obtained via simulation, are found to vary considerably, depending on conditions on the error terms. The performance of the bootstrap in approximating p-values of the distributions is assessed in a simulation study. A sample approximation to asymptotic analytical expressions extending those of Kim and Siegmund [The likelihood ratio test for a change-point in simple linear regression. Biometrika. 1989;76:409–423] in the case of the sup-LR test is also assessed. The approximations and bootstrap are applied to the Quandt data [The estimation of a parameter of a linear regression system obeying two separate regimes. J Amer Statist Assoc. 1958;53:873–880] and real data concerning a change-point in oxygen uptake during incremental exercise testing and the bootstrap gives reasonable results.     

Estimation of Standard Errors of Empirical Bayes Estimators in Capm-Type Models

This paper is concerned with the problem of estimating the standard errors of the empirical Bayes estimators in linear regression models. The problem of deriving an exact expression for the standard error of this estimator is generally intractable. We suggest a procedure based on Efron’s bootstrap method as a way of estimating the standard error. It is shown, through simulations, that the bootstrap method provides a more accurate estimate of the standard error of the empirical Bayes estimator than the traditional large sample method.     

Change-Point Tests for the Error Distribution in Non-parametric Regression

Abstract.  Several testing procedures are proposed that can detect change-points in the error distribution of non-parametric regression models. Different settings are considered where the change-point either occurs at some time point or at some value of the covariate. Fixed as well as random covariates are considered. Weak convergence of the suggested difference of sequential empirical processes based on non-parametrically estimated residuals to a Gaussian process is proved under the null hypothesis of no change-point. In the case of testing for a change in the error distribution that occurs with increasing time in a model with random covariates the test statistic is asymptotically distribution free and the asymptotic quantiles can be used for the test. This special test statistic can also detect a change in the regression function. In all other cases the asymptotic distribution depends on unknown features of the data-generating process and a bootstrap procedure is proposed in these cases. The small sample performances of the proposed tests are investigated by means of a simulation study and the tests are applied to a data example.     

Likelihood ratio-based distribution-free sequential change-point detection

Most existing control charts are for monitoring location or scale parameters, rather than any change in process distribution such as shift in shape. Goodness-of-fit (GOF) test can detect any change in distribution. This paper develops a new distribution-free control chart by integrating a powerful two-sample nonparametric likelihood ratio GOF test into the effective change-point model. Our proposed chart is easy in computation, convenient to use, and very efficient in detecting any change in process distribution, including shifts in location, scale, and shape. It is also robust in detecting various magnitudes of shifts and especially powerful in monitoring any distributional change involving a decrease in scale.     

On multiple change-point estimation for Poisson process

This work is devoted to the problem of change-point parameter estimation in the case of the presence of multiple changes in the intensity function of the Poisson process. It is supposed that the observations are independent inhomogeneous Poisson processes with the same intensity function and this intensity function has two jumps separated by a known quantity. The asymptotic behavior of the maximum-likelihood and Bayesian estimators are described. It is shown that these estimators are consistent, have different limit distributions, the moments converge and that the Bayesian estimators are asymptotically efficient. The numerical simulations illustrate the obtained results.     

Constant hazard against a change-point alternative: a bayesian approach with censored data

A Bayesian approach to the problem of a constant hazard with a single change-point is developed using noninformative reference priors. We also present a generalization for the comparison for two treatments.     

Linear statistics in change-point estimation and their asymptotic behaviour

ABSTRACT The limiting behaviour of Bayes procedures in the asymptotic setting of the change-point estimation problem is studied. It is shown that the distribution of the difference between the Bayes estimator and the parameter converges to the distribution of a fairly complicated random variable. A class of linear statistics is introduced, and the form of the Bayes estimator within this class is deduced. The asymptotic properties of this linear estimator are investigated in two different settings for the prior distribution.     

Page's sequential procedure for change-point detection in time series regression

In a variety of different settings cumulative sum (CUSUM) procedures have been applied for the sequential detection of structural breaks in the parameters of stochastic models. Yet their performance depends strongly on the time of change and is best under early change scenarios. For later changes their finite sample behavior is rather questionable. We therefore propose modified CUSUM procedures for the detection of abrupt changes in the regression parameter of multiple time series regression models, that show a higher stability with respect to the time of change than ordinary CUSUM procedures. The asymptotic distributions of the test statistics and the consistency of the procedures are provided. In a simulation study it is shown that the proposed procedures behave well in finite samples. Finally the procedures are applied to a set of capital asset pricing data related to the Fama–French extension of the CAPM.     

Statistical inference for multiple change-point models

In this article, we propose a new technique for constructing confidence intervals for the mean of a noisy sequence with multiple change-points. We use the weighted bootstrap to generalize the bootstrap aggregating or bagging estimator. A standard deviation formula for the bagging estimator is introduced, based on which smoothed confidence intervals are constructed. To further improve the performance of the smoothed interval for weak signals, we suggest a strategy of adaptively choosing between the percentile intervals and the smoothed intervals. A new intensity plot is proposed to visualize the pattern of the change-points. We also propose a new change-point estimator based on the intensity plot, which has superior performance in comparison with the state-of-the-art segmentation methods. The finite sample performance of the confidence intervals and the change-point estimator are evaluated through Monte Carlo studies and illustrated with a real data example.     

A Bayesian analysis of the change-point problem for directional data

In this paper, we discuss a simple fully Bayesian analysis of the change-point problem for the directional data in the parametric framework with von Mises or circular normal distribution as the underlying distribution. We first discuss the problem of detecting change in the mean direction of the circular normal distribution using a latent variable approach when the concentration parameter is unknown. Then, a simpler approach, beginning with proper priors for all the unknown parameters – the sampling importance resampling technique – is used to obtain the posterior marginal distribution of the change-point. The method is illustrated using the wind data [E.P. Weijers, A. Van Delden, H.F. Vugts and A.G.C.A. Meesters, The composite horizontal wind field within convective structures of the atmospheric surface layer, J. Atmos. Sci. 52 (1995. 3866–3878]. The method can be adapted for a variety of situations involving both angular and linear data and can be used with profit in the context of statistical process control in Phase I of control charting and also in Phase II in conjunction with control charts.     

An extension of a change-point problem

We consider a specific classification problem in the context of change-point detection. We present generalized classical maximum likelihood tests for homogeneity of the observed sample in a simple form which avoids the complex direct estimation of unknown parameters. This paper proposes a martingale approach to transformation of test statistics. For sequential and retrospective testing problems, we propose the adapted Shiryayev–Roberts statistics in order to obtain simple tests with asymptotic power one. An important application of the developed methods is in the analysis of exposure's measurements subject to limits of detection in occupational medicine.     

Estimation of parameters and reliability from generalized life models

Simultaneous estimation of parameters with p (≥ 2) components, where each component has a generalized life distribution, is considered under a sum of squared error loss function. Improved estimators are obtained which dominate the maximum likelihood and the niinimum mean square estimators. Robustness of the improved estimators is shown even when the component distributions are dependent. The result is extended to the estimation of the system reliability when the components are connected in series. Several numerical studies are performed to demonstrate the risk improvement and the Pitman closeness of the new estimators.     

Estimation in a change-point non linear quantile model

This paper considers a non linear quantile model with change-points. The quantile estimation method, which as a particular case includes median model, is more robust with respect to other traditional methods when model errors contain outliers. Under relatively weak assumptions, the convergence rate and asymptotic distribution of change-point and of regression parameter estimators are obtained. Numerical study by Monte Carlo simulations shows the performance of the proposed method for non linear model with change-points.     

Monitoring and change-point estimation for spline-modeled non-linear profiles in phase II

In some applications of statistical quality control, quality of a process or a product is best characterized by a functional relationship between a response variable and one or more explanatory variables. This relationship is referred to as a profile. In certain cases, the quality of a process or a product is better described by a non-linear profile which does not follow a specific parametric model. In these circumstances, nonparametric approaches with greater flexibility in modeling the complicated profiles are adopted. In this research, the spline smoothing method is used to model a complicated non-linear profile and the Hotelling T² control chart based on the spline coefficients is used to monitor the process. After receiving an out-of-control signal, a maximum likelihood estimator is employed for change point estimation. The simulation studies, which include both global and local shifts, provide appropriate evaluation of the performance of the proposed estimation and monitoring procedure. The results indicate that the proposed method detects large global shifts while it is very sensitive in detecting local shifts.     

A Simulator for Twenty20 Cricket

This paper develops a Twenty20 cricket simulator for matches between sides belonging to the International Cricket Council. As input, the simulator requires the probabilities of batting outcomes which are dependent on the batsman, the bowler, the number of overs consumed and the number of wickets lost. The determination of batting probabilities is based on an amalgam of standard classical estimation techniques and a hierarchical empirical Bayes approach where the probabilities of batting outcomes borrow information from related scenarios. Initially, the probabilities of batting outcomes are obtained for the first innings. In the second innings, the target score obtained from the first innings affects the aggressiveness of batting during the second innings. We use the target score to modify batting probabilities in the second innings simulation. This gives rise to the suggestion that teams may not be adjusting their second innings batting aggressiveness in an optimal way. The adequacy of the simulator is addressed through various goodness‐of‐fit diagnostics.     

Choosing between two unknown intervals: an empirical bayes testing approach to a classification problem

Let X₁,X₂…be i.i.d. observations from a mixture density. The support of the unknown prior distribution is the union of two unknown intervals. The paper deals with an empirical Bayes testing approach (?≤ c against>c where c is an unknown parameter to be estimated) in order to classify the observed variables as coming from one population or the other as ? belongs to one or the other unknown interval. Two methods are proposed in which asymptotically optimal decision rules are constructed avoiding the estimation of the unknown prior. The first method deals with the case of exponential families and is a generalization of the method of Johns and Van Ryzin (1971, 1972) whereas the second one deals with families that are closed under convolution and is a Fourier method. The application of the Fourier method to some densities (i.e. contaminated Gaussian distributions, exponential distribution, double-exponential distribution) which are interesting in view of applications and which cannot be studied by means of the direct method, is also considered herein.     

A backward procedure for change-point detection with applications to copy number variation detection

Change-point detection regains much attention recently for analyzing array or sequencing data for copy number variation (CNV) detection. In such applications, the true signals are typically very short and buried in the long data sequence, which makes it challenging to identify the variations efficiently and accurately. In this article, we propose a new change-point detection method, a backward procedure, which is not only fast and simple enough to exploit high-dimensional data but also performs very well for detecting short signals. Although motivated by CNV detection, the backward procedure is generally applicable to assorted change-point problems that arise in a variety of scientific applications. It is illustrated by both simulated and real CNV data that the backward detection has clear advantages over other competing methods, especially when the true signal is short. The Canadian Journal of Statistics 48: 366–385; 2020 © 2020 Statistical Society of Canada     

Change point-cure models with application to estimating the change-point effect of age of diagnosis among prostate cancer patients

Previous research on prostate cancer survival trends in the United States National Cancer Institute's Surveillance Epidemiology and End Results database has indicated a potential change-point in the age of diagnosis of prostate cancer around age 50. Identifying a change-point value in prostate cancer survival and cure could have important policy and health care management implications. Statistical analysis of this data has to address two complicating features: (1) change-point models are not smooth functions and so present computational and theoretical difficulties; and (2) models for prostate cancer survival need to account for the fact that many men diagnosed with prostate cancer can be effectively cured of their disease with early treatment. We develop a cure survival model that allows for change-point effects in covariates to investigate a potential change-point in the age of diagnosis of prostate cancer. Our results do not indicate that age under 50 is associated with increased hazard of death from prostate cancer.