Convergence of Heavy-tailed Monte Carlo Markov Chain Algorithms

Abstract.  In this paper, we use recent results of Jarner & Roberts ( Ann. Appl. Probab., 12, 2002, 224) to show polynomial convergence rates of Monte Carlo Markov Chain algorithms with polynomial target distributions, in particular random-walk Metropolis algorithms, Langevin algorithms and independence samplers. We also use similar methodology to consider polynomial convergence of the Gibbs sampler on a constrained state space. The main result for the random-walk Metropolis algorithm is that heavy-tailed proposal distributions lead to higher rates of convergence and thus to qualitatively better algorithms as measured, for instance, by the existence of central limit theorems for higher moments. Thus, the paper gives for the first time a theoretical justification for the common belief that heavy-tailed proposal distributions improve convergence in the context of random-walk Metropolis algorithms. Similar results are shown to hold for Langevin algorithms and the independence sampler, while results for the mixing of Gibbs samplers on uniform distributions on constrained spaces are rather different in character.     

Convergence of Slice Sampler Markov Chains

We analyse theoretical properties of the slice sampler. We find that the algorithm has extremely robust geometric ergodicity properties. For the case of just one auxiliary variable, we demonstrate that the algorithm is stochastically monotone, and we deduce analytic bounds on the total variation distance from stationarity of the method by using Foster–Lyapunov drift condition methodology.     

Markov Chains and De-initializing Processes

We define a notion of de-initializing Markov chains. We prove that to analyse convergence of Markov chains to stationarity, it suffices to analyse convergence of a de-initializing chain. Applications are given to Markov chain Monte Carlo algorithms and to convergence diagnostics.     

Distance-based approach in univariate longitudinal data analysis

In this paper, we propose a methodology to analyze longitudinal data through distances between pairs of observations (or individuals) with regard to the explanatory variables used to fit continuous response variables. Restricted maximum-likelihood and generalized least squares are used to estimate the parameters in the model. We applied this new approach to study the effect of gender and exposure on the deviant behavior variable with respect to tolerance for a group of youths studied over a period of 5 years. Were performed simulations where we compared our distance-based method with classic longitudinal analysis with both AR(1) and compound symmetry correlation structures. We compared them under Akaike and Bayesian information criterions, and the relative efficiency of the generalized variance of the errors of each model. We found small gains in the proposed model fit with regard to the classical methodology, particularly in small samples, regardless of variance, correlation, autocorrelation structure and number of time measurements.     

Book reviews

S.M.Kendall:Multivariate Analysis.Charles Griffin & Co. Ltd., London and High Wycombe 1975, 210 pp

C.T.Leondes (ed.):Control and Dynamic Systems, Advances in Theory and Applications. Vol. 11, Academic Press, New York and London 1974, 516 pp., $ 24.50.

CH. R.Nelson:Applied Time Series Analysis for Managerial Forecasting. Holden Day, Inc., San Francisco 1973, 231 pp., $ 14.95.

B.DE Finetti:Theory of Probability. Vol. 1, 2, John Wiley & Sons, New York, London, Sydney, Toronto. Vol. 1, 1974, 300 pp., £ 7.50 - Vol. 2 1975, 375 pp., £ 10.50.

P.Erdördos, J. Spencer:Probabilistic Methods in Combinatorics. Akadémic Press, New York and London; Akadémiai Kiadó, Budapest 1974, 106 pp., $ 11.75.

J.S.R.Ustagi:Variational Methods in Statistics.Academic Press, New York and London 1975.

J.S.Rustagi:Optimizing Methods in Statistics.Academic Press, New York and London 1971,488 pp., $ 17.00.

Karl V. Bury:Statistical Models in Applied Science. John Wiley & Sons, New York-London-Sydney-Toronto 1975,.625 pp., £ 15.60; $ 28.00.

Michael R. Anderberg:Cluster Analysis for Applications. Academic Press, New York-San Francisco-London 1973, 359 pp., $ 27,–.

J.L.Fleiss:Statistical Methods for Rates and Proportions. John Wiley & Sons, New York-London-Sydney-Toronto 1973. 223 pp., £ 6.50.

J.Tanur et al. (Ed.):Statistics:A Guide to the Unknown. Holden Day, Inc., San Francisco 1972, 430 pp.

H.VÁliaho, T. Pekkonen:A Procedure for Stepwise Regression Analysis.Akademie-Verlag, Berlin 1976, 90 pp., 18,– M.

M.Reinfeldt, U. TrÁnkle:Signifikanztabellen statistischer Testvertellungen. R. Oldenbourg Verlag, Mnchen, Wien 1976, 151 S., DM 44,–.

R.E.Barlow, D.J.Batholomew, J.M.Bremner, H.D.Brunk:Statistical Inference Under Order Restrictions.(The Theory and Applications of Isotonic Regression.) John Wiley & Sons, New York 1972, 388 pp., £ 7.50.

H.J.Larson:Introduction to Probability Theory and Statistical Inference. Wiley, New York 1974, 430 pp., £ 6.85.

R.A.Carlson:Statistics. Holden Day, Inc., San Francisco 1973, 393 pp.

E. Page:Queueing Theory in OR. Butterworths, London 1972, 187 pp., £ 3.60.

H.Krampe, J.Kubat, W.Runge:Bedienungsmodelle. Ein Leitfaden für die praktische Anwendung, Verlag Die Wirtachaft, Berlin 1973, 512 S., 79,– M.

G.S.Fishman:Concepts and Methods in Discrete Events Digital Simulation. John Wiley & Sons, New York 1973, 385 pp., £ 8,75.     

Maximum likelihood estimation of the bimodal failure rate for censored and tied observations

DIMITROV, RACHEV and YAKOVLEV ( 1985 ) have obtained the isotonic maximum likelihood estimator for the bimodal failure rate function. The authors considered only the complete failure time data. The generalization of this estimator for the case of censored and tied observations is now proposed.     

Accent on Teaching Materials

Review of International Association for Statistical Education Proceedings: Proceedings of the First Scientific Meeting of the International Association for Statistical Education, Lina Brunelli and Guiseppe Cicchitelli, Editors. U.S. $5 (cost of postage) from International Statistical Institute, 428 Prinses Beatrixlann, 2270 AZ Voorburg, The Netherlands. Includes 49 papers presented in Perugia, Italy, in August 1993; 476 pages. Reviewed by Peter Holmes     

Accent on Teaching Materials

A linear combination test for combining several tests of the correlation coefficient in the bivariate normal distribution is proposed. The linear combination test is compared with the well-known Fisher method of combining tests. It is shown by a Monte Carlo study that the linear combination test has a larger power.     

Accent on Teaching Materials

Estimation of covariance components in the multivariate random-effect model with nested covariance structure is discussed. There are two covariance matrices to be estimated, namely, the between-group and the within-group covariance matrices. These two covariance matrices are most often estimated by forming a multivariate analysis of variance and equating mean square matrices to their expectations. Such a procedure involves taking the difference between the between-group mean square and the within-group mean square matrices, and often produces an estimated between-group covariance matrix that is not nonnegative definite. We present estimators of the two covariance matrices that are always proper covariance matrices. The estimators are the restricted maximum likelihood estimators if the random effects are normally distributed. The estimation procedure is extended to more complicated models, including the twofold nested and the mixed-effect models. A numerical example is presented to illustrate the use of the estimation procedure.