The collected works of john w. tukey

We describe novel, analytical, data-analysis, and Monte-Carlo-simulation studies of strongly heteroscedastic data of both small and wide range.Many different types of heteroscedasticity and fixed or variable weighting are incorporated through error-variance models.Attention is given to parameter bias determinations, evaluations of their significances, and to new ways to correct for bias.The error-variance models allow for both additive and independent power-law errors, and the power exponent is shown to be able to be well determined for typical physicalsciences data by the rapidly-converging, general-purpose, extended-least-squares program we use.The fitting and error-variance models are applied to both low-and high-heteroscedasticity situations, including single-response data from radioactive decay.Monte-Carlo simulations of data with similar parameters are used to evaluate the analytical models developed and the various minimization methods em-ployed, such as extended and generalized least squares.Logarithmic and inversion transformations are investigated in detail, and it is shown analytically and by simulations that exponential data with constant percentage errors can be logarithmically transformed to allow a simple parameter-bias-removal procedure.A more-general bias-reduction approach combining direct and inversion fitting is also developed.Distributions of fitting-model and error-variance-model parameters are shown to be typically non-normal, thus invalidating the usual estimates of parameter bias and precision.Errors in conventional confidence-interval estimates are quantified by comparison with accurate simulation results.     

Efficiency and Validity Analyses of Two-Stage Estimation Procedures and Derived Testing Procedures in Quantitative Linear Models with AR(1) Errors

Abstract

In a quantitative linear model with errors following a stationary Gaussian, first-order autoregressive or AR(1) process, Generalized Least Squares (GLS) on raw data and Ordinary Least Squares (OLS) on prewhitened data are efficient methods of estimation of the slope parameters when the autocorrelation parameter of the error AR(1) process, ρ, is known. In practice, ρ is generally unknown. In the so-called two-stage estimation procedures, ρ is then estimated first before using the estimate of ρ to transform the data and estimate the slope parameters by OLS on the transformed data. Different estimators of ρ have been considered in previous studies. In this article, we study nine two-stage estimation procedures for their efficiency in estimating the slope parameters. Six of them (i.e., three noniterative, three iterative) are based on three estimators of ρ that have been considered previously. Two more (i.e., one noniterative, one iterative) are based on a new estimator of ρ that we propose: it is provided by the sample autocorrelation coefficient of the OLS residuals at lag 1, denoted r(1). Lastly, REstricted Maximum Likelihood (REML) represents a different type of two-stage estimation procedure whose efficiency has not been compared to the others yet. We also study the validity of the testing procedures derived from GLS and the nine two-stage estimation procedures. Efficiency and validity are analyzed in a Monte Carlo study. Three types of explanatory variable x in a simple quantitative linear model with AR(1) errors are considered in the time domain: Case 1, x is fixed; Case 2, x is purely random; and Case 3, x follows an AR(1) process with the same autocorrelation parameter value as the error AR(1) process. In a preliminary step, the number of inadmissible estimates and the efficiency of the different estimators of ρ are compared empirically, whereas their approximate expected value in finite samples and their asymptotic variance are derived theoretically. Thereafter, the efficiency of the estimation procedures and the validity of the derived testing procedures are discussed in terms of the sample size and the magnitude and sign of ρ. The noniterative two-stage estimation procedure based on the new estimator of ρ is shown to be more efficient for moderate values of ρ at small sample sizes. With the exception of small sample sizes, REML and its derived F-test perform the best overall. The asymptotic equivalence of two-stage estimation procedures, besides REML, is observed empirically. Differences related to the nature, fixed or random (uncorrelated or autocorrelated), of the explanatory variable are also discussed.     

Two stage multiple comparison procedures based on the studentized range

Stein’s (1945) two sample approach and Tukey’s T-Method of multiple comparisons (see e.g. Miller, 1966, Ch. 2) are combined to obtain fixed width simultaneous confidence intervals and simultaneous test procedures of predetermined Type I and Type II error levels, for all contrasts, in a one way layout. The necessary constants for implementing the two stage procedure are obtained under a least favorable configuration of the parameters. This provides the required protection of the null and alternative hypotheses under any configuration of parameters. A table is provided for some selected designs and error levels and an example is given to illustrate certain features of the new procedure.     

Income vulnerability of rural households in Bangladesh: a comparison between Bayesian and classical methods

The geographical location and the monsoon climate render Bangladesh highly vulnerable to natural hazards, deteriorating the country's socio-economic stability. This study is based on 500 randomly chosen rural households from the Household Income and Expenditure Survey [Bangladesh Bureau of Statistics, Planning Division, Ministry of Planning, Government of the People's Republic of Bangladesh, Dhaka, 2006]. The objectives are to estimate the income vulnerability of rural households and to check whether the Bayesian approaches (natural conjugate prior and non-informative prior estimates) have any superiority over the classical (feasible generalized least square (FGLS)) method. The poverty level, measured from the data, is 24%; whereas the vulnerability estimates, using FGLS, natural conjugate prior and non-informative prior are 31%, 69% and 82%, respectively. Vulnerability estimates by the Bayesian natural conjugate prior approach is found to have greater efficiency compared with FGLS and non-informative prior approaches.     

Geometric characterization of planar regression

The geometric characterization of linear regression in terms of the ‘concentration ellipse’ by Galton [Galton, F., 1886, Family likeness in stature (with Appendix by Dickson, J.D.H.). Proceedings of the Royal Society of London, 40, 42–73.] and Pearson [Pearson, K., 1901, On lines and planes of closest fit to systems of points in space. Philosophical Magazine, 2, 559–572.] was extended to the case of unequal variances of the presumably uncorrelated errors in the experimental data [McCartin, B.J., 2003, A geometric characterization of linear regression. Statistics, 37(2), 101–117.]. In this paper, this geometric characterization is further extended to planar (and also linear) regression in three dimensions where a beautiful interpretation in terms of the concentration ellipsoid is developed.     

Strong consistency of least squares estimates with i.i.d. errors with mean values not necessarily defined

We establish strong consistency of the least squares estimates in multiple regression models discarding the usual assumption of the errors having null mean value. Thus, we required them to be i.i.d. with absolute moment of order r, 0<r<2, and null mean value when r>1. Only moderately restrictive conditions are imposed on the model matrix. In our treatment, we use an extension of the Marcinkiewicz–Zygmund strong law to overcome the errors mean value not being defined. In this way, we get a unified treatment for the case of i.i.d. errors extending the results of some previous papers.     

Asymptotic results for random coefficient bifurcating autoregressive processes

The purpose of this paper is to study the asymptotic behaviour of the weighted least-squares estimators of the unknown parameters of random coefficient bifurcating autoregressive processes. Under suitable assumptions on the immigration and the inheritance, we establish the almost sure convergence of our estimators, as well as a quadratic strong law and central limit theorems. Our study mostly relies on limit theorems for vector-valued martingales.     

Distance-based approach in univariate longitudinal data analysis

In this paper, we propose a methodology to analyze longitudinal data through distances between pairs of observations (or individuals) with regard to the explanatory variables used to fit continuous response variables. Restricted maximum-likelihood and generalized least squares are used to estimate the parameters in the model. We applied this new approach to study the effect of gender and exposure on the deviant behavior variable with respect to tolerance for a group of youths studied over a period of 5 years. Were performed simulations where we compared our distance-based method with classic longitudinal analysis with both AR(1) and compound symmetry correlation structures. We compared them under Akaike and Bayesian information criterions, and the relative efficiency of the generalized variance of the errors of each model. We found small gains in the proposed model fit with regard to the classical methodology, particularly in small samples, regardless of variance, correlation, autocorrelation structure and number of time measurements.