Data skeletons: simultaneous estimation of multiple quantiles for massive streaming datasets with applications to density estimation

We consider the problem of density estimation when the data is in the form of a continuous stream with no fixed length. In this setting, implementations of the usual methods of density estimation such as kernel density estimation are problematic. We propose a method of density estimation for massive datasets that is based upon taking the derivative of a smooth curve that has been fit through a set of quantile estimates. To achieve this, a low-storage, single-pass, sequential method is proposed for simultaneous estimation of multiple quantiles for massive datasets that form the basis of this method of density estimation. For comparison, we also consider a sequential kernel density estimator. The proposed methods are shown through simulation study to perform well and to have several distinct advantages over existing methods.     

Issues in applying recent CPMP ‘Points to Consider’ and FDA guidance documents with biostatistical implications

The International Conference on Harmonisation guideline ‘Statistical Principles for Clinical Trials’ was adopted by the Committee for Proprietary Medicinal Products (CPMP) in March 1998, and consequently is operational in Europe. Since then more detailed guidance on selected topics has been issued by the CPMP in the form of ‘Points to Consider’ documents. The intent of these was to give guidance particularly to non‐statistical reviewers within regulatory authorities, although of course they also provide a good source of information for pharmaceutical industry statisticians. In addition, the Food and Drug Administration has recently issued a draft guideline on data monitoring committees. In November 2002 a one‐day discussion forum was held in London by Statisticians in the Pharmaceutical Industry (PSI). The aim of the meeting was to discuss how statisticians were responding to some of the issues covered in these new guidelines, and to document consensus views where they existed. The forum was attended by industry, academic and regulatory statisticians. This paper outlines the questions raised, resulting discussions and consensus views reached. It is clear from the guidelines and discussions at the workshop that the statistical analysis strategy must be planned during the design phase of a clinical trial and carefully documented. Once the study is complete the analysis strategy should be thoughtfully executed and the findings reported. Copyright © 2003 John Wiley & Sons, Ltd.     

A simple estimator for a shared frailty regression model

Summary. We propose a simple estimation procedure for a proportional hazards frailty regression model for clustered survival data in which the dependence is generated by a positive stable distribution. Inferences for the frailty parameter can be obtained by using output from Cox regression analyses. The computational burden is substantially less than that of the other approaches to estimation. The large sample behaviour of the estimator is studied and simulations show that the approximations are appropriate for use with realistic sample sizes. The methods are motivated by studies of familial associations in the natural history of diseases. Their practical utility is illustrated with sib pair data from Beaver Dam, Wisconsin.     

Organizational Compatibility and Workplace Drug Testing: Modeling the Adoption of Innovative Social Control Practices

Few researchers have examined organizational variation in the adoption of workplace drug testing, but innovation theory suggests that adoption is more likely when it is compatible with an organization's values, previously introduced ideas, and needs. Using data from the 1997 National Employee Survey, this research models the effects of organizational compatibility, industry, and establishment size on the adoption of drug testing. The data reveal that compatibility, as measured by an organization's rules orientation, presence of an employee assistance program, and mechanization, is associated with the adoption of drug testing. As predicted, the adoption of drug testing varies across industries and by establishment size.