Inference and Decision Making for 21st-Century Drug Development and Approval

ABSTRACT

The cost and time of pharmaceutical drug development continue to grow at rates that many say are unsustainable. These trends have enormous impact on what treatments get to patients, when they get them and how they are used. The statistical framework for supporting decisions in regulated clinical development of new medicines has followed a traditional path of frequentist methodology. Trials using hypothesis tests of “no treatment effect” are done routinely, and the p-value < 0.05 is often the determinant of what constitutes a “successful” trial. Many drugs fail in clinical development, adding to the cost of new medicines, and some evidence points blame at the deficiencies of the frequentist paradigm. An unknown number effective medicines may have been abandoned because trials were declared “unsuccessful” due to a p-value exceeding 0.05. Recently, the Bayesian paradigm has shown utility in the clinical drug development process for its probability-based inference. We argue for a Bayesian approach that employs data from other trials as a “prior” for Phase 3 trials so that synthesized evidence across trials can be utilized to compute probability statements that are valuable for understanding the magnitude of treatment effect. Such a Bayesian paradigm provides a promising framework for improving statistical inference and regulatory decision making.     

Properties of the weighted log‐rank test in the design of confirmatory studies with delayed effects

Proportional hazards are a common assumption when designing confirmatory clinical trials in oncology. This assumption not only affects the analysis part but also the sample size calculation. The presence of delayed effects causes a change in the hazard ratio while the trial is ongoing since at the beginning we do not observe any difference between treatment arms, and after some unknown time point, the differences between treatment arms will start to appear. Hence, the proportional hazards assumption no longer holds, and both sample size calculation and analysis methods to be used should be reconsidered. The weighted log‐rank test allows a weighting for early, middle, and late differences through the Fleming and Harrington class of weights and is proven to be more efficient when the proportional hazards assumption does not hold. The Fleming and Harrington class of weights, along with the estimated delay, can be incorporated into the sample size calculation in order to maintain the desired power once the treatment arm differences start to appear. In this article, we explore the impact of delayed effects in group sequential and adaptive group sequential designs and make an empirical evaluation in terms of power and type‐I error rate of the of the weighted log‐rank test in a simulated scenario with fixed values of the Fleming and Harrington class of weights. We also give some practical recommendations regarding which methodology should be used in the presence of delayed effects depending on certain characteristics of the trial.     

Ethical Numbers: Ethics Training in U.S. Graduate Statistics Programs, 2013–2014

As important members of research teams, statisticians bear an ethical responsibility to analyze, interpret, and report data honestly and objectively. One way of reinforcing ethical responsibilities is through required courses covering a variety of ethics-related topics at the graduate level. We assessed ethics requirements for graduate-level statistics training programs in the United States for the 2013–2014 academic year using the websites of 88 universities, examining 103 biostatistics programs, and 136 statistics degree programs. We categorized programs’ ethics training requirements as required or not required. Thirty-one (35.1%) universities required an ethics course for at least some degree students. Sixty-two (25.5%) degree programs required an ethics course for at least some students. The majority (77.4%) of required courses were worth 0 or 1 credit. Of the 177 programs without an ethics requirement, 19 (10.7%) listed an ethics elective. Although a single ethics course is insufficient for instilling an ethical approach to science, degree programs that model expectations through coursework point to the value of ethics in science. More training programs should prepare statisticians to consider the ethical dimensions of their work through required coursework. Supplementary materials for this article are available online.     

Sex Related Factors in the Perception of Threatening Facial Expressions

This study replicated and extended previously reported sex differences involving both viewer and target in the recognition of threatening facial expressions. Based on the assumption that the evolved cognitive mechanisms mediating anger recognition would have been designed by natural selection to operate quickly in the interests of survival, brief tachistoscopic presentation of stimulus photographs was used. Additionally, in contrast to prior published studies, the statistical methods of signal detection research were used to control for the confounding effects of non-random guessing. The main hypothesis, that anger posed by males would be more accurately perceived than anger posed by females, was supported. A secondary hypothesis, that female-posed anger would be more accurately perceived by women than by men, received partial support. Testosterone levels, measured inferentially in terms of diurnal cycles, failed to show the hypothesized positive relationship to accuracy of anger perception.     

Wage and Non-Wage Compensation Among Young Alcoholic and Heavy Drinking Women: A Preliminary Analysis

The association between drinking and selected job characteristics among women aged 24 to 31 is examined. Using the 1989 NLSY, women are classified as alcohol abusers or dependent based on DSM-III-R criteria or as heavy drinkers based on reported frequency of six or more drinks. Heavy drinking is negatively associated with wage and non-wage compensation. These effects diminish when human capital measures are controlled. Current alcoholism and current and past heavy drinking are strongly negatively associated with years of schooling. The association between alcoholism and job compensation and characteristics is not as strong as that seen for heavy drinking. It is not known if this is a consequence of errors in identifying alcoholic women in population-based surveys.     

A NOTE ON EVANESCENT PROCESSES

This note examines the connection between μ-invariant measures for the transition function of a continuous-time Markov chain and those of its q-matrix, Q. The major result establishes a necessary and aufficient condition for a convergent μ-invariant measure for Q to be μ-inhant for the minimal transition function, P, under the assumption that P is honest. This corrects Theorem 6 of Vere-Jones (1969) and the first part of Corollary 1 of Pollett (1986), both of which assert that the above conclusion holds in the absence of this condition. The error was pointed out by E.A. van Doom (1991) and the counterexample which be presented provides the basis for the present arguments. In determining where the error occurred in the original proof, we are able to identify a simple sufficient condition for μ-invariance.     

Why sociology does not need to be saved: Analytic reflections on public sociologies

After reviewing the debate about public sociologies in the American Sociological Association over the past few years, we offer a response to calls for “saving sociology” from the Burawoy approach as well as an analytic critique of the former ASA president's “For Public Sociology” address. While being sympathetic to the basic idea of public sociologies, we argue that the “reflexive” and “critical” categories of sociology, as Burawoy has conceptualized them, are too ambiguous and value-laden to allow for empirical investigation of the different major orientations of sociological research and the ways the discipline can address non-academic audiences. Debates about the future of sociology should be undertaken with empirical evidence, and we need a theoretical approach that can allow us to compare both disciplines and nations as well as taking into account the institutional context of the universities in which we operate. Research into the conditions under which professional, critical, policy, and public sociologies could work together for the larger disciplinary and societal good is called for instead of overheated rhetoric both for and against public sociologies.     

Don't mention Stonehenge!

It rises massive and magnificent above Salisbury Plain. The extraordinary monoliths of Stonehenge leave us as impressed today as ever—and as baffled. Archaeologists argue about how it was made. Can statisticians tell the answer? Chris Jones thinks they can be of considerable assistance.