A Simple Data Transformation for Estimating Benchmark Doses in Developmental Toxicity Experiments

Developmental anomalies induced by toxic chemicals may be identified using laboratory experiments with rats, mice or rabbits. Multinomial responses of fetuses from the same mother are often positively correlated, resulting in overdispersion relative to multinomial variation. In this article, a simple data transformation based on the concept of generalized design effects due to Rao-Scott is proposed for dose-response modeling of developmental toxicity. After scaling the original multinomial data using the average design effect, standard methods for analysis of uncorrected multinomial data can be applied. Benchmark doses derived using this approach are comparable to those obtained using generalized estimating equations with an extended Dirichlet-trinomial covariance function to describe the dispersion of the original data. This empirical agreement, coupled with a large sample theoretical justification of the Rao-Scott transformation, confirms the applicability of the statistical methods proposed in this article for developmental toxicity risk assessment.     

Modeling Fetal Death and Malformation in Developmental Toxicity Studies

We review approaches to dose-response modeling and risk assessment for binary data from developmental toxicity studies. In particular, we focus on jointly modeling fetal death and malformation and use a continuation ratio formulation of the multinomial distribution to provide a model for risk. Generalized estimating equations are used to account for clustering of animals within litters. The fitted model is then used to calculate doses corresponding to a specified level of excess risk. Two methods of arriving at a lower confidence limit or Benchmark dose are illustrated and compared. We also discuss models based on single binary end points and compare our approach to a binary analysis of whether or not the animal was 'affected' (either dead or malformed). The models are illustrated using data from four developmental toxicity studies in EG, DEHP, TGDM, and DYME conducted through the National Toxicology Program.     

Applications of Multinomial Dose-Response Models in Developmental Toxicity Risk Assessment

Reproductive and developmental anomalies induced by toxic chemicals may be identified using laboratory experiments with small mammalian species such as rats, mice, and rabbits. In this paper, dose-response models for correlated multinomial data arising in studies of developmental toxicity are discussed. These models provide a joint characterization of dose-response relationships for both embryolethality and teratogenicity. Generalized estimating equations are used for model fitting, incorporating overdispersion relative to the multinomial variation due to correlation among littermates. The fitted dose-response models are used to estimate benchmark doses in a series of experiments conducted by the U.S. National Toxicology Program. Joint analysis of prenatal death and fetal malformation using an extended Dirichlet-trinomial covariance function to characterize overdispersion appears to have statistical and computational advantages over separate analysis of these two end points. Benchmark doses based on overall toxicity are below the minimum of those for prenatal death and fetal malformation and may, thus, be preferred for risk assessment purposes.     

Regression Models and Risk Estimation for Mixed Discrete and Continuous Outcomes in Developmental Toxicology

Multivariate dose-response models have recently been proposed for developmental toxicity data to simultaneously model malformation incidence (a binary outcome), and reductions in fetal weight (a continuous outcome). In this and other applications, the binary outcome often represents a dichotomization of another outcome or a composite of outcomes, which facilitates analysis. For example, in Segment II developmental toxicology studies, multiple malformation types (i.e., external, visceral, skeletal) are evaluated on each fetus; malformation status may also be ordinally measured (e.g., normal, signs of variation, full malformation). A model is proposed is for fetal weight and multiple malformation variables measured on an ordinal scale, where the correlations between the outcomes and between the offspring within a litter are taken into account. Fully specifying the joint distribution of outcomes within a litter is avoided by specifying only the distribution of the multivariate outcome for each fetus and using generalized estimating equation methodology to account for correlations due to litter clustering. The correlations between the outcomes are required to characterize joint risk to the fetus, and are therefore a focus of inference. Dose-response models and their application to quantitative risk assessment are illustrated using data from a recent developmental toxicology experiment of ethylene oxide in mice.     

A Comparison of Methods for Estimating the Benchmark Dose Based on Overdispersed Data from Developmental Toxicity Studies

Developmental anomalies resulting from prenatal toxicity can be manifested in terms of both malformations among surviving offspring and prenatal death. Although these two endpoints have traditionally been analyzed separately in the assessment of risk, multivariate methods of risk characterization have recently been proposed. We examined this and other issues in developmental toxicity risk assessment by evaluating the accuracy and precision of estimates of the effective dose ( ED ₀₅) and the benchmark dose ( BMD ₀₅) using computer simulation. Our results indicated that different variance structures (Dirichlet-trinomial and generalized linear model) used to characterize overdispersion yielded comparable results when fitting joint dose response models based on generalized estimating equations. (The choice of variance structure in separate modeling was also not critical.) However, using the Rao-Scott transformation to eliminate overdispersion tended to produce estimates of the ED ₀₅ with reduced bias and mean squared error. Because joint modeling ensures that the ED ₀₅ for overall toxicity (based on both malformations and prenatal death) is always less than the ED ₀₅ for either malformations or prenatal death, joint modeling is preferred to separate modeling for risk assessment purposes.     

Implications of Developmental Toxicity Study Design for Quantitative Risk Assessment

Standard experimental designs for conducting developmental toxicity studies typically include three- or four-dose levels in addition to a control group. Some researchers have suggested that designs with more exposure groups would improve dose-response characterization and risk estimation. Such proposals have not, however, been supported by the results of simulation studies, which instead back the use of fewer dose levels. This discrepancy is partly due to using a known dose–response pattern to generate data, making model choice obvious. While the carcinogenicity literature has explored implications of different study designs, little attention has been given to the role of design in developmental toxicity risk assessment (or noncancer toxicology in general). In this research, we explore the implications of various experimental designs for developmental toxicity by resampling data from a large study of 2,4,5-trichlorophenoxyacetic acid in mice. We compare the properties of benchmark dose (BMD) estimation for different design strategies by randomly selecting animals within particular dose groups from the entire 2,4,5-T database of over 77,000 birth outcomes to create smaller "pseudo-studies" that are representative of standard bioassay sample sizes. Our results show that experimental designs which include more dose levels have advantages in terms of risk characterization and estimation.     

Optimal Designs for Estimating the Effective Dose in Developmental Toxicity Experiments

Recent advances in risk assessment have led to the development of joint dose-response models to describe prenatal death and fetal malformation rates in developmental toxicity experiments. These models can be used to estimate the effective dose corresponding to a 5% excess risk for both these toxicological endpoints, as well as for overall toxicity. In this article, we develop optimal experimental designs for the estimation of the effective dose for developmental toxicity using joint Weibull dose-response models for prenatal death and fetal malformation. Based on an extended series of developmental studies, near-optimal designs for prenatal death, malformation, and overall toxicity were found to involve three dose groups: an unexposed control group, a high dose equal to the maximum tolerated dose, and a low dose above or comparable to the effective dose. The effect on the optimal designs of changing the number of implants and the degree of intra-litter correlation is also investigated. Although the optimal design has only three dose groups in most cases, practical considerations involving model lack of fit and estimation of the shape of the dose-response curve suggest that, in practice, suboptimal designs with more than three doses will often be preferred.     

A Parametric Model for Detecting Hormetic Effects in Developmental Toxicity Studies

Hormetic effects have been observed at low exposure levels based on the dose-response pattern of data from developmental toxicity studies. This indicates that there might actually be a reduced risk of exhibiting toxic effects at low exposure levels. Hormesis implies the existence of a threshold dose level and there are dose-response models that include parameters that account for the threshold. We propose a function that introduces a parameter to account for hormesis. This function is a subset of the set of all functions that could represent a hormetic dose-response relationship at low exposure levels to toxic agents. We characterize the overall dose-response relationship with a piecewise function that consists of a hormetic u-shape curve at low dose levels and a logistic curve at high dose levels. We apply our model to a data set from an experiment conducted at the National Toxicology Program (NTP). We also use the beta-binomial distribution to model the litter response data. It can be seen by observing the structure of these data that current experimental designs for developmental studies employ a limited number of dose groups. These designs may not be satisfactory when the goal is to illustrate the existence of hormesis. In particular, increasing the number of low-level doses improves the power for detecting hormetic effects. Therefore, we also provide the results of simulations that were done to characterize the power of current designs in detecting hormesis and to demonstrate how this power can be improved upon by altering these designs with the addition of only a few low exposure levels.     

Evaluation of Developmental Toxicity Data: A Discussion of Some Pertinent Factors and a Proposal

There is currently no well-accepted standard method for evaluation of developmental toxicity data. This paper presents one approach to the evaluation of developmental toxicity data. We initially identify some pertinent factors that influence the interpretation of animal data and summarize the literature pertaining to these factors. Such factors include the quality and quantity of data and the relationship between maternal and developmental toxicity. We proceed with a discussion of quantitative assessment of data and propose schemes for qualitative and quantitative developmental hazard assessments.     

Re-evaluation of the Reference Dose for Methylmercury and Assessment of Current Exposure Levels

Methylmercury (Me-Hg) is widely distributed through freshwater and saltwater food chains and human consumption of fish and shellfish has lead to widespread exposure. Both the U.S. EPA Reference Dose (0.3 μg/kg/day) and the FAO/WHO Permissible Tolerable Weekly Intake (3.3 μg/kg/week) are currently based on the prevention of paraesthesia in adult and older children. However, Me-Hg exposure in utero is known to result in a range of developmental neurologic effects including clinical CNS symptoms and delayed onset of walking. Based on a critical review of developmental toxicity data from human and animal studies, it is concluded that current guidelines for the prevention of paraesthesia are not adequate to address developmental effects. A dose of 0.07 μ/kg/day is suggested as the best estimate of a potential reference dose for developmental effects. Data on nationwide fish consumption rates and Me-Hg levels in fish/seafood weighted by proportion of the catch intended for human consumption are analyzed in a Monte Carlo simulation to derive a probability distribution of background Me-Hg exposure. While various uncertainties in the toxicologic and exposure data limit the precision with which health risk can be estimated, this analysis suggests that at current levels of Me-Hg exposure, a significant fraction of women of childbearing age have exposures above this suggested reference dose.     

Inference Based on Conditional Moment Inequalities

In this paper, we propose an instrumental variable approach to constructing confidence sets (CS's) for the true parameter in models defined by conditional moment inequalities/equalities. We show that by properly choosing instrument functions, one can transform conditional moment inequalities/equalities into unconditional ones without losing identification power. Based on the unconditional moment inequalities/equalities, we construct CS's by inverting Cramér–von Mises‐type or Kolmogorov–Smirnov‐type tests. Critical values are obtained using generalized moment selection (GMS) procedures. We show that the proposed CS's have correct uniform asymptotic coverage probabilities. New methods are required to establish these results because an infinite‐dimensional nuisance parameter affects the asymptotic distributions. We show that the tests considered are consistent against all fixed alternatives and typically have power against n^−1/2‐local alternatives to some, but not all, sequences of distributions in the null hypothesis. Monte Carlo simulations for five different models show that the methods perform well in finite samples.     

Summary of the Workshop on Issues in Risk Assessment: Quantitative Methods for Developmental Toxicology

This report summarizes the proceedings of a conference on quantitative methods for assessing the risks of developmental toxicants. The conference was planned by a subcommittee of the National Research Council's Committee on Risk Assessment Methodology ⁴ in conjunction with staff from several federal agencies, including the U.S. Environmental Protection Agency, U.S. Food and Drug Administration, U.S. Consumer Products Safety Commission, and Health and Welfare Canada. Issues discussed at the workshop included computerized techniques for hazard identification, use of human and animal data for defining risks in a clinical setting, relationships between end points in developmental toxicity testing, reference dose calculations for developmental toxicology, analysis of quantitative dose-response data, mechanisms of developmental toxicity, physiologically based pharmacokinetic models, and structure-activity relationships. Although a formal consensus was not sought, many participants favored the evolution of quantitative techniques for developmental toxicology risk assessment, including the replacement of lowest observed adverse effect levels (LOAELs) and no observed adverse effect levels (NOAELs) with the benchmark dose methodology.     

Design of Developmental Toxicity Studies for Assessing Joint Effects of Dose and Duration

In the assessment of developmental and reproductive effects, the timing and duration of exposures to chemical compounds or other environmental contaminants are of particular interest, as the gestational cycle is known to have periods of increased sensitivity. The goal of this research is to identify optimal experimental designs for conducting developmental toxicity studies when the effects of both exposure level and duration of exposure are of interest. The elements of the study design considered in this evaluation are the allocation of animals to dose-duration exposure groups and the determination of the most efficient intermediate exposure levels. The optimality of various designs is assessed via the accuracy of the estimated excess risk as well as testing criteria. Simulation studies are conducted to compare these criteria and determine optimal design strategies under various underlying dose-response patterns. Asymptotic results are also derived to lend support to the simulation studies.     

Estimation and Inference With Weak,Semi‐Strong,and Strong Identification

This paper analyzes the properties of standard estimators, tests, and confidence sets (CS's) for parameters that are unidentified or weakly identified in some parts of the parameter space. The paper also introduces methods to make the tests and CS's robust to such identification problems. The results apply to a class of extremum estimators and corresponding tests and CS's that are based on criterion functions that satisfy certain asymptotic stochastic quadratic expansions and that depend on the parameter that determines the strength of identification. This covers a class of models estimated using maximum likelihood (ML), least squares (LS), quantile, generalized method of moments, generalized empirical likelihood, minimum distance, and semi‐parametric estimators. The consistency/lack‐of‐consistency and asymptotic distributions of the estimators are established under a full range of drifting sequences of true distributions. The asymptotic sizes (in a uniform sense) of standard and identification‐robust tests and CS's are established. The results are applied to the ARMA(1, 1) time series model estimated by ML and to the nonlinear regression model estimated by LS. In companion papers, the results are applied to a number of other models.     

Issues in Qualitative and Quantitative Risk Analysis for Developmental Toxicology1

The qualitative and quantitative evaluation of risk in developmental toxicology has been discussed in several recent publications.(^1–3) A number of issues still are to be resolved in this area. The qualitative evaluation and interpretation of end points in developmental toxicology depends on an understanding of the biological events leading to the end points observed, the relationships among end points, and their relationship to dose and to maternal toxicity. The interpretation of these end points is also affected by the statistical power of the experiments used for detecting the various end points observed. The quantitative risk assessment attempts to estimate human risk for developmental toxicity as a function of dose. The current approach is to apply safety (uncertainty) factors to die no observed effect level (NOEL). An alternative presented and discussed here is to model the experimental data and apply a safety factor to an estimated risk level to achieve an “acceptable” level of risk. In cases where the dose-response curves upward, this approach provides a conservative estimate of risk. This procedure does not preclude the existence of a threshold dose. More research is needed to develop appropriate dose-response models that can provide better estimates for low-dose extrapolation of developmental effects.     

Assessing Overall Risk in Reproductive Experiments

Toxicologists are often interested in assessing the joint effect of an exposure on multiple reproductive endpoints, including early loss, fetal death, and malformation. Exposures that occur prior to mating or extremely early in development can adversely affect the number of implantation sites or fetuses that form within each dam and may even prevent pregnancy. A simple approach for assessing overall adverse effects in such studies is to consider fetuses or implants that fail to develop due to exposure as missing data. The missing data can be imputed, and standard methods for the analysis of quantal response data can then be used for quantitative risk assessment or testing. In this article, a new bias-corrected imputation procedure is proposed and evaluated. The procedure is straightforward to implement in standard statistical packages and has excellent operating characteristics when used in combination with a marginal model fit with generalized estimating equations. The methods are applied to data from a reproductive toxicity study of Nitrofurazone conducted by the National Toxicology Program.     

A Comparison of Three Methods for Calculating Confidence Intervals for the Benchmark Dose

Various methods exist to calculate confidence intervals for the benchmark dose in risk analysis. This study compares the performance of three such methods in fitting nonlinear dose-response models: the delta method, the likelihood-ratio method, and the bootstrap method. A data set from a developmental toxicity test with continuous, ordinal, and quantal dose-response data is used for the comparison of these methods. Nonlinear dose-response models, with various shapes, were fitted to these data. The results indicate that a few thousand runs are generally needed to get stable confidence limits when using the bootstrap method. Further, the bootstrap and the likelihood-ratio method were found to give fairly similar results. The delta method, however, resulted in some cases in different (usually narrower) intervals, and appears unreliable for nonlinear dose-response models. Since the bootstrap method is more time consuming than the likelihood-ratio method, the latter is more attractive for routine dose-response analysis. In the context of a probabilistic risk assessment the bootstrap method has the advantage that it directly links to Monte Carlo analysis.     

Improving the Predictive Accuracy of Hurricane Power Outage Forecasts Using Generalized Additive Models

Electric power is a critical infrastructure service after hurricanes, and rapid restoration of electric power is important in order to minimize losses in the impacted areas. However, rapid restoration of electric power after a hurricane depends on obtaining the necessary resources, primarily repair crews and materials, before the hurricane makes landfall and then appropriately deploying these resources as soon as possible after the hurricane. This, in turn, depends on having sound estimates of both the overall severity of the storm and the relative risk of power outages in different areas. Past studies have developed statistical, regression-based approaches for estimating the number of power outages in advance of an approaching hurricane. However, these approaches have either not been applicable for future events or have had lower predictive accuracy than desired. This article shows that a different type of regression model, a generalized additive model (GAM), can outperform the types of models used previously. This is done by developing and validating a GAM based on power outage data during past hurricanes in the Gulf Coast region and comparing the results from this model to the previously used generalized linear models.     

Dose‐Response Modeling with Summary Data from Developmental Toxicity Studies

Dose‐response analysis of binary developmental data (e.g., implant loss, fetal abnormalities) is best done using individual fetus data (identified to litter) or litter‐specific statistics such as number of offspring per litter and proportion abnormal. However, such data are not often available to risk assessors. Scientific articles usually present only dose‐group summaries for the number or average proportion abnormal and the total number of fetuses. Without litter‐specific data, it is not possible to estimate variances correctly (often characterized as a problem of overdispersion, intralitter correlation, or “litter effect”). However, it is possible to use group summary data when the design effect has been estimated for each dose group. Previous studies have demonstrated useful dose‐response and trend test analyses based on design effect estimates using litter‐specific data from the same study. This simplifies the analysis but does not help when litter‐specific data are unavailable. In the present study, we show that summary data on fetal malformations can be adjusted satisfactorily using estimates of the design effect based on historical data. When adjusted data are then analyzed with models designed for binomial responses, the resulting benchmark doses are similar to those obtained from analyzing litter‐level data with nested dichotomous models.