Optimal Experimental Design Strategies for Detecting Hormesis

Hormesis is a widely observed phenomenon in many branches of life sciences, ranging from toxicology studies to agronomy, with obvious public health and risk assessment implications. We address optimal experimental design strategies for determining the presence of hormesis in a controlled environment using the recently proposed Hunt‐Bowman model. We propose alternative models that have an implicit hormetic threshold, discuss their advantages over current models, and construct and study properties of optimal designs for (i) estimating model parameters, (ii) estimating the threshold dose, and (iii) testing for the presence of hormesis. We also determine maximin optimal designs that maximize the minimum of the design efficiencies when we have multiple design criteria or there is model uncertainty where we have a few plausible models of interest. We apply these optimal design strategies to a teratology study and show that the proposed designs outperform the implemented design by a wide margin for many situations.     

Issues in Qualitative and Quantitative Risk Analysis for Developmental Toxicology1

The qualitative and quantitative evaluation of risk in developmental toxicology has been discussed in several recent publications.(^1–3) A number of issues still are to be resolved in this area. The qualitative evaluation and interpretation of end points in developmental toxicology depends on an understanding of the biological events leading to the end points observed, the relationships among end points, and their relationship to dose and to maternal toxicity. The interpretation of these end points is also affected by the statistical power of the experiments used for detecting the various end points observed. The quantitative risk assessment attempts to estimate human risk for developmental toxicity as a function of dose. The current approach is to apply safety (uncertainty) factors to die no observed effect level (NOEL). An alternative presented and discussed here is to model the experimental data and apply a safety factor to an estimated risk level to achieve an “acceptable” level of risk. In cases where the dose-response curves upward, this approach provides a conservative estimate of risk. This procedure does not preclude the existence of a threshold dose. More research is needed to develop appropriate dose-response models that can provide better estimates for low-dose extrapolation of developmental effects.     

Implications of Developmental Toxicity Study Design for Quantitative Risk Assessment

Standard experimental designs for conducting developmental toxicity studies typically include three- or four-dose levels in addition to a control group. Some researchers have suggested that designs with more exposure groups would improve dose-response characterization and risk estimation. Such proposals have not, however, been supported by the results of simulation studies, which instead back the use of fewer dose levels. This discrepancy is partly due to using a known dose–response pattern to generate data, making model choice obvious. While the carcinogenicity literature has explored implications of different study designs, little attention has been given to the role of design in developmental toxicity risk assessment (or noncancer toxicology in general). In this research, we explore the implications of various experimental designs for developmental toxicity by resampling data from a large study of 2,4,5-trichlorophenoxyacetic acid in mice. We compare the properties of benchmark dose (BMD) estimation for different design strategies by randomly selecting animals within particular dose groups from the entire 2,4,5-T database of over 77,000 birth outcomes to create smaller "pseudo-studies" that are representative of standard bioassay sample sizes. Our results show that experimental designs which include more dose levels have advantages in terms of risk characterization and estimation.     

Hormesis Without Cell Killing

Stochastic two-stage clonal expansion (TSCE) models of carcinogenesis offer the following clear theoretical explanation for U-shaped cancer dose-response relations. Low doses that kill initiated (premalignant) cells thereby create a protective effect. At higher doses, this effect is overwhelmed by an increase in the net number of initiated cells. The sum of these two effects, from cell killing and cell proliferation, gives a U-shaped or J-shaped dose-response relation. This article shows that exposures that do not kill, repair, or decrease cell populations, but that only hasten transitions that lead to cancer, can also generate U-shaped and J-shaped dose-response relations in a competing-risk (modified TSCE) framework where exposures disproportionately hasten transitions into carcinogenic pathways with relatively long times to tumor. Quantitative modeling of the competing effects of more transitions toward carcinogenesis (risk increasing) and a higher proportion of transitions into the slower pathway (risk reducing) shows that a J-shaped dose-response relation can occur even if exposure increases the number of initiated cells at every positive dose level. This suggests a possible new explanation for hormetic dose-response relations in response to carcinogenic exposures that do not have protective (cell-killing) effects. In addition, the examples presented emphasize the role of time in hormesis: exposures that monotonically increase risks at younger ages may nonetheless produce a U-shaped or J-shaped dose-response relation for lifetime risk of cancer.     

A Biologically-Based Dose—Response Model for Developmental Toxicology

The methods currently used to evaluate the risk of developmental defects in humans from exposure to potential toxic agents do not reflect biological processes in extrapolating estimated risks to low doses and from test species to humans. We develop a mathematical model to describe aspects of the dynamic process of organogenesis, based on branching process models of cell kinetics. The biological information that can be incorporated into the model includes timing and rates of dynamic cell processes such as differentiation, migration, growth, and replication. The dose-response models produced can explain patterns of malformation rates as a function of both dose and time of exposure, resulting in improvements in risk assessment and understanding of the underlying mechanistic processes. To illustrate the use of the model, we apply it to the prediction of the effects of methylmercury on brain development in rats.     

Estimation of a Benchmark Dose in the Presence or Absence of Hormesis Using Posterior Averaging

U.S. Environment Protection Agency benchmark doses for dichotomous cancer responses are often estimated using a multistage model based on a monotonic dose‐response assumption. To account for model uncertainty in the estimation process, several model averaging methods have been proposed for risk assessment. In this article, we extend the usual parameter space in the multistage model for monotonicity to allow for the possibility of a hormetic dose‐response relationship. Bayesian model averaging is used to estimate the benchmark dose and to provide posterior probabilities for monotonicity versus hormesis. Simulation studies show that the newly proposed method provides robust point and interval estimation of a benchmark dose in the presence or absence of hormesis. We also apply the method to two data sets on carcinogenic response of rats to 2,3,7,8‐tetrachlorodibenzo‐p‐dioxin.     

Optimal Designs for Estimating the Effective Dose in Developmental Toxicity Experiments

Recent advances in risk assessment have led to the development of joint dose-response models to describe prenatal death and fetal malformation rates in developmental toxicity experiments. These models can be used to estimate the effective dose corresponding to a 5% excess risk for both these toxicological endpoints, as well as for overall toxicity. In this article, we develop optimal experimental designs for the estimation of the effective dose for developmental toxicity using joint Weibull dose-response models for prenatal death and fetal malformation. Based on an extended series of developmental studies, near-optimal designs for prenatal death, malformation, and overall toxicity were found to involve three dose groups: an unexposed control group, a high dose equal to the maximum tolerated dose, and a low dose above or comparable to the effective dose. The effect on the optimal designs of changing the number of implants and the degree of intra-litter correlation is also investigated. Although the optimal design has only three dose groups in most cases, practical considerations involving model lack of fit and estimation of the shape of the dose-response curve suggest that, in practice, suboptimal designs with more than three doses will often be preferred.     

A Malformation Incidence Dose-Response Model Incorporating Fetal Weight and/or Litter Size as Covariates

A dose-response model is often fit to bioassay data to provide a mathematical relationship between the incidence of a developmental malformation and dose of a toxicant. To utilize the interrelations among the fetal weight, incidence of malformation and number of the live fetuses, a conditional Gaussian regression chain model is proposed to model the dose-response function for developmental malformation incidence using the litter size and/or the fetal weight as covariates. The litter size is modeled as a function of dose, the fetal weight is modeled as a function of dose conditional on the litter size, and the malformation incidence is modeled as a function of dose conditional on both the litter size and the fetal weight, which itself is also conditional on the litter size. Data from a developmental experiment conducted at the National Center for Toxicological Research to investigate the growth stunting and increased incidence of cleft palate induced by Dexamethasone (DEX) exposure in rats was used as an illustration.     

Experimental Design of Bioassays for Screening and Low Dose Extrapolation

Relatively high doses of chemicals generally are employed in animal bioassays to detect potential carcinogens with relatively small numbers of animals. The problem investigated here is the development of experimental designs which are effective for high to low dose extrapolation for tumor incidence as well as for screening (detecting) carcinogens. Several experimental designs are compared over a wide range of different dose response curves. Linear extrapolation is used below the experimental data range to establish an upper bound on carcinogenic risk at low doses. The goal is to find experimental designs which minimize the upper bound on low dose risk estimates (i.e., maximize the allowable dose for a given level of risk). The maximum tolerated dose (MTD) is employed for screening purposes. Among the designs investigated, experiments with doses at the MTD, 1/2 MTD, 1/4 MTD, and controls generally provide relatively good data for low dose extrapolation with relatively good power for detecting carcinogens. For this design, equal numbers of animals per dose level perform as well as unequal allocations.     

Bayesian Quantile Impairment Threshold Benchmark Dose Estimation for Continuous Endpoints

Quantitative risk assessment often begins with an estimate of the exposure or dose associated with a particular risk level from which exposure levels posing low risk to populations can be extrapolated. For continuous exposures, this value, the benchmark dose, is often defined by a specified increase (or decrease) from the median or mean response at no exposure. This method of calculating the benchmark dose does not take into account the response distribution and, consequently, cannot be interpreted based upon probability statements of the target population. We investigate quantile regression as an alternative to the use of the median or mean regression. By defining the dose–response quantile relationship and an impairment threshold, we specify a benchmark dose as the dose associated with a specified probability that the population will have a response equal to or more extreme than the specified impairment threshold. In addition, in an effort to minimize model uncertainty, we use Bayesian monotonic semiparametric regression to define the exposure–response quantile relationship, which gives the model flexibility to estimate the quantal dose–response function. We describe this methodology and apply it to both epidemiology and toxicology data.     

Applications of Multinomial Dose-Response Models in Developmental Toxicity Risk Assessment

Reproductive and developmental anomalies induced by toxic chemicals may be identified using laboratory experiments with small mammalian species such as rats, mice, and rabbits. In this paper, dose-response models for correlated multinomial data arising in studies of developmental toxicity are discussed. These models provide a joint characterization of dose-response relationships for both embryolethality and teratogenicity. Generalized estimating equations are used for model fitting, incorporating overdispersion relative to the multinomial variation due to correlation among littermates. The fitted dose-response models are used to estimate benchmark doses in a series of experiments conducted by the U.S. National Toxicology Program. Joint analysis of prenatal death and fetal malformation using an extended Dirichlet-trinomial covariance function to characterize overdispersion appears to have statistical and computational advantages over separate analysis of these two end points. Benchmark doses based on overall toxicity are below the minimum of those for prenatal death and fetal malformation and may, thus, be preferred for risk assessment purposes.     

Design of Developmental Toxicity Studies for Assessing Joint Effects of Dose and Duration

In the assessment of developmental and reproductive effects, the timing and duration of exposures to chemical compounds or other environmental contaminants are of particular interest, as the gestational cycle is known to have periods of increased sensitivity. The goal of this research is to identify optimal experimental designs for conducting developmental toxicity studies when the effects of both exposure level and duration of exposure are of interest. The elements of the study design considered in this evaluation are the allocation of animals to dose-duration exposure groups and the determination of the most efficient intermediate exposure levels. The optimality of various designs is assessed via the accuracy of the estimated excess risk as well as testing criteria. Simulation studies are conducted to compare these criteria and determine optimal design strategies under various underlying dose-response patterns. Asymptotic results are also derived to lend support to the simulation studies.     

Re-evaluation of the Reference Dose for Methylmercury and Assessment of Current Exposure Levels

Methylmercury (Me-Hg) is widely distributed through freshwater and saltwater food chains and human consumption of fish and shellfish has lead to widespread exposure. Both the U.S. EPA Reference Dose (0.3 μg/kg/day) and the FAO/WHO Permissible Tolerable Weekly Intake (3.3 μg/kg/week) are currently based on the prevention of paraesthesia in adult and older children. However, Me-Hg exposure in utero is known to result in a range of developmental neurologic effects including clinical CNS symptoms and delayed onset of walking. Based on a critical review of developmental toxicity data from human and animal studies, it is concluded that current guidelines for the prevention of paraesthesia are not adequate to address developmental effects. A dose of 0.07 μ/kg/day is suggested as the best estimate of a potential reference dose for developmental effects. Data on nationwide fish consumption rates and Me-Hg levels in fish/seafood weighted by proportion of the catch intended for human consumption are analyzed in a Monte Carlo simulation to derive a probability distribution of background Me-Hg exposure. While various uncertainties in the toxicologic and exposure data limit the precision with which health risk can be estimated, this analysis suggests that at current levels of Me-Hg exposure, a significant fraction of women of childbearing age have exposures above this suggested reference dose.     

Risk/Benefit Assessments of Human Diseases: Optimum Dose for Intervention

A simple procedure is proposed in order to quantify the tradeoff between a loss suffered from an illness due to exposure to a microbial pathogen and a loss due to a toxic effect, perhaps a different illness, induced by a disinfectant employed to reduce the microbial exposure. Estimates of these two types of risk as a function of disinfectant dose and their associated relative losses provide information for the estimation of the optimum dose of disinfectant that minimizes the total expected loss. The estimates of the optimum dose and expected relative total loss were similar regardless of whether the beta-Poisson, log-logistic, or extreme value function was used to model the risk of illness due to exposure to a microbial pathogen. This is because the optimum dose of the disinfectant and resultant expected minimum loss depend upon the estimated slope (first derivative) of the models at low levels of risk, which appear to be similar for these three models at low levels of risk. Similarly, the choice among these three models does not appear critical for estimating the slope at low levels of risk for the toxic effect induced by the use of a disinfectant. For the proposed procedure to estimate the optimum disinfectant dose, it is not necessary to have absolute values for the losses due to microbial-induced or disinfectant-induced illness, but only relative losses are required. All aspects of the problem are amenable to sensitivity analyses. The issue of risk/benefit tradeoffs, more appropriately called risk/risk tradeoffs, does not appear to be an insurmountable problem.     

Quantitative Risk Assessment for Developmental Neurotoxic Effects

Developmental neurotoxicity concerns the adverse health effects of exogenous agents acting on neurodevelopment. Because human brain development is a delicate process involving many cellular events, the developing fetus is rather susceptible to compounds that can alter the structure and function of the brain. Today, there is clear evidence that early exposure to many neurotoxicants can severely damage the developing nervous system. Although in recent years, there has been much attention given to model development and risk assessment procedures for developmental toxicants, the area of developmental neurotoxicity has been largely ignored. Here, we consider the problem of risk estimation for developmental neurotoxicants from animal bioassay data. Since most responses from developmental neurotoxicity experiments are nonquantal in nature, an adverse health effect will be defined as a response that occurs with very small probability in unexposed animals. Using a two-stage hierarchical normal dose-response model, upper confidence limits on the excess risk due to a given level of added exposure are derived. Equivalently, the model is used to obtain lower confidence limits on dose for a small negligible level of risk. Our method is based on the asymptotic distribution of the likelihood ratio statistic (cf. Crump, 1995). An example is used to provide further illustration.     

Bootstrap Estimation of Benchmark Doses and Confidence Limits with Clustered Quantal Data

The benchmark dose (BMD) is an exposure level that would induce a small risk increase (BMR level) above the background. The BMD approach to deriving a reference dose for risk assessment of noncancer effects is advantageous in that the estimate of BMD is not restricted to experimental doses and utilizes most available dose-response information. To quantify statistical uncertainty of a BMD estimate, we often calculate and report its lower confidence limit (i.e., BMDL), and may even consider it as a more conservative alternative to BMD itself. Computation of BMDL may involve normal confidence limits to BMD in conjunction with the delta method. Therefore, factors, such as small sample size and nonlinearity in model parameters, can affect the performance of the delta method BMDL, and alternative methods are useful. In this article, we propose a bootstrap method to estimate BMDL utilizing a scheme that consists of a resampling of residuals after model fitting and a one-step formula for parameter estimation. We illustrate the method with clustered binary data from developmental toxicity experiments. Our analysis shows that with moderately elevated dose-response data, the distribution of BMD estimator tends to be left-skewed and bootstrap BMDL s are smaller than the delta method BMDL s on average, hence quantifying risk more conservatively. Statistically, the bootstrap BMDL quantifies the uncertainty of the true BMD more honestly than the delta method BMDL as its coverage probability is closer to the nominal level than that of delta method BMDL. We find that BMD and BMDL estimates are generally insensitive to model choices provided that the models fit the data comparably well near the region of BMD. Our analysis also suggests that, in the presence of a significant and moderately strong dose-response relationship, the developmental toxicity experiments under the standard protocol support dose-response assessment at 5% BMR for BMD and 95% confidence level for BMDL.     

Benchmark Dose Risk Assessment for Formaldehyde Using Airflow Modeling and a Single-Compartment, DNA-Protein Cross-Link Dosimetry Model to Estimate Human Equivalent Doses

Formaldehyde induced squamous-cell carcinomas in the nasal passages of F344 rats in two inhalation bioassays at exposure levels of 6 ppm and above. Increases in rates of cell proliferation were measured by T. M. Monticello and colleagues at exposure levels of 0.7 ppm and above in the same tissues from which tumors arose. A risk assessment for formaldehyde was conducted at the CIIT Centers for Health Research, in collaboration with investigators from Toxicological Excellence in Risk Assessment (TERA) and the U.S. Environmental Protection Agency (U.S. EPA) in 1999. Two methods for dose-response assessment were used: a full biologically based modeling approach and a statistically oriented analysis by benchmark dose (BMD) method. This article presents the later approach, the purpose of which is to combine BMD and pharmacokinetic modeling to estimate human cancer risks from formaldehyde exposure. BMD analysis was used to identify points of departure (exposure levels) for low-dose extrapolation in rats for both tumor and the cell proliferation endpoints. The benchmark concentrations for induced cell proliferation were lower than for tumors. These concentrations were extrapolated to humans using two mechanistic models. One model used computational fluid dynamics (CFD) alone to determine rates of delivery of inhaled formaldehyde to the nasal lining. The second model combined the CFD method with a pharmacokinetic model to predict tissue dose with formaldehyde-induced DNA-protein cross-links (DPX) as a dose metric. Both extrapolation methods gave similar results, and the predicted cancer risk in humans at low exposure levels was found to be similar to that from a risk assessment conducted by the U.S. EPA in 1991. Use of the mechanistically based extrapolation models lends greater certainty to these risk estimates than previous approaches and also identifies the uncertainty in the measured dose-response relationship for cell proliferation at low exposure levels, the dose-response relationship for DPX in monkeys, and the choice between linear and nonlinear methods of extrapolation as key remaining sources of uncertainty.     

Comparing Experimental Designs for Benchmark Dose Calculations for Continuous Endpoints

The BMD (benchmark dose) method that is used in risk assessment of chemical compounds was introduced by Crump (1984) and is based on dose-response modeling. To take uncertainty in the data and model fitting into account, the lower confidence bound of the BMD estimate (BMDL) is suggested to be used as a point of departure in health risk assessments. In this article, we study how to design optimum experiments for applying the BMD method for continuous data. We exemplify our approach by considering the class of Hill models. The main aim is to study whether an increased number of dose groups and at the same time a decreased number of animals in each dose group improves conditions for estimating the benchmark dose. Since Hill models are nonlinear, the optimum design depends on the values of the unknown parameters. That is why we consider Bayesian designs and assume that the parameter vector has a prior distribution. A natural design criterion is to minimize the expected variance of the BMD estimator. We present an example where we calculate the value of the design criterion for several designs and try to find out how the number of dose groups, the number of animals in the dose groups, and the choice of doses affects this value for different Hill curves. It follows from our calculations that to avoid the risk of unfavorable dose placements, it is good to use designs with more than four dose groups. We can also conclude that any additional information about the expected dose-response curve, e.g., information obtained from studies made in the past, should be taken into account when planning a study because it can improve the design.     

Incorporation of Pharmacokinetics in Noncancer Risk Assessment: Example with Chloropentafluorobenzene

Noncancer risk assessment traditionally relies on applied dose measures, such as concentration in inhaled air or in drinking water, to characterize no-effect levels or low-effect levels in animal experiments. Safety factors are then incorporated to address the uncertainties associated with extrapolating across species, dose levels, and routes of exposure, as well as to account for the potential impact of variability of human response. A risk assessment for chloropentafluorobenzene (CPFB) was performed in which a physiologically based pharmacokinetic model was employed to calculate an internal measure of effective tissue dose appropriate to each toxic endpoint. The model accurately describes the kinetics of CPFB in both rodents and primates. The model calculations of internal dose at the no-effect and low-effect levels in animals were compared with those calculated for potential human exposure scenarios. These calculations were then used in place of default interspecies and route-to-route safety factors to determine safe human exposure conditions. Estimates of the impact of model parameter uncertainty, as estimated by a Monte Carlo technique, also were incorporated into the assessment. The approach used for CPFB is recommended as a general methodology for noncancer risk assessment whenever the necessary pharmacokinetic data can be obtained.     

Effects of the Mechanism of Receptor-Mediated Gene Expression on the Shape of the Dose-Response Curve

A mathematical model of receptor-mediated gene expression that includes receptor binding of natural and xenobiotic ligands, protein synthesis and degradation, and metabolism of the xenobiotic ligand was created to identify the determinants of the shape of the dose-response profile. Values of the model's parameters were varied to reflect alternative mechanisms of expression of the protein. These assumptions had dramatic effects on the computed response to a bolus dose of the xenobiotic ligand. If all processes in the model exhibit hyperbolic kinetics, the dose-response curves can appear sigmoidal but actually be linear with a positive slope at low doses. The slope of the curve only approached zero at low dose, indicative of a threshold for response, if binding of the xenobiotic ligand to the receptor exhibited positive cooperativity (ligand binding at one site increases the affinity for ligand at another binding site on the receptor). Positive cooperativity in the rate-limiting step of protein synthesis produced dose-response curves which were "U-shaped" at low doses, also indicative of a threshold. Positive cooperativity in the metabolism of the xenobiotic ligand produced dose-response curves that increased more rapidly than linearly with increasing dose. The model illustrates the fact that response cannot be predicted from qualitative mechanistic arguments alone; any assessment of risk to health from xenobiotic chemicals must be based on a detailed quantitative examination of the kinetic behavior of each chemical species individually.