Classic Dose‐Response and Time Postinoculation Models for Leptospira

Leptospirosis is a preeminent zoonotic disease concentrated in tropical areas, and prevalent in both industrialized and rural settings. Dose‐response models were generated from 22 data sets reported in 10 different studies. All of the selected studies used rodent subjects, primarily hamsters, with the predominant endpoint as mortality with the challenge strain administered intraperitoneally. Dose‐response models based on a single evaluation postinfection displayed median lethal dose (LD₅₀) estimates that ranged between 1 and 10⁷ leptospirae depending upon the strain's virulence and the period elapsed since the initial exposure inoculation. Twelve of the 22 data sets measured the number of affected subjects daily over an extended period, so dose‐response models with time‐dependent parameters were estimated. Pooling between data sets produced seven common dose‐response models and one time‐dependent model. These pooled common models had data sets with different test subject hosts, and between disparate leptospiral strains tested on identical hosts. Comparative modeling was done with parallel tests to test the effects of a single different variable of either strain or test host and quantify the difference by calculating a dose multiplication factor. Statistical pooling implies that the mechanistic processes of leptospirosis can be represented by the same dose‐response model for different experimental infection tests even though they may involve different host species, routes, and leptospiral strains, although the cause of this pathophysiological phenomenon has not yet been identified.     

Dose‐Response Model of Rocky Mountain Spotted Fever (RMSF) for Human

Rickettsia rickettsii is the causative agent of Rocky Mountain spotted fever (RMSF) and is the prototype bacterium in the spotted fever group of rickettsiae, which is found in North, Central, and South America. The bacterium is gram negative and an obligate intracellular pathogen. The disease is transmitted to humans and vertebrate host through tick bites; however, some cases of aerosol transmission also have been reported. The disease can be difficult to diagnose in the early stages, and without prompt and appropriate treatment, it can be fatal. This article develops dose‐response models of different routes of exposure for RMSF in primates and humans. The beta‐Poisson model provided the best fit to the dose‐response data of aerosol‐exposed rhesus monkeys, and intradermally inoculated humans (morbidity as end point of response). The average 50% infectious dose among (ID₅₀) exposed human population, N₅₀, is 23 organisms with 95% confidence limits of 1 to 89 organisms. Similarly, ID₁₀ and ID₂₀ are 2.2 and 5.0, respectively. Moreover, the data of aerosol‐exposed rhesus monkeys and intradermally inoculated humans could be pooled. This indicates that the dose‐response models fitted to different data sets are not significantly different and can be described by the same relationship.     

Dose‐Response Models Incorporating Aerosol Size Dependency for Francisella tularensis

The effect of bioaerosol size was incorporated into predictive dose‐response models for the effects of inhaled aerosols of Francisella tularensis (the causative agent of tularemia) on rhesus monkeys and guinea pigs with bioaerosol diameters ranging between 1.0 and 24 μm. Aerosol‐size‐dependent models were formulated as modification of the exponential and β‐Poisson dose‐response models and model parameters were estimated using maximum likelihood methods and multiple data sets of quantal dose‐response data for which aerosol sizes of inhaled doses were known. Analysis of F. tularensis dose‐response data was best fit by an exponential dose‐response model with a power function including the particle diameter size substituting for the rate parameter k scaling the applied dose. There were differences in the pathogen's aerosol‐size‐dependence equation and models that better represent the observed dose‐response results than the estimate derived from applying the model developed by the International Commission on Radiological Protection (ICRP, 1994) that relies on differential regional lung deposition for human particle exposure.     

Evaluation of Inhaled Versus Deposited Dose Using the Exponential Dose‐Response Model for Inhalational Anthrax in Nonhuman Primate,Rabbit, and Guinea Pig

The application of the exponential model is extended by the inclusion of new nonhuman primate (NHP), rabbit, and guinea pig dose‐lethality data for inhalation anthrax. Because deposition is a critical step in the initiation of inhalation anthrax, inhaled doses may not provide the most accurate cross‐species comparison. For this reason, species‐specific deposition factors were derived to translate inhaled dose to deposited dose. Four NHP, three rabbit, and two guinea pig data sets were utilized. Results from species‐specific pooling analysis suggested all four NHP data sets could be pooled into a single NHP data set, which was also true for the rabbit and guinea pig data sets. The three species‐specific pooled data sets could not be combined into a single generic mammalian data set. For inhaled dose, NHPs were the most sensitive (relative lowest LD₅₀) species and rabbits the least. Improved inhaled LD₅₀s proposed for use in risk assessment are 50,600, 102,600, and 70,800 inhaled spores for NHP, rabbit, and guinea pig, respectively. Lung deposition factors were estimated for each species using published deposition data from Bacillus spore exposures, particle deposition studies, and computer modeling. Deposition was estimated at 22%, 9%, and 30% of the inhaled dose for NHP, rabbit, and guinea pig, respectively. When the inhaled dose was adjusted to reflect deposited dose, the rabbit animal model appears the most sensitive with the guinea pig the least sensitive species.     

Ebola Virus Dose Response Model for Aerosolized Exposures: Insights from Primate Data

This study develops dose–response models for Ebolavirus using previously published data sets from the open literature. Two such articles were identified in which three different species of nonhuman primates were challenged by aerosolized Ebolavirus in order to study pathology and clinical disease progression. Dose groups were combined and pooled across each study in order to facilitate modeling. The endpoint of each experiment was death. The exponential and exact beta-Poisson models were fit to the data using maximum likelihood estimation. The exact beta-Poisson was deemed the recommended model because it more closely approximated the probability of response at low doses though both models provided a good fit. Although transmission is generally considered to be dominated by person-to-person contact, aerosolization is a possible route of exposure. If possible, this route of exposure could be particularly concerning for persons in occupational roles managing contaminated liquid wastes from patients being treated for Ebola infection and the wastewater community responsible for disinfection. Therefore, this study produces a necessary mathematical relationship between exposure dose and risk of death for the inhalation route of exposure that can support quantitative microbial risk assessment aimed at informing risk mitigation strategies including personal protection policies against occupational exposures.     

Dose‐Response Modeling for Inhalational Anthrax in Rabbits Following Single or Multiple Exposures

There is a need to advance our ability to characterize the risk of inhalational anthrax following a low‐dose exposure. The exposure scenario most often considered is a single exposure that occurs during an attack. However, long‐term daily low‐dose exposures also represent a realistic exposure scenario, such as what may be encountered by people occupying areas for longer periods. Given this, the objective of the current work was to model two rabbit inhalational anthrax dose‐response data sets. One data set was from single exposures to aerosolized Bacillus anthracis Ames spores. The second data set exposed rabbits repeatedly to aerosols of B. anthracis Ames spores. For the multiple exposure data the cumulative dose (i.e., the sum of the individual daily doses) was used for the model. Lethality was the response for both. Modeling was performed using Benchmark Dose Software evaluating six models: logprobit, loglogistic, Weibull, exponential, gamma, and dichotomous‐Hill. All models produced acceptable fits to either data set. The exponential model was identified as the best fitting model for both data sets. Statistical tests suggested there was no significant difference between the single exposure exponential model results and the multiple exposure exponential model results, which suggests the risk of disease is similar between the two data sets. The dose expected to cause 10% lethality was 15,600 inhaled spores and 18,200 inhaled spores for the single exposure and multiple exposure exponential dose‐response model, respectively, and the 95% lower confidence intervals were 9,800 inhaled spores and 9,200 inhaled spores, respectively.     

Risk of Fetal Mortality After Exposure to Listeria monocytogenes Based on Dose-Response Data from Pregnant Guinea Pigs and Primates

One‐third of the annual cases of listeriosis in the United States occur during pregnancy and can lead to miscarriage or stillbirth, premature delivery, or infection of the newborn. Previous risk assessments completed by the Food and Drug Administration/the Food Safety Inspection Service of the U.S. Department of Agriculture/the Centers for Disease Control and Prevention (FDA/USDA/CDC)^{( 1 )} and Food and Agricultural Organization/the World Health Organization (FAO/WHO)^{( 2 )} were based on dose‐response data from mice. Recent animal studies using nonhuman primates^{( 3 , 4 )} and guinea pigs^{( 5 )} have both estimated LD₅₀s of approximately 10⁷ Listeria monocytogenes colony forming units (cfu). The FAO/WHO^{( 2 )} estimated a human LD₅₀ of 1.9 × 10⁶ cfu based on data from a pregnant woman consuming contaminated soft cheese. We reevaluated risk based on dose‐response curves from pregnant rhesus monkeys and guinea pigs. Using standard risk assessment methodology including hazard identification, exposure assessment, hazard characterization, and risk characterization, risk was calculated based on the new dose‐response information. To compare models, we looked at mortality rate per serving at predicted doses ranging from 10^?4 to 10¹² L. monocytogenes cfu. Based on a serving of 10⁶ L. monocytogenes cfu, the primate model predicts a death rate of 5.9 × 10^?1 compared to the FDA/USDA/CDC (fig. IV‐12)^{( 1 )} predicted rate of 1.3 × 10^?7. Based on the guinea pig and primate models, the mortality rate calculated by the FDA/USDA/CDC^{( 1 )} is underestimated for this susceptible population.     

Development and application of a dose–response model for Elizabethkingia spp

Elizabethkingia spp. are common environmental pathogens responsible for infections in more vulnerable populations. Although the exposure routes of concern are not well understood, some hospital-associated outbreaks have indicated possible waterborne transmission. In order to facilitate quantitative microbial risk assessment (QMRA) for Elizabethkingia spp., this study fit dose–response models to frog and mice datasets that evaluated intramuscular and intraperitoneal exposure to Elizabethkingia spp. The frog datasets could be pooled, and the exact beta-Poisson model was the best fitting model with optimized parameters α  = 0.52 and β = 86,351. Using the exact beta-Poisson model, the dose of Elizabethkingia miricola resulting in a 50% morbidity response (LD₅₀) was estimated to be approximately 237,000 CFU. The model developed herein was used to estimate the probability of infection for a hospital patient under a modeled exposure scenario involving a contaminated medical device and reported Elizabethkingia spp. concentrations isolated from hospital sinks after an outbreak. The median exposure dose was approximately 3 CFU/insertion event, and the corresponding median risk of infection was 3.4E-05. The median risk estimated in this case study was lower than the 3% attack rate observed in a previous outbreak, however, there are noted gaps pertaining to the possible concentrations of Elizabethkingia spp. in tap water and the most likely exposure routes. This is the first dose–response model developed for Elizabethkingia spp. thus enabling future risk assessments to help determine levels of risk and potential effective risk management strategies.     

Development of an Interspecies Nested Dose‐Response Model for Mycobacterium avium subspecies paratuberculosis

Mycobacterium avium subspecies paratuberculosis (MAP) causes chronic inflammation of the intestines in humans, ruminants, and other species. It is the causative agent of Johne's disease in cattle, and has been implicated as the causative agent of Crohn's disease in humans. To date, no quantitative microbial risk assessment (QMRA) for MAP utilizing a dose‐response function exists. The objective of this study is to develop a nested dose‐response model for infection from oral exposure to MAP utilizing data from the peer‐reviewed literature. Four studies amenable to dose‐response modeling were identified in the literature search and optimized to the one‐parameter exponential or two‐parameter beta‐Poisson dose‐response models. A nesting analysis was performed on all permutations of the candidate data sets to determine the acceptability of pooling data sets across host species. Three of four data sets exhibited goodness of fit to at least one model. All three data sets exhibited good fit to the beta‐Poisson model, and one data set exhibited goodness of fit, and best fit, to the exponential model. Two data sets were successfully nested using the beta‐Poisson model with parameters α = 0.0978 and N₅₀ = 2.70 × 10² CFU. These data sets were derived from sheep and red deer host species, indicating successful interspecies nesting, and demonstrate the highly infective nature of MAP. The nested dose‐response model described should be used for future QMRA research regarding oral exposure to MAP.     

Microbiota and Dose Response: Evolving Paradigm of Health Triangle

SRA Dose‐Response and Microbial Risk Analysis Specialty Groups jointly sponsored symposia that addressed the intersections between the “microbiome revolution” and dose response. Invited speakers presented on innovations and advances in gut and nasal microbiota (normal microbial communities) in the first decade after the Human Microbiome Project began. The microbiota and their metabolites are now known to influence health and disease directly and indirectly, through modulation of innate and adaptive immune systems and barrier function. Disruption of healthy microbiota is often associated with changes in abundance and diversity of core microbial species (dysbiosis), caused by stressors including antibiotics, chemotherapy, and disease. Nucleic‐acid‐based metagenomic methods demonstrated that the dysbiotic host microbiota no longer provide normal colonization resistance to pathogens, a critical component of innate immunity of the superorganism. Diverse pathogens, probiotics, and prebiotics were considered in human and animal models (in vivo and in vitro ). Discussion included approaches for design of future microbial dose–response studies to account for the presence of the indigenous microbiota that provide normal colonization resistance , and the absence of the protective microbiota in dysbiosis. As NextGen risk analysis methodology advances with the “microbiome revolution,” a proposed new framework, the Health Triangle, may replace the old paradigm based on the Disease Triangle (focused on host, pathogen, and environment) and germophobia. Collaborative experimental designs are needed for testing hypotheses about causality in dose–response relationships for pathogens present in our environments that clearly compete in complex ecosystems with thousands of bacterial species dominating the healthy superorganism.     

Modeling Rabbit Responses to Single and Multiple Aerosol Exposures of Bacillus anthracis Spores

Survival models are developed to predict response and time‐to‐response for mortality in rabbits following exposures to single or multiple aerosol doses of Bacillus anthracis spores. Hazard function models were developed for a multiple‐dose data set to predict the probability of death through specifying functions of dose response and the time between exposure and the time‐to‐death (TTD). Among the models developed, the best‐fitting survival model (baseline model) is an exponential dose–response model with a Weibull TTD distribution. Alternative models assessed use different underlying dose–response functions and use the assumption that, in a multiple‐dose scenario, earlier doses affect the hazard functions of each subsequent dose. In addition, published mechanistic models are analyzed and compared with models developed in this article. None of the alternative models that were assessed provided a statistically significant improvement in fit over the baseline model. The general approach utilizes simple empirical data analysis to develop parsimonious models with limited reliance on mechanistic assumptions. The baseline model predicts TTDs consistent with reported results from three independent high‐dose rabbit data sets. More accurate survival models depend upon future development of dose–response data sets specifically designed to assess potential multiple‐dose effects on response and time‐to‐response. The process used in this article to develop the best‐fitting survival model for exposure of rabbits to multiple aerosol doses of B. anthracis spores should have broad applicability to other host–pathogen systems and dosing schedules because the empirical modeling approach is based upon pathogen‐specific empirically‐derived parameters.     

New Data,Strategies, and Insights for Listeria monocytogenes Dose‐Response Models: Summary of an Interagency Workshop, 2011

Listeria monocytogenes is a leading cause of hospitalization, fetal loss, and death due to foodborne illnesses in the United States. A quantitative assessment of the relative risk of listeriosis associated with the consumption of 23 selected categories of ready‐to‐eat foods, published by the U.S. Department of Health and Human Services and the U.S. Department of Agriculture in 2003, has been instrumental in identifying the food products and practices that pose the greatest listeriosis risk and has guided the evaluation of potential intervention strategies. Dose‐response models, which quantify the relationship between an exposure dose and the probability of adverse health outcomes, were essential components of the risk assessment. However, because of data gaps and limitations in the available data and modeling approaches, considerable uncertainty existed. Since publication of the risk assessment, new data have become available for modeling L. monocytogenes dose‐response. At the same time, recent advances in the understanding of L. monocytogenes pathophysiology and strain diversity have warranted a critical reevaluation of the published dose‐response models. To discuss strategies for modeling L. monocytogenes dose‐response, the Interagency Risk Assessment Consortium (IRAC) and the Joint Institute for Food Safety and Applied Nutrition (JIFSAN) held a scientific workshop in 2011 (details available at http://foodrisk.org/irac/events/ ). The main findings of the workshop and the most current and relevant data identified during the workshop are summarized and presented in the context of L. monocytogenes dose‐response. This article also discusses new insights on dose‐response modeling for L. monocytogenes and research opportunities to meet future needs.     

Quantitative Risk Estimation for a Legionella pneumophila Infection Due to Whirlpool Use

Quantitative microbiological risk assessment was used to quantify the risk associated with the exposure to Legionella pneumophila in a whirlpool. Conceptually, air bubbles ascend to the surface, intercepting Legionella from the traversed water. At the surface the bubble bursts into dominantly noninhalable jet drops and inhalable film drops. Assuming that film drops carry half of the intercepted Legionella, a total of four (95% interval: 1–9) and 4.5×10⁴ (4.4×10⁴ – 4.7×10⁴) cfu/min were estimated to be aerosolized for concentrations of 1 and 1,000 legionellas per liter, respectively. Using a dose‐response model for guinea pigs to represent humans, infection risks for active whirlpool use with 100 cfu/L water for 15 minutes were 0.29 (～0.11–0.48) for susceptible males and 0.22 (～0.06–0.42) for susceptible females. A L. pneumophila concentration of ≥1,000 cfu/L water was estimated to nearly always cause an infection (mean: 0.95; 95% interval: 0.9–～1). Estimated infection risks were time‐dependent, ranging from 0.02 (0–0.11) for 1‐minute exposures to 0.93 (0.86–0.97) for 2‐hour exposures when the L. pneumophila concentration was 100 cfu/L water. Pool water in Dutch bathing establishments should contain <100 cfu Legionella/L water. This study suggests that stricter provisions might be required to assure adequate public health protection.     

Development of Dose‐Response Models to Predict the Relationship for Human Toxoplasma gondii Infection Associated with Meat Consumption

Toxoplasma gondii is a protozoan parasite that is responsible for approximately 24% of deaths attributed to foodborne pathogens in the United States. It is thought that a substantial portion of human T. gondii infections is acquired through the consumption of meats. The dose‐response relationship for human exposures to T. gondii‐infected meat is unknown because no human data are available. The goal of this study was to develop and validate dose‐response models based on animal studies, and to compute scaling factors so that animal‐derived models can predict T. gondii infection in humans. Relevant studies in literature were collected and appropriate studies were selected based on animal species, stage, genotype of T. gondii, and route of infection. Data were pooled and fitted to four sigmoidal‐shaped mathematical models, and model parameters were estimated using maximum likelihood estimation. Data from a mouse study were selected to develop the dose‐response relationship. Exponential and beta‐Poisson models, which predicted similar responses, were selected as reasonable dose‐response models based on their simplicity, biological plausibility, and goodness fit. A confidence interval of the parameter was determined by constructing 10,000 bootstrap samples. Scaling factors were computed by matching the predicted infection cases with the epidemiological data. Mouse‐derived models were validated against data for the dose‐infection relationship in rats. A human dose‐response model was developed as P (d) = 1–exp (–0.0015 × 0.005 × d) or P (d) = 1–(1 + d × 0.003 / 582.414)^?1.479. Both models predict the human response after consuming T. gondii‐infected meats, and provide an enhanced risk characterization in a quantitative microbial risk assessment model for this pathogen.     

Dose‐Response Model of Coxiella burnetii (Q Fever)

Q fever is a zoonotic disease caused by the intracellular gram‐negative bacterium Coxiella burnetii (C. burnetii), which only multiplies within the phagolysosomal vacuoles. Q fever may manifest as acute or chronic disease. The acute form is generally not fatal and manifestes as self‐controlled febrile illness. Chronic Q fever is usually characterized by endocarditis. Many animal models, including humans, have been studied for Q fever infection through various exposure routes. The studies considered different endpoints including death for animal models and clinical signs for human infection. In this article, animal experimental data available in the open literature were fit to suitable dose‐response models using maximum likelihood estimation. Research results for tests of severe combined immunodeficient mice inoculated intraperitoneally (i.p.) with C. burnetii were best estimated with the Beta‐Poisson dose‐response model. Similar inoculation (i.p.) trial outcomes conducted on C57BL/6J mice were best fit by an exponential model, whereas those tests run on C57BL/10ScN mice were optimally represented by a Beta‐Poisson dose‐response model.     

Development of a Dose‐Response Model for SARS Coronavirus

In order to develop a dose‐response model for SARS coronavirus (SARS‐CoV), the pooled data sets for infection of transgenic mice susceptible to SARS‐CoV and infection of mice with murine hepatitis virus strain 1, which may be a clinically relevant model of SARS, were fit to beta‐Poisson and exponential models with the maximum likelihood method. The exponential model (k= 4.1 × l0²) could describe the dose‐response relationship of the pooled data sets. The beta‐Poisson model did not provide a statistically significant improvement in fit. With the exponential model, the infectivity of SARS‐CoV was calculated and compared with those of other coronaviruses. The does of SARS‐CoV corresponding to 10% and 50% responses (illness) were estimated at 43 and 280 PFU, respectively. Its estimated infectivity was comparable to that of HCoV‐229E, known as an agent of human common cold, and also similar to those of some animal coronaviruses belonging to the same genetic group. Moreover, the exponential model was applied to the analysis of the epidemiological data of SARS outbreak that occurred at an apartment complex in Hong Kong in 2003. The estimated dose of SARS‐CoV for apartment residents during the outbreak, which was back‐calculated from the reported number of cases, ranged from 16 to 160 PFU/person, depending on the floor. The exponential model developed here is the sole dose‐response model for SARS‐CoV at the present and would enable us to understand the possibility for reemergence of SARS.     

Comparison of cancer slope factors using different statistical approaches.

The U.S. Environmental Protection Agency's cancer guidelines ( USEPA, 2005 ) present the default approach for the cancer slope factor (denoted here as s*) as the slope of the linear extrapolation to the origin, generally drawn from the 95% lower confidence limit on dose at the lowest prescribed risk level supported by the data. In the past, the cancer slope factor has been calculated as the upper 95% confidence limit on the coefficient (q*₁) of the linear term of the multistage model for the extra cancer risk over background. To what extent do the two approaches differ in practice? We addressed this issue by calculating s* and q*₁ for 102 data sets for 60 carcinogens using the constrained multistage model to fit the dose‐response data. We also examined how frequently the fitted dose‐response curves departed appreciably from linearity at low dose by comparing q₁, the coefficient of the linear term in the multistage polynomial, with a slope factor, s_c, derived from a point of departure based on the maximum liklihood estimate of the dose‐response. Another question we addressed is the extent to which s* exceeded s_c for various levels of extra risk. For the vast majority of chemicals, the prescribed default EPA methodology for the cancer slope factor provides values very similar to that obtained with the traditionally estimated q*₁. At 10% extra risk, q*₁/s* is greater than 0.3 for all except one data set; for 82% of the data sets, q*₁ is within 0.9 to 1.1 of s*. At the 10% response level, the interquartile range of the ratio, s*/s_c, is 1.4 to 2.0.     

An International Pooled Analysis for Obtaining a Benchmark Dose for Environmental Lead Exposure in Children

Lead is a recognized neurotoxicant, but estimating effects at the lowest measurable levels is difficult. An international pooled analysis of data from seven cohort studies reported an inverse and supra‐linear relationship between blood lead concentrations and IQ scores in children. The lack of a clear threshold presents a challenge to the identification of an acceptable level of exposure. The benchmark dose (BMD) is defined as the dose that leads to a specific known loss. As an alternative to elusive thresholds, the BMD is being used increasingly by regulatory authorities. Using the pooled data, this article presents BMD results and applies different statistical techniques in the analysis of multistudy data. The calculations showed only a limited variation between studies in the steepness of the dose‐response functions. BMD results were quite robust to modeling assumptions with the best fitting models yielding lower confidence limits (BMDLs) of about 0.1–1.0 μ g/dL for the dose leading to a loss of one IQ point. We conclude that current allowable blood lead concentrations need to be lowered and further prevention efforts are needed to protect children from lead toxicity.     

Incorporating Time‐Dose‐Response into Legionella Outbreak Models

A novel method was used to incorporate in vivo host–pathogen dynamics into a new robust outbreak model for legionellosis. Dose‐response and time‐dose‐response (TDR) models were generated for Legionella longbeachae exposure to mice via the intratracheal route using a maximum likelihood estimation approach. The best‐fit TDR model was then incorporated into two L. pneumophila outbreak models: an outbreak that occurred at a spa in Japan, and one that occurred in a Melbourne aquarium. The best‐fit TDR from the murine dosing study was the beta‐Poisson with exponential‐reciprocal dependency model, which had a minimized deviance of 32.9. This model was tested against other incubation distributions in the Japan outbreak, and performed consistently well, with reported deviances ranging from 32 to 35. In the case of the Melbourne outbreak, the exponential model with exponential dependency was tested against non‐time‐dependent distributions to explore the performance of the time‐dependent model with the lowest number of parameters. This model reported low minimized deviances around 8 for the Weibull, gamma, and lognormal exposure distribution cases. This work shows that the incorporation of a time factor into outbreak distributions provides models with acceptable fits that can provide insight into the in vivo dynamics of the host‐pathogen system.