Abstract
Regulatory agencies recommend that centrally active drugs are tested for abuse potential before approval. Standard preclinical assessments are conducted in rats or non-human primates (NHPs). This study evaluated the ability of the zebrafish conditioned place preference (CPP) model to predict human abuse outcomes. Twenty-seven compounds from a variety of pharmacological classes were tested in zebrafish CPP, categorized as positive or negative, and analyzed using standard diagnostic tests of binary classification to determine the likelihood that zebrafish correctly predict robust positive signals in human subjective effects studies (+HSE) and/or Drug Enforcement Administration drug scheduling. Results were then compared with those generated for rat self-administration and CPP, as well as NHP self-administration, using this same set of compounds. The findings reveal that zebrafish concordance and sensitivity values were not significantly different from chance for both +HSE and scheduling. Although significant improvements in specificity and negative predictive values were observed for zebrafish relative to +HSE, specificity without sensitivity provides limited predictive value. Moreover, assessments in zebrafish provided no added value for predicting scheduling. By contrast, rat and NHP models generally possessed significantly improved concordance, sensitivity, and positive predictive values for both clinical measures. Although there may be predictive value with compounds from specific pharmacological classes (e.g., µ-opioid receptor agonists, psychostimulants) for zebrafish CPP, altogether these data highlight that using the current methodology, the zebrafish CPP model does not add value to the preclinical assessment of abuse potential.
Introduction
Zebrafish are one of the most widely used model systems in developmental biology. Owing to the numerous benefits of using this vertebrate system, including their small size, inexpensive housing costs, short life span, and unparalleled genetic tractability, they are also now becoming widely used in other areas of biological sciences, including pharmacological and behavioral screening (Guo, 2004; Stewart et al., 2015). The zebrafish system can provide a relatively high throughput in vivo option, bridging the gap between in vitro cell-based models and in vivo rodent models; therefore, zebrafish may contribute to the refinement of animal use in research. Mounting evidence implicates zebrafish as a promising model species for reward and addiction research (Guo, 2004; Ninkovic et al., 2006; Mathur and Guo, 2010; Klee et al., 2012; Stewart et al., 2015). Thus, there may be a potential role for zebrafish abuse models in the drug discovery process, where centrally active compounds are typically assessed for their abuse potential in animal models before regulatory approval.
Two of the main animal models used to assess the rewarding properties of compounds are self-administration and conditioned place preference (CPP) (Panlilio and Goldberg, 2007; Tzschentke, 2007). Although self-administration has greater face and predictive validity to human drug-seeking behavior than CPP, the simplicity of CPP has led to its widespread use in the study of reward processes (Bardo and Bevins, 2000; Tzschentke, 2007). Based on the principles of Pavlovian conditioning, CPP is proposed to reflect the rewarding properties of drugs through examination of their association with contextual stimuli (Tzschentke, 1998, 2007). CPP protocols are typically conducted in an apparatus with a retractable partition that can divide the apparatus into two compartments, each side with distinct visual and/or tactile cues. CPP usually comprises three phases: 1) the animal is allowed to explore the entire apparatus, and the time spent in each compartment is used as a measure of baseline preference; 2) the animal is sequentially restricted to each compartment for a period of time in which they are exposed to either drug or control, thus forming a Pavlovian association between the drug and the environment; and 3) the animal is once again allowed access to the entire apparatus in the absence of drug, and final place preference for the compartments is measured. If a significant change in preference toward the drug-paired compartment is observed, CPP is considered to have been established, reflecting rewarding properties of the drug.
Previous work has shown that cocaine (Darland and Dowling, 2001), amphetamine (Ninkovic et al., 2006), nicotine, ethanol (Kily et al., 2008; Brennan et al., 2011), and morphine (Lau et al., 2006) induce place preference in zebrafish; however, the number of compounds assessed in this model has been too limited to quantitatively analyze the predictive value of the model for effects in humans. The aim of the present study was to expand the number of compounds tested in zebrafish CPP using a standardized study design to determine the ability of the model to predict the outcome of robust positive human subjective effects (+HSE) and/or Drug Enforcement Administration (DEA) scheduling status in the United States. We selected scheduling status in addition to +HSE, because a number of factors other than the pharmacology of a drug can influence whether a drug is scheduled (e.g., medicinal uses, overall safety profile, as well as societal and economic factors). Compounds from a variety of pharmacological classes were tested, and the list included drugs that are considered to have positive outcomes in the clinic (including both strong and weak reinforcing drugs), as well as drugs that have negative clinical outcomes (i.e., do not exhibit +HSE or are unscheduled). The confidence of zebrafish CPP to predict positive clinical outcomes was determined using binary classification to categorize the selected drugs as true positives, true negatives, false positives, or false negatives in the model. Overall concordance and standard diagnostic tests of binary classifications were used to quantify objectively and statistically the predictive validity of zebrafish CPP. Similar analyses have been used to determine the predictive validity of other preclinical abuse assessments, including self-administration, drug discrimination, and locomotor activity in rats and non-human primates (NHPs) (O'Connor et al., 2011; Horton et al., 2013). As such, outcomes from zebrafish CPP were then compared with those reported in the literature with rat self-administration and CPP models, as well as NHP self-administration, using the same set of compounds.
Methods
Subjects.
Wild-type zebrafish (Danio rerio) were either bred in house or obtained from a commercial supplier (Wades Tropical Import Ltd, London) at 4 weeks of age (Tubingen wild type) or Wades Singapore strain, respectively) and raised in the Queen Mary University London Fish Facility according to standard protocols. Based on power analysis of previous studies using nicotine and ethanol, we aimed to use approximately 20 fish for each concentration of each drug (including vehicle) in CPP experiments and 10 fish for each concentration of each drug (including vehicle) for locomotion analysis. All analyses were performed using 3- to 4-month-old (0.4–0.8 g) male and female fish with as close to 50% distribution of sexes across the concentration groups as possible. All behavioral experiments were carried out in a 28°C room with water changes between each test subject to ensure water temperature was as consistent as possible for each fish and was similar to standard housing conditions. During experimental days, fish were fed in the morning (8:00–9:00 AM) as well as in the evening but not during an experiment. Fish were tested over an entire day (∼8 hours, 10:00 AM–6:00 PM) with an equal number of fish from each concentration tested at the same time to minimize any effect that time of day may have on experimental outcomes. All experiments were carried out in accordance with the Animals (Scientific Procedures) Act, 1986, under local ethical guidelines from the Queen Mary Animal Care and Use Committee and under a UK Home Office project license.
CPP Experimental Design.
CPP was conducted as previously published (Parker et al., 2013, 2014). Fish were singly housed for 1 week before being habituated to the conditioning tank over 2 consecutive days. The conditioning tank consisted of an opaque tank measuring 20 cm (w) × 15 cm (h) × 30 cm (l) containing 2.5 l of aquarium water with distinct visual cues (spots or stripes) on walls at each end of the tank (Supplemental Fig. 1). A ceiling-mounted camera and Noldus Ethovision XT 9 software (TrackSys, Nottingham, UK) were used to track automatically the behavior of the fish. After 2 days of habituation sessions, each drug was tested over 5 days, consisting of 1 baseline day and 3 conditioning days followed by 1 day of probe trials. During habituation, each individual fish was placed in the conditioning apparatus for 20 minutes with free access to both compartments and then returned to its home tank. On the day after the final habituation session, baseline assessments were carried out as follows: fish were placed in the conditioning tank for 10 minutes. Basal preference was determined by recording time spent in either compartment of the apparatus during the second 5 minutes of this period (% time spent in each side). Any fish with basal preference greater than 75% was excluded from the study. The number of fish excluded from the study by this criterion ranged widely, with 5% to 40% of the habituated fish showing a basal preference greater than 75%.
Each fish with basal preference less than 75% was then conditioned to the test drug (or its vehicle) over 3 consecutive days. Specifically, fish were placed in the conditioning tank containing 2.5 l of water and were restricted first to their preferred side for 20 minutes in the absence of drug (i.e., conditioned to vehicle) and then to their least preferred side for 20 minutes in the presence of test drug (or its vehicle in the case of the vehicle controls). The test drug (or vehicle) was added to the tank as a concentrated stock in a volume of 50-ml aquarium water. Each fish was conditioned to the same concentration of drug for 3 consecutive days. A total of five concentrations were used for each drug (including vehicle) with ∼20 fish at each dose (dependent on how many fish were excluded from baseline). No data were recorded during the conditioning sessions. On the day after the final conditioning day, a 10-minute probe trial was conducted in which the fish were allowed free access to both sides of the tank in the absence of drug to measure the time spent on both sides. Place preference was calculated taking basal preference and preference for the drug-paired side into account, again using only the second 5-minute period for data collection. The last 5 minutes were used for analysis, because fish often display an initial “freezing” behavior as a stress response when first added to the test tank, particularly during baseline measurements. Omission of the first 5 minutes allows for a habituation period in which the fish are able to acclimate to the tank and ensures that this potential freezing behavior does not contribute toward calculations in change of preference scores. This was repeated in the probe trial to be consistent with the measurements being used for calculations in probe and baseline comparisons.
Locomotor Activity.
All drugs were tested for their effects on locomotion (distance traveled) independent of the place preference assessment. This was included as a proxy measure to give an indication of whether the 20-minute exposure time used for CPP was sufficient to allow uptake of the test drug into the central nervous system (CNS). Each drug was tested at the same five concentrations as in the CPP assessment (using approximately 10 fish per concentration per drug). The order of drug exposure was pseudo-randomized between subjects. Fish were pre-exposed for 20 minutes in 1 l of aquarium water plus test drug in a tank measuring 11 cm (w) × 10 cm (h) × 20 cm (l). After drug exposure, the fish were netted into locomotor activity assay tanks [22 cm (w) × 16 cm (h) × 27 cm (l)] containing fresh aquarium water. Locomotor activity was recorded for 20 minutes using a ceiling mounted camera and Noldus Ethovision XT 9 software (TrackSys). These data were sorted into 2-minute time bins to allow temporal as well as spatial analysis.
Drugs and Concentrations.
Twenty-seven compounds were analyzed in this study; 26 drugs were tested at four different concentrations plus vehicle, and one drug (ethanol) was tested at three different concentrations plus vehicle. The compounds that were tested included drugs that had been previously used in zebrafish CPP studies, including nicotine, ethanol, cocaine, morphine, caffeine, and amphetamine (Darland and Dowling, 2001; Lau et al., 2006; Ninkovic and Bally-Cuif, 2006; Ninkovic et al., 2006; Kily et al., 2008; Brennan et al., 2011; Collier et al., 2014), and 21 previously untested compounds (see Table 1 for drugs tested, supplier, concentration range, and vehicle).
List of compounds tested by class along with supplier name, catalog number, concentration range tested and references used to select the concentration range
Concentration ranges were based on concentrations previously found to be rewarding in zebrafish in other studies or using a concentration that corresponded to doses that were positive in either rodent or NHP CPP or self-administration studies. We employed a maximum final tank concentration (mg/l, administered as µM or mM solution in the tank water) equivalent to 2× the mammalian effective dose (mg/kg). Compounds with no known rewarding properties were tested at similar ranges (mg/l, administered as a µM or mM solution in the tank water, equivalent to 2× the mg/kg dose used in mammals). All drugs were made up as stock solutions in either water or DMSO (see Table 1) and stored frozen where applicable. All drugs were used at a pH of between 6.95 and 7.5 and were assessed for toxic effects before CPP analysis; starting at the lowest concentration, 3 fish were placed individually in a volume of 200 ml of the drug solution in fish water for an hour. Fish were assessed for signs of toxicity (difficulty swimming, exaggerated breathing, hemorrhaging gills, internal bleeding) during this time and at regular intervals for the following 6 hours and the following morning. If no adverse signs were detected, the concentration was increased and the procedure was repeated until the maximal intended dose had been assessed. Concentrations that induced signs of toxicity were not used further. Drugs were diluted from frozen stocks 10 minutes before use. All drugs were added to the conditioning tanks in a volume of 50 ml aquarium water. When used, the final concentration of DMSO did not exceed 0.1%
CPP Data Analysis.
Concentration-response graphs with 95% confidence interval (CI) estimates are included for all drugs assessed in the zebrafish CPP (see Supplemental Fig. 2). We assessed each of the compounds tested under the null hypothesis to ensure they did not induce a change in preference for the drug-paired stimulus after conditioning. A change in preference was calculated as the proportion of time spent in the drug-paired side in the probe trial minus the proportion of time spent in the drug-paired side during the basal preference trial. To assess whether a drug induced a statistically significant change in preference, a two-stage approach was implemented. First, an overall test for evidence of nonmonotonicity was performed. If there was no evidence of nonmonotonicity (i.e., the response was monotonic or, in other words, followed an increasing or decreasing trend with increasing concentration of drug), a sequential trend test was used. If there was evidence of nonmonotonicity (i.e., the response did not follow an increasing or decreasing trend with increasing concentration of drug), a Dunnett’s post hoc test was performed.
In cases where there was no evidence of nonmonotonicity and a sequential trend test was conducted, a trend test across all concentrations was first performed. If this test was not statistically significant, the analysis was stopped and no concentrations were declared statistically significantly different from vehicle. If this test was statistically significant, the highest concentration was declared statistically significant, and the process was repeated for all but the highest concentration. This process continued for the remaining lower concentrations, until the point at which the test was no longer statistically significant. In cases where there was evidence of nonmonotonicity, a Dunnett’s post hoc test was conducted to compare each concentration to vehicle.
Only drugs that induced a statistically significant increase in preference for the drug-paired side at any concentration were considered a positive in zebrafish CPP. If a drug induced a statistically significant decrease in preference for the drug-paired side (i.e., the drug might be considered aversive) or CPP was not observed at any concentration, the drug was deemed a negative in zebrafish CPP. CPP data were analyzed in RStudio (version 0.99.489) (RStudio, Boston, MA). For all analyses, statistical significance was set at α = 0.05.
Locomotor Behavior Data Analysis.
Data were fitted to linear mixed effects models, with distance traveled as the dependent variable, and time and concentration as fixed effects (fish identification as a random effect). Time bins in which the fish moved less than 100 cm in 2 minutes were checked for tracking failure, and where tracking failed, they were removed from analysis. For each drug, any time bins in which the fish moved two standard deviations from the mean distance moved across all drug concentrations in a drug group including paired controls were regarded as outliers and were excluded from analysis. Furthermore, any fish that “froze” (failed to travel 100 cm in any 2-minute time bin over the entire assay) were removed (20 of 1300 fish randomly distributed across all drugs and concentrations).
Binary Classification, Concordance, and Diagnostic Tests.
The ability of zebrafish CPP to predict clinical outcomes with respect to +HSE, and scheduling status was assessed and compared with outcomes calculated with self-administration and CPP models in rats, as well as self-administration in NHPs. Classification of positives and negatives in zebrafish CPP are described above. For all other endpoints (+HSE, scheduling status, rat self-administration, rat CPP, and NHP self-administration), classification was conducted as described in Horton et al. (2013) and Supplemental Table 3. In brief, PubMed was the primary tool for locating peer-reviewed source documents. Google Scholar search engine was used as a follow up to obtain additional resources, but only peer-reviewed data or government documents were used for classifications. Many of the classifications were captured originally in Horton et al. (2013). A positive in rat/NHP self-administration or rat CPP was defined as a drug maintaining a higher level of responding under a fixed ratio schedule or inducing place preference for the drug-paired side, respectively, than the drug’s vehicle. In cases where there were differences between data published in the literature, a drug was considered positive if any studies revealed a positive result. A drug was considered to induce +HSE if >50% of participants (volunteers with a history of drug use) reported positive “euphoric,” “drug-liking,” or “high” effects after drug administration using scales such as the Visual Analog Scale of global drug effects, the Addiction Research Center Inventory, the Drug Class Questionnaire, or the Profile of Mood States. If a drug has been classified with a scheduling status of I–V by the Controlled Substances Act, it was considered a positive for scheduling status. Drugs were considered negative in the clinical outcomes if they did not induce +HSE or were unscheduled.
For each preclinical model (zebrafish CPP, rat self-administration, rat CPP, NHP self-administration), drugs were classified relative to +HSE and scheduling status as either a true positive (positive in both the preclinical model and clinical measure), true negative (negative in both the preclinical model and clinical measure), false positive (positive in the preclinical model but negative in the clinical measure), or false negative (negative in the preclinical model but positive in the clinical measure). The overall concordance of each preclinical model was calculated by dividing the number of compounds for which the model correctly predicted the clinical outcome (total of true positives and true negatives) divided by the total number of compounds. Standard diagnostic tests of binary classifications (e.g., sensitivity and specificity) and estimation of diagnostic value and level of uncertainty (e.g., positive and negative predictive value (positive predictive value and negative predictive value, respectively), value added positive predictive value and negative predictive value, and proportionate reduction in uncertainty [PRU] for positive and negative findings) were calculated as described in Coulthard (2007) and Horton et al. (2013) (Table 2). Pretest prevalence, or the overall probability of a drug being abused, was set as described previously in Horton et al. (2013). Briefly, the pretest prevalence was set at ∼0.3, or 30%. This estimate was determined by dividing the number of scheduled drugs (II–V) in the United States in 2013 (total of 217) by the total number of approved drugs in the United States as described in the http://www.fda.gov/cder/orange/default.htm. U.S. Food and Drug Administration. Center for Drug Evaluation and Research Approved Drug Products with Therapeutic Equivalence Evaluations Orange Book (total of 1468), which gave a ratio of 0.15, or 15%. Given that many of the approved drugs are not centrally active and would therefore inherently lack abuse liability, this ratio was doubled, giving a final pretest prevalence of 0.3, or 30%, to estimate the likely prevalence in a data set with CNS-active compounds. For concordance, sensitivity, and specificity, pre-test probability was set at 50%, or chance. To determine the confidence or reliability of the statistical estimates used in this study, 95% CIs were calculated for each measure using R statistical software (version 3.3.0) and, in particular, the PropCIs and pairwiseCI libraries, as well as StatXact (Cytel Studio version 10; Cytel Inc. Cambridge, MA). In cases where CIs did not overlap with pretest probabilities (adjusted for prevalence where appropriate), it was considered that the model (e.g., zebrafish CPP, rat self-administration, rat CPP, or NHP self-administration) provided a statistically significant improvement in predictive value.
Descriptions of and calculations for diagnostic tests conducted
Results
Zebrafish CPP Analysis: Positives.
As seen in previous studies, nicotine, ethanol, amphetamine, cocaine, and morphine induced statistically significant, concentration-dependent increases in preference for the drug-paired side (Fig. 1, A–E), with the largest magnitude changes occurring at concentrations of at 5 μM (25.6 ± 7.8%), 171 mM (21.5 ± 3.7%), 50 μM (15.0 ± 2.9%), 29.4 μM (26.9 ± 4.3%), and 7.9 μM (19.8 ± 7.8%), respectively (Table 3; Supplemental Table 1).
Confirmation of change in preference (±S.E.M.) after conditioned place preference training in adult zebrafish in drugs previously assessed in this species are included to confirm reliability of the procedure. There were statistically significant concentration-dependent changes observed for nicotine (A) and ethanol (B), the stimulants amphetamine (C) and cocaine (D), and the opioid agonist morphine (E). *P < 0.05; **P < 0.01; ***P < 0.001.
Summary of binary classification for zebrafish and rat to human subjective effects and scheduling status.
Of the previously untested compounds, the µ-opioid agonists fentanyl (Fig. 2A) and oxycodone (Fig. 2B) resulted in statistically significant, concentration-dependent increases in preference for the drug-paired side. The general anesthetics tetracaine (Fig. 2C) and phencyclidine (Fig. 2D), as well as the antihistamine chlorpheniramine (Fig. 2E), also significantly increased preference for the drug-paired side. The largest magnitude changes were observed for these drugs at the following concentrations: fentanyl, 0.076 μM (18.0 ± 4.3%); oxycodone, 1.14 μM (25.0 ± 5.0%); tetracaine, 6.3 μM (17.0 ± 7.0%); phencyclidine, 3.57 μM (24.3 ± 5.7%); chlorpheniramine, 5.1 μM (22.7 ± 5.9%) (Tables 3 and 4; Fig. 2, A–E). All of these drugs were considered positives in the zebrafish model (Table 3; Supplemental Table 1).
Change in preference (±S.E.M.) after conditioned place preference training in adult zebrafish for opioid agonists fentanyl (A) and oxycodone (B), the general anesthetics tetracaine (C) and phencyclidine (D), and the antihistamine chlorpheniramine (E). *P < 0.05; **P < 0.01.
Statistical summary of diagnostic tests for the prediction of human subjective effects
Summary for prediction of human subjective effects, demonstrating the number of false positives, true positives, true negatives, false negatives, and outcome ratios for various statistical outputs with regard to diagnostic value. Values in parentheses indicate 95% confidence intervals. Values indicate a significant difference from pretest probability [concordance, PPV, NPV, PPV (30% prev), NHP (30% prev)] or from zero predictive value (VaPPV, VaNPV). PPV and NPV represent observed predictive values. PPV (30%) and NPV (30% prev) represent predictive values corrected for an estimated prevalence of 0.3.
Zebrafish CPP Analysis: Negatives.
The remaining previously untested compounds did not induce a change in place preference in zebrafish at the concentrations evaluated in this study, including the general anesthetics ketamine (Fig. 3A) and procaine (Fig. 3B), the antidepressants atomoxetine (Fig. 3C), bupropion (Fig. 3D), citalopram (Fig. 3E), and fluoxetine (Fig. 3F), the antihistamine diphenhydramine (Fig. 3G), the benzodiazepine diazepam (Fig. 3H), the cannabinoid 1 receptor antagonist rimonabant (Fig. 3I), the cannabinoid receptor agonists ∆-9 tetrahydrocannabinol (Fig. 3J), and WIN-55,212 (Fig. 3K), the potassium channel opener retigabine (ezogabine) (Fig. 3L), the metabotropic glutamate receptor 5 (mGluR5) antagonist 2-methyl-6(phenylethynl)pyridine (MPEP) (Fig. 3M), and the opioid receptor inverse agonist naloxone (Fig. 3N). The barbiturates methohexital and pentobarbital resulted in statistically significant decreases in preference for the drug-paired side, suggesting place aversion (Fig. 3, O and P). In agreement with previously published data (Collier et al., 2014), caffeine did not induce a statistically significant change in place preference (Fig. 3Q). All of these drugs were considered negatives in the zebrafish CPP model (Table 3; Supplemental Table 1).
Change in preference (±S.E.M.) after conditioned place preference training in adult zebrafish for the general anesthetics ketamine (A) and procaine (B); antidepressants atomoxetine (C), bupropion (D), citalopram (E), and fluoxetine (F); antihistamine diphenhydramine (G); benzodiazepine diazepam (H); CB1 receptor antagonist rimonabant (I); CB receptor agonists ∆-9 tetrahydrocannabinol (THC) (J) and WIN-55,212 (K); potassium channel opener retigabine (L); mGluR5 antagonist 2-methyl-6(phenylethynl)pyridine (MPEP; M); opioid receptor inverse agonist naloxone (N); barbiturates methohexital (O) and pentobarbital (P); caffeine (Q). *P < 0.05.
Locomotor Activity Analysis.
Locomotor activity was included as a proxy measure to give an indication of whether the 20-minute exposure time used for CPP was sufficient to allow uptake of the test drug into the CNS. All of the compounds tested in this study resulted in a significant concentration-dependent change in distance traveled over the 20-minute testing period, with the exception of procaine, phencyclidine, and fentanyl (Supplementary Fig. 3; Supplementary Table 2). Because phencyclidine and fentanyl resulted in a significant increase in place preference for the drug-paired side (Fig. 2; Table 3; Supplemental Table 1), they were assumed to be CNS active.
Predictive Value for Human Subjective Effects Outcome.
Out of the 27 drugs evaluated in zebrafish CPP, HSE data were only available for 20 drugs, so only those 20 were used to determine the predictive value of zebrafish CPP for +HSE (Table 3; Supplemental Table 3). Data for rat CPP, rat self-administration, and NHP self-administration were only available for 19, 18, and 19, respectively, of the 20 drugs with HSE data; therefore, only those drugs with data were used for calculating the predictive value of the models for +HSE using this data set. Table 4 and Supplemental Table 4 provide a statistical summary of the diagnostic tests of the models to +HSE. The overall concordance of zebrafish CPP relative to +HSE was 65%, compared with 84%, 83%, and 89% for rat CPP, rat self-administration, and NHP self-administration, respectively. Sensitivity values were generally high for +HSE with rat CPP and self-administration (0.93 for both models) and NHP self-administration (1.0), whereas sensitivity for zebrafish CPP was lower (0.53). For both concordance and sensitivity, only the rat and NHP models had values that were significantly greater than chance (or 50%). On the other hand, specificity for zebrafish CPP relative to +HSE was 1.0, whereas the values were lower for both rat and NHP models (ranging from 0.5 to 0.6). In this instance, only zebrafish had a specificity value that was significantly greater than chance. It should, however, be noted that the data set for specificity (i.e., clinical negatives) was relatively small in each of these cases (n = 5), which limits the ability to draw definitive conclusions. When estimated pretest prevalence (0.3) was taken into account, rat CPP and NHP self-administration possessed positive predictive values (0.5 and 0.52, respectively) that were significantly greater than the pretest prevalence. Although zebrafish CPP appeared to have the highest positive predictive value (1.0) compared with other models, there was overlap of 95% CIs with the pretest prevalence value of 0.3; therefore, this did not reach statistical significance. With regard to negative predictive value (i.e., the ability to correctly predict when a drug does not exhibit +HSE), zebrafish and rat CPP, as well as NHP self-administration, models offered negative predictive values that were significantly greater than pretest prevalence (0.83, 0.95, and 1.0, respectively). For this data set, although rat self-administration yielded a negative predictive value that was 0.94, which was within the same range as rat CPP and NHP self-administration; however, 95% CIs overlapped with pretest prevalence values for self-administration, therefore it did not reach statistical significance. Additionally, analysis of PRU values indicated that positive findings in rat CPP and NHP self-administration (PRU+) and negative findings in zebrafish and rat CPP, as well as NHP self-administration (PRU−), significantly reduced the uncertainty of predicting drugs correctly with regard to +HSE. These findings suggest higher confidence for NHP self-administration compared with other preclinical models that a positive result would correctly predict a drug with +HSE; however, classification of one drug, caffeine, as a positive in NHP self-administration appears to be what may be differentiating NHP self-administration from rat self-administration. Furthermore, there is lower confidence for zebrafish CPP compared with rat CPP and NHP self-administration that a negative result would result in a drug without +HSE.
Predictive Value for Scheduling Status.
Twenty-four of the drugs evaluated in zebrafish CPP in this study have a scheduling designation by the Drug Enforcement Agency, so only these 24 were used to determine the predictive value (Table 4). Data for rat CPP, rat self-administration, and NHP self-administration were available for 24, 22, and 21, respectively, of the 24 drugs with scheduling status; therefore, only those drugs with scheduling data were used for calculating the predictive value of the rat and NHP models using this data set. Table 5 and Supplemental Table 4 provide a statistical summary of the diagnostic tests of the models to scheduling status. With regard to scheduling, overall concordance was relatively similar for zebrafish and rat CPP (58% and 52%, respectively) and NHP self-administration (62%), whereas rat self-administration was higher (75%) and was the only model to have a value that was significantly greater than chance (50%). Similar to the data generated for +HSE, sensitivity values were generally high for scheduling status with rat CPP, rat self-administration, and NHP self-administration (0.82, 1.0, and 1.0, respectively), whereas sensitivity for zebrafish CPP was lower (0.5). With respect to scheduling status, specificity values were lower than the values generated for +HSE for all four models, ranging from 0.2 (rat CPP and NHP self-administration) to 0.44 (rat self-administration) to 0.67 (zebrafish CPP). Taking prevalence into account, rat self-administration provided the highest predictive values for both positive (0.44) and negative (1.0) findings, demonstrating increased absolute added value over pretest prevalence (0.3). This contrasts with results obtained for the other models, where adjusted predictive values were at or near pretest prevalence values. As a result, these findings reveal no or limited absolute added value for either positive or negative findings with regard to scheduling status for zebrafish and rat CPP, as well as NHP self-administration, for this data set. Similar to rat self-administration, NHP self-administration yielded a high adjusted negative predictive value (1.0); however 95% CIs overlapped with pretest prevalence. Examination of PRU+ and PRU– values shows that with respect to scheduling status, positive and negative results in the rat self-administration model significantly reduce the uncertainty of predicting scheduling by the highest proportions, at 0.19 and 1.0 for PRU+ and PRU–, respectively. Zebrafish CPP models offered lower reductions in uncertainty for positive and negative findings (proportions of 0.13 and 0.19, respectively) that were not statistically significant, and rat CPP models yielded no reductions in uncertainty (proportions of 0.01 and 0.07 for PRU+ and PRU–, respectively). NHP self-administration did not yield any statistically significant reductions in uncertainly for positive (0.07) or negative (1.0) findings.
Statistical summary of diagnostic tests for the prediction of scheduling status
Summary for prediction of scheduling status, demonstrating the number of false positives, true positives, true negatives, false negatives, and outcome ratios for various statistical outputs with regards to diagnostic value. Values in parentheses indicate 95% confidence intervals. Values indicate a significant difference from pretest probability [concordance, PPV, NPV, PPV (30% prev), NHP (30% prev)] or from zero predictive value (VaPPV, VaNPV). PPV and NPV represent observed predictive values. PPV (30%) and NPV (30% prev) represent predictive values corrected for an estimated prevalence of 0.3.
Discussion
In this work, 27 compounds were evaluated in zebrafish CPP to determine how the model predicts human abuse outcomes. At the concentrations tested, 10 induced CPP and were considered positives, and 17 did not induce CPP and deemed negatives. With the exception of procaine, each of the negatives affected locomotion, suggesting brain penetration. As procaine had no effect on locomotion or CPP, one possibility is that its brain penetration may have been impaired. Results from zebrafish CPP were then used to objectively and quantitatively analyze the model’s predictive value for +HSE or scheduling. These results were compared with outcomes generated with rat self-administration and CPP, as well as NHP self-administration. The findings show that zebrafish CPP specificity, but not sensitivity, is significantly greater than pretest probability with respect to HSE; therefore, there is potential value in predicting negative clinical outcomes (drugs without +HSE). However, there is limited value for zebrafish to correctly predict drugs with +HSE. Because zebrafish values were not greater than pretest prevalence for scheduling status, the data indicate no added value for predicting scheduling. With few exceptions, rat and NHP models generally possessed concordance, sensitivity, and predictive values that were significantly greater than pretest probabilities for both clinical measures. Overall, although there may be predictive value for zebrafish for some pharmacological classes, such as µ-opioid receptor agonists and psychostimulants, these data highlight that rat and NHP models possess greater predictive value than zebrafish for this limited set of compounds.
This is the first study to demonstrate that fentanyl, oxycodone, tetracaine, phencyclidine, and chlorpheniramine are rewarding in zebrafish CPP. Given that all µ-opioid receptor agonists induced CPP in zebrafish, the data suggests conserved opioid reward pathways with mammals. In contrast, only 2 of the 4 anesthetics tested induced CPP, with no consistency in the mechanism of action and the observed CPP result. Although both ketamine and phencyclidine act as N-methyl-d-aspartate receptor antagonists, phencyclidine, but not ketamine, induced CPP. Tetracaine and procaine are local anesthetics that inhibit monoamine uptake transporters, but only tetracaine induced CPP. Similarly, both diphenhydramine and chlorpheniramine are histamine receptor H1 antagonists; however, CPP was only produced with chlorpheniramine. The basis for these differences has yet to be determined; however, it is possible that the concentrations tested, species-specific drug sensitivities or target expression play a role.
Data from zebrafish CPP were analyzed using standard diagnostic tests of binary classification to determine the model’s predictive value relative to +HSE and scheduling. Other abuse-related preclinical models, such as in vitro binding and functional activity, locomotor activity, drug discrimination, and self-administration have been evaluated similarly (Horton et al., 2013). To compare the ability of zebrafish CPP to predict clinical abuse outcomes with other preclinical models, binary classifications of rat and NHP self-administration and rat CPP were generated and analyzed using published literature sources. Because not all drugs assessed in zebrafish have reported HSE data or are approved for medicinal use (and consequently do not have scheduling data), the sample sizes for our analyses were generally small (∼18−24 drugs, depending on the model). Therefore, one limitation is that the estimates of variance are relatively high for some comparisons, and data should be interpreted with this in mind.
For both +HSE and scheduling, six drugs were considered true positives in zebrafish: phencyclidine, fentanyl, morphine, oxycodone, amphetamine, and cocaine. Four drugs (ethanol, nicotine, tetracaine, and chlorpheniramine) were considered true positives with regard to +HSE, but were deemed false positives with regard to scheduling (Tables 6 and 7). Classification of ethanol and nicotine as false positives with respect to scheduling is because both are unscheduled drugs due to their historically accepted societal use. Neither tetracaine nor chlorpheniramine are scheduled, which may reflect their medicinal use (e.g., tetracaine is typically used as ophthalmic drops) or lack of real-world human abuse. True positives included psychostimulants, µ-opioid receptor agonists, general anesthetics, and antihistamines. CPP was not induced by drugs from the barbiturate or benzodiazepine classes at the concentrations used here (Tables 6 and 7). Given that varying results have been reported with the barbiturates methohexital and pentobarbital in other abuse-related preclinical models depending on the route of administration and doses evaluated (Pickens et al., 1981; Mucha and Iversen, 1984; Lew and Parker, 1998; O'Connor et al., 2011), a negative result in a zebrafish model may reflect an inappropriate concentration range or may be due to differences in the procedures used (CPP versus self-administration).
Summary of false positives and false negatives for each model with respect to positive human subjective effects
Summary of false positives and false negatives for each model with respect to scheduling status
The lack of false positives with regard to +HSE revealed that zebrafish CPP yielded the highest adjusted positive predictive value compared with rats and NHPs; however, because CIs for zebrafish overlapped with pretest prevalence, the data did not reach statistical significance. Inclusion of more compounds for this analysis could potentially alter the results to suggest significant added value. Although zebrafish CPP possessed significant value added for correctly predicting when a drug would not exhibit +HSE (i.e., adjusted negative predictive value), rat and NHP models were generally higher. Importantly, without confidence in the ability to predict correctly +HSE (i.e., positive clinical outcome), there is minimal value added overall for zebrafish CPP. Additionally, given that none of the diagnostic tests for correctly predicting scheduling with zebrafish CPP were significantly greater than chance or pretest prevalence, it can be concluded that zebrafish do not provide added value for predicting scheduling.
A few of the drugs that were false negatives with regard to +HSE and scheduling had limited solubility, requiring DMSO or ethanol as a solvent. Thus poor solubility may have prevented efficient uptake into the fish. However, methohexital induced significant conditioned place aversion, and all of the false negatives induced effects on locomotion. Diazepam also reportedly induces anxiolytic effects in zebrafish using similar concentrations (Bencan et al., 2009; Maximino et al., 2010, 011). Thus failure of these drugs to induce CPP does not appear to be due to inefficient uptake. DMSO could also influence visual acuity (Hull et al., 1969; Silverman, 1972), anxiety status (Hallare et al., 2004, 2005), or locomotion (Chen et al., 2011). Indeed, it is notable that “control” group data with drugs formulated in DMSO were more variable than when water was used.
The finding that rat self-administration offers limited added value over pretest prevalence for HSE is consistent with previous reports using an even larger data set (56 drugs) (Horton et al., 2013). Interestingly, NHP self-administration does offer significantly greater predictive value over pretest for +HSE; however, this appears to be driven by one drug, caffeine, which was deemed as a positive here due to the criteria used, but variable results are reported in the literature. Subjective effects are generally assessed preclinically using drug discrimination procedures and are not always linked to the reinforcing effects of a drug (Ator, 2002; Martelle and Nader, 2009). Thus, it is no surprise that significant predictive value is added for rat drug discrimination compared with +HSE (Horton et al., 2013). Furthermore, given that both rat and zebrafish CPP yielded limited value with regard to scheduling, the data suggest a limitation of the model itself and not the species. CPP and self-administration measure fundamentally different behaviors. It is possible that these differences are important in terms of correctly predicting scheduling or +HSE.
Significant drawbacks exist for using zebrafish CPP as performed here in the pharmaceutical industry. First, the attrition rate can be high, given that 5–40% of zebrafish fail basal preference requirements and some fish tend to “freeze.” Second, immersing zebrafish in the tank water containing drug during conditioning can be cost prohibitive. The average drug requirement was 7 g (ranging from 0.04–68 g) for the concentrations tested here. Alternatives to immersing zebrafish in the tank water may exist, such as pretreating zebrafish in a smaller volume containing drug before immersing them in the conditioning tank or direct injections into zebrafish (Ninkovic et al., 2006; Cadet, 2009). For the latter, both ethical and practical limitations exist, including repeat injections that can cause local trauma at the injection site. Third, water-insoluble compounds that require solvents may prove problematic. Administering compounds to zebrafish in food pellets (Zang et al., 2011) is an option that may be more cost effective and avoid solubility issues. Automated systems to deliver such pellets also exist (Brock et al., 2017), which may allow for the development of self-administration paradigms.
The intention of this work was not to propose replacing mammalian abuse potential assessments in drug development before approval. Rather, the goal was to determine whether there is potential value of zebrafish CPP earlier in drug discovery, when screening compounds might allow for redirection of resources away from targets or chemical series with high risk. Also, the compounds selected for this assessment were not all inclusive; therefore, it is possible that additional data may alter the interpretation of zebrafish CPP predictive value. Even so, by evaluating drugs from a variety of pharmacological classes that are both positive and negative clinically for abuse, this work expands our understanding of the translation of zebrafish CPP and offers some insight about how it might be applied in drug discovery, particularly with drugs from certain classes.
Acknowledgments
The authors thank Dr. Helen Moore for involvement with experimental design and conduct and Dr. David Potter and Dr. Dingzhou Li from the Pfizer Drug Safety Research and Development Statistics for advice on the statistical analyses conducted in the study.
Authorship Contributions
Participated in research design: Goody, Mead, Parker, Brennan.
Conducted experiments: Brock, Sudwarts.
Performed data analysis: Goody, Parker, Sudwarts.
Wrote or contributed to the writing of the manuscript: Brock, Goody, Mead, Parker, Brennan.
Footnotes
- Received May 16, 2017.
- Accepted August 2, 2017.
↵1 Current affiliation: Drug Safety and Metabolism, AstraZeneca Innovative Medicines and Early Development, Cambridge, UK.
This work was supported by grants from the Medical Research Council UK (G1000403), National Committee for the Replacement Refinement and Reduction of Animals in Research (G1000053), BBSRC (BBM007863/1), EPSRC DTG (to A.S.), and a Royal Society Industry Fellowship to C.H.B.
S.M.G.G. is currently employed by Pfizer Drug Safety Research and Development, and A.N.M. was employed by Pfizer Drug Safety Research and Development during the inception of this work and the generation of data. A.N.M. is currently an employee of AstraZeneca. No information is presented that advocates for or promotes commercial products from any of our organizations. There are no other conflicts of interest.
↵
This article has supplemental material available at jpet.aspetjournals.org.
Abbreviations
- CI
- confidence interval
- CNS
- central nervous system
- CPP
- conditioned place preference
- DMSO
- dimethylsulfoxide
- HSE
- human subjective effects
- NHP
- nonhuman primate
- PRU
- proportionate reduction in uncertainty
- Copyright © 2017 by The American Society for Pharmacology and Experimental Therapeutics
References
In this issue
Assessing Zebrafish CPP for Predicting Human Abuse Potential
