Skip to main content

Exploring NMR ensembles of calcium binding proteins: Perspectives to design inhibitors of protein-protein interactions

Abstract

Background

Disrupting protein-protein interactions by small organic molecules is nowadays a promising strategy employed to block protein targets involved in different pathologies. However, structural changes occurring at the binding interfaces make difficult drug discovery processes using structure-based drug design/virtual screening approaches. Here we focused on two homologous calcium binding proteins, calmodulin and human centrin 2, involved in different cellular functions via protein-protein interactions, and known to undergo important conformational changes upon ligand binding.

Results

In order to find suitable protein conformations of calmodulin and centrin for further structure-based drug design/virtual screening, we performed in silico structural/energetic analysis and molecular docking of terphenyl (a mimicking alpha-helical molecule known to inhibit protein-protein interactions of calmodulin) into X-ray and NMR ensembles of calmodulin and centrin. We employed several scoring methods in order to find the best protein conformations. Our results show that docking on NMR structures of calmodulin and centrin can be very helpful to take into account conformational changes occurring at protein-protein interfaces.

Conclusions

NMR structures of protein-protein complexes nowadays available could efficiently be exploited for further structure-based drug design/virtual screening processes employed to design small molecule inhibitors of protein-protein interactions.

Background

Protein-protein interactions (PPIs) are important for regulating many biological functions. It has been suggested that the human interactome involves about 650,000 interactions [1] and disrupting these interactions could be an attractive way to block a number of targets involved in different pathologies [2, 3]. A possible strategy to inhibit undesired PPIs is to design small organic molecules binding in the zone of interactions and the increasing number of such recent success stories prove it [3–5]. Yet, it is difficult to efficiently target PPIs due to large and flat interfaces [6], the nature of the chemicals present in chemical libraries [7, 8], and in particular due to the structural changes that can occur upon ligand binding. In some cases, small structural changes have been observed at the PPIs interfaces due to small inhibitors' binding [5]. Other proteins, i.e. calmodulin, undergo considerable conformational changes due to protein or small ligand binding [9]. Indeed, limitations in describing potential small-molecule binding sites have been noted when using static structures of either the unbound protein or the protein-protein complex [6].

Some early designed inhibitors of PPIs mimic short secondary-structural elements of proteins [2]. Other molecules, like the terphenyl and its derivates (mimicking alpha-helical regions), were shown to be able to inhibit several PPIs [10, 11], e.g. terphenyls disrupt the calmodulin (CaM) interactions with smooth muscle myosin light-chain kinase (smMLCK), with 3'-5'-cyclic nucleotide phosphodiesterase, or with the helical peptide C20W of the plasma membrane calcium pump [12].

We exploit here docking of 1-naphthyl terphenyl (see Figure 1) into two homologous Ca2+-binding proteins, CaM and human centrin 2 (HsCen2), to find out the CaM and HsCen2 conformations that could efficiently be employed for further structure-based design of inhibitors of PPIs. CaM and HsCen2 have a high sequence homology (Figure 2A) and display a structural similarity as both proteins are composed by two EF-hand N- and C-terminal domains connected by a helical linker (see Figure 2B). The binding of 1-naphthyl terphenyl by CaM (IC50 = 9 nM) has already been shown experimentally [12]. Following the strong similarity between the two Ca2+-binding proteins we probe in this study a potential terphenyl binding into HsCen2.

Figure 1
figure 1

1-naphthyl therphenyl structure colored by atom type. The pharmacophoric points chosen for docking accuracy evaluation are shown as purple circles for CaM: 1, 1', and 2, and for HsCen2: 1, 2, and 3.

Figure 2
figure 2

Sequence and structural homology of calmodulin and centrin. (A) sequence alignment of CaM and HsCen2, the C-terminal domains are shown in blue and the pocket regions in magenta; (B) superposition of the X-ray structures of CaM (yellow cartoon, unbound form, code 1CLL) and HsCen2 (blue cartoon, bound form, code 2GGM); (C) CaM in a complex with trifluorperasine (sticks in magenta) (code 1LIN); (D) structure of HsCen2 (unbound form, code 1M39). The blue region corresponds to the C-domain of HsCen2; the helix (in cyan) belongs to the N-terminal domain.

CaM is expressed in all eukaryotic cells and interacts with a large number of different protein targets [13], being thus involved in regulation of different cellular processes, such as cell division and differentiation, ion transport, muscle contraction, etc. [14, 15]. Ca2+-binding induces a rearrangement of the tertiary structure of EF-hand domains of CaM [16] with an exposure of a large hydrophobic cavity promoting the association of a wide array of target proteins, including kinases, cyclases, various cell surface receptors, etc. CaM displays a multitude of conformational states [17–19]. Modulation of physiological targets of CaM through CaM inhibition by small natural or synthetic compounds [20] may guide discovery of new therapeutic agents.

Centrins are involved in the centrosome duplication [21], in the nuclear excision repair (NER) mechanism [22] or in the multiple nuclear export pathways [23]. NER is an essential molecular mechanism responsible for repairing of DNA lesions caused by UV light or antitumor agents like cis-platin. Cis-platin resistance in chemotherapy is a major complication in cancer and seems to be associated with the stimulation of NER DNA repair mechanism [24]. Centrin forms a heterotrimeric complex with XPC (Xeroderma pigmentosum group C) and hHR23B proteins, which play a key role in the DNA damage recognition. Recent in vivo and in vitro studies [25, 26] revealed that HsCen2 binds to a 17-mer peptide (N847-R863) of XPC protein (P17-XPC) with a high affinity in the presence of Ca2+ (~ 108 M-1). Human cell lines expressing a mutant XPC protein (in the centrin binding motif) exhibited in vitro and in vivo a significant reduction of NER activity [25]. Thus, inhibition of centrin-XPC interactions involved in the NER mechanism might be an efficient way to modulate these processes.

Structural changes occurring at PPIs interfaces make difficult to successfully proceed to structure-based drug design/virtual screening of novel small molecules inhibiting PPIs [27–29]. Selecting appropriate conformations, taking into account the protein plasticity, could be a valuable starting point for subsequent structure-based virtual screening studies. One possibility to incorporate the protein receptor flexibility for ligand docking is to explore multiple receptor conformations (MRC) [30, 31], either experimental [32–34] or modeled [35–39]. Once the MRC selected, ligand candidates can be docked into each receptor conformation and the results from each docking run can be combined together in a post-processing step [40]. Recent papers showed examples of using NMR ensembles of the protein receptor for docking and screening processes [33, 41]. In this work we performed in silico analysis and docking of 1-naphthyl terphenyl into NMR ensembles of CaM and HsCen2 that revealed a small set of NMR conformations appropriate to perform further structure-based virtual screening for discovering of small PPIs inhibitors.

Results and Discussion

Protein-protein binding site analysis

CaM and HsCen2 share about 50% sequence homology extending even to the positions of side chains in the hydrophobic core of the proteins. The main difference between them is the presence in HsCen2 of a 25 amino acids N-terminal ending region (Figure 2A). Both proteins possess four EF-hands, but for HsCen2 only the EF hands belonging to the C-terminal domain bind Ca2+ ions [42] with a significant affinity (~ 104-105 M-1). We should note the high sequence homology of the C-terminal domains of these two Ca2+-binding proteins (blue and purple regions in Figure 2A), especially in the binding sites (purple regions in Figure 2A). The superposition of CaM and HsCen2 structures shows their strong structural similarity (Figure 2B). The root mean square deviations (RMSD) between the carbon alpha atoms of the CaM and HsCen2 structures shown in Figure 2B is 3.3 Ã…, whereas the RMSD between the two C-terminal domains is 0.8 Ã….

The flexible helical linker between N- and C-terminal domains enables the switch between different conformational states of CaM and HsCen2. Figures 2B and 2C show two conformations of CaM, namely an "extended" mode (in the absence of ligand) and a "wrap-around" mode (in a complex with trifluorperasine), respectively. In the last one, the central helix becomes partially unstructured and the helices of the N-terminal domain point toward the bound trifluorperasine molecules. It has been demonstrated that the C-terminal domain of CaM (C-CaM) binds several peptides/proteins [43]. Similarly, the terphenyl molecule (mimicking the CaM-binding face of smMLCK), binds exclusively into the C-domain of CaM [12]. The residues W4, T7 and V11 of smMLCK (noted as i, i + 3, i + 7 of the alpha-helix) are critical for the interaction with C-CaM [16].

Similarly, HsCen2 undergoes important conformational changes depending on the presence of a bound ligand (see Figure 2B and 2D) [18]. In the HsCen2/P17-XPC complex, the alpha-helical linker between the two domains undertakes an extended form (Figure 2B), and in the unliganded form the same region closes the C-terminal peptide binding site (Figure 2D). Structural studies showed that HsCen2 binds the 17-mer XPC peptide only by its C-terminal domain and the W2, L5 and L9 residues (1-4-8 motif) of the P17-XPC have been shown as critical anchoring side chains [26, 44]. Thermodynamic studies [26] enabled the definition of a minimal centrin binding site, a peptide of five residues, which accounted for about 75% of the total free energy of interaction between the two proteins.

The above presented data indicate that the C-terminal domains of both Ca2+-binding proteins are more functional regarding the peptides binding. Therefore, we explored the C-terminal domains of CaM and HsCen2 for potential small ligands' binding. We analyzed several X-ray structures and NMR ensembles of both proteins to construct a relevant ensemble of multiple receptor conformations for the docking process of 1-naphthyl terphenyl. The selected sets contained crystal structures as well as 31 NMR structures (among 160 ones) and 20 NMR structures for C-CaM and C-HsCen2, respectively (see for details the Methods section). The selected NMR and X-ray structures of C-CaM and C-HsCen2 are shown in Figure 3. The residue numbers correspond to the ones in the NMR files, 2K0F for CaM and 2A4J for HsCen2.

Figure 3
figure 3

Superposition of the C-terminal domains of CaM and HsCen2 used for docking. (A) 31 NMR (code 2K0F; in grey cartoon) and one X-ray (code 1CLL; in green cartoon) structures of CaM. One of the NMR smMLCK peptide structures bound to CaM is shown in pink (code 2K0F); (B) 20 NMR (code 2A4J; in grey cartoon) and one X-ray (code 2GGM; in green cartoon) structures of HsCen2. The peptide P17-XPC bound to HsCen2 is shown in pink (code 2GGM); (C) surface presentation of the X-ray structure of CaM (code 1CLL); (D) surface presentation of the X-ray structure of HsCen2 (code 2GGM). The sticks in pink represent the positions of the peptide residues i, i + 3, i + 7 key for the binding.

Docking of terphenyl

The docking-scoring protocol employed to dock 1-naphthyl terphenyl into the selected structures is shown in Figure 4 (see for details in the Methods section). In order to identify the "best" protein conformations for further analysis, we calculated the RMSD between each pose obtained after docking with DOCK6.0 [45] and the reference points of smMLCK and P17-XPC for CaM and HsCen2, respectively (see Figure 1). The obtained RMSD values are shown in Figure 5A and 5B. Overall, docking results are best for the structures of C-HsCen2. We compared the binding zones of the two proteins to analyze these results. For C-CaM, the binding pocket consists of one cavity (volume 314.22 Ã…3, code 1CLL) containing residues F88, I96, L101, M105, M120, E123, M140 and M141. The residue F88 placed in the center of the binding zone is in contact with W4 and T7 of the smMLCK peptide. The binding site of HsCen2 is larger (volume 417.27 Ã…3, code 2GGM) and consists of two hydrophobic cavities separated by F113 interacting with L5 of the P17-XPC peptide, and L126 and M145 interacting with W2 of the peptide. The close contact of F113 and L5 of the bound peptide has also been observed in the structure of HsCen2 complexed with another protein partner targeting the same HsCen2 zone [46]. The deeper and bigger cavity contains the residues F113, I146, E148, V157, I165 and M166, and the smaller one contains the residues L126, V129, A130, L137, L142 and M145. The replacement of one Met residue (M105) of C-CaM with a smaller one, an Ala residue (A130), enlarges the hydrophobic cavity of the C-HsCen2. This facilitates a potential anchoring of 1-naphthyl terphenyl into the C-HsCen2.

Figure 4
figure 4

Flowchart of the employed docking-scoring protocol.

Figure 5
figure 5

Box plots of RMDS values (Ã…) between the docking poses of terphenyl and the reference pharmacophoric points. The box region corresponds to the 50% of the distribution, with shown median. (A) docking into the X-ray (code 1CLL) and the 31 NMR structures (code 2K0F) of CaM; (B) docking on the X-ray (code 2GGM) and the 20 NMR structures (code 2A4J ) of HsCen2.

We also compared the flexibility of the binding zone of CaM and HsCen2, by analyzing the B-factors of the carbon alpha atoms for all residues in the binding pocket of HsCen2 complexed with P17-XPC, as well as for a few complexes of human CaM interacting with helical peptides of similar length as P17-XPC (PDB codes: 3EWV, 1IWQ, 2VAY, 1ZUZ, 3BYA, and 1YR5). This analysis showed an enhanced flexibility of CaM in a bound state, in the region 107-113 compared to the binding zone 132-138 of HsCen2. Structural comparison of these complexes suggested that this difference would be mainly due to a higher mobility of the K111 side chain of CaM compared to N136 of HsCen2. Moreover, we should note the presence of four Met residues in the binding site of C-CaM (M105, M120, M140, M141) and two Met residues in the pocket of C-HsCen2 (M145 and M166). The flexible nature of the Met side chains at the binding surface has previously been discussed as a critical factor to facilitate the surface complementarity between CaM and its partner [19, 47]. This analysis shows a higher plasticity of the binding pocket of the C-CaM than the C-HsCen2, and, therefore, more structural arrangements might occur for the C-CaM than for the C-HsCen2 upon ligand binding.

The 3D electrostatic potential distribution on the X-ray C-CaM and C-HsCen2 surfaces (see Figure 6) indicates that overall C-CaM is more negatively charged than C-HsCen2; this could be related with the stronger affinity of Ca2+ for CaM than HsCen2 [48]. This observation is also valid for the binding zone of the C-CaM and C-HsCen2. The presence of a large number of negatively charged residues in both proteins, and especially in C-CaM, resulted in several computed abnormal pKa values for C-CaM: 7.3 for E100, 8.4 for D129, and 7.6 for E136; for HsCen2: 6.6 for D114 and 7.4 for D154 (these residues are not situated in the binding pocket). The mean local hydrophobic density calculated using Fpocket tool [49] was 41.39 and 54.78 for the binding pockets of C-CaM and C-HsCen2, respectively. Following these results, we can speculate that the higher hydrophobicity of C-HsCen2 binding zone might facilitate a potential binding of the hydrophobic 1-naphthyl terphenyl.

Figure 6
figure 6

Electrostatic potential distribution on the protein surface of the C-terminal domains. (A) CaM; (B) HsCen2. The potential computed using PCE [59] is shown from -3.0 kcal/mol/e (red) to +3.0 kcal/mol/e (blue). The residue numbers correspond to the ones in the NMR files, 2K0F for CaM and 2A4J for HsCen2.

The RMSD results allowed to retain for further analysis five best NMR models for the C-HsCen2 and C-CaM, in addition to the X-ray structures (for CaM:2K0F: models 31, 76, 98, 156 and 160; for HsCen2:2A4J models 1, 5, 6, 7 and 17). As can be seen for both proteins better docking poses were obtained when docking on some of the NMR conformations compared to the X-ray ones. The binding pockets of the five best NMR models have larger volumes than the X-ray structures for both proteins. For C-CaM, the cavity is deeper in the selected NMR models (e.g. the volume is 399 Ã…3 for the model 31) than in the X-ray structure (volume 314 Ã…3). The binding pocket of the X-ray structure of HsCen2 (volume 417 Ã…3) is much smaller than those of the best five NMR models (volumes: 1043 Ã…3 for model 1, 934 Ã…3 for model 5, 1419 Ã…3 for models 6, 1277 Ã…3 for models 7 and 1134 Ã…3 for model 17), that obviously makes easier the terphenyl docking into these NMR structures. We suggest that this observation would be valid as well for other small ligands' docking. The large difference between the pocket volumes of the best NMR models and X-ray structure of C-HsCen2 is due to the orientation of two residues, F113 and F162, that fill a large part of the binding cavity in the X-ray structure. Similar situation was observed for C-CaM and F88.

Poses' refinement and interaction energy analysis

As previously shown [50, 51], post-docking optimization may help to further improve both docking poses and scores. We performed additional energetic analysis (see Tables 1 and 2) of docking poses on the selected best MRC to optimize the predicted binding modes and to re-calculate the interaction energies taking into account desolvation effects due to ligand binding. Firstly, we carried out an energy minimization of the docking poses on the selected NMR conformations and X-ray structures of both proteins using the program AMMOS [52]. The included flexible side chains of the protein receptor around the bound terphenyl enabled to relax the complex structures in the binding pocket. The energy gain due to the AMMOS relaxation for the best scored poses is shown in Tables 1 and 2. The important energy decrease during this step is due to reducing clashes between the docked ligand and some residues of the protein binding pocket, as well as internal ligand energy optimization. Figure 7 represents the side-chain orientations after the energy minimization for the different docking poses. The residues slightly moving due to the optimization are F88, L101, M105, E110, M120, E123, and M140 for CaM (Figure 7A) and F113, L126, E132, M145, E148 and E161 for HsCen2 (Figure 7B). Interestingly, it can be seen that Met residues M105, M120 and M140 are among the moving residues, as discussed above. As seen in Figure 7, the changes due to the optimization are not very large, still small variations of the docked complex structure can affect the interaction energy prediction (see Tables 1 and 2, the AMMOS energy, before and after AMMOS refinement). It has been previously discussed that even small receptor movements can lead to important modifications into the molecular recognition pattern and/or binding energy prediction errors [53]. To this end, the AMMOS refinement step could be useful to "rescue" some docking poses with bad energy score after docking on a rigid receptor (e.g. the docking pose 19 on the 2K0F model 160, Table 1).

Table 1 Terphenyl-CaM interaction energy (in kcal/mol) predicted by the methods DOCK, AMMOS, GBSA, X-Score for the top scored poses
Table 2 Terphenyl-HsCen2 interaction energy (in kcal/mol) predicted by the methods DOCK, AMMOS, GBSA, X-Score for the top scored poses
Figure 7
figure 7

Side chains of the protein residues moving after the refinement with AMMOS (in pink sticks). The top AMMOS scored poses of terphenyl are shown in yellow sticks. (A) CaM, the 2K0F model 31; (B) HsCen2, the 2A4J model 5.

Further, we employed re-scoring with the GBSA Hawking model as implemented in DOCK6.0, and re-scoring with X-Score [54] on the AMMOS optimized docked complex structures. Tables 1 and 2 show the top scored poses retrieved by each of the methods: DOCK, AMMOS, GBSA and X-Score. We consider docking poses of bound terphenyl within 2.5 Ã… RMSD as acceptable. The best protein conformations for CaM and HsCen2 were found by consensus between AMMOS, GBSA and X-Score re-scoring if the best score corresponds to a good RMSD pose. Among the twelve protein structures, 1CLL, 2K0F model 76, and 2K0F model 98 were considered as "bad" because no one of the re-scoring methods AMMOS, GBSA and X-score retrieved good docking poses. The AMMOS energy and X-Score retrieved good docking poses for 8 out of the 9 remaining acceptable cases. GBSA scoring found good poses for 6 out of the 9 acceptable cases. Figure 8 illustrates one good and one bad solutions found by GBSA. In the case of NMR model 5 of C-HsCen2, (Figure 8B), GBSA retrieved a good docking pose. However, for the NMR model 31 of C-CaM, (Figure 8A), the pose retrieved by GBSA is completely upside-down. GBSA failed to find the good poses in 3 out of 9 possible cases. Similar problems (taking into account more complex physical terms, via PBSA or GBSA methods, that demand precise positions of the protein and ligand atoms) have already been found in other docking studies [51, 55]. It might be possible that a further optimization of the docked complexes including an implicit solvent or explicit water molecules during the minimization would be useful for a more successful re-scoring with the GBSA method.

Figure 8
figure 8

Superposition of the top scored poses of terphenyl. The poses after docking-scoring with DOCK6.0 are shown in cyan and the poses after the GBSA re-scoring are shown in orange. (A) CaM, the 2K0F model 31; (B) HsCen2, the 2A4J model 5.

The results in Table 1 reveal the best C-CaM conformations suitable for further structure-based drug design/virtual screening: the best one is 2K0F model 156 where the good docking poses were found by the three re-scoring scoring methods; the models 2K0F 31 and 160 are acceptable with good poses found by AMMOS and X-Score. In the case of HsCen2 (Table 2), the 2A4J models 5, 6, 7, and 17 appear to be best ones where the three re-scoring methods retrieved the good docking poses; the 2A4J model 1 is acceptable with good poses found again by AMMOS and X-Score.

Conclusions

This work highlights that scoring and docking accuracy strongly depend on considering the receptor flexibility, either large conformational changes or small side-chain adjustments in the protein-protein binding region occur. Exploiting the NMR ensembles could be very helpful to take into account the receptor conformational changes into docking/virtual screening exercises. Local induced-fit optimization in a protein-ligand complex structure can be achieved by using the AMMOS method. We explored docking of terphenyl on a number of NMR conformations vs X-ray structures of CaM and HsCen2. Using the NMR ensembles of the receptor structure substantially improved the docking and scoring compared to the X-ray structures. Our study provided a minimal set of conformations of CaM and HsCen2 suitable for small ligand docking/virtual screening targeting the CaM and HsCen2 interactions. The comparative structural and energetic analysis of the binding sites of both proteins demonstrate large similarities and some differences. All together these data can be valuable for a future design of small PPIs inhibitors for CaM and HsCen2.

Methods

Selection of CaM and HsCen2 structures and binding pocket analysis

X-ray structures and NMR ensembles of CaM and HsCen2, all in the Ca2+-bound state, have been taken from the Protein Data Bank [56] and analyzed in details as follows: i) For CaM: an unliganded X-ray structure, code 1CLL at 1.7 Ã… resolution [57]; a NMR ensemble of 160 unliganded structures, code 2K0E [58]; a NMR ensemble of 160 structures bound to 19-mer peptide from smMLCK, code 2K0F [58]; ii) For HsCen2: a NMR ensemble of unliganded C-terminal domain, code 1M39; a X-ray structure of HsCen2 bound to the P17-XPC peptide, code 2GGM at 2.35 Ã… resolution [44]; a NMR ensemble of 20 structures of HsCen2 bound to P17-XPC, code 2A4J [48].

For CaM, the X-ray structure of the human unliganded CaM (1CLL) with the highest resolution among other retrieved X-ray CaM structures (PDB codes: 1LIN, 3EWV, 1IWQ, 2VAY, 1ZUZ, 3BYA, 1YR5) has been considered for docking calculations. We selected the NMR ensemble 2K0F for docking experiments as the key for the binding residues i, i + 3, i + 7 (W4, T7 and V11) (see Figure 3) [16] of the bound helical peptide smMLCK can be mimicked by the docked 1-naphthyl terphenyl.

For HsCen2, we have taken the X-ray structure of HsCen2 extracted from the complex with the P17-XPC peptide (code PDB 2GGM). In the NMR ensemble 1M39, the helix F86-Q95 enters in the binding site and closes the conformation. For 2A4J, the C-terminal domain of HsCen2 is in an open conformation and the binding site is occupied by the side chains of the bulky hydrophobic residues W2, L5 and L9 of P17-XPC. Taking into account that 1-naphthyl terphenyl mimics the binding motif i, i + 3, i + 7 (residues W2, L5 and L9) of P17-XPC, we have considered the 2A4J ensemble for our docking experiments.

The superposition and the analysis of all mentioned structures when focusing on the protein binding sites of CaM and HsCen2, revealed that the pockets are quite similar in the NMR ensembles 2K0F and 2A4J. The bound peptides open the protein binding sites, which enables targeting by other binders. In the case of 2K0F, including 160 models, we have chosen those 31 models giving the better superposition of the binding zone into the X-ray structure 1CLL. The residues 4-12 of 19-mer smMLCK peptide bound in 2K0F was considered to define the binding pocket. The residues 2-10 of P17-XPC peptide were used to define the binding site of C-HsCen2. Thus, for all selected protein structures of C-CaM and C-HsCen2, the pocket region involved the residues 88-142 and 112-166, respectively.

Using the on-line tool Fpocket [49] we calculated the volume and the local hydrophobic density of the binding pockets. The on-line tool PCE "Protein Continuum Electrostatics" [59] was used to calculate the pKa values of the titratable groups as well as the 3D electrostatic potential distribution of the C-terminal domains on the X-ray CaM (code 1CLL) and HsCen2 (code 2GGM) structures including the Ca2+ atoms and taking dielectric constants of the solute and solvent as 11 and 80, respectively.

Molecular docking

Figure 4 represents the entire workflow of the docking-scoring procedure. For all selected protein structures, the binding sites were prepared uniformly as input for docking experiments using the Dock Prep tool of Chimera [60]. Water molecules were removed from the protein binding sites and hydrogen atoms were added. The molecular surface of the receptor structures was computed using the program DMS [61] with a probe radius of 1.4 Ã…. For docking of 1-naphthyl terphenyl we used the program DOCK6.0 [45] accomplishing a sphere-matching algorithm via an "anchor-first" algorithm to fit ligand atoms to spheres representing a negative image of the receptor binding site. For ligand rotatable bonds we applied our optimized parameters [62] to better handle the ligand flexibility. The spheres were generated using the program SPHGEN [63]. We selected the set of spheres representing the binding site within 4 Ã… around the reference ligand, the bound peptides smMLCK and P17-XPC for C-CaM and C-HsCen2, respectively. The 3D structure of 1-naphthyl terphenyl was generated using the in-house program DG-AMMOS [64]. During the docking run, a maximum of 1000 orientations have been generated for each anchor and the DOCK grid energy score including electrostatic and van der Waals interactions was employed. The top 20 scored poses were retained for further consideration. In order to validate the docking performance of DOCK6.0 we performed self-docking test with trifluoperazine on the X-ray PDB structure of the CaM-trifluoperazine complex (code 1CTR, 1:1 complex) following the same protocol. Three of the top 20 scored poses showed RMSD with the bioactive trifluoperazine conformation of 1.5 - 2 Ã… which can be considered as good results keeping in mind the large binding pocket of CaM.

To evaluate the docking of 1-naphthyl terphenyl into CaM and HsCen2 we calculated the RMSD values between the docking poses and the bound peptides for each retained pose. The RMSD values were computed on the pharmacophoric points of 1-naphthyl terphenyl (see Figure 1) as follows: for CaM: the middle point between the atoms CD2 and CE2 of W4 (i residue) corresponding to the point 1, the CA atom of W4 corresponding to the point 1', and the atom CA of T7 (i + 3 residue) corresponding to the point 2; for HsCen2: the middle point between the atoms CD2 and CE2 of W2 corresponding to the point 1 (i residue), the atom CA of L5 (i + 3 residue) corresponding to the point 2, and the atom CA of L9 (i + 7 residue) corresponding to the point 3.

Post-docking refinement and re-scoring

We used the open source program AMMOS recently developed by our group [52] for pose refinement on the best NMR and X-ray protein structures. We employed an energy minimization to refine all poses retained after DOCK6.0 docking on the selected protein receptor conformations allowing flexible ligand and flexible side chains of the receptor residues inside of a sphere with radius 6 Ã… around the ligand.

Next, we performed re-scoring on the AMMOS minimized docking poses with the Generalized Born/solvent accessible surface area (GBSA) method estimating the electrostatic/nonpolar contribution to solvation by employing the Hawkins GBSA method available in DOCK6.0. The Hawkins GBSA score is an implementation of the Molecular Mechanics Generalized Born Surface Area (MM-GBSA) method originally described by [65]. The Ca2+ ions were included in the GBSA computations and the charges of titratable protein groups were assigned corresponding to the performed pKa calculations. The nonbonded van der Waals and electrostatic interaction terms were taken in the final GBSA scoring.

In addition, we performed re-scoring on the AMMOS minimized docking poses by using the program X-Score [54] developed for binding affinity estimation [66]. The X-Score empirical scoring functions implemented in X-Score, HSScore, HPScore and HMScore, include terms for: van der Waals interactions, hydrogen bonds, hydrophobic effects, a torsional entropy penalty and a regression constant. They differ in the manner of estimation of the hydrophobic effects. We used the averaged score of the three X-Score functions.

All structure figures were generated with PYMOL software [67].

References

  1. Stumpf MP, Thorne T, de Silva E, Stewart R, An HJ, Lappe M, Wiuf C: Estimating the size of the human interactome. Proc Natl Acad Sci USA 2008, 105: 6959–6964. 10.1073/pnas.0708078105

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  2. Cochran AG: Protein-protein interfaces: mimics and inhibitors. Curr Opin Chem Biol 2001, 5: 654–659. 10.1016/S1367-5931(01)00262-9

    Article  CAS  PubMed  Google Scholar 

  3. Wells JA, McClendon CL: Reaching for high-hanging fruit in drug discovery at protein-protein interfaces. Nature 2007, 450: 1001–1009. 10.1038/nature06526

    Article  CAS  PubMed  Google Scholar 

  4. Villoutreix BO, Bastard K, Sperandio O, Fahraeus R, Poyet JL, Calvo F, Deprez B, Miteva MA: In silico-in vitro screening of protein-protein interactions: towards the next generation of therapeutics. Curr Pharm Biotechnol 2008, 9: 103–122. 10.2174/138920108783955218

    Article  CAS  PubMed  Google Scholar 

  5. Bourgeas R, Basse MJ, Morelli X, Roche P: Atomic analysis of protein-protein interfaces with known inhibitors: the 2P2I database. PLoS One 2010, 5: e9598. 10.1371/journal.pone.0009598

    Article  PubMed Central  PubMed  Google Scholar 

  6. Fuller JC, Burgoyne NJ, Jackson RM: Predicting druggable binding sites at the protein-protein interface. Drug Discov Today 2009, 14: 155–161. 10.1016/j.drudis.2008.10.009

    Article  CAS  PubMed  Google Scholar 

  7. Reynes C, Host H, Camproux AC, Laconde G, Leroux F, Mazars A, Deprez B, Fahraeus R, Villoutreix BO, Sperandio O: Designing focused chemical libraries enriched in protein-protein interaction inhibitors using machine-learning methods. PLoS Comput Biol 2010, 6: e1000695. 10.1371/journal.pcbi.1000695

    Article  PubMed Central  PubMed  Google Scholar 

  8. Sperandio O, Reynes CH, Camproux AC, Villoutreix BO: Rationalizing the chemical space of protein-protein interaction inhibitors. Drug Discov Today 2010, 15: 220–229. 10.1016/j.drudis.2009.11.007

    Article  CAS  PubMed  Google Scholar 

  9. Vertessy BG, Harmat V, Bocskei Z, Naray-Szabo G, Orosz F, Ovadi J: Simultaneous binding of drugs with different chemical structures to Ca2+-calmodulin: crystallographic and spectroscopic studies. Biochemistry 1998, 37: 15300–15310. 10.1021/bi980795a

    Article  CAS  PubMed  Google Scholar 

  10. Kutzki O, Park HS, Ernst JT, Orner BP, Yin H, Hamilton AD: Development of a potent Bcl-x(L) antagonist based on alpha-helix mimicry. J Am Chem Soc 2002, 124: 11838–11839. 10.1021/ja026861k

    Article  CAS  PubMed  Google Scholar 

  11. Yin H, Lee GI, Sedey KA, Kutzki O, Park HS, Orner BP, Ernst JT, Wang HG, Sebti SM, Hamilton AD: Terphenyl-Based Bak BH3 alpha-helical proteomimetics as low-molecular-weight antagonists of Bcl-xL. J Am Chem Soc 2005, 127: 10191–10196. 10.1021/ja050122x

    Article  CAS  PubMed  Google Scholar 

  12. Orner BP, Ernst JT, Hamilton AD: Toward proteomimetics: terphenyl derivatives as structural and functional mimics of extended regions of an alpha-helix. J Am Chem Soc 2001, 123: 5382–5383. 10.1021/ja0025548

    Article  CAS  PubMed  Google Scholar 

  13. Yap KL, Kim J, Truong K, Sherman M, Yuan T, Ikura M: Calmodulin Target Database. J Stru Funct Gen 2000, 1: 8–14. 10.1023/A:1011320027914

    Article  CAS  Google Scholar 

  14. Chin D, Means AR: Calmodulin: a prototypical calcium sensor. Trends Cell Biol 2000, 10: 322–328. 10.1016/S0962-8924(00)01800-6

    Article  CAS  PubMed  Google Scholar 

  15. Suever JD, Chen Y, McDonald JM, Song Y: Conformation and free energy analyses of the complex of calcium-bound calmodulin and the Fas death domain. Biophys J 2008, 95: 5913–5921. 10.1529/biophysj.108.130542

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  16. Meador WE, Means AR, Quiocho FA: Target enzyme recognition by calmodulin: 2.4 A structure of a calmodulin-peptide complex. Science 1992, 257: 1251–1255. 10.1126/science.1519061

    Article  CAS  PubMed  Google Scholar 

  17. Drum CL, Yan SZ, Bard J, Shen YQ, Lu D, Soelaiman S, Grabarek Z, Bohm A, Tang WJ: Structural basis for the activation of anthrax adenylyl cyclase exotoxin by calmodulin. Nature 2002, 415: 396–402. 10.1038/415396a

    Article  CAS  PubMed  Google Scholar 

  18. Matei E, Miron S, Blouquit Y, Duchambon P, Durussel I, Cox JA, Craescu CT: C-terminal half of human centrin 2 behaves like a regulatory EF-hand domain. Biochemistry 2003, 42: 1439–1450. 10.1021/bi0269714

    Article  CAS  PubMed  Google Scholar 

  19. Bhattacharya S, Bunick CG, Chazin WJ: Target selectivity in EF-hand calcium binding proteins. Biochim Biophys Acta 2004, 1742: 69–79. 10.1016/j.bbamcr.2004.09.002

    Article  CAS  PubMed  Google Scholar 

  20. Figueroa M, Gonzalez Mdel C, Rodriguez-Sotres R, Sosa-Peinado A, Gonzalez-Andrade M, Cerda-Garcia-Rojas CM, Mata R: Calmodulin inhibitors from the fungus Emericella sp. Bioorg Med Chem 2009, 17: 2167–2174. 10.1016/j.bmc.2008.10.079

    Article  CAS  PubMed  Google Scholar 

  21. Salisbury JL, Suino KM, Busby R, S M: Centrin-2 is required for centriole duplication in mammalian cells. Curr Biol 2002, 12: 1287–1292. 10.1016/S0960-9822(02)01019-9

    Article  CAS  PubMed  Google Scholar 

  22. Araki M, Masutani C, Takemura M, Uchida A, Sugasawa K, Kondoh J, Ohkuma Y, Hanaoka F: Centrosome protein centrin 2/caltractin 1 is part of the xeroderma pigmentosum group C complex that initiates global genome nucleotide excision repair. J Biol Chem 2001, 276: 18665–18672. 10.1074/jbc.M100855200

    Article  CAS  PubMed  Google Scholar 

  23. Resendes KK, Rasala BA, Forbes DJ: Centrin 2 localizes to the vertebrate nuclear pore and plays a role in mRNA and protein export. Moll Cel Biol 2008, 28: 1755–1769. 10.1128/MCB.01697-07

    Article  CAS  Google Scholar 

  24. Saldivar JS, Wu X, Follen M, Gershenson D: Nucleotide excision repair pathway review I: implications in ovarian cancer and platinum sensitivity. Gynecol Oncol 2007, 107: S56–71. 10.1016/j.ygyno.2007.07.043

    Article  CAS  PubMed  Google Scholar 

  25. Nishi R, Okuda Y, Watanabe E, Mori T, Iwai S, Masutani C, Sugasawa K, Hanaoka F: Centrin 2 Stimulates Nucleotide Excision Repair by Interacting with Xeroderma Pigmentosum Group C Protein. Moll Cel Biol 2005, 25: 5664–5674. 10.1128/MCB.25.13.5664-5674.2005

    Article  CAS  Google Scholar 

  26. Charbonnier JB, Renaud E, Miron S, Le Du MH, Blouquit Y, Duchambon P, Christova P, Shosheva A, Rose T, Angulo JF, Craescu CT: Structural, thermodynamic, and cellular characterization of human centrin 2 interaction with xeroderma pigmentosum group C protein. J Mol Biol 2007, 373: 1032–1046. 10.1016/j.jmb.2007.08.046

    Article  CAS  PubMed  Google Scholar 

  27. Shoichet BK: Virtual screening of chemical libraries. Nature 2004, 432: 862–865. 10.1038/nature03197

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  28. Montes M, Miteva MA, Villoutreix BO: Structure-based virtual ligand screening with LigandFit: pose prediction and enrichment of compound collections. Proteins 2007, 68: 712–725. 10.1002/prot.21405

    Article  CAS  PubMed  Google Scholar 

  29. Villoutreix BO, Eudes R, Miteva MA: Structure-based virtual ligand screening: recent success stories. Combinatorial Chemistry & High Throughput Screening 2009, 12: 1000–1016. 10.2174/138620709789824682

    Article  CAS  Google Scholar 

  30. Totrov M, Abagyan R: Flexible ligand docking to multiple receptor conformations: a practical alternative. Curr Opin Struct Biol 2008, 18: 178–184. 10.1016/j.sbi.2008.01.004

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  31. Yang LW, Eyal E, Bahar I, Kitao A: Principal component analysis of native ensembles of biomolecular structures (PCA_NEST): insights into functional dynamics. Bioinformatics 2009, 25: 606–614. 10.1093/bioinformatics/btp023

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  32. Barril X, Morley SD: Unveiling the full potential of flexible receptor docking using multiple crystallographic structures. J Med Chem 2005, 48: 4432–4443. 10.1021/jm048972v

    Article  CAS  PubMed  Google Scholar 

  33. Damm KL, Carlson HA: Exploring experimental sources of multiple protein conformations in structure-based drug design. J Am Chem Soc 2007, 129: 8225–8235. 10.1021/ja0709728

    Article  CAS  PubMed  Google Scholar 

  34. Rueda M, Bottegoni G, Abagyan R: Recipes for the selection of experimental protein conformations for virtual screening. J Chem Inf Model 2010, 50: 186–193. 10.1021/ci9003943

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  35. Mangoni M, Roccatano D, Di Nola A: Docking of flexible ligands to flexible receptors in solution by molecular dynamics simulation. Proteins 1999, 35: 153–162. 10.1002/(SICI)1097-0134(19990501)35:2<153::AID-PROT2>3.0.CO;2-E

    Article  CAS  PubMed  Google Scholar 

  36. Lin JH, Perryman AL, Schames JR, McCammon JA: The relaxed complex method: Accommodating receptor flexibility for drug design with an improved scoring scheme. Biopolymers 2003, 68: 47–62. 10.1002/bip.10218

    Article  CAS  PubMed  Google Scholar 

  37. Cavasotto CN, Kovacs JA, Abagyan RA: Representing receptor flexibility in ligand docking through relevant normal modes. J Am Chem Soc 2005, 127: 9632–9640. 10.1021/ja042260c

    Article  CAS  PubMed  Google Scholar 

  38. Dobbins SE, Lesk VI, Sternberg MJ: Insights into protein flexibility: The relationship between normal modes and conformational change upon protein-protein docking. Proc Natl Acad Sci USA 2008, 105: 10390–10395. 10.1073/pnas.0802496105

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  39. Sperandio O, Mouawad L, Pinto E, Villoutreix BO, Perahia D, Miteva MA: How to choose relevant multiple receptor conformations for virtual screening: a test case of Cdk2 and normal mode analysis. Eur Biophys J 2010, 39: 1365–1372. 10.1007/s00249-010-0592-0

    Article  CAS  PubMed  Google Scholar 

  40. Bottegoni G, Kufareva I, Totrov M, Abagyan R: Four-dimensional docking: a fast and accurate account of discrete receptor flexibility in ligand docking. J Med Chem 2009, 52: 397–406. 10.1021/jm8009958

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  41. Bolstad ES, Anderson AC: In pursuit of virtual lead optimization: the role of the receptor structure and ensembles in accurate docking. Proteins 2008, 73: 566–580. 10.1002/prot.22081

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  42. Durussel I, Blouquit Y, Middendorp S, Craescu CT, Cox JA: Cation- and peptide-binding properties of human centrin 2. FEBS Lett 2000, 472: 208–212. 10.1016/S0014-5793(00)01452-6

    Article  CAS  PubMed  Google Scholar 

  43. Elshorst B, Hennig M, Forsterling H, Diener A, Maurer M, Schulte P, Schwalbe H, Griesinger C, Krebs J, Schmid H, Vorherr T, Carafoli E: NMR solution structure of a complex of calmodulin with a binding peptide of the Ca2+ pump. Biochemistry 1999, 38: 12320–12332. 10.1021/bi9908235

    Article  CAS  PubMed  Google Scholar 

  44. Thompson JR, Ryan ZC, Salisbury JL, Kumar R: The structure of the human centrin 2-xeroderma pigmentosum group C protein complex. J Biol Chem 2006, 281: 18746–18752. 10.1074/jbc.M513667200

    Article  CAS  PubMed  Google Scholar 

  45. Moustakas DT, Lang PT, Pegg S, Pettersen E, Kuntz ID, Brooijmans N, Rizzo RC: Development and validation of a modular, extensible docking program: DOCK 5. J Comput Aided Mol Des 2006, 20: 601–619. 10.1007/s10822-006-9060-4

    Article  CAS  PubMed  Google Scholar 

  46. Martinez-Sanz J, Kateb F, Assairi L, Blouquit Y, Bodenhausen G, Abergel D, Mouawad L, Craescu CT: Structure, dynamics and thermodynamics of the human centrin 2/hSfi1 complex. J Mol Biol 2010, 395: 191–204. 10.1016/j.jmb.2009.10.041

    Article  CAS  PubMed  Google Scholar 

  47. Yuan T, Vogel HJ: Substitution of the methionine residues of calmodulin with the unnatural amino acid analogs ethionine and norleucine: biochemical and spectroscopic studies. Protein Sci 1999, 8: 113–121.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  48. Yang A, Miron S, Mouawad L, Duchambon P, Blouquit Y, Craescu CT: Flexibility and plasticity of human centrin 2 binding to the xeroderma pigmentosum group C protein (XPC) from nuclear excision repair. Biochemistry 2006, 45: 3653–3663. 10.1021/bi0524868

    Article  CAS  PubMed  Google Scholar 

  49. Le Guilloux V, Schmidtke P, Tuffery P: Fpocket: an open source platform for ligand pocket detection. BMC Bioinformatics 2009, 10: 168. 10.1186/1471-2105-10-168

    Article  PubMed Central  PubMed  Google Scholar 

  50. Huang N, Kalyanaraman C, Irwin JJ, Jacobson MP: Physics-based scoring of protein-ligand complexes: enrichment of known inhibitors in large-scale virtual screening. J Chem Inf Model 2006, 46: 243–253. 10.1021/ci0502855

    Article  CAS  PubMed  Google Scholar 

  51. Pencheva T, Soumana OS, Pajeva I, Miteva MA: Post-docking virtual screening of diverse binding pockets: comparative study using DOCK, AMMOS, X-Score and FRED scoring functions. Eur J Med Chem 2010, 45: 2622–2628. 10.1016/j.ejmech.2009.12.025

    Article  CAS  PubMed  Google Scholar 

  52. Pencheva T, Lagorce D, Pajeva I, Villoutreix BO, Miteva MA: AMMOS: Automated Molecular Mechanics Optimization tool for in silico Screening. BMC Bioinformatics 2008, 9: 438. 10.1186/1471-2105-9-438

    Article  PubMed Central  PubMed  Google Scholar 

  53. Cavasotto CN, Abagyan RA: Protein flexibility in ligand docking and virtual screening to protein kinases. J Mol Biol 2004, 337: 209–225. 10.1016/j.jmb.2004.01.003

    Article  CAS  PubMed  Google Scholar 

  54. X-Score[http://www.sioc-ccbg.ac.cn/software/xscore/]

  55. Thompson DC, Humblet C, Joseph-McCarthy D: Investigation of MM-PBSA rescoring of docking poses. J Chem Inf Model 2008, 48: 1081–1091. 10.1021/ci700470c

    Article  CAS  PubMed  Google Scholar 

  56. Berman HM, Westbrook J, Feng Z, Gilliland G, Bhat TN, Weissig H, Shindyalov IN, Bourne PE: The Protein Data Bank. Nucleic Acids Res 2000, 28: 235–242. 10.1093/nar/28.1.235

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  57. Chattopadhyaya R, Meador WE, Means AR, Quiocho FA: Calmodulin structure refined at 1.7 A resolution. J Mol Biol 1992, 228: 1177–1192. 10.1016/0022-2836(92)90324-D

    Article  CAS  PubMed  Google Scholar 

  58. Gsponer J, Christodoulou J, Cavalli A, Bui JM, Richter B, Dobson CM, Vendruscolo M: A coupled equilibrium shift mechanism in calmodulin-mediated signal transduction. Structure 2008, 16: 736–746. 10.1016/j.str.2008.02.017

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  59. Miteva MA, Tuffery P, Villoutreix BO: PCE: web tools to compute protein continuum electrostatics. Nucleic Acids Res 2005, 33: W372–375. 10.1093/nar/gki365

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  60. Pettersen EF, Goddard TD, Huang CC, Couch GS, Greenblatt DM, Meng EC, Ferrin TE: UCSF Chimera--a visualization system for exploratory research and analysis. J Comput Chem 2004, 25: 1605–1612. 10.1002/jcc.20084

    Article  CAS  PubMed  Google Scholar 

  61. DMS[http://www.cgl.ucsf.edu/Overview/software.html#dms]

  62. Sauton N, Lagorce D, Villoutreix BO, Miteva MA: MS-DOCK: Accurate multiple conformation generator and rigid docking protocol for multi-step virtual ligand screening. BMC Bioinformatics 2008, 9: 184. 10.1186/1471-2105-9-184

    Article  PubMed Central  PubMed  Google Scholar 

  63. DesJarlais RL, Sheridan RP, Seibel GL, Dixon JS, Kuntz ID, Venkataraghavan R: Using shape complementarity as an initial screen in designing ligands for a receptor binding site of known three-dimensional structure. J Med Chem 1988, 31: 722–729. 10.1021/jm00399a006

    Article  CAS  PubMed  Google Scholar 

  64. Lagorce D, Pencheva T, Villoutreix BO, Miteva MA: DG-AMMOS: A New tool to generate 3D conformation of small molecules using Distance Geometry and Automated Molecular Mechanics Optimization for in silico Screening. BMC Chem Biol 2009, 9: 6. 10.1186/1472-6769-9-6

    Article  PubMed Central  PubMed  Google Scholar 

  65. Srinivasan J, Cheatham TE, Cieplak P, Kollman PA, Case DA: Continuum solvent studies of the stability of DNA, RNA, and phosphoramidate - DNA helices. J am Chem Soc 1998, 120: 9401–9409. 10.1021/ja981844+

    Article  CAS  Google Scholar 

  66. Wang R, Lai L, Wang S: Further development and validation of empirical scoring functions for structure-based binding affinity prediction. J Comput Aided Mol Des 2002, 16: 11–26. 10.1023/A:1016357811882

    Article  CAS  PubMed  Google Scholar 

  67. Delano WL: The PyMOL Molecular Graphics System. DeLano Scientific 2002.

    Google Scholar 

Download references

Acknowledgements and Funding

We appreciate the financial supports from EGIDE, the INSERM institute, University Paris Diderot, and the Institut Curie. We thank Dr. Samna Soumana for helping with data preparation.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maria A Miteva.

Additional information

Authors' contributions

MAM, SM and CTC designed the project. AI and AB performed docking simulations. All authors participated in the analysis and manuscript writing. All authors read and approved the final manuscript.

Adriana Isvoran, Anne Badel contributed equally to this work.

Authors’ original submitted files for images

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Isvoran, A., Badel, A., Craescu, C.T. et al. Exploring NMR ensembles of calcium binding proteins: Perspectives to design inhibitors of protein-protein interactions. BMC Struct Biol 11, 24 (2011). https://doi.org/10.1186/1472-6807-11-24

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1472-6807-11-24

Keywords