- Research article
- Open Access
An improved protein structure evaluation using a semi-empirically derived structure property
BMC Structural Biology volume 18, Article number: 16 (2018)
In the backdrop of challenge to obtain a protein structure under the known limitations of both experimental and theoretical techniques, the need of a fast as well as accurate protein structure evaluation method still exists to substantially reduce a huge gap between number of known sequences and structures. Among currently practiced theoretical techniques, homology modelling backed by molecular dynamics based optimization appears to be the most popular one. However it suffers from contradictory indications of different validation parameters generated from a set of protein models which are predicted against a particular target protein. For example, in one model Ramachandran Score may be quite high making it acceptable, whereas, its potential energy may not be very low making it unacceptable and vice versa. Towards resolving this problem, the main objective of this study was fixed as to utilize a simple experimentally derived output, Surface Roughness Index of concerned protein of unknown structure as an intervening agent that could be obtained using ordinary microscopic images of heat denatured aggregates of the same protein.
It was intriguing to observe that direct experimental knowledge of the concerned protein, however simple it may be, might give insight on acceptability of its particular structural model out of a confusion set of models generated from database driven comparative technique for structure prediction. The result obtained from a widely varying structural class of proteins indicated that speed of protein structure evaluation can be further enhanced without compromising with accuracy by recruiting simple experimental output.
In this work, a semi-empirical methodological approach was provided for improving protein structure evaluation. It showed that, once structure models of a protein were obtained through homology technique, the problem of selection of a best model out of a confusion set of Pareto-optimal structures could be resolved by employing a structure agent directly obtainable through experiment with the same protein as experimental ingredient. Overall, in the backdrop of getting a reasonably accurate protein structure of pathogens causing epidemics or biological warfare, such approach could be of use as a plausible solution for fast drug design.
Development of method to provide fast solution of protein structure is important for many reasons. First off, important roles of proteins particularly in living systems, such as, regulating, catalyzing, and triggering many biological, immunological as well as pathophysiological processes. This has led to development of both experimental and theoretical prediction methods to accomplice this task. However, experimental methods are constrained with want of protein crystals for X-Ray Crystallography; smaller proteins (< 80 KD) for NMR and lengthy experimental time (nearly 2 years) for both of these methods [1, 2]. On the other hand, theoretical prediction methods are although quite fast, suffers limitation of less accuracy and reliability . This creates an apparently unbridgeable huge gap between number of proteins and their known structures . The most popular theoretical prediction method, homology modelling builds initial structure model through comparison of similar templates searched out from database of known protein structures [5,6,7,8]. The initial model is subsequently optimized through Molecular Dynamics Simulation producing a set of Pareto-optimal candidate structure models. The trouble starts from there due to confusion posed by contradictory indication of different validation parameters for different models of the same target protein. For example say, Ramachandran score of a model is quite high while its potential energy is not that low and vice versa. The complexity further increases due to addition of more important validation parameters, such as, G-factor which gives account of model’s adherence to steric hindrance property, Verified 3D providing insight to compatibility of an model with its own amino acid sequence, etc.. Drawbacks of knowledge based validation parameters used for acceptability of protein structure are well reported in the review of Kihara et al. . For this reason, functional utilization of structure models outputted by comparative prediction methods is very challenging . This piece of work put effort to resolve this problem through the intervention of simple experimental output obtainable from the target protein. The idea is that a protein of known sequence can be isolated, purified into a sizeable quantity to perform many simple experiments on it. Examples of such experiments are: study on patterns of temperature-function kinetics, pH-function kinetics in presence of substrates, aggregation through heat denaturation, emission-absorption spectra etc.. It appears to be interesting to see whether any of such experimental output can be utilized to select best structure model out of a set of such models resulted in through theoretical exercise. Furthermore, to corroborate correctness of theoretically found models through such experimentally found information there must be a common parameter that can be extracted both from the experimental information as well as from the structures. Only then, this common parameter extracted from experiment can be stored and utilized as standard to compare its closeness with that extracted from predicted structure models for picking the closest one as the best structure model. Also, this common parameter should also have the attribute of uniqueness at least for the target protein class if not for the actual protein itself. In search of such parameter, in this study first it was identified that Surface Roughness Index (SRI) of a protein as derived, calculated from its known structure by Singha et al.  might be utilized as common structure parameter since it could also be extracted through experiment on the same protein as depicted by Mishra et al. . In this regard the role of predicted SRI was to serve as a standard parameter that can be compared for its closeness with the values calculated from the predicted models to pick the best structure solution under the premise: closest model was the best one. Finally this semi-empirical structure validation method was tested for some judiciously chosen proteins taken from protein data bank (PDB) of widely varying structure class which could also be procured through purchase for further experimentation. To test whether the method could match the real life challenge for protein structure evaluation, the template search step of Homology Modelling was specifically employed to select first three templates with sequence similarities less than equal to 77% applying BLASTP. The cut-off 77% was chosen considering the fact that a sequence similarity more than 90% guaranteed to produce structure comparable to X-Ray crystallographic structure of a protein except for a few individual side chains [17,18,19] thus making this study unnecessary. Also, the first hit having 100% similarity was intentionally ignored since this was the target protein itself and already present in PDB. In the next step, for the output structure models generated through Homology Modelling, different knowledge based validation parameters were calculated. As expected contradictory indications from these validation parameters generated a confusion set of structure models the correctness of which was finally resolved by the use of experimentally extracted value of SRI. The final validation of the selected model was done by comparing root mean square deviation (RMSD) of backbones of all models with that of reported PDB structure of the target protein.
Description of proteins used in this study
Six proteins, albumin, cytochrome c, ferritin, lysozyme, insulin and hemoglobin which could be procured through purchase from the market as well as reported in the PDB site were selected and finally purchased from Sigma Aldrich (USA). Also, these proteins were chosen for experimentation for their widely varying structural properties where the structural properties, class, fold, super family, family, duplication and species as retrieved for these proteins from SCOP  were given in the following Table 1. Sample size of such proteins were in concurrence with Sandelowski, 1995 .
Obtaining structure models of proteins using homology modelling
To get structure models of a protein Easymodeller Graphical Interface of Kuntal et al.  was used to implement Modeller [5,6,7,8]. To avoid self-matching with already stored PDB template for the same protein, and also, to avoid templates of very high sequence similarity leading to near perfect solution of structure (as already described in Introduction Section) [17,18,19], first three templates with sequence similarity obtained through BLASTP ≤77% were chosen as input to Modeller.
Application of existing validation parameters for selection of best model
Energy Score of a protein was calculated as Random Walk potential following the method of Knowledge Based Scoring Function as described by Zhang and Zhang . However, for calculation of Ramachandran Score and G factor Procheck NT Suite  was downloaded from http://www.ruppweb.org/ftp_warning.html and utilized. Verified 3D (% residue) was calculated using Structure Analysis and Verification Server (version 4) following the protocol of Bowie, et al.  and Luthy et al. . The justification for choosing these validation parameters was that these parameters were commonly computable for all proteins utilized in this work.
Calculation of surface roughness index (SRI) of a given protein structure following published protocol
One of the structural component of a protein, its surface was characterized by a 8 valued vector SRI . Each element of this vector can be calculated as standard deviation of distances of its surface residue-points represented by the C-alpha atoms of surface residues falling within a particular octant of a invariant coordinate system (ICS) (described latter) from the protein-centre that is calculated as the average coordinate of all C-alpha coordinates of that protein. In short, as described by Singha et al. , ICS of a protein can be calculated following the steps given below:
Step1: Origin (O) of ICS of a protein is calculated as average coordinate of C-alpha coordinates of all of its residues as shown in (Fig. 1a).
Step2: Line joining O and maximally distant C-alpha coordinate is considered as z-axis of ICS as shown in (Fig. 1b).
Step3: Plane normal to z-axis and passing through O is considered as xy-plane. The C-alpha atom which satisfies two constraints: first, it lies within a lamellar space of width 4 Å i.e., within a distance of 2 Å from each side of the xy-plane, and second, its distance from O is maximum among all other C-alpha atoms within this lamellar space, is considered to create x-axis with O as the line joining its projection on xy-plane (P) and O. This step is further clarified in (Fig. 1c).
Step4: Line passing through O and perpendicular to both x and z-axis is considered as y-axis as shown in (Fig. 1d).
Step5: The PDB coordinates of all the atoms of a protein are transformed to ICS following simple geometric rule of coordinate transformation.
Experimental steps in details leading to prediction of SRI following published papers
SRI of a protein was also predicted through simple experiment from its heat denatured aggregate (HDA) following protocol described by Mishra et al. , steps of which were given below:
Step 1: Solution of the concerned protein was prepared in milipore water at concentration 25 mg/cc and put in hot water bath at temperature 100 °C for 15 min to obtain its HDA.
Step 2: 10 μL of HDA solution of the protein was put in a hemocytometer slide (Model: Neubauer Chamber, Marienfeld, Germany) and covered with thin microscopic glass cover slip. Subsequently, it was visualized at 400X magnification using phase contrast microscope (Leica Model DML-B2).
Step 3: Digital images of aggregates were captured using a camera (Canon PowerShot S50) at optical zoom 2X. Thus cumulative optical zoom of the microscope and camera was 800X. 50 images of HDA at different locations of slide were captured for each protein.
Step 4: Grey scale converted and 1/3rd resized images of HDAs were manually segmented out using MS Paint XP software having intensity range from 0 to 255. Segmented image was further splitted into 10 binary images on the basis of filtering through fixed intensity-ranges by applying the rule described by Mishra et al. . Fractal dimension of each of these binary HDA images were calculated through box-counting method to obtained 10 valued Intensity Level Based Multifractal Dimension (ILMFD). This step is further clarified in (Fig. 2).
Step 5: A non-parametric function was designed employing Recurrent Backpropagation Neural Network (RBPN) as shown in (Fig. 3) with capability of taking multiple inputs (10 valued ILMFD) and deliver multiple outputs (8 valued SRI after normalization). For optimizing this function 70% of images (i.e., 35 out of 50 images) were used for training and remaining 30% (15 images) were used for testing purpose. For enhancing prediction accuracy through removal of ill-posed noisy data, 15 function-outputs (each of which were 8 valued candidate for predicted SRI) were further passed through a two tier hierarchical clustering method to finally select the centre of the optimally chosen cluster as predicted SRI after denormalization following the algorithm of Mishra et al. .
Steps describing selection of best model using predicted SRI of original protein and calculated SRI of its models
Steps followed to select best structural model of a protein were given below:
Step1: SRI of each of the structure models of a protein obtained through methodology section 2 were calculated using protocol described in methodology section 4 and designated as SRI_CM. The same method was applied to calculate original protein structure obtained from PDB and was designated as SRI_C.
Step2: SRI of the original protein was predicted through experiment as described in methodology section 5 and was designated as SRI_P.
Step3: Euclidean distance, DCMOD between SRI_CM of a model and SRI_C was calculated and it was repeated for all the models. The model with least distance (i.e., that closest to the original) was selected as the best structure model of this protein.
Step4: Step3 was repeated to calculate distance, DPMOD by replacing SRI_C with SRI_P and the best structure model for the same model was selected.
Step5: Euclidean distances between coordinates of corresponding Cα atoms of a model and original PDB structure were calculated and Root Mean Square Deviation of these distances were stored. Similarly RMSDs for all the models from original structure were calculated. The model with least RMSD was selected for final validation. For calculation of RMSD between a pair of protein structures, coordinates of both of these structures were transformed under Invariant Coordinated System (ICS) as described in methodological section 4.
Step 1 to 5 was repeated for all the 6 proteins used in this study.
To check coherency in protein structure validation parameters, results of calculation of above-referred validation parameters, Energy Score as Knowledge Based Scoring Function (KBSF), Ramachandran Score (RS), G factor (GF) and Verified 3D (% residue) (V3D) were shown in Table 2 for all the protein models obtained through Modeller along with their PDB structures. However, it was evident from the best matches of the models for a particular protein and validation parameter, the coherency did not exist. For example, in case of albumin, KBSF indicated 2nd model as best, while V3D showed 5th model as the best. Similarly it was shown for all other proteins.
The values of SRIs both calculated from known structure and predicted through experiment for the proteins were shown in Table 3 from which parameters DCMOD and DPMOD were calculated.
List of data similar to that shown in Table 2 were prepared using DCMOD, DPMOD and RMSD parameters as described in methodology section 6 replacing the validation parameters where best models were obtained using least values of all these parameters. It was intriguing to find that there existed a concurrency of decision provided by all these parameters as shown in Table 4 except for albumin and insulin the explanation for which was given in discussion section.
The diversity in the physiochemical properties and number of residues of the proteins selected for this study was shown in Table 5 below:
Objective of this study was to strengthen already existing theoretical protocol to expedite solution for protein structure without compromising with accuracy. Towards this direction, published reports were first explored to check whether assimilation of already existing methods can help in achieving the same through development of a new methodical approach. In this regard, the main bottleneck as found in this work was to resolve confusion set of models produced by Homology Modelling with subsequent application of Molecular Dynamics based optimization techniques as reported by [5,6,7,8] and implemented through Modeller. However, the confusion in selecting the best model was generated due to incoherent decision provided by different validation parameters as shown in Table 2. As for solution, in this study it was strongly felt to validate those structure models through comparison with a data that can be directly extracted from actual protein of concern through simple experimentation rather than by knowledge based validation parameters, e.g., KBSF, RS, GF and V3D. In this regard, it was imperative to devise a strategy through which model structure could be validated both from the end of the theoretically computable validation parameter as well as that obtainable from actual protein itself, say, through simple experimental exercises as discussed in the Introduction section. It was necessary to see the convergence of validations from both of these ends since in real life problem calculation of SRI values from known protein structure would not be possible and the predicted SRI extracted through experiment was supposed to serve as the only validation agent. It indicated requirement of a common validation parameter which could be obtained both through computational exercise using structure model and experimental method using the same protein as its ingredient. Unfortunately no commonly known existing validation parameters appeared to serve this purpose. However, one such example could be found from the report of Mishra and Lahiri  in which a typical structure parameter SRI of a protein was found to be obtained from a semi-empirical method using it as experimental ingredient (as described in methodological section 5) as well as computable from its structure (if known) Singha et al. . As designated in methodological section 6, the need of experimentally extracted parameter SRI_P was to find minimum of DPMOD to pick the best structure model comparing SRI to SRI distances of all the models from SRI_P. Since this methodological approach had to be validated also, only those proteins were selected, PDB structures of which were also available and thus their SRI were also computable (designated as SRI_C) using method of Singha et al.  as described in methodological section 4. Therefore, it was left as an interesting exercise to see whether the solution of best model obtained utilizing DPMOD parameter was matching with that obtained utilizing DCMOD. Interestingly, while Table 4 showed the result as affirmative for all the six proteins, the final validation of this approach was done by utilizing universally accepted parameter RMSD of corresponding Cα to Cα distances between a model and already evaluated PDB structure of the protein and repeating it for all the models of the same protein. As shown in Table 4, result of selection of best model using RMSD was further encouraging since it re-confirmed the result using DCMOD and DPMOD except for the cases of Albumin and Insulin. In case of Albumin the possible reason of mismatch might be because of very close proximity of all the models with the original structure as shown in Table 4. Furthermore, in case of Insulin we found the solutions obtained through SRI (i.e., the same 5th model obtained through both DCMOD and DPMOD) and RMSD (the 2nd model) are actually closest to each other with lowest RMSD, 4.50. One more interesting observation as found after comparing results of Table 2 and Table 4 was that, percentage of success of RS, GF and V3D in selecting best models through predicted SRI was 50% while that for KBSF was zero only. It indicated that Ramachandran Score, G factor and Verified 3D were better validation parameters in comparison to Energy Score (Knowledge Based Scoring Function). The possible reason of success in SRI based validation as shown in this work for almost all the proteins of wide variety of classes (as shown in Tables 1 and 5) could be explained through its underlying geometric attribute. As designed and implemented by Singha et al.  SRI basically represented surface roughness profile of a protein through an 8 valued surface roughness vector each element of which actually represented roughness of protein surface within one out of 8 octants of a 3 dimensional invariant coordinate system containing this protein. They also showed that proteins could be classified at the level of SCOP defined classes by SRI with reasonably high efficiency (almost 85%) which indicated capability of SRI to describe a protein with quite high structural specificity. This attribute of SRI might be considered as the most important factor contributing towards its potential to successfully select best structure model of a protein out of other models. However, SRI being a key agent for such selection, further improvement could be thought of in the design of SRI through creation of optimum number of solid angles as argued by Singha et al.  in contrast to 8 in the existing protocol to increase its specificity for a protein. Furthermore, since SRI not only needed to be calculated from a given structure, but also to be extracted from a protein as experimental compound as described by Mishra and Lahiri , the root experimental output ILMFD as described above in methodological section 5 might be further looked into to consider its replacement by some other possibly more efficient experimental output e.g., two dimensional excitation-emission spectra of protein suspension within visible light range through simple spectrophotometry instead of Heat Denatured Aggregates as described earlier.
This work showed a way which could be of help towards fast solution of a protein structure without compromising with its accuracy. The importance of this work was that it provided a methodological approach through which once structure models of a protein were obtained through currently best theoretical exercise, say, Homology Modelling, the problem of selection of a best model out of a confusion set of same could be resolved by employing a structure agent Surface Roughness Index which could be directly obtained through a semi-empirical method using microscopic images of Heat Denatured Aggregates of the same protein as experimental ingredient. Overall, in this work it was emphasized that in absence of an ordered aggregate of protein as its crystal, experimental use of its irregular assemblies could also be of help in solving its structure. In the backdrop of getting a reasonably accurate protein structure of pathogens causing epidemics or biological warfare, such approach could be of use as a plausible solution for fast drug design to contain their effect.
Heat denatured aggregate
Invariant coordinate system
Intensity Level Based Multifractal
Knowledge Based Scoring Function
protein data bank
Root mean square deviation
Structural Classification of Proteins
Surface Roughness Index
Verified 3D (% residue)
Liu HL, Hsu JP. Recent developments in structural proteomics for protein structure determination. Proteomics. 2005;5:2056–68.
Frueh DP, Goodrich AC, Mishra SH, Nichols SR. NMR methods for structural studies of large monomeric and multimeric proteins. Curr Opin Struct Biol. 2013;23:734–9.
Launay G, Simonson T. Homology modelling of protein-protein complexes: a simple method and its possibilities and limitations. BMC Bioinformatics. 2008;9:427.
Li Y, Yaseen A. Pareto-Based Optimal Sampling Method and Its Applications in Protein Structural Conformation Sampling AAAI; 2013. p. 20–5.
Webb B, Sali A. Comparative protein structure modeling using Modeller. Curr Protoc Bioinformatics. 2014;47:5.6.1–32.
Martí-Renom MA, Stuart AC, Fiser A, Sánchez R, Melo F, Sali A. Comparative protein structure modeling of genes and genomes. Annu Rev Biophys Biomol Struct. 2000;29:291–325.
Sali A, Blundell TL. Comparative protein modelling by satisfaction of spatial restraints. J Mol Biol. 1993;234:779–815.
Fiser A, Do RK, Sali A. Modeling of loops in protein structures. Protein Sci. 2000;9:1753–73.
Kihara D, Chen H, Yang YD. Quality assessment of protein structure models. Curr Protein. 2009;10:216–28.
Singha S, Lahiri T, Dasgupta AK, Chakrabarti P. Structural classification of protein using surface roughness index. Online J Bioinformatics. 2006;7:74–84.
Mishra H, Lahiri T. Neurocognitive derivation of protein surface property from protein aggregate parameters. Bioinformation. 2011;6:158–61.
Kuntal BK, Aparoy P, Reddanna P. EasyModeller: a graphical interface to MODELLER. BMC Res Notes. 2010;3:226.
Zhang J, Zhang Y. A novel side-chain orientation dependent potential derived from random-walk reference state for protein fold selection and structure prediction. PLoS One. 2010;5:1–13.
Laskowski RA, Macarthur MW, Moss DS, Thornton JM. PROCHECK: a program to check the stereochemical quality of protein structures. J Appl Crystallogr. 1993;26:283–91.
Bowie JU, Lüthy R, Eisenberg D. A method to identify protein sequences that fold into a known three-dimensional structure. Science. 1991;253:164–70.
Lüthy R, Bowie JU, Eisenberg D. Assessment of protein models with three-dimensional profiles. Nature. 1992;356:83–5.
Chothia C, Lesk AM. The relation between the divergence of sequence and structure in proteins. EMBO J. 1986;5:823–36.
Sippl MJ. Recognition of errors in three dimensional structures of proteins. Proteins. 1993;17:355–62.
Krieger E, Nabuurs SB, Vriend G. HOMOLOGY MODELING. In: Bourne PE, Weissig H, editors. Structural Bioinformatics: Wiley-Liss; 2003. p. 507–21.
Murzin AG, Brenner SE, Hubbard T, Chothia C. SCOP: a structural classification of proteins database for the investigation of sequences and structures. J Mol Biol. 1995;247:536–40.
Sandelowski M. Sample size in qualitative research. Research in Nursing & Health. 1995;18:179–83.
This work was initially supported by Indian Council of Medical Research through their project grant (sanction letter no. 52/8/2005-BMS, dated February 4, 2010) and further supported by Department of Applied Science, IIIT-Allahabad, India allowing uninterrupted use of equipments and chemicals since the completion of this project in the year of 2013. Manoj Kumar Pal and Rajnish Kumar are grateful to IIIT-Allahabad for providing them fellowship to pursue their doctoral work. Garima Tanwar gratefully acknowledge her stipend provided by IIIT-Allahabad for pursuing her 2 year M.Tech. in IT (Specialization in Bioinformatics) course. The help provided by Amaresh Sahoo, Sintu Kumar Samanta and Anirudh Singh for using facilities of IRCB lab, IIIT-Allahabad, India is gratefully acknowledged.
Availability of data and materials
As provided through this submission.
Ethics approval and consent to participate
Consent for publication
The corresponding author confirms that none of the authors have any competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Pal, M.K., Lahiri, T., Tanwar, G. et al. An improved protein structure evaluation using a semi-empirically derived structure property. BMC Struct Biol 18, 16 (2018). https://doi.org/10.1186/s12900-018-0097-0
- Protein structure validation
- Semi-empirical method
- Surface roughness index
- Confusion set of models
- Selection of best structure model