CAFASP3 in the spotlight of EVA

Citations Over TimeTop 12% of 2003 papers

Abstract

We have analysed fold recognition, secondary structure and contact prediction servers from CAFASP3. This assessment was carried out in the framework of the fully automated, web-based evaluation server EVA. Detailed results are available at http://cubic.bioc.columbia.edu/eva/cafasp3/. We observed that the sequence-unique targets from CAFASP3/CASP5 were not fully representative for evaluating performance. For all three categories, we showed how careless ranking might be misleading. We compared methods from all categories to experts in secondary structure and contact prediction and homology modellers to fold recognisers. While the secondary structure experts clearly outperformed all others, the contact experts appeared to outperform only novel fold methods. Automatic evaluation servers are good at getting statistics right and at using these to discard misleading ranking schemes. We challenge that to let machines rule where they are best might be the best way for the community to enjoy the tremendous benefit of CASP as a unique opportunity for brainstorming.

Related Papers

• → Critical assessment of methods of protein structure prediction (CASP)—Round XIII(2019)538 cited
• → Critical assessment of methods of protein structure prediction (CASP)—Round XIV(2021)521 cited
• → CAFASP2: The second critical assessment of fully automated structure prediction methods(2001)199 cited
• → A Historical Perspective of Template-Based Protein Structure Prediction(2008)28 cited
• → Predicting protein three-dimensional structure(1999)81 cited